Augmented reality

Virtual Fixtures – first A.R. system, 1992, U.S. Air Force, WPAFB

Augmented Reality (AR) is an interactive experience of a real-world environment whereby the objects that reside in the real-world are "augmented" by computer-generated perceptual information, sometimes across multiple sensory modalities, including visual, auditory, haptic, somatosensory, and olfactory.[1] The overlaid sensory information can be constructive (i.e. additive to the natural environment) or destructive (i.e. masking of the natural environment) and is seamlessly interwoven with the physical world such that it is perceived as an immersive aspect of the real environment.[2] In this way, augmented reality alters one’s ongoing perception of a real world environment, whereas virtual reality completely replaces the user's real world environment with a simulated one.[3][4] Augmented reality is related to two largely synonymous terms: mixed reality and computer-mediated reality.

The primary value of augmented reality is that it brings components of the digital world into a person's perception of the real world, and does so not as a simple display of data, but through the integration of immersive sensations that are perceived as natural parts of an environment. The first functional AR systems that provided immersive mixed reality experiences for users were invented in the early 1990s, starting with the Virtual Fixtures system developed at the U.S. Air Force's Armstrong Laboratory in 1992.[2][5][6][7] The first commercial augmented reality experiences were used largely in the entertainment and gaming businesses, but now other industries are also getting interested about AR's possibilities for example in knowledge sharing, educating, managing the information flood and organizing distant meetings. Augmented reality is also transforming the world of education, where content may be accessed by scanning or viewing an image with a mobile device.[8] Another example is an AR helmet for construction workers which display information about the construction sites.

Augmented Reality (AR) is used to enhance natural environments or situations and offer perceptually enriched experiences. With the help of advanced AR technologies (e.g. adding computer vision and object recognition) the information about the surrounding real world of the user becomes interactive and digitally manipulable. Information about the environment and its objects is overlaid on the real world. This information can be virtual[9][10][11][12][13][14] or real, e.g. seeing other real sensed or measured information such as electromagnetic radio waves overlaid in exact alignment with where they actually are in space.[15][16][17] Augmented reality also has a lot of potential in the gathering and sharing of tacit knowledge. Augmentation techniques are typically performed in real time and in semantic context with environmental elements. Immersive perceptual information is sometimes combined with supplemental information like scores over a live video feed of a sporting event. This combines the benefits of both augmented reality technology and heads up display technology (HUD).

Technology

A Microsoft HoloLens being worn by a man

Hardware

Hardware components for augmented reality are: processor, display, sensors and input devices. Modern mobile computing devices like smartphones and tablet computers contain these elements which often include a camera and MEMS sensors such as accelerometer, GPS, and solid state compass, making them suitable AR platforms.[18]

Display

Various technologies are used in augmented reality rendering, including optical projection systems, monitors, handheld devices, and display systems worn on the human body.

A head-mounted display (HMD) is a display device worn on the forehead, such as a harness or helmet. HMDs place images of both the physical world and virtual objects over the user's field of view. Modern HMDs often employ sensors for six degrees of freedom monitoring that allow the system to align virtual information to the physical world and adjust accordingly with the user's head movements.[19][20][21] HMDs can provide VR users with mobile and collaborative experiences.[22] Specific providers, such as uSens and Gestigon, include gesture controls for full virtual immersion.[23][24]

In January 2015, Meta launched a project led by Horizons Ventures, Tim Draper, Alexis Ohanian, BOE Optoelectronics and Garry Tan.[25][26][27] On February 17, 2016, Meta announced their second-generation product at TED, Meta 2. The Meta 2 head-mounted display headset uses a sensory array for hand interactions and positional tracking, visual field view of 90 degrees (diagonal), and resolution display of 2560 x 1440 (20 pixels per degree), which is considered the largest field of view (FOV) currently available.[28][29][30][31]

Eyeglasses
Vuzix AR3000 AugmentedReality SmartGlasses

AR displays can be rendered on devices resembling eyeglasses. Versions include eyewear that employs cameras to intercept the real world view and re-display its augmented view through the eyepieces[32] and devices in which the AR imagery is projected through or reflected off the surfaces of the eyewear's lenspieces.[33][34][35]

HUD
Headset computer

A head-up display (HUD) is a transparent display that presents data without requiring users to look away from their usual viewpoints. A precursor technology to augmented reality, heads-up displays were first developed for pilots in the 1950s, projecting simple flight data into their line of sight, thereby enabling them to keep their "heads up" and not look down at the instruments. Near-eye augmented reality devices can be used as portable head-up displays as they can show data, information, and images while the user views the real world. Many definitions of augmented reality only define it as overlaying the information.[36][37] This is basically what a head-up display does; however, practically speaking, augmented reality is expected to include registration and tracking between the superimposed perceptions, sensations, information, data, and images and some portion of the real world.[38]

CrowdOptic, an existing app for smartphones, applies algorithms and triangulation techniques to photo metadata including GPS position, compass heading, and a time stamp to arrive at a relative significance value for photo objects.[39] CrowdOptic technology can be used by Google Glass users to learn where to look at a given point in time.[40]

A number of smartglasses have been launched for augmented reality. Due to encumbered control, smartglasses are primarily designed for micro-interaction like reading a text message but still far from more well-rounded applications of augmented reality.[41] In January 2015, Microsoft introduced HoloLens, an independent smartglasses unit. Brian Blau, Research Director of Consumer Technology and Markets at Gartner, said that "Out of all the head-mounted displays that I've tried in the past couple of decades, the HoloLens was the best in its class."[42] First impressions and opinions were generally that HoloLens is a superior device to the Google Glass, and manages to do several things "right" in which Glass failed.[42][43]

Contact lenses

Contact lenses that display AR imaging are in development. These bionic contact lenses might contain the elements for display embedded into the lens including integrated circuitry, LEDs and an antenna for wireless communication. The first contact lens display was reported in 1999,[44] then 11 years later in 2010-2011.[45][46][47][48] Another version of contact lenses, in development for the U.S. military, is designed to function with AR spectacles, allowing soldiers to focus on close-to-the-eye AR images on the spectacles and distant real world objects at the same time.[49][50]

The futuristic short film Sight[51] features contact lens-like augmented reality devices.[52][53]

Many scientists have been working on contact lenses capable of many different technological feats. The company Samsung has been working on a contact lens as well. This lens, when finished, is meant to have a built-in camera on the lens itself.[54] The design is intended to have you blink to control its interface for recording purposes. It is also intended to be linked with your smartphone to review footage, and control it separately. When successful, the lens would feature a camera, or sensor inside of it. It is said that it could be anything from a light sensor, to a temperature sensor.

In Augmented Reality, the distinction is made between two distinct modes of tracking, known as ''marker'' and ''markerless''. Marker are visual cues which trigger the display of the virtual information.[55] A piece of paper with some distinct geometries can be used. The camera recognizes the geometries by identifying specific points in the drawing. Markerless also called instant tracking does not use marker. Instead the user positions the object in the camera view preferably in an horizontal plane.It uses sensors in mobile devices to accurately detect the real-world environment, such as the locations of walls and points of intersection.[56]

Virtual retinal display

A virtual retinal display (VRD) is a personal display device under development at the University of Washington's Human Interface Technology Laboratory under Dr. Thomas A. Furness III.[57] With this technology, a display is scanned directly onto the retina of a viewer's eye. This results in bright images with high resolution and high contrast. The viewer sees what appears to be a conventional display floating in space.[58]

Several of tests were done in order to analyze the safety of the VRD.[57] In one test, patients with partial loss of vision were selected to view images using the technology having either macular degeneration (a disease that degenerates the retina) or keratoconus. In the macular degeneration group, 5 out of 8 subjects preferred the VRD images to the CRT or paper images and thought they were better and brighter and were able to see equal or better resolution levels. The Kerocunus patients could all resolve smaller lines in several line tests using the VDR as opposed to their own correction. They also found the VDR images to be easier to view and sharper. As a result of these several tests, virtual retinal display is considered safe technology.

Virtual retinal display creates images that can be seen in ambient daylight and ambient roomlight. The VRD is considered a preferred candidate to use in a surgical display due to its combination of high resolution and high contrast and brightness. Additional tests show high potential for VRD to be used as a display technology for patients that have low vision.

EyeTap

The EyeTap (also known as Generation-2 Glass[59]) captures rays of light that would otherwise pass through the center of the lens of the eye of the wearer, and substitutes synthetic computer-controlled light for each ray of real light.

The Generation-4 Glass[59] (Laser EyeTap) is similar to the VRD (i.e. it uses a computer-controlled laser light source) except that it also has infinite depth of focus and causes the eye itself to, in effect, function as both a camera and a display by way of exact alignment with the eye and resynthesis (in laser light) of rays of light entering the eye.[60]

Handheld

A Handheld display employs a small display that fits in a user's hand. All handheld AR solutions to date opt for video see-through. Initially handheld AR employed fiducial markers,[61] and later GPS units and MEMS sensors such as digital compasses and six degrees of freedom accelerometergyroscope. Today SLAM markerless trackers such as PTAM are starting to come into use. Handheld display AR promises to be the first commercial success for AR technologies. The two main advantages of handheld AR are the portable nature of handheld devices and the ubiquitous nature of camera phones. The disadvantages are the physical constraints of the user having to hold the handheld device out in front of them at all times, as well as the distorting effect of classically wide-angled mobile phone cameras when compared to the real world as viewed through the eye.[62] The issues arising from the user having to hold the handheld device (manipulability) and perceiving the visualisation correctly (comprehensibility) have been summarised into the HARUS usability questionnaire.[63]

Games such as Pokémon Go and Ingress utilize an Image Linked Map (ILM) interface, where approved geotagged locations appear on a stylized map for the user to interact with.[64]

Spatial

Spatial augmented reality (SAR) augments real-world objects and scenes without the use of special displays such as monitors, head-mounted displays or hand-held devices. SAR makes use of digital projectors to display graphical information onto physical objects. The key difference in SAR is that the display is separated from the users of the system. Because the displays are not associated with each user, SAR scales naturally up to groups of users, thus allowing for collocated collaboration between users.

Examples include shader lamps, mobile projectors, virtual tables, and smart projectors. Shader lamps mimic and augment reality by projecting imagery onto neutral objects, providing the opportunity to enhance the object's appearance with materials of a simple unit - a projector, camera, and sensor.

Other applications include table and wall projections. One innovation, the Extended Virtual Table, separates the virtual from the real by including beam-splitter mirrors attached to the ceiling at an adjustable angle.[65] Virtual showcases, which employ beam-splitter mirrors together with multiple graphics displays, provide an interactive means of simultaneously engaging with the virtual and the real. Many more implementations and configurations make spatial augmented reality display an increasingly attractive interactive alternative.

An SAR system can display on any number of surfaces of an indoor setting at once. SAR supports both a graphical visualization and passive haptic sensation for the end users. Users are able to touch physical objects in a process that provides passive haptic sensation.[12][66][67][68]

Tracking

Modern mobile augmented-reality systems use one or more of the following tracking technologies: digital cameras and/or other optical sensors, accelerometers, GPS, gyroscopes, solid state compasses, RFID. These technologies offer varying levels of accuracy and precision. The most important is the position and orientation of the user's head. Tracking the user's hand(s) or a handheld input device can provide a 6DOF interaction technique.[69][70]

Networking

Mobile augmented reality applications are gaining popularity due to the wide adoption of mobile and especially wearable devices. However, they often rely on computationally intensive computer vision algorithms with extreme latency requirements. To compensate for the lack of computing power, offloading data processing to a distant machine is often desired. Computation offloading introduces new constraints in applications, especially in terms of latency and bandwidth. Although there are a plethora of real-time multimedia transport protocols, there is a need for support from network infrastructure as well.[71]

Input devices

Techniques include speech recognition systems that translate a user's spoken words into computer instructions, and gesture recognition systems that interpret a user's body movements by visual detection or from sensors embedded in a peripheral device such as a wand, stylus, pointer, glove or other body wear.[72][73][74][75] Products which are trying to serve as a controller of AR headsets include Wave by Seebright Inc. and Nimble by Intugine Technologies.

Computer

The computer analyzes the sensed visual and other data to synthesize and position augmentations. Computers are responsible for the graphics that go with augmented reality. Augmented reality uses a computer-generated image and it has an striking effect on the way the real world is shown. With the improvement of technology and computers, augmented reality is going to have a drastic change on our perspective of the real world.[76] According to Time Magazine, in about 15–20 years it is predicted that Augmented reality and virtual reality are going to become the primary use for computer interactions.[77] Computers are improving at a very fast rate, which means that we are figuring out new ways to improve other technology. The more that computers progress, augmented reality will become more flexible and more common in our society. Computers are the core of augmented reality.

[78] The Computer receives data from the sensors which determine the relative position of objects surface. This translates to an input to the computer which then outputs to the users by adding something that would otherwise not be there. The computer comprises memory and a processor.[79] The computer takes the scanned environment then generates images or a video and puts it on the receiver for the observer to see. The fixed marks on an objects surface are stored in the memory of a computer. The computer also withdrawals from its memory to present images realistically to the onlooker. The best example of this is of the Pepsi Max AR Bus Shelter.[80]

Software and algorithms

A key measure of AR systems is how realistically they integrate augmentations with the real world. The software must derive real world coordinates, independent from the camera, from camera images. That process is called image registration, and uses different methods of computer vision, mostly related to video tracking.[81][82] Many computer vision methods of augmented reality are inherited from visual odometry.

Usually those methods consist of two parts. The first stage is to detect interest points, fiducial markers or optical flow in the camera images. This step can use feature detection methods like corner detection, blob detection, edge detection or thresholding, and other image processing methods.[83][84] The second stage restores a real world coordinate system from the data obtained in the first stage. Some methods assume objects with known geometry (or fiducial markers) are present in the scene. In some of those cases the scene 3D structure should be precalculated beforehand. If part of the scene is unknown simultaneous localization and mapping (SLAM) can map relative positions. If no information about scene geometry is available, structure from motion methods like bundle adjustment are used. Mathematical methods used in the second stage include projective (epipolar) geometry, geometric algebra, rotation representation with exponential map, kalman and particle filters, nonlinear optimization, robust statistics.

Augmented Reality Markup Language (ARML) is a data standard developed within the Open Geospatial Consortium (OGC),[85] which consists of XML grammar to describe the location and appearance of virtual objects in the scene, as well as ECMAScript bindings to allow dynamic access to properties of virtual objects.

To enable rapid development of augmented reality applications, some software development kits (SDKs) have emerged.[86][87] A few SDKs such as CloudRidAR[88] leverage cloud computing for performance improvement. AR SDKs are offered by Vuforia,[89] ARToolKit, Catchoom CraftAR[90] Mobinett AR,[91] Wikitude,[92] Blippar[93] Layar,[94] Meta.[95][96] and ARLab.[97]

Development

The implementation of Augmented Reality in consumer products requires considering the design of the applications and the related constraints of the technology platform. Since AR system rely heavily on the immersion of the user and the interaction between the user and the system, design can facilitate the adoption of virtuality. For most Augmented Reality systems, a similar design guideline can be followed. The following lists some considerations for designing Augmented Reality applications:

Environmental/context design[98]

Context Design focuses on the end-user’s physical surrounding, spatial space, and accessibility that may play a role when using the AR system.  Designers should be aware of the possible physical scenarios the end-user may be in such as:

  • Public, in which the users uses their whole body to interact with the software
  • Personal, in which the user uses a smartphone in a public space
  • Intimate, in which the user is sitting with a desktop and is not really in movement
  • Private, in which the user has on a wearable.

By evaluating each physical scenario, potential safety hazard can be avoided and changes can be made to greater improve the end-user’s immersion. UX designers will have to define user journeys for the relevant physical scenarios and define how the interface will react to each.

Especially in AR systems, it is vital to also consider the spatial space and the surrounding elements that change the effectiveness of the AR technology. Environmental elements such as lighting, and sound can prevent the sensor of AR devices from detecting necessary data and ruin the immersion of the end-user.[99]

Another aspect of context design involves the design of the system’s functionality and its ability to accommodate for user preferences.[100][101] While accessibility tools are common in basic application design, some consideration should be made when designing time-limited prompts (to prevent unintentional operations), audio cues and overall engagement time. It is important to note that in some situations, the application’s functionality may hinder the user’s ability. For example, applications that is used for driving should reduce the amount of user interaction and user audio cues instead.

Interaction design

Interaction design in augmented reality technology centers on the user’s engagement with the end product to improve the overall user experience and enjoyment. The purpose of Interaction Design is to avoid alienating or confusing the user by organising the information presented. Since user interaction relies on the user’s input, designers must make system controls easier to understand and accessible. A common technique to improve usability for augmented reality applications is by discovering the frequently accessed areas in the device’s touch display and design the application to match those areas of control.[102] It is also important to structure the user journey maps and the flow of information presented which reduce the system’s overall cognitive load and greatly improves the learning curve of the application.[103]

In interaction design, it is important for developers to utilize augmented reality technology that complement the system’s function or purpose.[104] For instance, the utilization of exciting AR filters and the design of the unique sharing platform in Snapchat enables users to better the user’s social interactions. In other applications that require users to understand the focus and intent, designers can employ a reticle or raycast from the device.[100] Moreover, augmented reality developers may find it appropriate to have digital elements scale or react to the direction of the camera and the context of objects that can are detected.[99]  

The most exciting factor of augmented reality technology is the ability to utilize the introduction of 3D space. This means that a user can potentially access multiple copies of 2D interfaces within a single AR application.[99] AR applications are collaborative, a user can also connect to another’s device and view or manipulate virtual objects in the other person’s context.

Visual design

In general, visual design is the appearance of the developing application that engages the user. To improve the graphic interface elements and user interaction, developers may use visual cues to inform user what elements of UI are designed to interact with and how to interact with them. Since navigating in AR application may appear difficult and seem frustrating, visual cues design can make interactions seem more natural.[98]

In some augmented reality applications that uses a 2D device as an interactive surface, the 2D control environment does not translate well in 3D space making users hesitant to explore their surroundings. To solve this issue, designers should apply visual cues to assist and encourage users to explore their surroundings.

It is important to note the two main objects in AR when developing VR applications: 3D volumetric objects that are manipulatable and realistically interact with light and shadow; and animated media imagery such as images and videos which are mostly traditional 2D media rendered in a new context for augmented reality.[98] When virtual objects are projected onto a real environment, it is challenging for augmented reality application designers to ensure a perfectly seamless integration relative to the real world environment, especially with 2D objects. As such, designers can add weight to objects, use depths maps, and choose different material properties that highlight the object’s presence in the real world. Another visual design that can be applied is using different lighting techniques or casting shadows to improve overall depth judgment. For instance, a common lighting technique is simply placing a light source overhead at the 12 o’clock position, to create shadows upon virtual objects.[98]

Possible applications

Augmented reality has been explored for many applications.[105] Since the 1970s and early 1980s, Steve Mann has developed technologies meant for everyday use i.e. "horizontal" across all applications rather than a specific "vertical" market. Examples include Mann's "EyeTap Digital Eye Glass", a general-purpose seeing aid that does dynamic-range management (HDR vision) and overlays, underlays, simultaneous augmentation and diminishment (e.g. diminishing the electric arc while looking at a welding torch).[106]

Literature

An example of an AR code containing a QR code

The first description of AR as it is known today was in Virtual Light, the 1994 novel by William Gibson. In 2011, AR was blended with poetry by ni ka from Sekai Camera in Tokyo, Japan. The prose of these AR poems come from Paul Celan, "Die Niemandsrose", expressing the aftermath of the 2011 Tōhoku earthquake and tsunami.[107][108][109]

Archaeology

AR has been used to aid archaeological research. By augmenting archaeological features onto the modern landscape, AR allows archaeologists to formulate possible site configurations from extant structures.[110] Computer generated models of ruins, buildings, landscapes or even ancient people have been recycled into early archaeological AR applications.[111][112][113] For example, implementing a system like, "VITA (Visual Interaction Tool for Archaeology)" will allow users to imagine and investigate instant excavation results without leaving their home. Each user can collaborate by mutually "navigating, searching, and viewing data." Hrvjone Benko, a researcher for the computer science department at Colombia University, points out that these particular systems and others like it can provide "3D panoramic images and 3D models of the site itself at different excavation stages" all the while organizing much of the data in a collaborative way that is easy to use. Collaborative AR systems supply multimodal interactions that combine the real world with virtual images of both environments.[114]

Architecture

AR can aid in visualizing building projects. Computer-generated images of a structure can be superimposed into a real life local view of a property before the physical building is constructed there; this was demonstrated publicly by Trimble Navigation in 2004. AR can also be employed within an architect's workspace, rendering animated 3D visualizations of their 2D drawings. Architecture sight-seeing can be enhanced with AR applications, allowing users viewing a building's exterior to virtually see through its walls, viewing its interior objects and layout.[115][116][117]

With the continual improvements to GPS accuracy, businesses are able to use augmented reality to visualize georeferenced models of construction sites, underground structures, cables and pipes using mobile devices.[118] Augmented reality is applied to present new projects, to solve on-site construction challenges, and to enhance promotional materials.[119] Examples include the Daqri Smart Helmet, an Android-powered hard hat used to create augmented reality for the industrial worker, including visual instructions, real-time alerts, and 3D mapping.

Following the Christchurch earthquake, the University of Canterbury released CityViewAR,[120] which enabled city planners and engineers to visualize buildings that had been destroyed.[121] Not only did this provide planners with tools to reference the previous cityscape, but it also served as a reminder to the magnitude of the devastation caused, as entire buildings had been demolished.

Visual art

AR applied in the visual arts allows objects or places to trigger artistic multidimensional experiences and interpretations of reality.

Augmented Reality can aid in the progression of visual art in museums by allowing museum visitors to view artwork in galleries in a multidimensional way through their phone screens. The Museum of Modern Art in New York has created an exhibit in their art museum showcasing Augmented Reality features that viewers can see using an app on their smartphone. [122]The museum has developed their personal app, called MoMAR Gallery, that museum guests can download and use in the Augmented Reality specialized gallery in order to view the museum’s paintings in a different way. [123]This allows individuals to see hidden aspects and information about the paintings, and to be able to have an interactive technological experience with the artwork as well.

AR technology aided the development of eye tracking technology[124] to translate a disabled person's eye movements into drawings on a screen.[125]

Commerce

The AR-Icon can be used as a marker on print as well as on online media. It signals the viewer that digital content is behind it. The content can be viewed with a smartphone or tablet.

AR is used to integrate print and video marketing. Printed marketing material can be designed with certain "trigger" images that, when scanned by an AR-enabled device using image recognition, activate a video version of the promotional material. A major difference between augmented reality and straightforward image recognition is that one can overlay multiple media at the same time in the view screen, such as social media share buttons, the in-page video even audio and 3D objects. Traditional print-only publications are using augmented reality to connect many different types of media.[126][127][128][129][130]

AR can enhance product previews such as allowing a customer to view what's inside a product's packaging without opening it.[131] AR can also be used as an aid in selecting products from a catalog or through a kiosk. Scanned images of products can activate views of additional content such as customization options and additional images of the product in its use.[132]

By 2010, virtual dressing rooms had been developed for e-commerce.[133]

Augment SDK
Augment SDK offers brands and retailers the capability to personalize their customers' shopping experience by embedding AR product visualization into their eCommerce platforms.

In 2012, a mint used AR techniques to market a commemorative coin for Aruba. The coin itself was used as an AR trigger, and when held in front of an AR-enabled device it revealed additional objects and layers of information that were not visible without the device.[134][135]

In 2013, L'Oreal Paris used CrowdOptic technology to create an augmented reality experience at the seventh annual Luminato Festival in Toronto, Canada.[40]

In 2014, L'Oreal brought the AR experience to a personal level with their "Makeup Genius" app. It allowed users to try out make-up and beauty styles via a mobile device.[136]

In 2015, the Bulgarian startup iGreet developed its own AR technology and used it to make the first premade "live" greeting card. A traditional paper card was augmented with digital content which was revealed by using the iGreet app.[137][138]

Education

In educational settings, AR has been used to complement a standard curriculum. Text, graphics, video, and audio may be superimposed into a student's real-time environment. Textbooks, flashcards and other educational reading material may contain embedded "markers" or triggers that, when scanned by an AR device, produced supplementary information to the student rendered in a multimedia format.[139][140][141] This makes AR a good alternative method for presenting information and Multimedia Learning Theory can be applied.[142]

As AR evolved, students can participate interactively and interact with knowledge more authentically. Instead of remaining passive recipients, students can become active learners, able to interact with their learning environment. Computer-generated simulations of historical events allow students to explore and learning details of each significant area of the event site.[143]

In higher education, Construct3D, a Studierstube system, allows students to learn mechanical engineering concepts, math or geometry.[144] Chemistry AR apps allow students to visualize and interact with the spatial structure of a molecule using a marker object held in the hand.[145] Others have used HP Reveal, a free app, to create AR notecards for studying organic chemistry mechanisms or to create virtual demonstrations of how to use laboratory instrumentation.[146] Anatomy students can visualize different systems of the human body in three dimensions.[147]

Remote collaboration

Primary school children learn easily from interactive experiences. Astronomical constellations and the movements of objects in the solar system were oriented in 3D and overlaid in the direction the device was held, and expanded with supplemental video information. Paper-based science book illustrations could seem to come alive as video without requiring the child to navigate to web-based materials.

In 2013, a project was launched on Kickstarter to teach about electronics with an educational toy that allowed children to scan their circuit with an iPad and see the electric current flowing around.[148] While some educational apps were available for AR by 2016, it was not broadly used. Apps that leverage augmented reality to aid learning included SkyView for studying astronomy,[149] AR Circuits for building simple electric circuits,[150] and SketchAr for drawing.[151]

AR would also be a way for parents and teachers to achieve their goals for modern education, which might include providing a more individualized and flexible learning, making closer connections between what is taught at school and the real world, and helping students to become more engaged in their own learning.

A recent research compared the functionalities of augmented reality tools with potential for education [152]

Emergency management/search and rescue

Augmented reality systems are used in public safety situations, from super storms to suspects at large.

As early as 2009, two articles from Emergency Management magazine discussed the power of this technology for emergency management. The first was "Augmented Reality--Emerging Technology for Emergency Management" by Gerald Baron.[153] Per Adam Crowe: "Technologies like augmented reality (ex: Google Glass) and the growing expectation of the public will continue to force professional emergency managers to radically shift when, where, and how technology is deployed before, during, and after disasters."[154] Moreover, a 2018 article in the Journal of Agromedicine describes lessons learned from the development of an augmented reality prototype app developed to assist emergency responders in rural and agricultural environments.[155] The article also describes this application's utility and current use as a training tool with rural firefighters, part of a National Farm Medicine Center research project on agricultural safety throughout Wisconsin and Minnesota.

Another early example was a search aircraft looking for a lost hiker in rugged mountain terrain. Augmented reality systems provided aerial camera operators with a geographic awareness of forest road names and locations blended with the camera video. The camera operator was better able to search for the hiker knowing the geographic context of the camera image. Once located, the operator could more efficiently direct rescuers to the hiker's location because the geographic position and reference landmarks were clearly labeled.[156]

Social interaction

AR can be used to facilitate social interaction. An augmented reality social network framework called Talk2Me enables people to disseminate information and view others’ advertised information in an augmented reality way. The timely and dynamic information sharing and viewing functionalities of Talk2Me help initiate conversations and make friends for users with people in physical proximity.[157]

Augmented reality also Gives users the ability to practice different forms of social interactions with other people in a safe, risk-free environment. Hannes Kauffman, Associate Professor for Virtual Reality at TU Vienna, says “In collaborative Augmented Reality multiple users may access a shared space populated by virtual objects, while remaining grounded in the real world. This technique is particularly powerful for educational purposes when users are collocated and can use natural means of communication (speech, gestures etc.), but can also be mixed successfully with immersive VR or remote collaboration.” (Hannes)Hannes cites a specific use for this technology, education.

Video games

Merchlar's mobile game Get On Target uses a trigger image as fiducial marker.

The gaming industry embraced AR technology. A number of games were developed for prepared indoor environments, such as AR air hockey, Titans of Space, collaborative combat against virtual enemies, and AR-enhanced pool table games.[158][159][160]

Augmented reality allowed video game players to experience digital game play in a real world environment. Companies and platforms like Niantic and Proxy42 emerged as major augmented reality gaming creators.[161][162] Niantic is notable for releasing the record-breaking game Pokémon Go.[163] Disney has partnered with Lenovo to create the augmented reality game Star Wars: Jedi Challenges that works with a Lenovo Mirage AR headset, a tracking sensor and a Lightsaber controller, scheduled to launch in December 2017.[164]

Industrial design

AR allows industrial designers to experience a product's design and operation before completion. Volkswagen has used AR for comparing calculated and actual crash test imagery.[165] AR has been used to visualize and modify car body structure and engine layout. It has also been used to compare digital mock-ups with physical mock-ups for finding discrepancies between them.[166][167]

Medical

Since 2005, a device called a near-infrared vein finder that films subcutaneous veins, processes and projects the image of the veins onto the skin has been used to locate veins.[168][169]

AR provides surgeons with patient monitoring data in the style of a fighter pilot's heads-up display, and allows patient imaging records, including functional videos, to be accessed and overlaid. Examples include a virtual X-ray view based on prior tomography or on real-time images from ultrasound and confocal microscopy probes,[170] visualizing the position of a tumor in the video of an endoscope,[171] or radiation exposure risks from X-ray imaging devices.[172][173] AR can enhance viewing a fetus inside a mother's womb.[174] Siemens, Karl Storz and IRCAD have developed a system for laparoscopic liver surgery that uses AR to view sub-surface tumors and vessels.[175] AR has been used for cockroach phobia treatment.[176] Patients wearing augmented reality glasses can be reminded to take medications.[177] Virtual reality has been seen promising in the medical field since the 90's.[178] Augmented reality can be very helpful in the medical field.[179] It could be used to provide crucial information to a doctor or surgeon with having them take their eyes off the patient. On the 30th of April, 2015 Microsoft announced the Microsoft HoloLens, their first shot at augmented reality. The HoloLens has advanced through the years and it has gotten so advanced that it has been used to project holograms for near infrared fluorescence based image guided surgery.[180] As augment reality advances, the more it is implemented into medical use. Augmented reality and other computer based-utility is being used today to help train medical professionals.[181] With the creation of Google Glass and Microsoft HoloLens, has helped pushed Augmented Reality into medical education.

Spatial immersion and interaction

Augmented reality applications, running on handheld devices utilized as virtual reality headsets, can also digitalize human presence in space and provide a computer generated model of them, in a virtual space where they can interact and perform various actions. Such capabilities are demonstrated by "Project Anywhere", developed by a postgraduate student at ETH Zurich, which was dubbed as an "out-of-body experience".[182][183][184]

Flight training

Building on decades of perceptual-motor research in experimental psychology, researchers at the Aviation Research Laboratory of the University of Illinois at Urbana-Champaign used augmented reality in the form of a flight path in the sky to teach flight students how to land a flight simulator. An adaptive augmented schedule in which students were shown the augmentation only when they departed from the flight path proved to be a more effective training intervention than a constant schedule.[185][186] Flight students taught to land in the simulator with the adaptive augmentation learned to land a light aircraft more quickly than students with the same amount of landing training in the simulator but with constant augmentation or without any augmentation.[185]

Military

Augmented Reality System for Soldier ARC4(USA)

An interesting early application of AR occurred when Rockwell International created video map overlays of satellite and orbital debris tracks to aid in space observations at Air Force Maui Optical System. In their 1993 paper "Debris Correlation Using the Rockwell WorldView System" the authors describe the use of map overlays applied to video from space surveillance telescopes. The map overlays indicated the trajectories of various objects in geographic coordinates. This allowed telescope operators to identify satellites, and also to identify and catalog potentially dangerous space debris.[187]

Starting in 2003 the US Army integrated the SmartCam3D augmented reality system into the Shadow Unmanned Aerial System to aid sensor operators using telescopic cameras to locate people or points of interest. The system combined both fixed geographic information including street names, points of interest, airports, and railroads with live video from the camera system. The system offered a "picture in picture" mode that allows the system to show a synthetic view of the area surrounding the camera's field of view. This helps solve a problem in which the field of view is so narrow that it excludes important context, as if "looking through a soda straw". The system displays real-time friend/foe/neutral location markers blended with live video, providing the operator with improved situational awareness.

Researchers at USAF Research Lab (Calhoun, Draper et al.) found an approximately two-fold increase in the speed at which UAV sensor operators found points of interest using this technology.[188] This ability to maintain geographic awareness quantitatively enhances mission efficiency. The system is in use on the US Army RQ-7 Shadow and the MQ-1C Gray Eagle Unmanned Aerial Systems.

In combat, AR can serve as a networked communication system that renders useful battlefield data onto a soldier's goggles in real time. From the soldier's viewpoint, people and various objects can be marked with special indicators to warn of potential dangers. Virtual maps and 360° view camera imaging can also be rendered to aid a soldier's navigation and battlefield perspective, and this can be transmitted to military leaders at a remote command center.[189]

LandForm video map overlay marking runways, road, and buildings during 1999 helicopter flight test

The NASA X-38 was flown using a Hybrid Synthetic Vision system that overlaid map data on video to provide enhanced navigation for the spacecraft during flight tests from 1998 to 2002. It used the LandForm software and was useful for times of limited visibility, including an instance when the video camera window frosted over leaving astronauts to rely on the map overlays.[190] The LandForm software was also test flown at the Army Yuma Proving Ground in 1999. In the photo at right one can see the map markers indicating runways, air traffic control tower, taxiways, and hangars overlaid on the video.[191]

AR can augment the effectiveness of navigation devices. Information can be displayed on an automobile's windshield indicating destination directions and meter, weather, terrain, road conditions and traffic information as well as alerts to potential hazards in their path.[192][193][194] Aboard maritime vessels, AR can allow bridge watch-standers to continuously monitor important information such as a ship's heading and speed while moving throughout the bridge or performing other tasks.[195]

Workplace

Augmented reality may have a good impact on work collaboration as people may be inclined to interact more actively with their learning environment. It may also encourage tacit knowledge renewal which makes firms more competitive. AR was used to facilitate collaboration among distributed team members via conferences with local and virtual participants. AR tasks included brainstorming and discussion meetings utilizing common visualization via touch screen tables, interactive digital whiteboards, shared design spaces, and distributed control rooms.[196][197][198]

In industrial environments, augmented reality is proving to have a substantial impact with more and more use cases emerging across all aspect of the product lifecycle, starting from product design and new product introduction (NPI) to manufacturing to service and maintenance, to material handling and distribution. For example, labels were displayed on parts of a system to clarify operating instructions for a mechanic performing maintenance on a system.[199][200] Assembly lines benefited from the usage of AR. In addition to Boeing, BMW and Volkswagen were known for incorporating this technology into assembly lines for monitoring process improvements.[201][202][203] Big machines are difficult to maintain because of their multiple layers or structures. AR permits people to look through the machine as if with an x-ray, pointing them to the problem right away.[204]

As AR technology has evolved and second and third generation AR devices come to market, the impact of AR in enterprise continues to flourish. In one Harvard Business Review article by Magid Abraham of Upskill and Marco Annunziata of GE, the authors discuss how AR devices are now being used to "boost workers’ productivity on an array of tasks the first time they’re used, even without prior training." They go on to contend that "these technologies increase productivity by making workers more skilled and efficient, and thus have the potential to yield both more economic growth and better jobs." To support their points, they reference a side-by-side time-lapse comparison of a GE technician wiring a wind turbine’s control box using the company’s current process, and then doing the same task while guided by line-of-sight instructions overlaid on the job by an AR headset. The device improved the worker’s performance by 34% on first use.

The new wave of professionals, the Millennial workforce, demands more efficient knowledge sharing solutions and easier access to rapidly growing knowledge bases. Augmented reality offers a solution to that.[205]

Broadcast and live events

Weather visualizations were the first application of augmented reality to television. It has now become common in weathercasting to display full motion video of images captured in real-time from multiple cameras and other imaging devices. Coupled with 3D graphics symbols and mapped to a common virtual geospace model, these animated visualizations constitute the first true application of AR to TV.

AR has become common in sports telecasting. Sports and entertainment venues are provided with see-through and overlay augmentation through tracked camera feeds for enhanced viewing by the audience. Examples include the yellow "first down" line seen in television broadcasts of American football games showing the line the offensive team must cross to receive a first down. AR is also used in association with football and other sporting events to show commercial advertisements overlaid onto the view of the playing area. Sections of rugby fields and cricket pitches also display sponsored images. Swimming telecasts often add a line across the lanes to indicate the position of the current record holder as a race proceeds to allow viewers to compare the current race to the best performance. Other examples include hockey puck tracking and annotations of racing car performance and snooker ball trajectories.[81][206]

Augmented reality for Next Generation TV allows viewers to interact with the programs they were watching. They can place objects into an existing program and interact with them, such as moving them around. Objects include avatars of real persons in real time who are also watching the same program.

AR has been used to enhance concert and theater performances. For example, artists allow listeners to augment their listening experience by adding their performance to that of other bands/groups of users.[207][208][209]

Tourism and sightseeing

Travelers may use AR to access real-time informational displays regarding a location, its features, and comments or content provided by previous visitors. Advanced AR applications include simulations of historical events, places, and objects rendered into the landscape.[210][211][212]

AR applications linked to geographic locations present location information by audio, announcing features of interest at a particular site as they become visible to the user.[213][214][215]

Companies can use AR to attract tourists to particular areas that they may not be familiar with by name. Tourists will be able to experience beautiful landscapes in first person with the use of AR devices. Companies like Phocuswright plan to use such technology in order to expose the lesser known but beautiful areas of the planet, and in turn, increase tourism. Other companies such as Matoke Tours have already developed an application where the user can see 360 degrees from several different places in Uganda. Matoke Tours and Phocuswright have the ability to display their apps on virtual reality headsets like the Samsung VR and Oculus Rift.[216]

Translation

AR systems such as Word Lens can interpret the foreign text on signs and menus and, in a user's augmented view, re-display the text in the user's language. Spoken words of a foreign language can be translated and displayed in a user's view as printed subtitles.[217][218][219]

Music

It has been suggested that augmented reality may be used in new methods of music production, mixing, control and visualization.[220][221][222][223]

A tool for 3D music creation in clubs that, in addition to regular sound mixing features, allows the DJ to play dozens of sound samples, placed anywhere in 3D space, has been conceptualized.[224]

Leeds College of Music teams have developed an AR app that can be used with Audient desks and allow students to use their smartphone or tablet to put layers of information or interactivity on top of an Audient mixing desk.[225]

ARmony is a software package that makes use of augmented reality to help people to learn an instrument.[226]

In a proof-of-concept project Ian Sterling, interaction design student at California College of the Arts, and software engineer Swaroop Pal demonstrated a HoloLens app whose primary purpose is to provide a 3D spatial UI for cross-platform devices — the Android Music Player app and Arduino-controlled Fan and Light — and also allow interaction using gaze and gesture control.[227][228][229][230]

AR Mixer is an app that allows one to select and mix between songs by manipulating objects – such as changing the orientation of a bottle or can.[231]

In a video, Uriel Yehezkel demonstrates using the Leap Motion controller and GECO MIDI to control Ableton Live with hand gestures and states that by this method he was able to control more than 10 parameters simultaneously with both hands and take full control over the construction of the song, emotion and energy.[232][233]

A novel musical instrument that allows novices to play electronic musical compositions, interactively remixing and modulating their elements, by manipulating simple physical objects has been proposed.[234]

A system using explicit gestures and implicit dance moves to control the visual augmentations of a live music performance that enable more dynamic and spontaneous performances and—in combination with indirect augmented reality—leading to a more intense interaction between artist and audience has been suggested.[235]

Research by members of the CRIStAL at the University of Lille makes use of augmented reality in order to enrich musical performance. The ControllAR project allows musicians to augment their MIDI control surfaces with the remixed graphical user interfaces of music software.[236] The Rouages project proposes to augment digital musical instruments in order to reveal their mechanisms to the audience and thus improve the perceived liveness.[237] Reflets is a novel augmented reality display dedicated to musical performances where the audience acts as a 3D display by revealing virtual content on stage, which can also be used for 3D musical interaction and collaboration.[238]

Retail

Augmented reality is becoming more frequently used for online advertising. Retailers offer the ability to upload a picture on their website and "try on" various clothes which is overlaid on the picture. Even further, companies such as Bodymetrics install dressing booths in department stores that offer full-body scanning. These booths render a 3-D model of the user, allowing the consumers to view different outfits on themselves without the need of physically changing clothes.[239] For example, JC Penney and Bloomingdale's use "virtual dressing rooms" that allow customers to see themselves in clothes without trying them on.[240] Another store that uses AR to market clothing to its customers is Neiman Marcus.[241] Neiman Marcus offers consumers the ability to see their outfits in a 360 degree view with their "memory mirror". [241] Makeup stores like L'Oreal, Sephora, Charlotte Tilbury, and Rimmel also have apps that utilize AR.[242] These apps allow consumers to see how the makeup will look on them.[242] According to Greg Jones, director of AR and VR at Google, augmented reality is going to "reconnect physical and digital retail."[242]

AR technology is also used by furniture retailers such as IKEA, Houzz, and Wayfair.[242][240] These retailers offer apps that allow consumers to view their products in their home prior to purchasing anything.[242] IKEA launched their IKEA Place at the end of 2017 and made it possible to have 3D and true to scale models of furniture in their living space, through using the app and their camera. IKEA realized that their customers are not shopping in stores as often or directly buy things anymore. So they created IKEA Place to tackle these problems and have people try out the furniture with Augmented Reality and then decide if they want to buy it. [243][244]


Snapchat

Snapchat users have access to augmented reality in the company's instant messaging app through use of camera filters. In September 2017, Snapchat updated its app to include a camera filter that allowed users to render an animated, cartoon version of themselves called "Bitmoji". These animated avatars would be projected in the real world through the camera, and can be photographed or video recorded.[245] In the same month, Snapchat also announced a new feature called "Sky Filters" that will be available on its app. This new feature makes use of augmented reality to alter the look of a picture taken of the sky, much like how users can apply the app's filters to other pictures. Users can choose from sky filters such as starry night, stormy clouds, beautiful sunsets, and rainbow.[246]

The Dangers of AR

Reality modifications

There is a danger that AR will make individuals overconfident and put their life at risk because of it. Pokemon GO with a couple of deaths and many injuries is the perfect example of it. "Death by Pokémon GO” , by a pair of researchers from Purdue University's Krannert School of Management, says the game caused “a disproportionate increase in vehicular crashes and associated vehicular damage, personal injuries, and fatalities in the vicinity of locations, called PokéStops, where users can play the game while driving.”[247]. The paper extrapolated what that might mean nationwide and concluded “the increase in crashes attributable to the introduction of Pokémon GO is 145,632 with an associated increase in the number of injuries of 29,370 and an associated increase in the number of fatalities of 256 over the period of July 6, 2016, through November 30, 2016.” The authors valued those crashes and fatalities at between $2bn and $7.3 billion for the same period.

Furthermore, more than one in three surveyed advanced internet users would like to edit out disturbing elements around them, such as garbage or graffiti [248]. They would like to even modify their surroundings by erasing street signs, billboard ads, and uninteresting shopping windows. So it seems that AR is a threat to companies as it is an opportunity. Although this could be a nightmare to numerous brands that do not manage to capture consumer imaginations it also creates the risk that the wearers of augmented reality glasses may become unaware of surrounding dangers. Consumers want to use augmented reality glasses to change their surroundings into something that reflects their own personal opinions. Around two in five want to change the way their surroundings look and even how people appear to them.

Next, to the possible privacy issues that are described below, overload and over-reliance issues is the biggest danger of AR. For the development of new AR related products, this implies that the user-interface should follow certain guidelines as not to overload the user with information while also preventing the user to overly rely on the AR system such that important cues from the environment are missed [249].  This is called the virtually-augmented key [250]. Once the key is not taken into account people might not need the real word anymore.

Privacy concerns

The concept of modern augmented reality depends on the ability of the device to record and analyze the environment in real time. Because of this, there are potential legal concerns over privacy. While the First Amendment to the United States Constitution allows for such recording in the name of public interest, the constant recording of an AR device makes it difficult to do so without also recording outside of the public domain. Legal complications would be found in areas where a right to a certain amount of privacy is expected or where copyrighted media are displayed.

In terms of individual privacy, there exists the ease of access to information that one should not readily possess about a given person. This is accomplished through facial recognition technology. Assuming that AR automatically passes information about persons that the user sees, there could be anything seen from social media, criminal record, and marital status.[251]

Privacy-compliant image capture solutions can be deployed to temper the impact of constant filming on individual privacy.[252]

Notable researchers

  • Ivan Sutherland invented the first VR head-mounted display at Harvard University.
  • Steve Mann formulated an earlier concept of mediated reality in the 1970s and 1980s, using cameras, processors, and display systems to modify visual reality to help people see better (dynamic range management), building computerized welding helmets, as well as "augmediated reality" vision systems for use in everyday life. He is also an adviser to Meta.[253]
  • Louis Rosenberg developed one of the first known AR systems, called Virtual Fixtures, while working at the U.S. Air Force Armstrong Labs in 1991, and published the first study of how an AR system can enhance human performance.[254] Rosenberg's subsequent work at Stanford University in the early 90's, was the first proof that virtual overlays when registered and presented over a user's direct view of the real physical world, could significantly enhance human performance.[255][256][257]
  • Mike Abernathy pioneered one of the first successful augmented video overlays (also called hybrid syntheric vision) using map data for space debris in 1993,[187] while at Rockwell International. He co-founded Rapid Imaging Software, Inc. and was the primary author of the LandForm system in 1995, and the SmartCam3D system.[190][191] LandForm augmented reality was successfully flight tested in 1999 aboard a helicopter and SmartCam3D was used to fly the NASA X-38 from 1999–2002. He and NASA colleague Francisco Delgado received the National Defense Industries Association Top5 awards in 2004.[258]
  • Steven Feiner, Professor at Columbia University, is the author of a 1993 paper on an AR system prototype, KARMA (the Knowledge-based Augmented Reality Maintenance Assistant), along with Blair MacIntyre and Doree Seligmann. He is also an advisor to Meta.[259]
  • Tracy McSheery, of Phasespace, developer of wide field of view AR lenses as used in Meta 2 and others.[260]
  • S. Ravela, B. Draper, J. Lim and A. Hanson develop marker/fixture-less augmented reality system with computer vision in 1994. They augmented an engine block observed from a single video camera with annotations for repair. They use model-based pose estimation, aspect graphs and visual feature tracking to dynamically register model with the observed video.[261]
  • Francisco "Frank" Delgado is a NASA engineer and project manager specializing in human interface research and development. Starting 1998 he conducted research into displays that combined video with synthetic vision systems (called hybrid synthetic vision at the time) that we recognize today as augmented reality systems for the control of aircraft and spacecraft. In 1999 he and colleague Mike Abernathy flight-tested the LandForm system aboard a US Army helicopter. Delgado oversaw integration of the LandForm and SmartCam3D systems into the X-38 Crew Return Vehicle.[190][191][7] In 2001, Aviation Week reported NASA astronaut's successful use of hybrid synthetic vision (augmented reality) to fly the X-38 during a flight test at Dryden Flight Research Center. The technology was used in all subsequent flights of the X-38. Delgado was co-recipient of the National Defense Industries Association 2004 Top 5 software of the year award for SmartCam3D.[258]
  • Bruce H. Thomas and Wayne Piekarski develop the Tinmith system in 1998.[262] They along with Steve Feiner with his MARS system pioneer outdoor augmented reality.
  • Mark Billinghurst is Director of the HIT Lab New Zealand (HIT Lab NZ) at the University of Canterbury in New Zealand and a notable AR researcher. He has produced over 250 technical publications and presented demonstrations and courses at a wide variety of conferences.
  • Reinhold Behringer performed important early work in image registration for augmented reality, and prototype wearable testbeds for augmented reality. He also co-organized the First IEEE International Symposium on Augmented Reality in 1998 (IWAR'98), and co-edited one of the first books on augmented reality.[263][264][265]
  • Dieter Schmalstieg and Daniel Wagner developed a marker tracking systems for mobile phones and PDAs in 2009.[266]

History

  • 1901: L. Frank Baum, an author, first mentions the idea of an electronic display/spectacles that overlays data onto real life (in this case 'people'). It is named a 'character marker'.[267]
  • 1957–62: Morton Heilig, a cinematographer, creates and patents a simulator called Sensorama with visuals, sound, vibration, and smell.[268]
  • 1968: Ivan Sutherland invents the head-mounted display and positions it as a window into a virtual world.[269]
  • 1975: Myron Krueger creates Videoplace to allow users to interact with virtual objects.
  • 1980: The research by Gavan Lintern of the University of Illinois is the first published work to show the value of a heads up display for teaching real-world flight skills.[185]
  • 1980: Steve Mann creates the first wearable computer, a computer vision system with text and graphical overlays on a photographically mediated scene.[270] See EyeTap. See Heads Up Display.
  • 1981: Dan Reitan geospatially maps multiple weather radar images and space-based and studio cameras to earth maps and abstract symbols for television weather broadcasts, bringing a precursor concept to augmented reality (mixed real/graphical images) to TV.[271]
  • 1984: In the film The Terminator, the Terminator uses a heads-up display in several parts of the film. In one part, he accesses a diagram of the gear system of the truck he gets into towards the end of the film.
  • 1987: Douglas George and Robert Morris create a working prototype of an astronomical telescope-based "heads-up display" system (a precursor concept to augmented reality) which superimposed in the telescope eyepiece, over the actual sky images, multi-intensity star, and celestial body images, and other relevant information.[272][273]
  • 1989: Jaron Lanier creates VPL Research, an early commercial business around virtual worlds.
  • 1990: The term 'Augmented Reality' is attributed to Thomas P. Caudell, a former Boeing researcher.[274]
  • 1992: Louis Rosenberg developed one of the first functioning AR systems, called Virtual Fixtures, at the United States Air Force Research Laboratory—Armstrong, that demonstrated benefit to human perception.[275]
  • 1993: Steven Feiner, Blair MacIntyre and Doree Seligmann present an early paper on an AR system prototype, KARMA, at the Graphics Interface conference.
  • 1993: Mike Abernathy, et al., report the first use of augmented reality in identifying space debris using Rockwell WorldView by overlaying satellite geographic trajectories on live telescope video.[187]
  • 1993 A widely cited version of the paper above is published in Communications of the ACM – Special issue on computer augmented environments, edited by Pierre Wellner, Wendy Mackay, and Rich Gold.[276]
  • 1993: Loral WDL, with sponsorship from STRICOM, performed the first demonstration combining live AR-equipped vehicles and manned simulators. Unpublished paper, J. Barrilleaux, "Experiences and Observations in Applying Augmented Reality to Live Training", 1999.[277]
  • 1994: Julie Martin creates first 'Augmented Reality Theater production', Dancing In Cyberspace, funded by the Australia Council for the Arts, features dancers and acrobats manipulating body–sized virtual object in real time, projected into the same physical space and performance plane. The acrobats appeared immersed within the virtual object and environments. The installation used Silicon Graphics computers and Polhemus sensing system.
  • 1995: S. Ravela et al. at University of Massachusetts introduce a vision-based system using monocular cameras to track objects (engine blocks) across views for augmented reality.
  • 1998: Spatial Augmented Reality introduced at University of North Carolina at Chapel Hill by Ramesh Raskar, Welch, Henry Fuchs.[66]
  • 1999: Frank Delgado, Mike Abernathy et al. report successful flight test of LandForm software video map overlay from a helicopter at Army Yuma Proving Ground overlaying video with runways, taxiways, roads and road names.[190][191]
  • 1999: The US Naval Research Laboratory engages on a decade-long research program called the Battlefield Augmented Reality System (BARS) to prototype some of the early wearable systems for dismounted soldier operating in urban environment for situation awareness and training.[278]
  • 1999: Hirokazu Kato (加藤 博一) created ARToolKit at HITLab, where AR later was further developed by other HITLab scientists, demonstrating it at SIGGRAPH.
  • 2000: Bruce H. Thomas develops ARQuake, the first outdoor mobile AR game, demonstrating it in the International Symposium on Wearable Computers.
  • 2001: NASA X-38 flown using LandForm software video map overlays at Dryden Flight Research Center.[279]
  • 2004: Outdoor helmet-mounted AR system demonstrated by Trimble Navigation and the Human Interface Technology Laboratory.[117]
  • 2008: Wikitude AR Travel Guide launches on 20 Oct 2008 with the G1 Android phone.[280]
  • 2009: ARToolkit was ported to Adobe Flash (FLARToolkit) by Saqoosha, bringing augmented reality to the web browser.[281]
  • 2012: Launch of Lyteshot, an interactive AR gaming platform that utilizes smart glasses for game data
  • 2013: Meta announces the Meta 1 developer kit. [282][283]
  • 2013: Google announces an open beta test of its Google Glass augmented reality glasses. The glasses reach the Internet through Bluetooth, which connects to the wireless service on a user’s cellphone. The glasses respond when a user speaks, touches the frame or moves the head.[284][285]
  • 2014: Mahei creates the first generation of augmented reality enhanced educational toys.[286]
  • 2015: Microsoft announces Windows Holographic and the HoloLens augmented reality headset. The headset utilizes various sensors and a processing unit to blend high definition "holograms" with the real world.[287]
  • 2016: Niantic released Pokémon Go for iOS and Android in July 2016. The game quickly became one of the most popular smartphone applications and in turn spikes the popularity of augmented reality games.[288]
  • 2017: Magic Leap announces the use of Digital Lightfield technology embedded into the Magic Leap One headset. The creators edition headset includes the glasses and a computing pack worn on your belt.[289]

See also

References

  1. Schueffel, Patrick (2017). The Concise Fintech Compendium. Fribourg: School of Management Fribourg/Switzerland.
  2. 1 2 Rosenberg, L.B. (1992). "The Use of Virtual Fixtures As Perceptual Overlays to Enhance Operator Performance in Remote Environments". Technical Report AL-TR-0089, USAF Armstrong Laboratory, Wright-Patterson AFB OH, 1992.
  3. Steuer, Jonathan. Defining Virtual Reality: Dimensions Determining Telepresence Archived 24 May 2016 at the Wayback Machine., Department of Communication, Stanford University. 15 October 1993.
  4. Introducing Virtual Environments National Center for Supercomputing Applications, University of Illinois.
  5. Rosenberg, L.B. (1993). "Virtual Fixtures: Perceptual Overlays for Telerobotic Manipulation". Proc. of the IEEE Annual Int. Symposium on Virtual Reality (1993): 76–82, .
  6. Dupzyk, Kevin (2016). "I Saw the Future Through Microsoft's Hololens".
  7. 1 2 II, Dennis Williams (2016-05-13). "The History of Augmented Reality (Infographic)". Huffington Post. Retrieved 2018-06-17.
  8. https://www.edsurge.com/news/2015-11-02-how-to-transform-your-classroom-with-augmented-reality
  9. Chen, Brian X. If You’re Not Seeing Data, You’re Not Seeing, Wired, 25 August 2009.
  10. Maxwell, Kerry. Augmented Reality, Macmillan Dictionary Buzzword.
  11. Augmented reality-Everything about AR Archived 5 April 2012 at the Wayback Machine., Augmented Reality On.
  12. 1 2 Azuma, Ronald. A Survey of Augmented Reality Presence: Teleoperators and Virtual Environments, pp. 355–385, August 1997.
  13. Chatzopoulos D., Bermejo C, Huang Z, and Hui P Mobile Augmented Reality Survey: From Where We Are to Where We Go.
  14. Huang Z,P Hui., et al. Mobile augmented reality survey: a bottom-up approach.
  15. Phenomenal Augmented Reality, IEEE Consumer Electronics, Volume 4, No. 4, October 2015, cover+pp92-97
  16. Time-frequency perspectives, with applications, in Advances in Machine Vision, Strategies and Applications, World Scientific Series in Computer Science: Volume 32, C Archibald and Emil Petriu, Cover + pp 99–128, 1992.
  17. Mann, Steve; Feiner, Steve; Harner, Soren; Ali, Mir Adnan; Janzen, Ryan; Hansen, Jayse; Baldassi, Stefano (2015-01-15). "Wearable Computing, 3D Aug* Reality, Photographic/Videographic Gesture Sensing, and Veillance". Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction - TEI '14. ACM. pp. 497–500. doi:10.1145/2677199.2683590. ISBN 9781450333054.
  18. Metz, Rachel. Augmented Reality Is Finally Getting Real Technology Review, 2 August 2012.
  19. Fleet Week: Office of Naval Research Technology- Virtual Reality Welder Training, eweek, 28 May 2012.
  20. Rolland, Jannick; Baillott, Yohan; Goon, Alexei.A Survey of Tracking Technology for Virtual Environments, Center for Research and Education in Optics and Lasers, University of Central Florida.
  21. Klepper, Sebastian.Augmented Reality – Display Systems Archived 28 January 2013 at the Wayback Machine..
  22. Rolland, J; Biocca F; Hamza-Lup F; Yanggang H; Martins R (October 2005). "Development of Head-Mounted Projection Displays for Distributed, Collaborative, Augmented Reality Applications" (PDF). Presence: Teleoperators & Virtual Environments. 14 (5): 528–549. doi:10.1162/105474605774918741.
  23. "Gestigon Gesture Tracking – TechCrunch Disrupt". TechCrunch. Retrieved 11 October 2016.
  24. Matney, Lucas. "uSens shows off new tracking sensors that aim to deliver richer experiences for mobile VR". TechCrunch. Retrieved 29 August 2016.
  25. Chapman, Lizette (2015-01-28). "Augmented-Reality Headset Maker Meta Secures $23 Million". Wall Street Journal. Retrieved 2016-02-29.
  26. Matney, Lucas (2016-03-02). "Hands-on with the $949 mind-bending Meta 2 augmented reality headset". TechCrunch. Retrieved 2016-03-02.
  27. Brewster, Signe (2015-01-28). "Meta raises $23M Series A to refine its augmented reality glasses". Gigaom. Retrieved 2016-02-29.
  28. "Meta Unveils Incredible Augmented Reality Headset at TED". UploadVR. 2016-02-17. Retrieved 2016-02-29.
  29. Wakefield, Jane (2016-02-17). "TED 2016: Meta augmented reality headset demoed at TED". BBC. Retrieved 2016-02-29.
  30. Helft, Miguel (2016-02-17). "New Augmented Reality Startup Meta Dazzles TED Crowd". Forbes. Retrieved 2016-02-29.
  31. Rosenbaum, Steven (2016-02-17). "Meron Gribetz Wants To Build The IOS Of The Mind". Forbes. Retrieved 2016-02-29.
  32. Grifatini, Kristina. Augmented Reality Goggles, Technology Review 10 November 2010.
  33. Arthur, Charles. UK company's 'augmented reality' glasses could be better than Google's, The Guardian, 10 September 2012.
  34. Gannes, Liz. "Google Unveils Project Glass: Wearable Augmented-Reality Glasses". allthingsd.com. Retrieved 2012-04-04. , All Things D.
  35. Benedetti, Winda. Xbox leak reveals Kinect 2, augmented reality glasses NBC News.
  36. "augmented reality | an enhanced version of reality created by the use of technology to overlay digital information on an image of something being viewed through a device (as a smartphone camera) also : the technology used to create augmented reality". www.merriam-webster.com. Retrieved 2015-10-08.
  37. "augmented reality: definition of augmented reality in Oxford dictionary (American English) (US)". www.oxforddictionaries.com. Retrieved 2015-10-08.
  38. "What is Augmented Reality (AR): Augmented Reality Defined, iPhone Augmented Reality Apps and Games and More". Digital Trends. Retrieved 2015-10-08.
  39. "How Crowdoptic's big data technology reveals the world's most popular photo objects". VentureBeat. Retrieved 6 June 2013.
  40. 1 2 Wadhwa, Tarun. "CrowdOptic and L'Oreal To Make History By Demonstrating How Augmented Reality Can Be A Shared Experience". Forbes. Retrieved 6 June 2013.
  41. Lik-Hang Lee and Pan Hui (2017). "Interaction Methods for Smart Glasses". arXiv:1707.09728 [cs.HC].
  42. 1 2 Sheridan, Kelly. "Microsoft HoloLens Vs. Google Glass: No Comparison". InformationWeek. Retrieved 15 February 2015.
  43. Berinato, Scott (January 29, 2015). "What HoloLens Has That Google Glass Didn't". Harward Business Preview. Retrieved 15 February 2015.
  44. "Patent CA2280022A1 – Contact lens for the display of information such as text, graphics, or pictures".
  45. Greenemeier, Larry. Computerized Contact Lenses Could Enable In-Eye Augmented Reality. Scientific American, 23 November 2011.
  46. Yoneda, Yuka. Solar Powered Augmented Contact Lenses Cover Your Eye with 100s of LEDs. inhabitat, 17 March 2010.
  47. Rosen, Kenneth. "Contact Lenses Can Display Your Text Messages". Mashable.com. Mashable.com. Retrieved 2012-12-13.
  48. O'Neil, Lauren. "LCD contact lenses could display text messages in your eye". CBC. Archived from the original on 11 December 2012. Retrieved 2012-12-12.
  49. Anthony, Sebastian. US military developing multi-focus augmented reality contact lenses. ExtremeTech, 13 April 2012.
  50. Bernstein, Joseph. 2012 Invention Awards: Augmented-Reality Contact Lenses Popular Science, 5 June 2012.
  51. Sight
  52. Kosner, Anthony Wing (29 July 2012). "Sight: An 8-Minute Augmented Reality Journey That Makes Google Glass Look Tame". Forbes. Retrieved 3 August 2015.
  53. O'Dell, J. (27 July 2012). "Beautiful short film shows a frightening future filled with Google Glass-like devices". Retrieved 3 August 2015.
  54. "Samsung Just Patented Smart Contact Lenses With a Built-in Camera". Science Alert.
  55. "What are augmented reality markers ?".
  56. "Markerless Augmented Reality is here". Marxent | Top Augmented Reality Apps Developer. 2014-05-09. Retrieved 2018-01-23.
  57. 1 2 Viirre, E.; Pryor, H.; Nagata, S.; Furness, T. A. (1998). "The virtual retinal display: a new technology for virtual reality and augmented vision in medicine". Studies in Health Technology and Informatics. 50: 252–257. ISSN 0926-9630. PMID 10180549.
  58. Tidwell, Michael; Johnson, Richard S.; Melville, David; Furness, Thomas A.The Virtual Retinal Display – A Retinal Scanning Imaging System Archived 13 December 2010 at the Wayback Machine., Human Interface Technology Laboratory, University of Washington.
  59. 1 2 "GlassEyes": The Theory of EyeTap Digital Eye Glass, supplemental material for IEEE Technology and Society, Volume Vol. 31, Number 3, 2012, pp. 10–14.
  60. "Intelligent Image Processing", John Wiley and Sons, 2001, ISBN 0-471-40637-6, 384 p.
  61. Marker vs Markerless AR Archived 28 January 2013 at the Wayback Machine., Dartmouth College Library.
  62. Feiner, Steve. "Augmented reality: a long way off?". AR Week. Pocket-lint. Retrieved 2011-03-03.
  63. Santos, M. E. C.; Polvi, J.; Taketomi, T.; Yamamoto, G.; Sandor, C.; Kato, H. (September 2015). "Toward Standard Usability Questionnaires for Handheld Augmented Reality". IEEE Computer Graphics and Applications. 35 (5): 66–75. doi:10.1109/mcg.2015.94. ISSN 0272-1716. PMID 26416363.
  64. Borge, Ariel (2016-07-11). "The story behind 'Pokémon Go's' impressive mapping". Mashable. Retrieved 2016-07-13.
  65. Bimber, Oliver; Encarnação, Miguel; Branco, Pedro. The Extended Virtual Table: An Optical Extension for Table-Like Projection Systems, MIT Press Journal Vol. 10, No. 6, Pages 613–631, March 13, 2006.
  66. 1 2 Ramesh Raskar, Greg Welch, Henry Fuchs Spatially Augmented Reality, First International Workshop on Augmented Reality, Sept 1998.
  67. Knight, Will. Augmented reality brings maps to life 19 July 2005.
  68. Sung, Dan. Augmented reality in action – maintenance and repair. Pocket-lint, 1 March 2011.
  69. Stationary systems can employ 6DOF track systems such as Polhemus, ViCON, A.R.T, or Ascension.
  70. Solinix Company (Spanish Language) Mobile Marketing based on Augmented Reality, First Company that revolutionizes the concept Mobile Marketing based on Augmented Reality, January 2015.
  71. Braud T, Hassani F, et al. Future Networking Challenges: The Case of Mobile Augmented Reality.
  72. Marshall, Gary.Beyond the mouse: how input is evolving, Touch, voice and gesture recognition and augmented realityTechRadar.computing\PC Plus 23 August 2009.
  73. Simonite, Tom. Augmented Reality Meets Gesture Recognition, Technology Review, 15 September 2011.
  74. Chaves, Thiago; Figueiredo, Lucas; Da Gama, Alana; de Araujo, Christiano; Teichrieb, Veronica. Human Body Motion and Gestures Recognition Based on Checkpoints. SVR '12 Proceedings of the 2012 14th Symposium on Virtual and Augmented Reality pp. 271–278.
  75. Barrie, Peter; Komninos, Andreas; Mandrychenko, Oleksii.A Pervasive Gesture-Driven Augmented Reality Prototype using Wireless Sensor Body Area Networks.
  76. Bosnor, Kevin. "How Augmented Reality Works". howstuffworks.
  77. Bajarin, Tim. "This Technology Could Replace the Keyboard and Mouse". Time Magazine.
  78. "Augmented reality technology". Jeffrey Meisner, Walter P. Donnelly, Richard Roosen, Jeffrey Meisner, Walter P. Donnelly, Richard Roosen. 1999-04-06.
  79. Krevelen, Poelman, D.W.F, Ronald (2010). A Survey of Augmented Reality Technologies, Applications and Limitations. International Journal of Virtual Reality. pp. 3, 6.
  80. Pepsi Max (2014-03-20), Unbelievable Bus Shelter | Pepsi Max. Unbelievable #LiveForNow, retrieved 2018-03-06
  81. 1 2 Azuma, Ronald; Balliot, Yohan; Behringer, Reinhold; Feiner, Steven; Julier, Simon; MacIntyre, Blair. Recent Advances in Augmented Reality Computers & Graphics, November 2001.
  82. Maida, James; Bowen, Charles; Montpool, Andrew; Pace, John. Dynamic registration correction in augmented-reality systems Archived 18 May 2013 at the Wayback Machine., Space Life Sciences, NASA.
  83. State, Andrei; Hirota, Gentaro; Chen,David T; Garrett, William; Livingston, Mark. Superior Augmented Reality Registration by Integrating Landmark Tracking and Magnetic Tracking, Department of Computer ScienceUniversity of North Carolina at Chapel Hill.
  84. Bajura, Michael; Neumann, Ulrich. Dynamic Registration Correction in Augmented-Reality Systems University of North Carolina, University of Southern California.
  85. "ARML 2.0 SWG". Open Geospatial Consortium website. Open Geospatial Consortium. Retrieved 12 November 2013.
  86. "Top 5 AR SDKs". Augmented Reality News. Retrieved 15 November 2013.
  87. "Top 10 AR SDKs". Augmented World Expo. Archived from the original on 23 November 2013. Retrieved 15 November 2013.
  88. Huang, Z., Li, W., Hui, P., Peylo, C. . CloudRidAR: A Cloud-based Architecture for Mobile Augmented Reality Proceeding of MARS'14, July 2014.
  89. "Vuforia AR SDK". Vuforia. Retrieved 15 November 2013.
  90. Catchoom CraftAR
  91. "Mobinett AR SDK". Mobinett. Retrieved 15 November 2014.
  92. "Wikitude AR SDK". Wikitude. Retrieved 15 November 2013.
  93. "Blippar AR". Blippar. Retrieved 3 January 2015.
  94. "Layar AR SDK". Layar. Retrieved 15 November 2013.
  95. Angley, Natalie (2013-10-31). "Glasses to make you a real-life Tony Stark". CNN. Retrieved 2014-11-14.
  96. Cava, Marco (2013-07-30). "Change Agents: Seeing world through Meta's 3-D glasses". USATODAY. Retrieved 2016-02-28.
  97. "ARLab Augmented Reality SDK". ARLab. Archived from the original on 18 July 2017.
  98. 1 2 3 4 Wilson, Tyler. ""The Principles of Good UX for Augmented Reality – UX Collective." UX Collective".
  99. 1 2 3 Haller, Michael, Billinghurst, Mark, Thomas, and Bruce. "Emerging Technologies of Augmented Reality: Interfaces and Design".
  100. 1 2 "Best Practices for Mobile AR Design- Google".
  101. "Human Computer Interaction with Augmented Reality" (PDF).
  102. "Basic Patterns of Mobile Navigation".
  103. "Principles of Mobile App Design: Engage Users and Drive Conversions". Archived from the original on 2018-04-13.
  104. "Inside Out: Interaction Design for Augmented Reality-UXmatters".
  105. Augmented Reality Landscape 11 August 2012.
  106. Davies, Chris (2012-09-12). "Quantigraphic camera promises HDR eyesight from Father of AR". SlashGear. Retrieved 2012-12-30.
  107. 「AR技術による喪の空間の創造 ni_kaのAR詩について」『DOMMUNE OFFICIAL GUIDE BOOK2』河出書房新社 2011年 pp 49–50
  108. 「ni_kaの「AR詩」」『Web Designing』2012年6月号 マイナビ p43
  109. "AR詩 | にかにかブログ! (おぶんがく&包丁&ちぽちぽ革命)". にかにかブログ! (おぶんがく&包丁&ちぽちぽ革命) (in Japanese). Retrieved 2018-05-20.
  110. Stuart Eve (2012). "Augmenting Phenomenology: Using Augmented Reality to Aid Archaeological Phenomenology in the Landscape" (PDF). Journal of Archaeological Method and Theory. 19 (4): 582–600. doi:10.1007/s10816-012-9142-7.
  111. Dähne, Patrick; Karigiannis, John N. "Archeoguide: System Architecture of a Mobile Outdoor Augmented Reality System". Retrieved 2010-01-06.
  112. LBI-ArchPro. "School of Gladiators discovered at Roman Carnuntum, Austria". Retrieved 2014-12-29.
  113. Papagiannakis, George; Schertenleib, Sébastien; O'Kennedy, Brian; Arevalo-Poizat, Marlene; Magnenat-Thalmann, Nadia; Stoddart, Andrew; Thalmann, Daniel (February 1, 2005). "Mixing virtual and real scenes in the site of ancient Pompeii". Computer Animation and Virtual Worlds. 16 (1): 11–24. doi:10.1002/cav.53. ISSN 1546-427X.
  114. Benko, Hrvoje (2004). "Collaborative Mixed Reality Visualization of an Archaeological Excavation". 1: 1–3. doi:10.1145/1040000/1033710/21910132.pdf (inactive 2018-08-02).
  115. Divecha, Devina.Augmented Reality (AR) used in architecture and design. designMENA 8 September 2011.
  116. Architectural dreams in augmented reality. University News, University of Western Australia. 5 March 2012.
  117. 1 2 Outdoor AR. TV One News, 8 March 2004.
  118. Churcher, Jason. "Internal accuracy vs external accuracy". Retrieved 7 May 2013.
  119. "Augment for Architecture & Construction". Retrieved 12 October 2015.
  120. "App gives a view of city as it used to be". Stuff. Retrieved 2018-05-20.
  121. Lee, Gun (2012). CityViewAR outdoor AR visualization. ACM. p. 97. ISBN 978-1-4503-1474-9.
  122. Kipper, Greg; Rampolla, Joseph (2012-12-31). Augmented Reality: An Emerging Technologies Guide to AR. Elsevier. ISBN 9781597497343.
  123. "Augmented Reality Is Transforming Museums". WIRED. Retrieved 2018-09-30.
  124. "Microsoft Hololens - Transform business with new dimensions from Yeppar". Yeppar. 2017-11-28. Retrieved 2018-05-20.
  125. Webley, Kayla. The 50 Best Inventions of 2010 – EyeWriter Time, 11 November 2010.
  126. Katts, Rima. Elizabeth Arden brings new fragrance to life with augmented reality Mobile Marketer, 19 September 2012.
  127. Meyer, David. Telefónica bets on augmented reality with Aurasma tie-in gigaom, 17 September 2012.
  128. Mardle, Pamela.Video becomes reality for Stuprint.com Archived 12 March 2013 at the Wayback Machine.. Printweek, 3 October 2012.
  129. Giraldo, Karina.Why mobile marketing is important for brands? Archived 2 April 2015 at the Wayback Machine.. SolinixAR, Enero 2015.
  130. "Augmented reality could be advertising world's best bet". The Financial Express. 18 April 2015. Archived from the original on 21 May 2015.
  131. Humphries, Mathew..Geek.com 19 September 2011.
  132. Netburn, Deborah.Ikea introduces augmented reality app for 2013 catalog. Los Angeles Times, 23 July 2012.
  133. The International Journal of Virtual Reality, 2010, 9 (2)
  134. Alexander, Michael.Arbua Shoco Owl Silver Coin with Augmented Reality, Coin Update July 20, 2012.
  135. Royal Mint produces revolutionary commemorative coin for Aruba Archived 4 September 2015 at the Wayback Machine., Today August 7, 2012.
  136. "Augmented Beauty: L'Oreal Makeup Genius App". Alexandru Tanase. Retrieved 1 January 2015.
  137. "5 Apps You Just Can't Miss This Week". time.com.
  138. "Greeting cards brought back to life via Bulgarian mobile application". bnr.bg.
  139. Groundbreaking Augmented Reality-Based Reading Curriculum Launches, ‘’PRweb’’, 23 October 2011.
  140. Stewart-Smith, Hanna. Education with Augmented Reality: AR textbooks released in Japan, ‘’ZDnet’’, 4 April 2012.
  141. Augmented reality in education smarter learning.
  142. Santos, M. E. C.; Chen, A.; Taketomi, T.; Yamamoto, G.; Miyazaki, J.; Kato, H. (January 2014). "Augmented Reality Learning Experiences: Survey of Prototype Design and Evaluation". IEEE Transactions on Learning Technologies. 7 (1): 38–56. doi:10.1109/tlt.2013.37. ISSN 1939-1382.
  143. Lubrecht, Anna. Augmented Reality for Education ‘’The Digital Union’’, The Ohio State University 24 April 2012.
  144. http://acdc.sav.us.es/pixelbit/images/stories/p41/15.pdf
  145. Maier, Patrick; Tönnis, Marcus; Klinker, Gudron. Augmented Reality for teaching spatial relations, Conference of the International Journal of Arts & Sciences (Toronto 2009).
  146. Plunkett, Kyle (2018-09-27). "A Simple and Practical Method for Incorporating Augmented Reality into the Classroom and Laboratory". Retrieved 2018-09-28.
  147. "Anatomy 4D – Qualcomm". Qualcomm. Archived from the original on 11 March 2016. Retrieved 2 July 2015.
  148. "LightUp - An award-winning toy that teaches kids about circuits and coding". LightUp. Retrieved 2018-08-29.
  149. "Terminal Eleven: SkyView – Explore the Universe". www.terminaleleven.com. Retrieved 2016-02-15.
  150. "AR Circuits – Augmented Reality Electronics Kit". arcircuits.com. Retrieved 2016-02-15.
  151. "SketchAR - start drawing easily using augmented reality". SketchAR - start drawing easily using augmented reality. Retrieved 2018-05-20.
  152. Herpich, F.; Guarese, R. L. M.; Tarouco, L. R.A Comparative Analysis of Augmented Reality Frameworks Aimed at the Development of Educational Applications, Creative Education, 08(09):1433-1451
  153. "Augmented Reality--Emerging Technology for Emergency Management", Emergency Management Magazine, September 24, 2009
  154. "What Does the Future Hold for Emergency Management?", Emergency Management Magazine, November 8, 2013
  155. Weichelt, Bryan; Yoder, Aaron; Bendixsen, Casper; Pilz, Matthew; Minor, Gerald; Keifer, Matthew (2018-07-03). "Augmented Reality Farm MAPPER Development: Lessons Learned from an App Designed to Improve Rural Emergency Response". Journal of Agromedicine. 23 (3): 284–296. doi:10.1080/1059924x.2018.1470051. ISSN 1059-924X. PMID 30047852.
  156. Cooper, J., "SUPPORTING FLIGHT CONTROL FOR UAV-ASSISTED WILDERNESS SEARCH AND RESCUE THROUGH HUMAN CENTERED INTERFACE DESIGN", Thesis, Brigham Young University, DEC 2007
  157. Talk2Me: A Framework for Device-to-Device Augmented Reality Social Network. Jiayu Shu, Sokol Kosta, Rui Zheng, Pan Hui. In Proceedings of IEEE International Conference on Pervasive Computing and Communications (PerCom 2018), Athens, Greece, March 2018.
  158. Hawkins, Mathew. Augmented Reality Used To Enhance Both Pool And Air Hockey Game Set WatchOctober 15, 2011.
  159. One Week Only – Augmented Reality Project Archived 6 November 2013 at the Wayback Machine. Combat-HELO Dev Blog July 31, 2012.
  160. Best VR, Augmented Reality apps & games on Android
  161. "YOUR THOUGHTS ABOUT AUGMENTED REALITY IN VIDEO GAMES". 2013-05-01. Retrieved 2013-05-07.
  162. "Father.io - AR FPS".
  163. Swatman, Rachel. "Pokémon Go catches five new world records". Guinness World Records. Retrieved 28 August 2016.
  164. https://www.cnbc.com/2017/08/31/star-wars-jedi-challenges-augmented-reality-game-launches-with-lenovo-mirage-headset.html
  165. Noelle, S. (2002). "Stereo augmentation of simulation results on a projection wall". Mixed and Augmented Reality, 2002. ISMAR 2002. Proceedings.: 271–322. Retrieved 2012-10-07.
  166. Verlinden, Jouke; Horvath, Imre. "Augmented Prototyping as Design Means in Industrial Design Engineering". Delft University of Technology. Archived from the original on 16 June 2013. Retrieved 2012-10-07.
  167. Pang, Y; Nee, A; Youcef-Toumie, Kamal; Ong, S.K; Yuan, M.L (November 18, 2004). "Assembly Design and Evaluation in an Augmented Reality Environment". National University of Singapore, M.I.T. Retrieved 2012-10-07.
  168. Miyake RK, et al. (2006). "Vein imaging: a new method of near infrared imaging, where a processed image is projected onto the skin for the enhancement of vein treatment". Dermatol Surg. 32 (8): 1031–8. doi:10.1111/j.1524-4725.2006.32226.x. PMID 16918565.
  169. "Reality_Only_Better". The Economist. 8 December 2007.
  170. Mountney P, Giannarou S, Elson D, Yang GZ (2009). "Optical biopsy mapping for minimally invasive cancer screening". Medical Image Computing and Computer-assisted Intervention. 12 (Pt 1): 483–90. PMID 20426023.
  171. Scopis Augmented Reality: Path guidance to craniopharyngioma on YouTube
  172. N. Loy Rodas, N. Padoy. "3D Global Estimation and Augmented Reality Visualization of Intra-operative X-ray Dose". Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), Oral, 2014
  173. 3D Global Estimation and Augmented Reality Visualization of Intra-operative X-ray Dose on YouTube
  174. "UNC Ultrasound/Medical Augmented Reality Research". Archived from the original on 12 February 2010. Retrieved 2010-01-06.
  175. Mountney, Peter; Fallert, Johannes; Nicolau, Stephane; Soler, Luc; Mewes, Philip W. (2014-01-01). "An augmented reality framework for soft tissue surgery". International Conference on Medical Image Computing and Computer-Assisted Intervention. Lecture Notes in Computer Science. 8673: 423–431. doi:10.1007/978-3-319-10404-1_53. ISBN 978-3-319-10403-4.
  176. Botella, C., Bretón-López, J., Quero, S., Baños, R., & García-Palacios, A. (2010). Treating Cockroach Phobia With Augmented Reality.
  177. "Augmented Reality Revolutionizing Medicine". Health Tech Event. Retrieved 9 October 2014.
  178. Riva, Giuseppe; Wiederhold, Brenda (2015-12-28). The New Dawn of Virtual Reality in Health Care: Medical Simulation and Experiential Interface. 13.
  179. Thomas, Daniel J. (December 2016). "Augmented reality in surgery: The Computer-Aided Medicine revolution". International Journal of Surgery. 36 (Pt A): 25. doi:10.1016/j.ijsu.2016.10.003. ISSN 1743-9159. PMID 27741424.
  180. Cui, Nan; Kharel, Pradosh; Gruev, Viktor (2017-02-08). "Augmented reality with Microsoft HoloLens holograms for near infrared fluorescence based image guided surgery". Augmented reality with Microsoft HoloLens holograms for near infrared fluorescence based image guided surgery. Molecular-Guided Surgery: Molecules, Devices, and Applications III. 10049. International Society for Optics and Photonics. pp. 100490I. doi:10.1117/12.2251625.
  181. Barsom, E. Z.; Graafland, M.; Schijven, M. P. (2016-10-01). "Systematic review on the effectiveness of augmented reality applications in medical training". Surgical Endoscopy. 30 (10): 4174–4183. doi:10.1007/s00464-016-4800-6. ISSN 0930-2794. PMC 5009168.
  182. Davis, Nicola (January 7, 2015). "Project Anywhere: digital route to an out-of-body experience". The Guardian. Retrieved September 21, 2016.
  183. "Project Anywhere: an out-of-body experience of a new kind". Euronews. 2015-02-25. Retrieved September 21, 2016.
  184. Project Anywhere at studioany.com
  185. 1 2 3 Lintern, Gavan (1980). "Transfer of landing skill after training with supplementary visual cues". Human Factors. 22: 81–88.
  186. Lintern, Gavan; Roscoe, Stanley N; Sivier, Jonathon (1990). "Display principles, control dynamics, and environmental factors in pilot training and transfer". Human Factors. 32: 299–317.
  187. 1 2 3 Abernathy, M., Houchard, J., Puccetti, M., and Lambert, J,"Debris Correlation Using the Rockwell WorldView System",Proceedings of 1993 Space Surveillance Workshop 30 March to 1 April 1993,pages 189-195
  188. Calhoun, G. L., Draper, M. H., Abernathy, M. F., Delgado, F., and Patzek, M. "Synthetic Vision System for Improving Unmanned Aerial Vehicle Operator Situation Awareness," 2005 Proceedings of SPIE Enhanced and Synthetic Vision, Vol. 5802, pp. 219–230.
  189. Cameron, Chris. Military-Grade Augmented Reality Could Redefine Modern Warfare ReadWriteWeb June 11, 2010.
  190. 1 2 3 4 Delgado, F., Abernathy, M., White J., and Lowrey, B. Real-Time 3-D Flight Guidance with Terrain for the X-38,SPIE Enhanced and Synthetic Vision 1999, Orlando Florida, April 1999, Proceedings of the SPIE Vol. 3691, pages 149–156
  191. 1 2 3 4 Delgado, F., Altman, S., Abernathy, M., White, J. Virtual Cockpit Window for the X-38,SPIE Enhanced and Synthetic Vision 2000, Orlando Florida, Proceedings of the SPIE Vol. 4023, pages 63–70
  192. GM's Enhanced Vision System. Techcrunch.com (17 March 2010). Retrieved 9 June 2012.
  193. Couts, Andrew. New augmented reality system shows 3D GPS navigation through your windshield Digital Trens,27 October 2011.
  194. Griggs, Brandon. Augmented-reality' windshields and the future of driving CNN Tech, 13 January 2012.
  195. Cheney-Peters, Scott (12 April 2012). "CIMSEC: Google's AR Goggles". Retrieved 2012-04-20.
  196. Stafford, Aaron; Piekarski, Wayne; Thomas, Bruce H. "Hand of God". Archived from the original on 2009-12-07. Retrieved 2009-12-18.
  197. Benford, S, Greenhalgh, C, Reynard, G, Brown, C and Koleva, B. Understanding and constructing shared spaces with mixed-reality boundaries. ACM Trans. Computer-Human Interaction, 5(3):185–223, Sep. 1998.
  198. Office of Tomorrow Media Interaction Lab.
  199. The big idea:Augmented Reality. Ngm.nationalgeographic.com (15 May 2012). Retrieved 2012-06-09.
  200. Henderson, Steve; Feiner, Steven. "Augmented Reality for Maintenance and Repair (ARMAR)". Retrieved 2010-01-06.
  201. Sandgren, Jeffrey. The Augmented Eye of the Beholder, BrandTech News January 8, 2011.
  202. Cameron, Chris. Augmented Reality for Marketers and Developers, ReadWriteWeb.
  203. Dillow, Clay BMW Augmented Reality Glasses Help Average Joes Make Repairs, Popular Science September 2009.
  204. King, Rachael. Augmented Reality Goes Mobile, Bloomberg Business Week Technology November 3, 2009.
  205. http://www.information-age.com/knowledge-sharing-age-millennials-123461732/
  206. Marlow, Chris. Hey, hockey puck! NHL PrePlay adds a second-screen experience to live games, digitalmediawire April 27, 2012.
  207. Pair, J.; Wilson, J.; Chastine, J.; Gandy, M. "The Duran Duran Project: The Augmented Reality Toolkit in Live Performance". The First IEEE International Augmented Reality Toolkit Workshop, 2002.
  208. Broughall, Nick. Sydney Band Uses Augmented Reality For Video Clip. Gizmodo, 19 October 2009.
  209. Pendlebury, Ty. Augmented reality in Aussie film clip. c|net 19 October 2009.
  210. Saenz, Aaron Augmented Reality Does Time Travel Tourism SingularityHUB November 19, 2009.
  211. Sung, Dan Augmented reality in action – travel and tourism Pocket-lint March 2, 2011.
  212. Dawson, Jim Augmented Reality Reveals History to Tourists Life Science August 16, 2009.
  213. Bartie, P and Mackaness, W.Development of a speech-based augmented reality system to support exploration of the cityscape. Trans. GIS, 10(1):63–86, 2006.
  214. Benderson, Benjamin B. Audio Augmented Reality: A Prototype Automated Tour Guide Archived 1 July 2002 at the Wayback Machine. Bell Communications Research, ACM Human Computer in Computing Systems Conference, pp. 210–211.
  215. Jain, Puneet and Manweiler, Justin and Roy Choudhury, Romit. OverLay: Practical Mobile Augmented Reality ACM MobiSys, May 2015.
  216. CNBC.com, Luke Graham, special to (2016-01-08). "VR devices could transform tourism". CNBC. Retrieved 2018-03-08.
  217. Tsotsis, Alexia. Word Lens Translates Words Inside of Images. Yes Really. TechCrunch (16 December 2010).
  218. N.B. Word Lens: This changes everything The Economist: Gulliver blog 18 December 2010.
  219. Borghino, Dario Augmented reality glasses perform real-time language translation. gizmag, 29 July 2012.
  220. "Music Production in the Era of Augmented Reality". Medium. 14 October 2016. Retrieved 5 January 2017.
  221. "Augmented Reality music making with Oak on Kickstarter – gearnews.com". gearnews.com. 3 November 2016. Retrieved 5 January 2017.
  222. Clouth, Robert (1 January 2013). "Mobile Augmented Reality as a Control Mode for Real-time Music Systems". Retrieved 5 January 2017.
  223. Farbiz, Farzam; Tang, Ka Yin; Manders, Corey; Herng, Chong Jyh; Tan, Yeow Kee; Wang, Kejian; Ahmad, Waqas (10 January 2008). "A multimodal augmented reality DJ music system". 2007 6th International Conference on Information, Communications & Signal Processing. ResearchGate. pp. 1–5. doi:10.1109/ICICS.2007.4449564. ISBN 978-1-4244-0982-2. Retrieved 5 January 2017.
  224. Stampfl, Philipp (1 January 2003). "Augmented Reality Disk Jockey: AR/DJ". ACM SIGGRAPH 2003 Sketches & Applications: 1–1. doi:10.1145/965400.965556.
  225. "GROUND-BREAKING AUGMENTED REALITY PROJECT Supporting music production through new technology". Retrieved 5 January 2017.
  226. "ARmony – Using Augmented Reality to learn music". YouTube. 24 August 2014. Retrieved 5 January 2017.
  227. "HoloLens concept lets you control your smart home via augmented reality". Digital Trends. 26 July 2016. Retrieved 5 January 2017.
  228. "Hololens: Entwickler zeigt räumliches Interface für Elektrogeräte" (in German). VRODO. 22 July 2016. Retrieved 5 January 2017.
  229. "Control Your IoT Smart Devices Using Microsoft HoloLen (video) – Geeky Gadgets". Geeky Gadgets. 27 July 2016. Retrieved 5 January 2017.
  230. "Experimental app brings smart home controls into augmented reality with HoloLens". Windows Central. Retrieved 5 January 2017.
  231. "This app can mix music while you mix drinks, and proves augmented reality can be fun". Digital Trends. 20 November 2013. Retrieved 5 January 2017.
  232. Sterling, Bruce. "Augmented Reality: Controlling music with Leapmotion Geco and Ableton (Hands Control)". WIRED. Retrieved 5 January 2017.
  233. "Controlling Music With Leap Motion Geco & Ableton". Synthtopia. 4 November 2013. Retrieved 5 January 2017.
  234. "Augmented Reality Interface for Electronic Music Performance" (PDF). Retrieved 5 January 2017.
  235. "Expressive Control of Indirect Augmented Reality During Live Music Performances" (PDF). Retrieved 5 January 2017.
  236. "ControllAR : Appropriation of Visual Feedback on Control Surfaces".
  237. "Rouages: Revealing the Mechanisms of Digital Musical Instruments to the Audience".
  238. "Reflets: Combining and Revealing Spaces for Musical Performances".
  239. Pavlik, John V., and Shawn McIntosh. “Augmented Reality.” Converging Media: a New Introduction to Mass Communication, 5th ed., Oxford University Press, 2017, pp. 184–185.
  240. 1 2 "Enabling smart retail settings via mobile augmented reality shopping apps". Technological Forecasting and Social Change. 124: 243–256. 2017-11-01. doi:10.1016/j.techfore.2016.09.032. ISSN 0040-1625.
  241. 1 2 "How Neiman Marcus is turning technology innovation into a 'core value'". Retail Dive. Retrieved 2018-09-23.
  242. 1 2 3 4 5 Arthur, Rachel. "Augmented Reality Is Set To Transform Fashion And Retail". Forbes. Retrieved 2018-09-23.
  243. IKEA Highlights 2017 https://www.ikea.com/ms/en_CH/this-is-ikea/ikea-highlights/2017/ikea-place-app/index.html
  244. Fact & Figures, IKEA, 2017, https://highlights.ikea.com/2017/facts-and-figures/
  245. Wagner, Kurt. “Snapchat's New Augmented Reality Feature Brings Your Cartoon Bitmoji into the Real World.” Recode, Recode, 14 Sept. 2017, www.recode.net/2017/9/14/16305890/snapchat-bitmoji-ar-facebook.
  246. Miller, Chance. “Snapchat’s Latest Augmented Reality Feature Lets You Paint the Sky with New Filters.” 9to5Mac, 9to5Mac, 25 Sept. 2017, 9to5mac.com/2017/09/25/how-to-use-snapchat-sky-filters/.
  247. Faccio, Mara and McConnell, John J., Death by Pokémon GO: The Economic and Human Cost of Using Apps While Driving (February 2, 2018). Available at SSRN: https://ssrn.com/abstract=3073723 or http://dx.doi.org/10.2139/ssrn.3073723
  248. Peddie, J., 2017, Agumented Reality, Springer
  249. Azuma, R. T. (1997). A survey of augmented reality. Presence-Teleoperators and Virtual Environments, 6(4), 355–385.
  250. Azuma, R. T. (1997). A survey of augmented reality. Presence-Teleoperators and Virtual Environments, 6(4), 355–385.
  251. TRoesner, Franziska, Tadayoshi Kohno, Tamara Denning, Ryan Calo, and Bryce Clayton Newell. "Augmented Reality." Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing Adjunct Publication – UbiComp '14 Adjunct (2014). The university of Utah. Ubicomp. Web. 18 Aug. 2015.
  252. Jiayu Shu, Rui Zheng, Pan Hui Your Privacy Is in Your Hand: Interactive Visual Privacy Control with Tags and Gestures.
  253. "Wearable Computing: A first step towards personal imaging", IEEE Computer, pp. 25–32, Vol. 30, Issue 2, Feb. 1997 link.
  254. L. B. Rosenberg. The Use of Virtual Fixtures As Perceptual Overlays to Enhance Operator Performance in Remote Environments. Technical Report AL-TR-0089, USAF Armstrong Laboratory, Wright-Patterson AFB OH, 1992.
  255. Rosenberg, L., "Virtual fixtures as tools to enhance operator performance in telepresence environments," SPIE Manipulator Technology, 1993.
  256. Rosenberg, "Virtual Haptic Overlays Enhance Performance in Telepresence Tasks," Dept. of Mech. Eng., Stanford Univ., 1994.
  257. Rosenberg, "Virtual Fixtures: Perceptual Overlays Enhance Operator Performance in Telepresence Tasks," Ph.D. Dissertation, Stanford University.
  258. 1 2 C. Segura E. George F. Doherty J. H. Lindley M. W. Evans "SmartCam3D Provides New Levels of Situation Awareness", CrossTalk: The Journal of Defense Software Engineering. Volume 18, Number 9, pages 10–11.
  259. "Knowledge-based augmented reality". ACM. July 1993.
  260. "SBIR STTR Development of Low-Cost Augmented Reality Head Mounted Display".
  261. "Adaptive tracking and model registration across distinct aspects", IROS, 174–180 vol.1, 1995
  262. Piekarski, William; Thomas, Bruce. Tinmith-Metro: New Outdoor Techniques for Creating City Models with an Augmented Reality Wearable Computer Fifth International Symposium on Wearable Computers (ISWC'01), 2001, pp. 31.
  263. Behringer, R.;Improving the Registration Precision by Visual Horizon Silhouette Matching. Rockwell Science Center.
  264. Behringer, R.;Tam, C; McGee, J.; Sundareswaran, V.; Vassiliou, Marius. Two Wearable Testbeds for Augmented Reality: itWARNS and WIMMIS. ISWC 2000, Atlanta, 16–17 October 2000.
  265. R. Behringer, G. Klinker,. D. Mizell. Augmented Reality – Placing Artificial Objects in Real Scenes. Proceedings of IWAR '98. A.K.Peters, Natick, 1999. ISBN 1-56881-098-9.
  266. Wagner, Daniel (29 September 2009). "First Steps Towards Handheld Augmented Reality". ACM. Retrieved 2009-09-29.
  267. Johnson, Joel. "The Master Key": L. Frank Baum envisions augmented reality glasses in 1901 Mote & Beam 10 September 2012.
  268. "3050870 – Google Search". google.com. Retrieved 2 July 2015.
  269. "Archived copy" (PDF). Archived from the original (PDF) on 23 January 2014. Retrieved 2014-02-19.
  270. Mann, Steve (2012-11-02). "Eye Am a Camera: Surveillance and Sousveillance in the Glassage". Techland.time.com. Retrieved 2013-10-14.
  271. "Archived copy". Archived from the original on 3 October 2013. Retrieved 2014-02-21.
  272. George, D.B., "A COMPUTER-DRIVEN ASTRONOMICAL TELESCOPE GUIDANCE AND CONTROL SYSTEM WITH SUPERIMPOSED STARFIELD AND CELESTIAL COORDINATE GRAPHICS DISPLAY", M.Eng. Thesis, Carleton University, Ottawa, Oct. 1987.
  273. George, Douglas; Morris, Robert. "A Computer-driven Astronomical Telescope Guidance and Control System with Superimposed Star Field and Celestial Coordinate Graphics Display" pp. 32–41, J. Roy. Astron. Soc. Can., Vol. 83, No. 1, 1989.
  274. Lee, Kangdon (March 2012). "Augmented Reality in Education and Training" (PDF). Techtrends: Linking Research & Practice to Improve Learning. 56 (2). Retrieved 2014-05-15.
  275. Rosenberg, R.; Rosenberg, S.; Rosenberg, R.; Fenton, D. (2009-04-07). "Bernard Cecil Rosenberg". BMJ. 338 (apr07 2): b1450–b1450. doi:10.1136/bmj.b1450. ISSN 0959-8138.
  276. Wellner, Pierre. "Computer Augmented Environments: back to the real world". ACM. Retrieved 2012-07-28.
  277. Barrilleaux, Jon. Experiences and Observations in Applying Augmented Reality to Live Training.
  278. NRL BARS Web page
  279. AviationNow.com Staff, "X-38 Test Features Use Of Hybrid Synthetic Vision" AviationNow.com, December 11, 2001
  280. Wikitude AR Travel Guide. Youtube.com. Retrieved 2012-06-09.
  281. Cameron, Chris. Flash-based AR Gets High-Quality Markerless Upgrade, ReadWriteWeb 9 July 2010.
  282. "Meta plans true augmented reality with Epson-powered wearable". SlashGear. 2013-01-28. Retrieved 2018-08-31.
  283. Lang, Ben (2013-08-13). "Meta 01 Augmented Reality Glasses Available for Pre-order for $667". Road to VR. Retrieved 2018-08-31.
  284. Miller, Claire. , New York Times 20 February 2013.
  285. "Timeline of Augmented Reality (Huffington Post)". huffingtonpost.com.
  286. "Mahei :: Augmented reality for mobile devices". mahei.es. Retrieved 2 July 2015.
  287. Microsoft Channel, YouTube , 23 January 2015.
  288. Bond, Sarah (July 17, 2016). "After the Success Of Pokémon Go, How Will Augmented Reality Impact Archaeological Sites?". Retrieved July 17, 2016.
  289. C|NET , 20 December 2017.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.