Synchronized, interactive augmented reality displays for multifunction devices
First Claim
1. An augmented reality device, comprising:
- one or more onboard motion sensors configured for sensing motion;
a camera for capturing a video for display on a display;
a processor coupled to the motion sensor and the video camera, the processor configured for;
modeling a computer-generated imagery representing one or more objects depicted in the video, wherein modeling the computer-generated imagery includes generating a three-dimensional model of the one or more objects depicted in the video,overlaying an information layer on the computer-generated imagery,combining the information layer and the video for presentation on the display,displaying the information layer and the computer-generated imagery representing one or more objects with the video on the display,receiving sensor data from the one or more onboard motion sensors indicating that the camera is in motion, andsynchronizing the video, the computer-generated imagery, and the information layer using the sensor data.
0 Assignments
0 Petitions
Accused Products
Abstract
A device can receive live video of a real-world, physical environment on a touch sensitive surface. One or more objects can be identified in the live video. An information layer can be generated related to the objects. In some implementations, the information layer can include annotations made by a user through the touch sensitive surface. The information layer and live video can be combined in a display of the device. Data can be received from one or more onboard sensors indicating that the device is in motion. The sensor data can be used to synchronize the live video and the information layer as the perspective of video camera view changes due to the motion. The live video and information layer can be shared with other devices over a communication link.
60 Citations
29 Claims
-
1. An augmented reality device, comprising:
-
one or more onboard motion sensors configured for sensing motion; a camera for capturing a video for display on a display; a processor coupled to the motion sensor and the video camera, the processor configured for; modeling a computer-generated imagery representing one or more objects depicted in the video, wherein modeling the computer-generated imagery includes generating a three-dimensional model of the one or more objects depicted in the video, overlaying an information layer on the computer-generated imagery, combining the information layer and the video for presentation on the display, displaying the information layer and the computer-generated imagery representing one or more objects with the video on the display, receiving sensor data from the one or more onboard motion sensors indicating that the camera is in motion, and synchronizing the video, the computer-generated imagery, and the information layer using the sensor data. - View Dependent Claims (2, 3, 4, 5, 6, 7, 26, 28)
-
-
8. A non-transitory machine-readable storage medium comprising a plurality of instructions that, in response to being executed on a computing device, cause the computing device to:
-
capture a video and display the video on a display of the computing device; generate computer-generated imagery based on the video; combine an information layer and the video, the information layer related to one or more objects in the video; display the computer-generated imagery representing one or more objects in the video on the display; overlay the information layer on the computer-generated imagery; receive sensor data from one or more onboard motion sensors indicating that the computing device is in motion; and synchronize the display of the video, the computer-generated imagery, and the information layer on the display using the sensor data. - View Dependent Claims (9, 10, 11, 12, 13, 14, 15, 16, 27)
-
-
17. A computer-implemented method for providing an augmented reality display comprising:
-
capturing video with a camera of a device and displaying the video on a display of the device; generating computer-generated imagery based on the video; combining an information layer and the video, the information layer related to one or more objects in the video; displaying the computer-generated imagery representing one or more objects in the video on the display; overlaying the information layer on the computer-generated imagery; processing sensor data from a motion sensor of the device indicating that the device is in motion; and synchronizing the display of the video, the computer-generated imagery, and the information layer on the display using the sensor data. - View Dependent Claims (18, 19, 20, 21, 22, 23)
-
-
24. A mobile device comprising:
-
a sensor configured to generate data related to position of the mobile device; a camera to capture video for display on a display; and a processor coupled to the display, the sensor and the camera, the mobile configured to; capture a video and display the video on a display of the computing device; generate computer-generated imagery based on the video; combine an information layer and the video, the information layer related to one or more objects in the video; display the computer-generated imagery representing one or more objects in the video on the display; overlay the information layer on the computer-generated imagery; receive sensor data from the sensor indicating that the mobile device is in motion; and synchronize the display of the video, the computer-generated imagery, and the information layer on the display using the sensor data. - View Dependent Claims (25, 29)
-
Specification