MOBILE AUGMENTED REALITY SYSTEM
First Claim
1. An apparatus comprising:
- a processor;
a memory; and
an augmentation module included in the memory and executed via the processor toreceive data identifying a point-of-interest (POI),detect a surface of a structure included in a live view captured by an image sensor, the structure to include the POI,determine a position and an orientation of the image sensor relative to the POI based, at least in part, on the detected surface of the structure included in the live view and data from a second sensor,track the position and the orientation of the image sensor while the image sensor captures the live view, andgenerate display data including image data associated with the POI for augmenting the live view, wherein the image data is three-dimensionally consistent with the position and the orientation of the image sensor when displayed in the live view at the POI on the detected surface of the structure.
2 Assignments
0 Petitions
Accused Products
Abstract
Embodiments of the invention relate to systems, apparatuses and methods to provide image data, augmented with related data, to be displayed on a mobile computing device. Embodiments of the invention display a live view augmented with information identifying an object amongst other objects. Embodiments of the invention may utilize other related data, such as 3D point cloud data, image data and location data related to the object, to obtain a specific location of an object within the live view. Embodiments of the invention may further display a live view with augmented data three-dimensionally consistent with the position and orientation of the image sensor of the mobile computing device.
-
Citations
20 Claims
-
1. An apparatus comprising:
-
a processor; a memory; and an augmentation module included in the memory and executed via the processor to receive data identifying a point-of-interest (POI), detect a surface of a structure included in a live view captured by an image sensor, the structure to include the POI, determine a position and an orientation of the image sensor relative to the POI based, at least in part, on the detected surface of the structure included in the live view and data from a second sensor, track the position and the orientation of the image sensor while the image sensor captures the live view, and generate display data including image data associated with the POI for augmenting the live view, wherein the image data is three-dimensionally consistent with the position and the orientation of the image sensor when displayed in the live view at the POI on the detected surface of the structure. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. An article of manufacture comprising a non-transitory machine-readable storage medium that provides instructions that, if executed by the machine, will cause the machine to perform operations comprising:
-
receiving data identifying a point-of-interest (POI); detecting a surface of a structure included in a live view captured by an image sensor, the structure to include the POI; determining a position and an orientation of the image sensor relative to the POI based, at least in part, on the detected surface of the structure included in the live view and data from a second sensor; tracking the position and the orientation of the image sensor while the image sensor captures the live view; and generating display data including image data associated with the POI for augmenting the live view, wherein the image data is three-dimensionally consistent with the position and the orientation of the image sensor when displayed in the live view at the POI on the detected surface of the structure. - View Dependent Claims (13, 14, 15)
-
-
16. A method comprising:
-
receiving data identifying a point-of-interest (POI); detecting a surface of a structure included in a live view captured by an image sensor, the structure to include the POI; determining a position and an orientation of the image sensor relative to the POI based, at least in part, on the detected surface of the structure included in the live view and data from a second sensor; tracking the position and the orientation of the image sensor while the image sensor captures the live view; and generating display data including image data associated with the POI for augmenting the live view, wherein the image data is three-dimensionally consistent with the position and the orientation of the image sensor when displayed in the live view at the POI on the detected surface of the structure. - View Dependent Claims (17, 18, 19, 20)
-
Specification