3D position tracking for panoramic imagery navigation
First Claim
1. A method performed by a processing system, comprising:
- displaying panoramic imagery on a display of a mobile device, wherein the panoramic imagery appears to an observer as a three dimensional panoramic view;
receiving input from one or more sensors onboard the mobile device, the one or more sensors comprising at least one of an accelerometer or an image sensor;
determining a device translation using the input from the one or more sensors, wherein the device translation includes determining a translation direction and distance of the mobile device and wherein the device translation results from the observer physically moving the mobile device left, right, forward, or backward;
determining a context in the panoramic imagery; and
navigating the imagery based on a mapping of the device translation to at least one navigation command, wherein the mapping is based on the context.
1 Assignment
0 Petitions
Accused Products
Abstract
Position tracking subsystems and onboard sensors enable a mobile device to navigate virtually a location in panoramic imagery. Physically moving the device through space provides translation data that can be used to move up or down a virtual street or other navigation actions. In some implementations, forward and backward translation enables the user to enter a structure (e.g., a commercial venue) or enter an intersection and navigate a turn onto another street at the intersection. In some implementations, information or an information layer can be displayed when translating. In some implementations, distance data can be used to move up or down a street a particular distance. Distance data can be obtained from motion and/or image sensors onboard the device. The distance data can be scaled to a virtual distance in the panoramic scene.
41 Citations
36 Claims
-
1. A method performed by a processing system, comprising:
-
displaying panoramic imagery on a display of a mobile device, wherein the panoramic imagery appears to an observer as a three dimensional panoramic view; receiving input from one or more sensors onboard the mobile device, the one or more sensors comprising at least one of an accelerometer or an image sensor; determining a device translation using the input from the one or more sensors, wherein the device translation includes determining a translation direction and distance of the mobile device and wherein the device translation results from the observer physically moving the mobile device left, right, forward, or backward; determining a context in the panoramic imagery; and navigating the imagery based on a mapping of the device translation to at least one navigation command, wherein the mapping is based on the context. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A system comprising:
-
one or more sensors comprising at least one of an accelerometer or an image sensor; a processing system comprising one or more processors; a display coupled to the processing system; memory coupled to the processing system, wherein the memory stores executable program instructions which when executed by the processing system cause the processing system to perform a method, the method comprising; displaying panoramic imagery on the display of a mobile device, wherein the panoramic imagery appears to an observer as a three dimensional panoramic view; receiving input from at least one of the sensors onboard the mobile device; determining a device translation using the input from at least one of the sensors, wherein the device translation includes determining a translation direction and distance of the mobile device, wherein the device translation results from the observer physically moving the mobile device left, right, forward or backward; determining a context in the panoramic imagery; and navigating the imagery based on a mapping of the device translation to at least one navigation command, wherein the mapping is based on the context. - View Dependent Claims (15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26)
-
-
27. A non-transitory computer readable medium comprising instructions which when executed by a processing system, including one or more processors, executes a method, the method comprising:
-
displaying panoramic imagery on a display of a mobile device, wherein the panoramic imagery appears to an observer as a three dimensional panoramic view; receiving input from one or more sensors onboard the mobile device, the one or more sensors comprising at least one of an accelerometer or an image sensor; determining a device translation using the input from the one or more sensors, wherein the device translation includes determining a translation direction and distance of the mobile device and wherein the device translation results from the observer physically moving the mobile device left, right, forward or backward; determining a context in the panoramic imagery; and navigating the imagery based on a mapping of the device translation to at least one navigation command, wherein the mapping is based on the context. - View Dependent Claims (28, 29, 30, 31, 32, 33, 34, 35, 36)
-
Specification