Augmented reality interface for interacting with displayed maps
First Claim
Patent Images
1. A mobile device comprising:
- a display;
a physical camera communicably coupled with the display;
a processor; and
a memory coupled to the processor, the memory storing instructions, which when executed by the processor, cause the mobile device to perform operations including;
displaying a map view on the display, the map view including a set of map objects corresponding to a location within a map from an initial virtual position of a virtual camera;
receiving user input specifying an interactive mode that uses the physical camera;
in response to the user input, capturing one or more first images of a physical environment within which the mobile device resides using the physical camera;
determining an initial position that corresponds to a physical location of the physical camera in the physical environment using the one or more first images;
specifying a set of physical positions of a set of objects of the map relative to the initial position of the physical camera, the set of objects corresponding to the set of map objects;
displaying a first virtual map image on the display, the first virtual map image being overlaid on the one or more first images;
capturing one or more second images of the physical environment within which the mobile device resides using the physical camera after movement of the mobile device;
determining a current physical position of the physical camera with respect to the initial position based on the one or more second images;
determining an updated virtual position of the virtual camera based on the current physical position of the physical camera;
rendering a second virtual map image of the set of objects based on the updated virtual position of the virtual camera; and
displaying the second virtual map image on the display, the second virtual map image being overlaid on the one or more second images.
1 Assignment
0 Petitions
Accused Products
Abstract
Various embodiments of the disclosure pertain to an augmented or virtual reality interface for interacting with maps displayed from a virtual camera perspective on a mobile device. Instead of manipulating the position of the virtual camera using a touchscreen interface, some embodiments allow a spatial location of the mobile device to control the position of the virtual camera. For example, a user can tilt the mobile device to obtain different angles of the virtual camera. As another example, the user can move the mobile device vertically to change the height of the virtual camera, e.g., a higher altitude above the ground.
-
Citations
19 Claims
-
1. A mobile device comprising:
-
a display; a physical camera communicably coupled with the display; a processor; and a memory coupled to the processor, the memory storing instructions, which when executed by the processor, cause the mobile device to perform operations including; displaying a map view on the display, the map view including a set of map objects corresponding to a location within a map from an initial virtual position of a virtual camera; receiving user input specifying an interactive mode that uses the physical camera; in response to the user input, capturing one or more first images of a physical environment within which the mobile device resides using the physical camera; determining an initial position that corresponds to a physical location of the physical camera in the physical environment using the one or more first images; specifying a set of physical positions of a set of objects of the map relative to the initial position of the physical camera, the set of objects corresponding to the set of map objects; displaying a first virtual map image on the display, the first virtual map image being overlaid on the one or more first images; capturing one or more second images of the physical environment within which the mobile device resides using the physical camera after movement of the mobile device; determining a current physical position of the physical camera with respect to the initial position based on the one or more second images; determining an updated virtual position of the virtual camera based on the current physical position of the physical camera; rendering a second virtual map image of the set of objects based on the updated virtual position of the virtual camera; and displaying the second virtual map image on the display, the second virtual map image being overlaid on the one or more second images. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A method of providing a view of a map on a display of a mobile device, the method comprising performing, by the mobile device having a physical camera communicably coupled with the display:
-
displaying a map view on the display, the map view including a set of map objects corresponding to a location within the map from an initial virtual position of a virtual camera; receiving user input specifying an interactive mode that uses the physical camera; in response to the user input, capturing one or more first images of a physical environment within which the mobile device resides using the physical camera; determining an initial position that corresponds to a physical location of the physical camera in the physical environment using the one or more first images; specifying a set of physical positions of a set of objects of the map relative to the initial position, the set of objects corresponding to the set of map objects; displaying a first virtual map image on the display, the first virtual map image being overlaid on the one or more first images; capturing one or more second images of the physical environment within which the mobile device resides using the physical camera after movement of the mobile device; determining a current physical position of the physical camera with respect to the initial position based on the one or more second images; determining an updated virtual position of the virtual camera based on the current physical position of the physical camera; rendering a second virtual map image of the set of objects based on the updated virtual position of the virtual camera; and displaying the second virtual map image on the display, the second virtual map image being overlaid on the one or more second images. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17)
-
-
18. A non-transitory computer-readable storage medium storing instructions that, when executed by one or more processors, cause the one or more processors to:
-
display a map view on a display of a mobile device, the map view including a set of map objects corresponding to a location within the map view from an initial virtual position of a virtual camera; receive user input specifying an interactive mode that uses a physical camera of the mobile device; in response to the user input, capture one or more first images of a physical environment within which the mobile device resides using the physical camera; determine an initial position that corresponds to a physical location of the physical camera in the physical environment using the one or more first images; specify a set of physical positions of a set of objects of the map view relative to the initial position of the physical camera, the set of objects corresponding to the set of map objects; display a first virtual map image on the display, the first virtual map image being overlaid on the one or more first images; capture one or more second images of the physical environment within which the mobile device resides using the physical camera after movement of the mobile device; determine a current physical position of the physical camera with respect to the initial position based on the one or more second images; determine an updated virtual position of the virtual camera based on the current physical position of the physical camera; render a second virtual map image of the set of objects based on the updated virtual position of the virtual camera; and display the second virtual map image on the display, the second virtual map image being overlaid on the one or more second images. - View Dependent Claims (19)
-
Specification