AUGMENTED REALITY INTERFACE FOR INTERACTING WITH DISPLAYED MAPS
First Claim
Patent Images
1. A mobile device comprising:
- a display;
a physical camera communicably coupled with the display;
a processor; and
a memory coupled to the processor, the memory storing instructions, which when executed by the processor, cause the mobile device to perform operations including;
displaying a map view on the display, the map view including a set of map objects corresponding to a location within a map from an initial virtual position of a virtual camera;
receiving user input specifying a 3D mode that uses the physical camera;
in response to the user input, capturing one or more first images of a physical environment within which the mobile device resides using the physical camera;
determining an initial position of the physical camera in the physical environment using the one or more first images;
specifying a set of physical positions of a set of 3D objects of the map relative to the initial position of the physical camera, the set of 3D objects corresponding to the set of map objects;
capturing one or more second images of the physical environment within which the mobile device resides using the physical camera after movement of the mobile device;
determining a current physical position of the physical camera with respect to the initial position based on the one or more second images;
determining an updated virtual position of the virtual camera based on the current physical position of the physical camera;
rendering a map image of the set of 3D objects based on the updated virtual position of the virtual camera; and
displaying the map image on the display.
1 Assignment
0 Petitions
Accused Products
Abstract
Various embodiments of the disclosure pertain to an augmented or virtual reality interface for interacting with maps displayed from a virtual camera perspective on a mobile device. Instead of manipulating the position of the virtual camera using a touchscreen interface, some embodiments allow a spatial location of the mobile device to control the position of the virtual camera. For example, a user can tilt the mobile device to obtain different angles of the virtual camera. As another example, the user can move the mobile device vertically to change the height of the virtual camera, e.g., a higher altitude above the ground.
18 Citations
19 Claims
-
1. A mobile device comprising:
-
a display; a physical camera communicably coupled with the display; a processor; and a memory coupled to the processor, the memory storing instructions, which when executed by the processor, cause the mobile device to perform operations including; displaying a map view on the display, the map view including a set of map objects corresponding to a location within a map from an initial virtual position of a virtual camera; receiving user input specifying a 3D mode that uses the physical camera; in response to the user input, capturing one or more first images of a physical environment within which the mobile device resides using the physical camera; determining an initial position of the physical camera in the physical environment using the one or more first images; specifying a set of physical positions of a set of 3D objects of the map relative to the initial position of the physical camera, the set of 3D objects corresponding to the set of map objects; capturing one or more second images of the physical environment within which the mobile device resides using the physical camera after movement of the mobile device; determining a current physical position of the physical camera with respect to the initial position based on the one or more second images; determining an updated virtual position of the virtual camera based on the current physical position of the physical camera; rendering a map image of the set of 3D objects based on the updated virtual position of the virtual camera; and displaying the map image on the display. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A method of providing a view of a map on a display of a mobile device, the method comprising performing, by the mobile device having a physical camera communicably coupled with the display:
-
displaying a map view on the display, the map view including a set of map objects corresponding to a location within the map from an initial virtual position of a virtual camera; receiving user input specifying a 3D mode that uses the physical camera; in response to the user input, capturing one or more first images of a physical environment within which the mobile device resides using the physical camera; determining an initial position of the physical camera in the physical environment using the one or more first images; specifying a set of physical positions of a set of 3D objects of the map relative to the initial position, the set of 3D objects corresponding to the set of map objects; capturing one or more second images of the physical environment within which the mobile device resides using the physical camera after movement of the mobile device; determining a current physical position of the physical camera with respect to the initial position based on the one or more second images; determining an updated virtual position of the virtual camera based on the current physical position of the physical camera; rendering a map image of the set of 3D objects based on the updated virtual position of the virtual camera; and displaying the map image on the display. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A non-transitory computer-readable storage medium storing instructions that, when executed by one or more processors, cause the one or more processors to:
-
display a map view on a display of a mobile device, the map view including a set of map objects corresponding to a location within the map from an initial virtual position of a virtual camera; receive user input specifying a 3D mode that uses a physical camera of the mobile device; in response to the user input, capture one or more first images of a physical environment within which the mobile device resides using the physical camera; determine an initial position of the physical camera in the physical environment using the one or more first images; specify a set of physical positions of a set of 3D objects of the map relative to the initial position, the set of 3D objects corresponding to the set of map objects; capture one or more second images of the physical environment within which the mobile device resides using the physical camera after movement of the mobile device; determine a current physical position of the physical camera with respect to the initial position based on the one or more second images; determine an updated virtual position of the virtual camera based on the current physical position of the physical camera; render a map image of the set of 3D objects based on the updated virtual position of the virtual camera; and display the map image on the display.
-
Specification