Navigation in a three dimensional environment using an orientation of a mobile device

• US 8,847,992 B2
• Filed: 08/24/2009
• Issued: 09/30/2014
• Est. Priority Date: 08/22/2008
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Kornmann, David, Birch, Peter
• Primary Examiner(s): HARRISON, CHANTE E
• Application Number:
  US12/546,293
• Publication Number:
  US 20100045667A1
• Time in Patent Office: 1,863 Days
• Field of Search: 345/649, 345/651, 345/653, 345/657, 345/659, 345/672, 345/677, 345/679, 345/419, 345/158, 715/864, 715/863, 715/848, 715/849, 701/202
• US Class Current: 345/659
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]

Abstract

This invention relates to navigation in a three dimensional environment using an orientation of a mobile device. In an embodiment, a computer-implemented method navigates a virtual camera in a three dimensional environment on a mobile device. The method includes: receiving orientation information of the mobile device; and orienting the virtual camera in the three dimensional environment according to the orientation information.

Claims

1. A computer-implemented method for navigating a virtual cameras in a three dimensional environments on a mobile device, comprising:

(a) accessing, from a memory device, data defining a three dimensional model of an environment;

(b) displaying from a perspective of a virtual camera a first view of the three dimensional model on a display of the mobile device;

(c) receiving orientation information, the orientation information comprising an angle of the mobile device relative to gravity;

(d) determining whether the angle of the mobile device exceeds a threshold orientation of the mobile device relative to gravity;

(e) when the angle of the mobile device is determined in (d) to exceed the threshold orientation, orienting the virtual camera in the three dimensional environment according to the angle of the mobile device; and

(f) displaying from a perspective of the virtual camera a second view of the three dimensional model on the display of the mobile device based on the orienting (e), the second view being different from the first view,

whereby the determining in (d) avoids changes in the perspective of the virtual camera when the angle does not exceed the threshold orientation.

2. The method of claim 1, wherein the orienting (e) comprises changing a pitch of the virtual camera according to the angle of the mobile device relative to gravity.

3. The method of claim 1, wherein the receiving (c) comprises receiving a heading of the mobile device, and wherein the orienting (e) comprises changing a yaw of the virtual camera according to the beading of the mobile device.

4. The method of claim 1, further comprising:

(g) receiving a location of the mobile device; and

(h) positioning the virtual camera according to the location of the mobile device.

5. The method of claim 4, further comprising:

(g) repeating steps (a) through (f) to track the mobile device.

6. The method of claim 5, wherein the three dimensional model comprises a three dimensional model of the Earth.

7. The method of claim 4, wherein the location of the mobile device comprises a latitude, longitude, and altitude of the mobile device.

8. The method of claim 1, wherein the angle of the mobile device is defined relative to a vector normal to a plane of a screen of the mobile device.

9. The method of claim 8, further comprising:

(g) detecting that gravity has an angle relative to the angle of the mobile device, wherein the orienting (e) comprises changing a pitch of the virtual camera based on the angle.

10. The method of claim 9, wherein a range of angles of the mobile device interpolates to a range of angles of the virtual camera.

11. The method of claim 1, further comprising:

(g) damping the orientation information, wherein the orienting (e) is based on the damped orientation information.

12. The method of claim 1, further comprising:

(g) when the angle of the mobile device is determined in (d) not to exceed the threshold, orienting the virtual camera irrespective of the angle of the mobile device.

19. The system of claim 8, wherein the orientation of the mobile device is defined relative to a vector normal to a plane of a screen of the mobile device.

20. The system of claim 19, wherein the sensor detects that gravity has an angle relative to the orientation of the mobile device, and navigation module changes a pitch of the virtual camera based on the angle.

13. A system for navigating a virtual camera in a three dimensional environment on a mobile device, comprising:

a sensor that receives orientation information of the mobile device, the orientation information comprising an angle of the mobile device relative to gravity;

a navigation module that accesses, from a memory device, data defining a three dimensional model of an environment, determines whether the angle of the mobile device exceeds a threshold orientation of the mobile device relative to gravity, and when the angle of the mobile device is determined to exceed the threshold orientation, orients the virtual camera in the three dimensional environment according to the angle of the mobile device; and

a display that displays from a perspective of the virtual camera a first view of the three dimensional model and that further displays from a perspective of the virtual camera a second view of the three dimensional model based on an orientation of the virtual camera, wherein the second view is different from the first view,

whereby the navigation module avoids changes in the perspective of the virtual camera when the angle does not exceed the threshold orientation.

14. The system of claim 13, wherein the navigation module changes a pitch of the virtual camera according to the angle of the mobile device relative to gravity.

15. The system of claim 13, wherein the sensor receives a heading of the mobile device, and the navigation module changes a yaw of the virtual camera according to the heading of the mobile device.

16. The system of claim 13, further comprising:

a location receiver that receives a location of the mobile device, and

wherein the navigation module positions the virtual camera according to the location of the mobile device.

17. The system of claim 16, wherein the three dimensional model comprises a three dimensional model of the Earth.

18. The system of claim 17, wherein the navigation module tracks the mobile device within the three dimensional model of the Earth.