Three-dimensional tilt and pan navigation using a single gesture

• US 9,329,750 B2
• Filed: 09/10/2013
• Issued: 05/03/2016
• Est. Priority Date: 09/10/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Kontkanen, Janne
• Primary Examiner(s): To, Jennifer
• Assistant Examiner(s): Wan, Jasmine
• Application Number:
  US14/022,262
• Publication Number:
  US 20150074611A1
• Time in Patent Office: 966 Days
• Field of Search: 715/848, 715/863, 345/419, 348/222.1
• US Class Current: 1/1
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Systems and methods for providing tilt and pan navigation within a three-dimensional environment in response to a single gesture are provided. An exemplary computer-implemented method includes receiving, by one or more computing devices, data describing a drag performed by a user. The computer-implemented method includes, in response to the drag, incrementally adjusting, by the one or more computing devices, a tilt angle of a virtual camera until the tilt angle equals one of a maximum tilt angle or a minimum tilt angle, and panning, by the one or more computing devices, the virtual camera with respect to a rendering of a three-dimensional model. An exemplary system includes a client device and a server in operative communication over a network.

Claims

1. A computer-implemented method for controlling a virtual camera in a three-dimensional environment, the computer-implemented method comprising:

receiving, by one or more computing devices, data describing a drag gesture performed by a user, wherein the drag gesture comprises a single user input that selects and then holds and drags a portion of the three-dimensional environment in a linear direction; and

in response to the drag gesture;

when the drag gesture comprises an upwards drag, incrementally adjusting, by the one or more computing devices, a tilt angle of the viewpoint until the tilt angle equals a maximum tilt value;

when the drag gesture comprises a downwards drag, incrementally adjusting, by the one or more computing devices, the tilt angle of the viewpoint until the tilt angle equals a minimum tilt value;

after the tilt angle of the virtual camera has been incrementally adjusted until the tilt angle equals one of the maximum tilt angle or the minimum tilt angle, panning, by the one or more computing devices, the virtual camera with respect to a rendering of a three-dimensional model included in the three-dimensional environment based at least in part on the data describing the drag gesture performed by the user, such that the virtual camera is sequentially tilted and then panned in response to the drag gesture;

wherein incrementally adjusting the tilt angle comprises pivoting the viewpoint of the three-dimensional rendering about a pivot point located beneath a surface of the three-dimensional rendering;

wherein panning the viewpoint with respect to the three-dimensional rendering comprises adjusting the location of the viewpoint in a direction parallel to the surface of the three-dimensional rendering while holding the tilt angle constant; and

wherein the tilt angle is defined with respect to the rendering of the three-dimensional model.

2. The computer-implemented method of claim 1, wherein a first distance at which the pivot point is located below the surface of the rendering of the three-dimensional model is based at least in part on a second distance at which the virtual camera is located above the surface of the rendering of the three-dimensional model.

3. The computer-implemented method of claim 1, wherein the pivot point is located along a line of sight associated with the virtual camera.

4. The computer-implemented method of claim 1, wherein the pivot point is located below a selected point on the surface of the rendering of the three-dimensional model, and wherein the selected point is the point at which the drag was initiated.

5. The computer-implemented method of claim 1, wherein the maximum tilt angle is based at least in part on an altitude of the virtual camera above the rendering of the three-dimensional model.

6. The computer-implemented method of claim 1, further comprising continuously providing, by the one or more computing devices, a depiction of the rendering of the three-dimensional model from a perspective of the virtual camera.

7. The computer-implemented method of claim 1, wherein:

the three-dimensional model comprises a three-dimensional model of the surface of the Earth; and

the tilt angle of the virtual camera is measured with respect to a normal vector that is normal to the surface of the Earth.

8. The computer-implemented method of claim 1, wherein:

the drag is performed in a first direction; and

panning the virtual camera with respect to the rendering of the three-dimensional model comprises panning the virtual camera in a second direction with respect to the rendering of the three-dimensional model, wherein the second direction is opposite to the first direction.

9. The computer-implemented method of claim 1, wherein the tilt angle comprises an x-axis tilt angle, wherein the x-axis tilt angle is defined as the angle between a normal vector normal to a surface of the rendering of the three-dimensional model and a projection of a line of sight associated with the virtual camera onto a y-axis plane.

10. The computer-implemented method of claim 1, wherein the minimum tilt angle comprises one of zero degrees or a negative value.

11. The computer-implemented method of claim 1, wherein incrementally adjusting the tilt angle of the virtual camera comprises incrementally increasing or decreasing the tilt angle at a rate that is proportional to a velocity of the drag.

15. The computer-implemented method of claim 1:

wherein the drag gesture has an up-axis component of a first magnitude and a right-axis component of a second magnitude, and wherein the up-axis and the right-axis are defined with respect to a viewpoint of the three-dimensional rendering provided to the user; and

wherein incrementally adjusting, by the one or more computing devices, the tilt angle of the virtual camera until the tilt angle equals one of the maximum tilt angle or the minimum tilt angle based at least in part on the data describing the drag gesture performed by the user comprises;

adjusting, by the one or more computing devices based on the first magnitude of the up-axis component of the drag gesture, an x-axis tilt angle of the viewpoint until the x-axis tilt angle equals one of the maximum tilt angle or the minimum tilt angle; and

maintaining, by the one or more computing devices, a y-axis tilt angle of the viewpoint at zero regardless of the second magnitude of the right-axis component of the drag gesture.

12. A non-transitory computer-readable medium storing instructions that, when executed by one or more computing devices, cause the one or more computing devices to perform operations, the operations comprising:

receiving, by the one or more computing devices, data describing a drag gesture performed by a user, wherein the drag gesture comprises a single user input that selects and then holds and drags a rendering of a three-dimensional model in a linear direction;

when the drag gesture comprises an upwards drag, adjusting, by the one or more computing devices in response to the drag gesture, a tilt angle of a viewpoint of the rendering of the three-dimensional model included in a three-dimensional environment to equal a maximum tilt value;

when the drag gesture comprises a downwards drag, adjusting, by the one or more computing devices in response to the drag gesture, the tilt angle of the viewpoint to equal a minimum tilt value; and

after adjusting the tilt angle of the viewpoint to equal the maximum tilt value or the minimum tilt value, panning, by the one or more computing devices in response to the drag gesture, the viewpoint with respect to the rendering of the three-dimensional model, such that the virtual camera is sequentially tilted and then panned in response to the drag gesture;

wherein adjusting the tilt angle comprises pivoting the viewpoint of the three-dimensional rendering about a pivot point located beneath a surface of the three-dimensional rendering; and

wherein panning the viewpoint with respect to the three-dimensional rendering comprises adjusting the location of the viewpoint in a direction parallel to the surface of the three-dimensional rendering while holding the tilt angle constant.

13. A computing device comprising a processor and a memory, the memory storing instructions that, when executed by the processor, cause the computing device to perform operations, the operations comprising:

receiving, by the computing device, data describing a drag gesture performed by a user, wherein the drag gesture has an up-axis component of a first magnitude and a right-axis component of a second magnitude, and wherein the up-axis and the right-axis are defined with respect to a viewpoint of a three-dimensional rendering provided to the user;

when the first magnitude is greater than zero;

adjusting, by the computing device, an x-axis tilt angle of the viewpoint to equal a maximum x-axis tilt value; and

panning, by the computing device, the viewpoint negatively along a y-axis of the three-dimensional rendering; and

when the first magnitude is less than zero;

adjusting, by the computing device, the x-axis tilt angle of the viewpoint to equal a minimum x-axis tilt value; and

panning, by the computing device, the viewpoint positively along the y-axis of the three-dimensional rendering;

when the second magnitude is greater than zero;

adjusting, by the computing device, a y-axis tilt angle of the viewpoint to equal a maximum y-axis tilt value; and

panning, by the computing device, the viewpoint negatively along an x-axis of the three-dimensional rendering; and

when the second magnitude is less than zero;

adjusting, by the computing device, the y-axis tilt angle of the viewpoint to equal a minimum y-axis tilt value; and

panning, by the computing device, the viewpoint positively along the x-axis of the three-dimensional rendering;

wherein the x-axis tilt angle and the y-axis tilt angle are adjusted in a simultaneous fashion; and

wherein the computing device continuously provides a depiction of the three-dimensional rendering while the x-axis tilt angle and the y-axis tilt angle are simultaneously adjusted.

14. The computing device of claim 13, wherein the x-axis tilt angle comprises the angle between a normal vector and a projection of a line of sight of the viewpoint onto a plane defined by the y-axis and the normal vector, and wherein the normal vector is normal to a surface of the three-dimensional rendering.