Teleportation in an augmented and/or virtual reality environment

• US 10,558,274 B2
• Filed: 05/14/2019
• Issued: 02/11/2020
• Est. Priority Date: 12/03/2015
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Glazier, Adam, Parker, Evan Hardesty
• Primary Examiner(s): Azongha, Sardis F
• Application Number:
  US16/411,429
• Publication Number:
  US 20190265804A1
• Time in Patent Office: 273 Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts

Abstract

In a system for teleporting and scaling in a virtual reality environment, a user may teleport from a first virtual location, being experienced at a first scale, to a second virtual location, to be experienced at a second scale. The user may select the new, second virtual location and the new, second scale with a single external input via a handheld electronic device so that, upon release of a triggering action of the electronic device, the user may teleport to the newly selected second virtual location at the newly selected scale.

Claims

1. A method, comprising:

generating a virtual rendering of a space view of a virtual scene at a first virtual scale;

receiving an input selecting;

a virtual location from within the virtual scene in response to a detected actuation of an input device, and

a second virtual scale in response to a detected physical scaling movement of the input device, for viewing of the virtual location at the second virtual scale, the first virtual scale being different than the second virtual scale; and

teleporting to the virtual location at the second virtual scale in response to the input such that a virtual rendering of the virtual location is generated at the second virtual scale.

2. The method of claim 1, wherein generating the virtual rendering of the space view of the virtual scene includes generating a virtual rendering of a space view of the earth.

3. The method of claim 2, wherein receiving the input includes:

generating a virtual beam directed from the input device at the selected virtual location, based on a detected physical orientation of the input device relative to the virtual location; and

detecting the physical scaling movement of the input device, including detecting a corresponding virtual movement of the virtual beam.

4. The method of claim 3, wherein detecting the physical scaling movement includes:

detecting an initial position of the input device corresponding to an initial virtual position of the portion of the virtual beam; and

at least one of

detecting a first physical movement including a rotation of the input device in a first rotational direction about an axis corresponding to the virtual beam, the detected first physical movement corresponding to an increase in virtual scale from the first virtual scale to the second virtual scale, or

detecting a second physical movement including a rotation of the input device in a second rotational direction, opposite the first rotational direction, about the axis corresponding to the virtual beam, the detected second physical movement corresponding to a decrease in virtual scale from the first virtual scale to the second virtual scale.

5. The method of claim 4, further comprising displaying a virtual visual indicator corresponding to the detected physical movement.

6. The method of claim 2, wherein teleporting to the virtual location at the second virtual scale includes:

detecting a release of the actuation of the input device after detecting the selection of the virtual location and the selection of the second virtual scale; and

teleporting to the virtual location at the second virtual scale in response to the detected release of the actuation of the input device.

7. The method of claim 6, wherein actuating the input device includes maintaining the actuation of the input device, and not releasing the actuation of the input device, until after the virtual location and the second virtual scale are selected.

8. The method of claim 7, wherein teleporting to the virtual location at the second virtual scale includes teleporting to the virtual location at the second virtual scale simultaneously in response to the detected release of the actuation of the input device.

9. The method of claim 8, wherein the input device includes at least one of a trigger of a handheld electronic device, a touch sensitive surface of the handheld electronic device, a button of the handheld electronic device, a joystick of the handheld electronic device, or a toggle switch of the handheld electronic device.

10. The method of claim 1, wherein the virtual rendering of the virtual scene at the first virtual scale and the virtual rendering of the virtual location at the second virtual scale are displayed in an augmented reality environment.

11. A system, comprising:

a computing device configured to generate a virtual environment, the computing device including;

a memory storing executable instructions; and

a processor configured to execute the instructions to cause the computing device to;

generate a virtual rendering of a virtual scene at a first virtual scale;

receive an input including selection of a virtual location from the virtual scene, and a second virtual scale for the virtual location, including;

detect the selection of the virtual location in response to a detected actuation of an input device; and

detect the selection of the second virtual scale in response to a detected physical scaling movement of the input device; and

teleport to the virtual location at the second virtual scale in response to the input, including generate a virtual rendering of the virtual location at the second virtual scale.

12. The system of claim 11, wherein the processor is configured to execute the instructions to cause the computing device to receive the input, including;

generate a virtual beam directed from the input device at the selected virtual location, based on a detected physical orientation of the input device relative to the virtual location; and

detect the physical scaling movement of the input device, including detecting a corresponding virtual movement of the virtual beam.

13. The system of claim 12, wherein the processor is configured to execute the instructions to cause the computing device to receive the input, including:

generate a virtual beam directed from the input device at the selected virtual location, based on a detected physical orientation of the input device relative to the virtual location; and

detect the physical scaling movement of the input device, including detecting a corresponding virtual movement of the virtual beam.

14. The system of claim 13, wherein the processor is configured to execute the instructions to cause the computing device to detect the physical scaling movement, including:

detect an initial position of the input device corresponding to an initial virtual position of the portion of the virtual beam; and

at least one of

detect a first physical movement including a rotation of the input device in a first rotational direction about an axis corresponding to the virtual beam, the detected first physical movement corresponding to an increase in virtual scale from the first virtual scale to the second virtual scale, or

detect a second physical movement including a rotation of the input device in a second rotational direction, opposite the first rotational direction, about the axis corresponding to the virtual beam, the detected second physical movement corresponding to a decrease in virtual scale from the first virtual scale to the second virtual scale.

15. The system of claim 14, wherein the processor is further configured to execute the instructions to cause the computing device to display a virtual visual indicator corresponding to the detected physical movement.

16. The system of claim 12, wherein the processor is configured to execute the instructions to cause the computing device to teleport to the virtual location at the second virtual scale, including:

detect a release of the actuation of the input device after detecting the selection of the virtual location and the selection of the second virtual scale; and

teleport to the virtual location at the second virtual scale in response to the detected release of the actuation of the input device.

17. The system of claim 16, wherein the processor is configured to execute the instructions to cause the computing device to detect an actuation of the input device, including detecting that actuation of the input device is maintained, and not released, until after the virtual location and the second virtual scale are selected.

18. The system of claim 17, wherein the processor is configured to execute the instructions to cause the computing device to teleport to the virtual location at the second virtual scale including teleporting to the virtual location at the second virtual scale simultaneously in response to the detected release of the actuation of the input device.

19. The system of claim 18, wherein the input device includes at least one of a trigger of a handheld electronic device, a touch sensitive surface of the handheld electronic device, a button of the handheld electronic device, a joystick of the handheld electronic device, or a toggle switch of the handheld electronic device.

20. The system of claim 11, wherein the virtual rendering of the virtual scene at the first virtual scale and the virtual rendering of the virtual location at the second virtual scale are displayed in an augmented reality environment.