MAPPING OF USER INTERACTION WITHIN A VIRTUAL REALITY ENVIRONMENT

• US 20170084084A1
• Filed: 09/21/2016
• Published: 03/23/2017
• Est. Priority Date: 09/22/2015
• Status: Abandoned Application

• Current Assignee: Thrillbox, Inc.
• Original Assignee: Thrillbox, Inc.
• Inventors: Durham, Benjamin T., Love, Mike, Egan, Jackson J., Lintz, Andrew J.
• Application Number:
  US15/272,210
• Publication Number:
  US 20170084084A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: H04N 21/00 Selective content distribution, e.g. interactive television or video on demand [VOD] real-time bi-directional transmission of motion video data H04N7/14 ; broadcast or conference over packet switching networks H04L12/18

Abstract

Method for tracking a user'"'"'s gaze within a virtual-reality environment comprises generating a user coordinate system within a virtual space. The user coordinate system is associated with a virtual sphere surrounding a location of a camera within the virtual space. The method also includes generating a hotspot within the virtual space. The hotspot comprises a hotspot coordinate associated with a virtual object and a pre-defined threshold of space surrounding the virtual object. Additionally, the method includes accessing view information, received from one or more sensors integrated within an end user virtual-reality hardware device. The view information relates to the direction of the user'"'"'s gaze within the real-world. Further, the method includes mapping the view information to the user coordinate system. Further still, the method includes determining, based upon the mapping, whether the user'"'"'s gaze intersected with the hotspot.

Claims

1. A computer system for tracking a user'"'"'s gaze within a virtual-reality environment comprising:

one or more processors; and

one or more storage devices having stored thereon computer-executable instructions that are executable by the one or more processors, and that configure the system to track the user'"'"'s gaze within the virtual-reality environment, including computer-executable instructions that configure the computer system to perform at least the following;

generate a virtual-reality environment coordinate system within a virtual space;

generate a hotspot within the virtual space, wherein the hotspot comprises a hotspot coordinate associated with a virtual object and a pre-defined threshold of space surrounding the virtual object;

access view information, received from one or more sensors integrated within an end user virtual reality hardware device, wherein the view information relates to the direction of the user'"'"'s gaze within the real-world;

map the view information to the environment coordinate system; and

determine, based upon the mapping, whether the user'"'"'s gaze included the hotspot.

2. The computer system as recited in claim 1, wherein the virtual-reality environment coordinate system comprises:

an X coordinate that is defined as the latitudinal value;

a Y coordinate that is defined as the longitudinal value;

a D coordinate that is defined as a distance value of the viewer from a virtual element in the virtual three-dimensional environment;

a T1 coordinate that is defined as a virtual time; and

a T2 coordinate that is defined as a real time.

3. The computer system as recited in claim 1, further comprising computer-executable instructions that are executable by the one or more processors to:

generate a user coordinate system within a virtual space, wherein the user coordinate system is associated with a virtual sphere surrounding a location of a camera within the virtual space; and

calculate a view reticle that extends from the center of the user'"'"'s field-of-view and intersects with a reticle coordinate on the virtual sphere.

4. The computer system as recited in claim 3, wherein the user coordinate system comprises a spherical and/or Cartesian coordinate system in three-dimensional space relative to the current origin, which is the user position, and time logs for both real and environment time.

5. The computer system as recited in claim 3, further comprising computer-executable instructions that are executable by the one or more processors to:

calculate a set of four coordinates that respectively define the locations of corner pixels at each corner of the user'"'"'s field-of-view.

6. The computer system as recited in claim 5, further comprising computer-executable instructions that are executable by the one or more processors to:

calculate a field-of view dataset, wherein the field-of-view dataset comprises a set of four coordinates that respectively define the locations of the pixels at each corner of the user'"'"'s field-of-view.

7. The computer system as recited in claim 6, wherein the field-of-view dataset comprises a hitpoint coordinate that defines the center of the user'"'"'s field-of-view.

8. The computer system as recited in claim 6, wherein the reticle coordinate and the field-of-view dataset are updated concurrently in parallel.

9. The computer system as recited in claim 8, further comprising computer-executable instructions that are executable by the one or more processors to determine that the user'"'"'s gaze intersected the hotspot by determining that the reticle coordinate mapped to a pixel associated with the hotspot.

10. The computer system as recited in claim 8, further comprising computer-executable instructions that are executable by the one or more processors to determine that the user'"'"'s gaze intersected the hotspot by determining that the hitpoint coordinate mapped to a pixel associated with the hotspot.

11. A computer-implemented method for tracking a user'"'"'s visual focus within a virtual-reality environment comprising:

generating a user coordinate system within a virtual space, wherein the user coordinate system is associated with a virtual sphere surrounding a location of a camera within the virtual space;

generating a hotspot within the virtual space, wherein the hotspot comprises a hotspot coordinate associated with a virtual object and a pre-defined threshold of space surrounding the virtual object;

accessing view information, received from one or more sensors integrated within an end user virtual reality hardware device, wherein the view information relates to the direction of the user'"'"'s gaze within the real-world;

mapping the view information to the user coordinate system; and

determining, based upon the mapping, whether the user'"'"'s gaze intersected with the hotspot.

12. The method as recited in claim 11, further comprising:

generating a view reticle that comprises an orientation vector that extends from a middle of the user'"'"'s field of view and intersects at a reticle coordinate with the user coordinate system; and

updating a reticle dataset that comprises both a spherical coordinate set and a coordinate set that describes a point where the view reticle intersects with the user coordinate system.

13. The method as recited in claim 12, further comprising:

calculating a set of four coordinates that respectively define the locations of corner pixels at each corner of the user'"'"'s field-of-view.

14. The method as recited in claim 13, further comprising computer-executable instructions that are executable by the one or more processors to:

calculate a field-of view dataset, wherein the field-of-view dataset comprises a set of four coordinates that respectively define the locations of the pixels at each corner of the user'"'"'s field-of-view.

15. The method as recited in claim 14, wherein the field-of-view dataset comprises a hitpoint coordinate that defines the center of the user'"'"'s field-of-view.

16. The method as recited in claim 14, wherein the reticle coordinate and the field-of-view dataset are updated concurrently in parallel.

17. The method as recited in claim 12, further comprising determining that the user'"'"'s gaze intersected the hotspot by determining that the reticle coordinate mapped to a pixel associated with the hotspot.

18. The method as recited in claim 11, wherein hotspot coordinate is associated with a different coordinate system than the user coordinate system.

19. The method as recited in claim 11, wherein the virtual-reality environment comprises a spherical video.

20. A computer system for tracking a user'"'"'s gaze within a virtual-reality environment comprising:

one or more processors; and

one or more storage devices having stored thereon computer-executable instructions that are executable by the one or more processors, and that configure the system to track the user'"'"'s gaze within the virtual-reality environment, including computer-executable instructions that configure the computer system to perform at least the following;

generate a user coordinate system within a virtual space, wherein the user coordinate system is associated with a virtual sphere surrounding a location of a camera within the virtual space;

generate a hotspot within the virtual space, wherein the hotspot comprises a hotspot coordinate associated with a virtual object and a pre-defined threshold of space surrounding the virtual object;

access view information, received from one or more sensors integrated within an end user virtual reality hardware device, wherein the view information relates to the direction of the user'"'"'s gaze within the real-world;

map the view information to the user coordinate system; and

determine, based upon the mapping, whether the user'"'"'s gaze intersected with the hotspot.