Intentional user experience

• US 9,971,403 B1
• Filed: 11/13/2017
• Issued: 05/15/2018
• Est. Priority Date: 01/27/2017
• Status: Active Grant

• Current Assignee: Emergent AR Platforms Corp.
• Original Assignee: Emergent AR Platforms Corp.
• Inventors: Kallmeyer, Raymond, Dawson, Andrew Warren
• Primary Examiner(s): Ma, Calvin C
• Application Number:
  US15/811,607
• Time in Patent Office: 183 Days
• Field of Search: 345 8, 345156
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris

Abstract

Methods for intentional user experience are provided herein. Exemplary methods include: getting point of interest data, including a location of a point of interest; receiving first user data, including a first location of the user and a first direction of a gaze of the user; calculating a first position of the gaze of the user using the first location of the user and the first direction of the gaze of the user; displaying a first indicator denoting the first position of the gaze of the user; receiving second user data, including a second location of the user and a second direction of a gaze of the user; calculating a second position of the gaze of the user using the second location of the user and the second direction of the gaze of the user; and displaying a second indicator denoting the second position of the gaze of the user.

Claims

1. A computer-implemented method for providing sensory cues to a user of an augmented reality device comprising:

getting point of interest data, including a location of a point of interest in a real space;

receiving first user data, including a first location of the user in the real space, the first user data provided by at least one sensor of the augmented reality device, the first location of the user in the real space comprising first Cartesian coordinates;

calculating a first direction from the first location of the user in the real space to the location of the point of interest;

displaying a first indicator denoting the first direction;

receiving second user data, including a second location of the user in the real space, the second user data provided by the at least one sensor of the augmented reality device, the second location of the user in the real space comprising second Cartesian coordinates;

calculating a second direction from the second location of the user in the real space to the location of the point of interest;

determining the second location of the user is closer to the location of the point of interest than the first location of the user;

displaying a second indicator denoting the second direction and using the second location, such that the second indicator is at least one of larger or smaller than the first indicator, moving at a higher or lower frequency than the first indicator, and having a brighter or darker color than the first indicator;

receiving third user data, including a third location of the user in the real space, the third user data provided by the at least one sensor of the augmented reality device, the third location of the user in the real space comprising third Cartesian coordinates;

calculating a third direction from the third location of the user in the real space to the location of the point of interest;

determining the third location of the user is closer to the location of the point of interest than the second location of the user; and

displaying a third indicator denoting the third direction and using the third location, such that the third indicator is at least one of larger or smaller than the second indicator, moving at a higher or lower frequency than the second indicator, and having a brighter or darker color than the second indicator.

2. The method of claim 1, wherein:

the first indicator includes a first tone;

the second indicator includes a second tone;

the third indicator includes a third tone;

a frequency of the second tone is an integral multiple of a frequency of the first tone; and

a frequency of the third tone is an integral multiple of the frequency of the second tone.

3. The method of claim 2 further comprising:

providing a fourth indicator when a location of the user in the real space falls within a predetermined distance from the point of interest, the fourth indicator being displayed at a center of the point of interest, the fourth indicator being at least one of larger or smaller than the first, second, and third indicators, moving at a higher or lower frequency than the first, second, and third indicators, and having a brighter or darker color than the first, second, and third indicators, the fourth indicator including a fourth tone, a frequency of the fourth tone being an integral multiple of the frequency of the first, second, and third tones.

4. The method of claim 1, wherein at least one of the first indicator, second indicator, and third indicator includes flow lines denoting the first direction, second direction, and third direction, respectively.

5. The method of claim 1, wherein:

the point of interest includes at least one of a real person, a real object, a virtual person, a virtual object, and a user-interface element.

6. The method of claim 1, wherein:

the augmented reality device includes at least one of a virtual-reality headset, a smartphone, a gamepad, a joystick, a keyboard, a keypad, and a glove controller; and

the at least one sensor of the augmented reality device is at least one of an accelerometer, a gyroscope, an eye-tracking device, and a Global Positioning System.

7. The method of claim 1, wherein at least some of the first user data, the second user data, and the third user data is received from a server.

8. The method of claim 1, wherein the first indicator, the second indicator, and the third indicator are provided using a display of the augmented reality device.

9. The method of claim 1, wherein the location of the point of interest, the first location of the user, the second location of the user, and the third location of the user each include at least one of Cartesian coordinates, Global Positioning System coordinates, and vectors.

10. The method of claim 1, wherein at least one of the first indicator, second indicator, and third indicator includes haptic feedback, the haptic feedback provided using the augmented reality device including at least one of a virtual-reality headset, a smartphone, a gamepad, a joystick, a keyboard, a keypad, and a glove controller.

11. A computer-implemented method for providing sensory cues to a user of an augmented reality device comprising:

getting point of interest data, including a location of a point of interest in a real space;

receiving first user data, including a first location of the user in the real space, the first user data provided by at least one sensor of the augmented reality device, the first location of the user in the real space comprising first Cartesian coordinates;

receiving second user data, including a second location of the user in the real space, the second user data provided by the at least one sensor of the augmented reality device, the second location of the user in the real space comprising second Cartesian coordinates;

providing a hot indication when the second location of the user is spatially closer to the location of the point of interest than the first location of the user;

providing a cold indication when the first location the user is spatially closer to the location of the point of interest than the second location of the user;

receiving third user data, including a third location of the user in the real space, the third user data provided by the at least one sensor of the augmented reality device, the third location of the user in the real space comprising third Cartesian coordinates;

providing a hot indication when the third location of the user is spatially closer to the location of the point of interest than the second location of the user; and

providing a cold indication when the second location of the user is spatially closer to the location of the point of interest than the third location of the user.

12. The method of claim 11, wherein:

the hot indication is at least one of larger or smaller than the cold indication, moving at a higher or lower frequency than the cold indication, and having a brighter or darker color than the cold indication.

13. The method of claim 12, wherein:

the cold indication includes a first tone;

the hot indication includes a second tone; and

a frequency of the second tone is an integral multiple of a frequency of the first tone.

14. The method of claim 13 further comprising:

providing an arrival indication when a location of the user in the real space falls within a predetermined distance from the point of interest, the arrival indication being displayed at a center of the point of interest, the arrival indication being at least one of larger or smaller than the cold and hot indications, moving at a higher or lower frequency than the cold and hot indications, and having a brighter or darker color than the cold and hot indications, the arrival indication including a third tone, a frequency of the third tone being an integral multiple of the frequency of the first and second tones.

15. The method of claim 12, further comprising:

producing flow lines using the first location of the user and the location of the point of interest, the flow lines indicating a direction from the first location of the user to the location of the point of interest; and

displaying the flow lines.

16. The method of claim 11, wherein:

the point of interest includes at least one of a real person, a real object, a virtual person, a virtual object, and a user-interface element.

17. The method of claim 11, wherein:

the augmented reality device includes at least one of a virtual-reality headset and a smartphone; and

the at least one sensor of the augmented reality device is at least one of an accelerometer, a gyroscope, an eye-tracking device, and a Global Positioning System.

18. The method of claim 11, wherein at least some of the first user data, the second user data, and the third user data is received from a server.

19. The method of claim 11, wherein the hot indication and the cold indication are provided using at least one of a transducer and a display of the augmented reality device.

20. The method of claim 11, wherein the location of the point of interest, the first location of the user, the second location of the user, and the third location of the user each include at least one of Cartesian coordinates, Global Positioning System coordinates, and vectors.

21. A non-transitory computer-readable storage medium having embodied thereon a program, the program being executable by a processor to perform a method for providing sensory cues to a user of an augmented reality device, the method comprising:

getting point of interest data, including a location of a point of interest in a real space;

receiving first user data, including a first location of the user in the real space, the first user data provided by at least one sensor of the augmented reality device, the first location of the user in the real space comprising first Cartesian coordinates;

calculating a first direction from the first location of the user in the real space to the location of the point of interest;

displaying a first indicator denoting the first direction;

receiving second user data, including a second location of the user in the real space, the second user data provided by the at least one sensor of the augmented reality device, the second location of the user in the real space comprising second Cartesian coordinates;

calculating a second direction from the second location of the user in the real space to the location of the point of interest;

determining the second location of the user is closer to the location of the point of interest than the first location of the user;

displaying a second indicator denoting the second direction and using the second location, such that the second indicator is at least one of larger or smaller than the first indicator, moving at a higher or lower frequency than the first indicator, and having a brighter or darker color than the first indicator;

receiving third user data, including a third location of the user in the real space, the third user data provided by the at least one sensor of the augmented reality device, the third location of the user in the real space comprising third Cartesian coordinates;

calculating a third direction from the third location of the user in the real space to the location of the point of interest;

determining the third location of the user is closer to the location of the point of interest than the second location of the user; and

displaying a third indicator denoting the third direction and using the third location, such that the third indicator is at least one of larger or smaller than the second indicator, moving at a higher or lower frequency than the second indicator, and having a brighter or darker color than the second indicator.