POSITION RELATIVE HOLOGRAM INTERACTIONS

• US 20130326364A1
• Filed: 05/31/2012
• Published: 12/05/2013
• Est. Priority Date: 05/31/2012
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Latta, Stephen G., Poulos, Adam G., McCulloch, Daniel J., Zhang, Wei
• Application Number:
  US13/485,511
• Publication Number:
  US 20130326364A1
• Time in Patent Office: Days
• US Class Current: 715/751
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

A system and method are disclosed for positioning and sizing virtual objects in a mixed reality environment in a way that is optimal and most comfortable for a user to interact with the virtual objects.

Claims

1. A system for presenting a mixed reality experience to one or more users, the system comprising:

one or more display devices for the one or more users, each display device including a display unit for displaying a virtual image to the user of the display device; and

a computing system operatively coupled to the one or more display devices, the computing system generating the virtual image for display on the one or more display devices, the computing system displaying the virtual image to a user of the one or more users at positions where the virtual object remains accessible to the user for interaction with the virtual object by the user as the user'"'"'s head position changes.

2. The system of claim 1, the computing system comprises at least one of a hub computing system and one or more processing units.

3. The system of claim 1, the computing system displays the virtual object at a fixed distance from the user within the user'"'"'s field of view as the user'"'"'s head position changes.

4. The system of claim 1, the computing system displays the virtual object at a fixed rotational orientation with respect to the user within the user'"'"'s field of view as the user'"'"'s head position changes.

5. The system of claim 1, the virtual object is displayed at a fixed rotational orientation with respect to the user'"'"'s face.

6. The system of claim 1, the virtual object is displayed at a fixed rotational orientation with respect to the user'"'"'s eyes.

7. The system of claim 1, wherein the virtual object remains accessible to the user upon the user selecting the virtual object for interaction with the virtual object.

8. The system of claim 7, wherein the virtual object is selected by the user performing a gesture with the user'"'"'s hands, body or eyes.

9. The system of claim 1, wherein the computing system allows a user to select the virtual object, and move the virtual object to a new position in three dimensional space with a gesture.

10. A system for presenting a mixed reality experience to a user, the system comprising:

a display device for the user, the display device including a first set of sensors for sensing data relating to a position of the display device and a display unit for displaying a virtual image to the user of the display device; and

a computing system operatively coupled to the display device, the computing system including a second set of sensors for sensing data relating to a position of the user, and the computing system generating the virtual image for display on the display device, the computing system displaying the virtual image to the user at positions in three-dimensional space that, over a predetermined period of time, average to a constant position within the user'"'"'s field of view as the user moves.

11. The system of claim 10, wherein the virtual object is a virtual display slate.

12. The system of claim 11, wherein the computing system displays at least one of one of static and dynamic images on the virtual display slate.

13. The system of claim 12, wherein the computing system displays stereoscopic images on the virtual display slate.

14. The system of claim 13, wherein the computing system displays different offsets to video streams forming the stereoscopic images depending on at least one of:

i) a distance of the virtual display slate from the user; and

ii) a measured interocular distance of the user.

15. The system of claim 13, wherein the computing system changes display of the content on the virtual display slate from stereoscopic to two-dimensional when the virtual display slate is less than a predefined distance away from the user.

16. The system of claim 11, wherein the computing system varies an opacity of the virtual display screen, depending on at least one of:

i) how much of the field of view is taken up by the virtual display screen, and ii) a rate of speed with which a user is moving.

17. A method of presenting a mixed reality experience to one or more users, the method comprising:

(a) displaying a static virtual object to a user at a first position in the user'"'"'s field of view;

(b) displaying a dynamic virtual object to the user at a second position in the user'"'"'s field of view;

(c) displaying the static virtual object to the user at a third position in the user'"'"'s field of view upon movement of the user; and

(d) displaying the dynamic virtual object to the user at the second position in the user'"'"'s field of view of said step (b) upon the movement of the user in said step (c).

18. The method of claim 17, wherein the dynamic virtual object remains in said second position in the user'"'"'s field of view, and in the same size in the user'"'"'s field of view, unless at least one of a position and size of the dynamic virtual object are changed by the user.

19. The method of claim 17, wherein the dynamic virtual object is a virtual display slate, the virtual display slate remaining orthogonal to a vector from the user to the virtual display slate upon movement of the user in said step (c).

20. The method of claim 17, wherein said step (d) of displaying the dynamic virtual object to the user at the second position upon the movement of the user occurs after selection of the dynamic virtual object, further comprising the steps of:

(e) receiving a gesture deselecting the dynamic virtual object after the user movement in said step (c); and

(f) displaying the dynamic virtual object to the user at the fourth position in the user'"'"'s field of view, different than the second position in the user'"'"'s field of view, upon movement of the user after deselection of the dynamic virtual object in said step (e).