USER-BASED CONTEXT SENSITIVE HOLOGRAM REACTION

• US 20160266386A1
• Filed: 03/09/2015
• Published: 09/15/2016
• Est. Priority Date: 03/09/2015
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Scott, Jason, Keibler, Evan Michael, Tomlin, Arthur Charles, Paulovich, Jonathan, Amador-Leon, Ron, Plumb, Jonathan, Fajt, Nicholas Gervase
• Granted Patent: US 10,156,721 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0134 of stereoscopic type
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts

Abstract

A system and method are disclosed for displaying virtual content. When a user is settled in a given geographic area, a full version of the content may be displayed at user-defined or processor-defined location. When the user is moving, for example leaving the geographic area, a mobile version of the content may be displayed at a body-locked position peripheral to the user'"'"'s view.

Claims

1. A system for presenting a virtual environment comprising:

a head mounted display device including a display unit for displaying three-dimensional virtual objects in the virtual environment; and

a processing unit operatively coupled to the display device, the processing unit determining a geographic area in which the head mounted display device is located based on feedback from the head mounted display device, the processing unit directing the display unit to display a virtual object based on the determined geographic area.

2. The system of claim 1, wherein the processing unit directs the display unit to display the virtual object so as to appear to be displayed at a determined position within the geographic area.

3. The system of claim 2, wherein the position is determined based on a stored rule indicating a user preference with respect to a displayed virtual object in the geographic area.

4. The system of claim 2, wherein the position is determined based on a scanning of the geographic area by sensors in the head mounted display device to determine a suitable position at which the virtual object is to appear to be displayed.

5. The system of claim 2, wherein the position is determined based on a gesture performed by a user and detected by the head mounted display device, the gesture indicating the position.

6. The system of claim 2, wherein the processing unit further directs the display unit to display the virtual object so as to appear to be displayed with a given size at the determined position.

7. The system of claim 6, wherein the given size is determined based on a stored rule indicating a user preference with respect to a size of a displayed virtual object in the geographic area.

8. The system of claim 2, wherein the given size is determined based on a scanning of the geographic area by sensors in the head mounted display device to determine a suitable size for display of the virtual object at the position at which the virtual object is to appear to be displayed.

9. The system of claim 1, wherein the processing unit determines a location of a wall, and that the wall has an open space, based on feedback from the head mounted display device, and the processing unit directs the head mounted display device to display the virtual object so as to appear to be displayed on the open space of the wall.

10. The system of claim 1, wherein the virtual object is virtual content including at least one of static images and dynamic content.

11. The system of claim 1, wherein the virtual object is virtual content including at least one of web pages and user interfaces for software applications.

12. A system for presenting a virtual environment comprising:

a head mounted display device including a display unit for displaying three-dimensional virtual objects in the virtual environment; and

a processing unit operatively coupled to the display device, the processing unit directing the display unit to display one of a full, world-locked version of virtual content and a mobile, body locked version of the content, depending at least in part on whether the processing unit determines that the user is in a settled state or is in a mobile state.

13. The system of claim 12, wherein the processing unit directs the display unit to display a portion of the virtual content in the mobile version, positioned in a periphery of the user'"'"'s view.

14. The system of claim 13, wherein the processing unit directs the display unit to display the virtual content with a degree of translucence in the mobile version.

15. The system of claim 12, wherein the processing unit automatically switches between the full version of the content and the mobile version of the content based on whether the processing unit detects the user going from a mobile state to a settled state, and vice versa.

16. The system of claim 12, wherein the processing unit directs the display unit to display a mobile version of the content when the user is in a mobile state and is leaving a defined geographic area and not when the user is walking around within the defined geographic area.

17. A method of presenting a virtual environment via a head mounted display device and a processing unit associated with the head mounted display device, the method comprising:

(a) detecting whether the head mounted display device is in a geographic location or walking out of the first geographic location;

(b) displaying virtual content in a determined world-locked position upon detecting that the head mounted display device is in the geographic location; and

(c) displaying a mobile version of the virtual content in a body-locked position upon detecting that the head mounted display device is leaving the geographic location.

18. The method of claim 17, said step (b) comprising the step of displaying the virtual content in a position determined based on input received from a user.

19. The method of claim 17, said step (b) comprising the step of displaying the virtual content in a position determined by the processing device based on a determined layout of the geographic area and available space for displaying the virtual content.

20. The method of claim 17, said step (b) comprising the step of displaying the virtual content in one of a plurality of positions in the geographic location, based on a location and orientation of the head mounted display device in the geographic location.