System and Method for Alerting VR Headset User to Real-World Objects

• US 20170123747A1
• Filed: 10/29/2015
• Published: 05/04/2017
• Est. Priority Date: 10/29/2015
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Rochford, Ciaran, Harscoet, Philippe
• Granted Patent: US 10,474,411 B2
• Time in Patent Office: Days
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user

Abstract

A system and method are presented for alerting a head mounted display (HMD) user to real-world objects. The HMD includes a controller, an internal display, and an external sensor. One or more characteristics of an object in a vicinity of the user are detected, using the external sensor. It is determined whether a detected characteristic matches a predefined criterion, and, if so, an alert is displayed to the user on the internal display.

Claims

1. A method for displaying an alert to a user of a head mounted display (HMD), the HMD comprising a controller, an internal display mechanically coupled to the HMD, communicatively coupled to the controller, and visible to a user of the HMD, and an external sensor, mechanically coupled to the headpiece and communicatively coupled to the controller, the method comprising:

using the external sensor, detecting one or more characteristics of an object in a vicinity of the user;

determining whether a detected characteristic matches a predefined criterion; and

in response to so determining, displaying an alert to the user on the internal display.

2. The method of claim 1, wherein determining whether the characteristic matches the predefined criterion comprises:

detecting a velocity of at least one of the object and the user; and

calculating whether the object will enter a trigger zone having a predefined extent centered on a position of the user.

3. The method of claim 2, further comprising detecting a velocity of the object and a velocity of the user.

4. The method of claim 2, further comprising:

detecting an environment in which the user is operating the HMD; and

selecting a value of the predefined extent based upon the detected environment.

5. The method of claim 4, wherein detecting the environment comprises one of receiving an input from the user and detecting an identity of a WiFi hotspot with which the HMD is communicating.

6. The method of claim 1, wherein detecting one or more characteristics of the object includes:

detecting that the object is a person; and

detecting an action by the person.

7. The method of claim 6, further comprising, in response to determining that the action matches the predefined criterion, capturing a visual recording of the person.

8. The method of claim 1, further comprising:

detecting that the object is a person;

detecting an identity of the person;

selecting a predefined criterion based upon the identity of the person; and

determining whether the characteristic matches the selected predefined criterion.

9. The method of claim 1, wherein the alert comprises a passthrough window.

10. The method of claim 1, further comprising, in response to determining whether the characteristic matches the predefined criterion, activating an external indicator, visible to a person other than the user.

11. A head mounted display (HMD), comprising:

a headpiece configured to removably couple the HMD to the body of a user of the HMD;

an internal display, mechanically coupled to the headpiece and visible to the user;

an external sensor, mechanically coupled to the headpiece; and

a controller, communicatively coupled to the internal display and the external sensor,

wherein the controller is configured to

detect one or more characteristics of an object in a vicinity of the user, using the external sensor,

determine whether a detected characteristic matches a predefined criterion, and

in response to so determining, display an alert to the user on the internal display.

12. The HMD of claim 11, wherein the controller is further configured to:

detect a velocity of at least one of the object and the user; and

calculate whether the object will enter a trigger zone having a predefined extent centered on a position of the user.

13. The HMD of claim 12, wherein the controller is further configured to detect a velocity of the object and a velocity of the user.

14. The HMD of claim 11, wherein the controller is further configured to:

detect an environment in which the user is operating the HMD; and

select a value of the predefined extent based upon the detected environment.

15. The HMD of claim 14, further comprising:

a communications interface, configured to communicate with a WiFi hotspot,

wherein the controller is further configured to detect the environment based upon one of an input received from the user and an identity of a WiFi hotspot with which the HMD is communicating.

16. The HMD of claim 11, wherein the controller is further configured to:

detect that the object is a person;

detect an action by the person; and

determine whether the action matches the predefined criterion.

17. The HMD of claim 16, wherein the controller is further configured to capture a visual recording of the person, in response to determining that the action matches the predefined criterion.

18. The HMD of claim 16, wherein the controller is further configured to:

detect that the object is a person;

detect an identity of the person;

select a predefined criterion based upon the identity of the person; and

determine whether the characteristic matches the selected predefined criterion.

19. The HMD of claim 16, wherein the alert comprises a passthrough window.

20. The HMD of claim 11, further comprising an external indicator, visible to a person other than the user, wherein the controller is further configured to activate the external indicator in response to determining whether the characteristic matches the predefined criterion.