Apparatus and method of providing user interface on head mounted display and head mounted display thereof

• US 8,482,527 B1
• Filed: 12/07/2012
• Issued: 07/09/2013
• Est. Priority Date: 09/14/2012
• Status: Expired due to Fees

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Kim, Jihwan
• Primary Examiner(s): Nguyen, Jimmy H
• Application Number:
  US13/708,561
• Time in Patent Office: 214 Days
• Field of Search: 345 7- 9, 345156-184, 715/773, 715/863, 715700-702
• US Class Current: 345/168
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 8/34 Graphical or visual programming

Abstract

An apparatus and method of providing a user interface (UI) on head mounted display and the head mounted display (HMD) thereof are discussed. The apparatus comprises a sensor unit detecting whether an object exists in the proximity of the HMD and if the object is detected, the sensor unit senses a distance between the object and the HMD. The apparatus further comprises a processor controlling a User Interface (UI) of the HMD based on a result of the sensor unit. A physical User Interface (UI) mode is applied if the detected object is within a predetermined distance from the HMD and a non-physical User Interface (UI) mode is applied if the object is not detected or is not within the predetermined distance from the HMD.

Claims

1. A User Interface (UI) apparatus for a Head Mounted Display (HMD), the apparatus comprising:

a sensor unit detecting whether an object exists in the proximity of the HMD and if the object is detected, sensing a distance between the object and the HMD; and

a processor controlling a User Interface (UI) of the HMD based on a result of the sensor unit such that a physical User Interface (UI) mode is applied if the detected object is within a predetermined distance from the HMD and a non-physical User Interface (UI) mode is applied if the object is not detected or is not within the predetermined distance from the HMD,

wherein the processor receives a user command inputted to the UI of the HMD in the physical UI mode by physically contacting the object and in the non-physical UI mode by not physically contacting the object.

2. The apparatus of claim 1, wherein the physical UI mode displays an imaginary User Interface (UI) function on a surface of the detected object.

3. The apparatus of claim 2, wherein the physical UI mode comprises at least one of a virtual keyboard User Interface (UI) or a drawing User Interface (UI).

4. The apparatus of claim 1, wherein the non-physical UI mode operates in a status in which the non-physical UI does not have a physical contact with the object.

5. The apparatus of claim 4, wherein the non-physical UI mode comprises at least one of a voice recognition User Interface (UI) or a gesture User Interface (UI).

6. The apparatus of claim 1, wherein the processor selects the physical UI mode if the detected object is within the predetermined distance and the detected object is within a view angle.

7. The apparatus of claim 6, wherein the processor changes to the non-physical UI mode if the detected object is within the view angle but is not user-interfaceable.

8. The apparatus of claim 6, wherein the processor selects the non-physical UI mode if the detected object is within the predetermined distance from the HMD but not within the view angle.

9. The apparatus of claim 8, wherein the processor changes to the physical UI mode if the detected object is not within the view angle but returns within the view angle within a predetermined period of time.

10. The apparatus of claim 8, wherein the processor stays the non-physical UI mode if the detected object is not within the view angle and does not return within the view angle within the predetermined period of time.

11. The apparatus of claim 1, wherein the processor selects the non-physical UI mode if the detected object is within the predetermined distance from the HMD but not within the view angle, and the detected object does not return within the view angle within the predetermined period of time.

12. The apparatus of claim 1, wherein the processor applies a display function of a new digital device as the physical UI mode if the detected object is within the predetermined distance from the HMD but not within the view angle, and the new digital device is detected within the predetermined distance within a certain period of time.

13. The apparatus of claim 12, wherein the processor applies the display of the new digital device as the physical UI mode if the object is not detected or is not within the predetermined distance from the HMD, and the new digital device is detected within the predetermined distance within the certain period of time.

14. A User Interface (UI) apparatus for a Head Mounted Display (HMD), the apparatus comprising:

a communications unit performing communications with a digital device in the proximity of the HMD;

a sensor unit detecting whether the digital device exists in the proximity of the HMD, and if the digital device is detected, sensing a distance between the digital device and the HMD; and

a processor controlling a User Interface (UI) of the HMD based on a result of the sensor unit, wherein a display function of the digital device is applied as a physical User Interface (UI) mode if the detected digital device is within a predetermined distance from the HMD and a non-physical User Interface (UI) mode is applied if the digital device is not detected or is not within the predetermined distance from the HMD,

wherein the processor receives a user command inputted to the UI of the HMD in the physical UI mode by physically contacting the object and in the non-physical UI mode by not physically contacting the object.

15. A method of providing a User Interface (UI) for a Head Mounted Display (HMD), the method comprising:

detecting whether an object exists in the proximity of the HMD;

if the object is detected, determining a distance between the detected object and the HMD; and

if the object is within a predetermined distance from the HMD, applying a physical User Interface (UI) mode, and if the object is not detected or is not within the predetermined distance from the HMD, applying a non-physical UI mode,

wherein the processor receives a user command inputted to the UI of the HMD in the physical UI mode by physically contacting the object and in the non-physical UI mode by not physically contacting the object.

16. The method of claim 15, further comprising selecting the physical UI mode if the detected object is within the predetermined distance from the HMD and within a view angle.

17. The method of claim 16, further comprising changing to the non-physical UI mode if the detected object is within the view angle but is not user-interfaceable.

18. The method of claim 16, further comprising selecting the non-physical UI mode if the detected object is within the predetermined distance from the HMD but not within the view angle.

19. The method of claim 18, further comprising changing to the physical UI mode if the detected object is not within the view angle but returns within the view angle within a predetermined period of time.

20. The method of claim 18, further comprising continuously staying the non-physical UI mode if the detected object is not within the view angle and does not return within the view angle within a predetermined period of time.