HEAD MOUNTED DISPLAY AND METHOD OF CONTROLLING DIGITAL DEVICE USING THE SAME

• US 20140062854A1
• Filed: 10/26/2012
• Published: 03/06/2014
• Est. Priority Date: 08/31/2012
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: CHO, Eunhyung
• Granted Patent: US 9,223,402 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

Disclosed is a method of receiving a gesture input of a user using a Head Mounted Display (HMD) and synthetically controlling a digital device using the received gesture input. The method includes detecting whether or not the HMD is worn by a user, detecting a positional state of an external digital device linked with the HMD, the positional state including a first state in which the external digital device is located in a preset view angle region of the HMD and a second state in which the external digital device is not located in the view angle region, detecting a gesture input of the user, determining at least one digital device to be controlled based on whether or not the HMD is worn by the user and the detected positional state, and controlling a display object of the determined digital device under application of the gesture input.

Claims

1. A control method of a digital device using a Head Mounted Display (HMD), the method comprising:

determining whether the HMD is linked with an external digital device;

detecting a positional state of the external digital device linked with the HMD, wherein the positional state includes a first state in which the external digital device is located in a predetermined view angle region of the HMD and a second state in which the external digital device is located outside of the predetermined view angle region of the HMD when the HMD is linked with the external device;

detecting a gesture input of the user and a pointing direction of the gesture input when the external digital device is in the first state, wherein the gesture input is located between the HMD and the external digital device, wherein the pointing direction is used to determine a control digital device to be controlled by the gesture input, the control device being one of the HMD and the external digital device;

determining, between the HMD and the external digital device, the control device which is to be controlled by the gesture input based on the detected pointing direction of the gesture input;

controlling a display object of the HMD when the HMD is determined as the control device; and

controlling a display object of the external digital device when the external digital device is determined as the control device.

5. The control method according to claim 1, wherein, if the determining the control device includes determining to control display of the external digital device, the controlling the display object includes transmitting the detected gesture input to the external digital device.

13. The control method according to claim 1, wherein, the detecting the positional state of the external digital device includes detecting the positional state of the external digital device using signals transmitted/received with the external digital device through at least one antenna equipped in the HMD.

14. The control method according to claim 1, wherein the detecting the positional state of the external digital device includes detecting the positional state of the external digital device based on whether or not an optical pattern output from the external digital device is detected.

15. The control method according to claim 1, wherein the position state of the external digital device includes a third state in which the external digital device is located in a visual field of the user wearing the HMD and a fourth state in which the external digital device is not located in the visual field of the user wearing the HMD.

18. The control method according to claim 1, wherein if the detected positional state of the external digital device is changed between the first state and the second state, the HMD provides vibration feedback.

19. The control method according to claim 1, wherein the detecting the gesture input of the user includes detecting the gesture input of the user using a sensed value of a kinetic sensor equipped in the HMD.

21. The control method according to claim 1, wherein the predetermined view angle region is a region forward of the HMD within a predetermined angular range.

2. -4. (canceled)

6. -12. (canceled)

16. -17. (canceled)

20. A Head Mounted Display (HMD) comprising:

a processor configured to control operation of the HMD;

a display unit configured to output an image based on a command of the processor;

a sensor unit configured to sense a peripheral environment of the HMD and transmit the sensed result to the processor; and

a communication unit configured to perform data transmission/reception with an external digital device based on a command of the processor,

wherein the processor is configured to;

determine whether the HMD is linked with an external digital device;

detect a positional state of the external digital device linked with the HMD, wherein the positional state includes a first state in which the external digital device is located in a predetermined view angle region of the HMD and a second state in which the external digital device is located outside of the predetermined view angle region of the HMD when the HMD is linked with the external digital device;

detect a gesture input of the user and a pointing direction of the gesture input when the external digital device is in the first state, wherein the gesture input is located between the HMD and the external digital device, wherein the pointing direction is used to determine a control digital device to be controlled by the gesture input, the control device being one of the HMD and the external device;

determine, between the HMD and the external digital device, the control digital device which is to be controlled based on the detected pointing direction of the gesture input;

control a display object of the HMD when the HMD is determined as the control device; and

control a display object of the external digital device when the external digital device is determined as the control device.

22. The HMD according to claim 20, wherein the processor further configured to transmit the detected gesture input to the external digital device, if display of the external digital device is determined to control.

23. The HMD according to claim 20, wherein the processor further configured to detect the positional state of the external digital device using signals transmitted/received with the external digital device through at least one antenna equipped in the HMD.

24. The HMD according to claim 20, wherein the processor further configured to detect the positional state of the external digital device based on whether or not an optical pattern output from the external digital device is detected.

25. The HMD according to claim 20, wherein the position state of the external digital device includes a third state in which the external digital device is located in a visual field of the user wearing the HMD and a fourth state in which the external digital device is not located in the visual field of the user wearing the HMD.

26. The HMD according to claim 20, wherein the processor further configured to provide vibration feedback, if the detected positional state of the external digital device is changed between the first state and the second state.

27. The HMD according to claim 20, wherein the processor further configured to detect the gesture input of the user using a sensed value of a kinetic sensor equipped in the HMD.

28. The HMD according to claim 20, wherein the predetermined view angle region is a region forward of the HMD within a predetermined angular range.