WEARABLE DISPLAY DEVICE AND METHOD FOR CONTROLLING LAYER IN THE SAME

• US 20150091943A1
• Filed: 01/29/2014
• Published: 04/02/2015
• Est. Priority Date: 09/30/2013
• Status: Abandoned Application

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: LEE, Doyoung, CHUN, Sinae, CHO, Eunhyung, KIM, Jihwan
• Application Number:
  US14/167,058
• Publication Number:
  US 20150091943A1
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence

Abstract

Discussed are a wearable display device and a method for controlling an augmented reality layer. The wearable display device may include a camera unit configured to capture an image of a user'"'"'s face, a sensor unit configured to sense whether or not the user is turning his (or her) head, and a controller configured to move a virtual object belonging to a layer being gazed upon by the user'"'"'s eye-gaze, when at least one of a turning of the user'"'"'s head and a movement in the user'"'"'s eye-gaze is identified based upon the image of the user'"'"'s face captured by the camera unit and information sensed by the sensor unit, and when the user'"'"'s eye-gaze is gazing upon any one of a first virtual object belonging to a first layer and a second virtual object belonging to a second layer.

Claims

1. A wearable display device, comprising:

a display unit configured to display a first virtual object belonging to a first layer and a second virtual object belonging to a second layer;

a camera unit configured to capture an image of a user'"'"'s face;

a sensor unit configured to sense whether the user is turning his (or her) head; and

a controller configured to move a virtual object belonging to a layer being gazed upon by the user'"'"'s eye-gaze when at least one of a turning of the user'"'"'s head and a movement in the user'"'"'s eye-gaze is identified based on the image of the user'"'"'s face captured by the camera unit and information sensed by the sensor unit, and when the user'"'"'s eye-gaze is gazing upon any one of the first virtual object belonging to the first layer and the second virtual object belonging to the second layer.

2. The wearable display device of claim 1, wherein the controller detects pupils of the user'"'"'s eyes from the captured image of the user'"'"'s face, and wherein the controller detects a gazing direction of the user'"'"'s eye-gaze based on the detected pupil information and whether the user has turned his (or her) head.

3. The wearable display device of claim 1, wherein the controller moves the virtual object belonging to the layer being gazed upon by the user'"'"'s eye-gaze, when the user'"'"'s eye-gaze is in a fixed state, while the user'"'"'s eye-gaze is gazing upon any one of the first virtual object belonging to the first layer and the second virtual object belonging to the second layer, and when the user'"'"'s head is turned sideways.

4. The wearable display device of claim 3, wherein a moving direction of the virtual object belonging to the layer that is being moved corresponds to an opposite direction of a turning direction of the user'"'"'s head.

5. The wearable display device of claim 3, wherein a moving distance of the virtual object belonging to the layer that is being moved is calculated based on a turning distance of the user'"'"'s head.

6. The wearable display device of claim 1, wherein the controller moves the virtual object belonging to the layer being gazed upon by the user'"'"'s eye-gaze, when the user'"'"'s head is in a fixed state, while the user'"'"'s eye-gaze gazes upon any one of the first virtual object belonging to the first layer and the second virtual object belonging to the second layer, and when the user'"'"'s eye-gaze is moved afterwards.

7. The device of claim 6, wherein a moving direction of the virtual object belonging to the layer that is being moved corresponds to the same direction as a moving direction of the user'"'"'s eye-gaze.

8. The wearable display device of claim 6, wherein a moving distance of the virtual object belonging to the layer that is being moved is calculated based on a moving distance of the user'"'"'s eye-gaze.

9. The wearable display device of claim 1, wherein the controller senses a turning direction and a turning distance of the user'"'"'s head by using at least one of a motion sensor, an acceleration sensor, and a gyro sensor.

10. The wearable display device of claim 1, wherein the controller senses a turning direction and a turning distance of the user'"'"'s head based on the captured image of the user'"'"'s face.

11. The wearable display device of claim 1, wherein the camera unit captures a reality image, and

wherein the display unit displays an augmented reality image by overlaying the first virtual object belonging to the first layer and the second virtual object belonging to the second layer over the captured reality image.

12. A method for controlling a layer in a wearable display device, the method comprising:

displaying a first virtual object belonging to a first layer and a second virtual object belonging to a second layer;

capturing an image of a user'"'"'s face;

sensing whether the user is turning his (or her) head; and

moving a virtual object belonging to a layer being gazed upon by the user'"'"'s eye-gaze, when at least one of a turning of the user'"'"'s head and a movement in the user'"'"'s eye-gaze is identified based on the captured image of the user'"'"'s face and the sensed information, and when the user'"'"'s eye-gaze is gazing upon any one of the first virtual object belonging to the first layer and the second virtual object belonging to the second layer.

13. The method of claim 12, wherein pupils of the user'"'"'s eyes are detected from the captured image of the user'"'"'s face, and wherein a gazing direction of the user'"'"'s eye-gaze is detected based on the detected pupil information and whether or not the user has turned his (or her) head.

14. The method of claim 12, wherein the virtual object belonging to the layer being gazed upon by the user'"'"'s eye-gaze is moved, when the user'"'"'s eye-gaze is in a fixed state, while the user'"'"'s eye-gaze is gazing upon any one of the first virtual object belonging to the first layer and the second virtual object belonging to the second layer, and when the user'"'"'s head is turned sideways.

15. The method of claim 14, wherein a moving direction of the virtual object belonging to the layer that is being moved corresponds to an opposite direction of a turning direction of the user'"'"'s head.

16. The method of claim 14, wherein a moving distance of the virtual object belonging to the layer that is being moved is calculated based on a turning distance of the user'"'"'s head.

17. The method of claim 12, wherein the virtual object belonging to the layer being gazed upon by the user'"'"'s eye-gaze is moved, when the user'"'"'s head is in a fixed state, while the user'"'"'s eye-gaze gazes upon any one of the first virtual object belonging to the first layer and the second virtual object belonging to the second layer, and when the user'"'"'s eye-gaze is moved afterwards.

18. The method of claim 17, wherein a moving direction of the virtual object belonging to the layer that is being moved corresponds to the same direction as a moving direction of the user'"'"'s eye-gaze.

19. The method of claim 17, wherein a moving distance of the virtual object belonging to the layer that is being moved is calculated based on a moving distance of the user'"'"'s eye-gaze.

20. The method of claim 12, further comprising:

capturing a reality image, and

displaying an augmented reality image by overlaying the first virtual object belonging to the first layer and the second virtual object belonging to the second layer over the captured reality image.