Display device and control method thereof

• US 9,746,928 B2
• Filed: 04/19/2011
• Issued: 08/29/2017
• Est. Priority Date: 04/19/2011
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Park, Sung Jong, Kim, Kyung Jin, Jang, Sae Hun, Jang, Gu-Ang, Cho, Sung IL, Cho, Yooseok, Hong, Jiyoung
• Primary Examiner(s): Rosario, Nelson
• Application Number:
  US14/004,642
• Publication Number:
  US 20140028567A1
• Time in Patent Office: 2,324 Days
• Field of Search: 345156-184
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042

Abstract

Disclosed are a display device and a control method thereof. The display device includes a display, a camera capturing a gesture in a three dimensional space; and a controller selectively displaying a virtual keyboard corresponding to a hand gesture for character input on the display when the captured gesture includes the hand gesture for the character input. Accordingly, the virtual keyboard corresponding to the hand gesture for the character input is displayed, so that the user may not perform an additional operation to display the virtual keyboard.

Claims

1. A display device comprising:

a display including a panel for displaying a stereoscopic image;

a camera capturing a gesture in a three dimensional space; and

a controller configured to cause the display to;

display a virtual keyboard in an activated display state on the display, in response to a first gesture,

change a display state of the virtual keyboard into a dimming display state in response to a second gesture, and

change the display state of the virtual keyboard into an inactivated display state and terminate a display of the virtual keyboard in the inactivated display state in response to a third gesture.

2. The display device of claim 1, wherein the third gesture includes a predetermined time passing after the second gesture.

3. The display device of claim 1, wherein the controller displays the virtual keyboard corresponding to at least one of a position of a hand making the first gesture for character input, the number of hands, the number of unfolded fingers, and an angle of the hand with respect to a reference surface.

4. The display device of claim 1, wherein the controller displays at least one first pointer corresponding to at least one finger unfolded for character input on the virtual keyboard.

5. The display device of claim 4, wherein when a plurality of fingers are unfolded for the character input, the controller displays a plurality of first pointers, respectively corresponding to the plurality of fingers, to vary in at least one of color and shape.

6. The display device of claim 4, wherein the first gesture for the character input includes a gesture made with at least one finger unfolded for the character input, wherein, when the first gesture made with the at least one unfolded finger moves outside a region in which the virtual keyboard is displayed, the controller displays a second pointer corresponding to the first gesture of the at least one finger.

7. The display device of claim 6, wherein the controller causes the displayed virtual keyboard to disappear when the third gesture made with the at least one unfolded finger moves completely out of the region in which the virtual keyboard is displayed.

8. The display device of claim 1, wherein the dimming display state indicates the virtual keyboard is displayed in a semitransparent state.

9. The display device of claim 8, wherein the dimming display state indicates a state for waiting for character input.

10. The display device of claim 1, wherein the first gesture for character input is a gesture made with a plurality of spread fingers of a hand making the first gesture, wherein the controller causes the displayed virtual keyboard to disappear in the case of a first state in which only one finger of the hand is unfolded, a second state in which at least two of the plurality of fingers are in contact, or a third state in which at least one finger of the hand is folded.

11. A control method of a display device, the control method comprising:

capturing a gesture of a user in a three dimensional space;

displaying a virtual keyboard in an activated display state on the display, in response to a first gesture;

changing a display state of the virtual keyboard into a dimming display state in response to a second gesture; and

changing the display state of the virtual keyboard into an inactivated display state and terminating a display of the virtual keyboard in the inactivated display state in response to a third gesture.

12. The control method of claim 11, wherein the third gesture includes a predetermined time passing after the second gesture.

13. The control method of claim 11, further comprising displaying on the virtual keyboard at least one first pointer corresponding to at least one finger unfolded for character input.

14. The control method of claim 11, wherein the dimming display state indicates the virtual keyboard is displayed in a semitransparent state.

15. The control method of claim 11, further comprising, when a gesture of at least one finger unfolded for the character input moves outside a region of the virtual keyboard is displayed, displaying a second pointer corresponding to the gesture of the at least one finger.

16. The control method of claim 11, wherein, in the displaying of the virtual keyboard, the virtual keyboard is displayed so as to reflect an angle between a reference surface and a hand making the gesture.