Display device and control method thereof

• US 9,189,072 B2
• Filed: 02/08/2011
• Issued: 11/17/2015
• Est. Priority Date: 02/08/2011
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Kim, Taehyeong, Lim, Kyungyoung, Kim, Sangki, Cho, Yongwon
• Primary Examiner(s): Mercedes, Dismery
• Application Number:
  US13/981,441
• Publication Number:
  US 20130307768A1
• Time in Patent Office: 1,743 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06V 10/40 Extraction of image or video features
• CPC Class Codes: G06V 40/107 Static hand or arm
• CPC Class Codes: G06V 40/113 Recognition of static hand signs
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

Disclosed are a display device and a control method thereof. The display device and the control method include a camera acquiring an image including a gesture made by a user, and a controller extracting an object making the gesture from the image acquired by the camera, and setting a specific spot in the extracted object to be a reference point of a movement of the object, the controller fixing the reference point to a set location regardless of a change in a shape of the extracted object. Accordingly, a reference point is set at a specific spot of an object having made a gesture corresponding to the acquisition of control thereon, thereby allowing for the accurate and effective recognition of a gesture made by a user.

Claims

1. A display device comprising:

a display unit;

a camera acquiring an image including a gesture made by a user; and

a controller configured to;

extract an object associated with the gesture from the image acquired by the camera;

set a reference point, fixed regardless of a change in a shape of the object according to the gesture, at a specific spot in the extracted object; and

control the display unit to display a cursor on a location matched to the reference point and execute a function corresponding to a gesture on a matched location,

wherein, when the controller recognizes the gesture corresponding to a selection of a preset function of the display device, the controller does not reflect a motion value of the reference point on a movement of the cursor on the display unit matched to the reference point.

2. The display device of claim 1, wherein the controller sets the reference point on the basis of a reference region in which the extracted object is not substantially changed in shape.

3. The display device of claim 2, wherein the controller sets the reference point at a central portion of the reference region.

4. The display device of claim 2, wherein the extracted object is a hand of the user, and the reference region is a palm of the hand,

wherein the controller sets the reference point in the palm.

5. The display device of claim 4, wherein the controller displays a cursor on a location on a display unit matched to the reference point, and a function corresponding to the gesture made by a finger of the hand is executed on the matched location.

6. The display device of claim 2, wherein the controller sets the reference region according to a kind of the extracted object.

7. A display device comprising:

a display unit;

a camera acquiring an image of an object; and

a controller extracting the object from the image acquired by the camera and displaying an indicator corresponding to a movement of the object on the display unit, the controller changing a location of the indicator displayed on the display unit, corresponding to one spot in a reference region in which the extracted object is not substantially changed in shape,

wherein, when the controller recognizes a gesture corresponding to a selection of a preset function of the display device, the controller does not reflect a motion value of a reference point on a movement of a cursor on the display unit matched to the reference point,

wherein the controller sets a central point of the reference region to be the reference point matched to the indicator, and

wherein the controller executes a function of the display device corresponding to a gesture of the object positioned outside the reference region.

8. The display device of claim 7, wherein the object is a hand, and the reference region is a palm of the hand,

wherein the controller sets the one spot in the palm.

9. A method of controlling a display device, the method comprising:

acquiring an image of a user;

extracting an object making a gesture from the acquired image;

setting a reference point, fixed regardless of a change in a shape of the object according to the gesture, at a specific spot in the extracted object; and

displaying a cursor on a location matched to the reference point on a display unit and executing a function corresponding to a predetermined gesture on a matched location,

wherein, when the controller recognizes the gesture corresponding to a selection of preset function of the display device, the controller does not reflect a motion value of the reference point on a movement of the cursor on the display unit matched to the reference point.

10. The method of claim 9, wherein, in the setting of the reference point, the reference point is set on the basis of a reference region in which the extracted object is not substantially changed in shape.

11. The method of claim 10, wherein, in the setting of the reference point, the reference point is set at a central point of the reference region.

12. The method of claim 10, wherein the extracted object is a hand of the user, and the reference region is a palm of the hand,

wherein the reference point is set in the palm.

13. The method of claim 9, further comprising displaying a cursor a location of which is changed corresponding to the reference point.

14. The method of claim 9, wherein the setting of the reference point includes:

determining a kind of object;

setting a reference region according to the determined kind of object; and

setting the reference point at a central point of the reference region.