Image display apparatus and operation method thereof

• US 10,162,423 B2
• Filed: 07/08/2014
• Issued: 12/25/2018
• Est. Priority Date: 06/03/2014
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Ahn, Wooseok, Kang, Sangkyu, Oh, Hyeongchul, Park, Sewon
• Primary Examiner(s): Eurice, Michael J
• Application Number:
  US15/316,452
• Publication Number:
  US 20170139482A1
• Time in Patent Office: 1,631 Days
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/03 Arrangements for converting the position or the displacement of a member into a coded form
• CPC Class Codes: G06F 40/55 Rule-based translation
• CPC Class Codes: G06T 7/00 Image analysis
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/251 involving models
• CPC Class Codes: G06T 7/254 involving subtraction of images
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: G09B 21/009 Teaching or communicating with deaf persons G09B21/04 takes precedence; deaf and dumb persons G09B21/00
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4227 Providing Remote input by a user located remotely from the client device, e.g. at work
• CPC Class Codes: H04N 21/4383 Accessing a communication channel
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4852 for modifying audio parameters, e.g. switching between mono and stereo
• CPC Class Codes: H04N 21/4854 : for modifying image parameters, e.g. image brightness, contrast

Abstract

A method of operating the video display device according to the embodiment of the present invention comprises acquiring a video of a video display device associated with a user; recognizing a gesture of the user in the acquired video; calculating a control amount with regard to the gesture based on the recognized gesture; and performing the control operation corresponding to the recognized gesture and the calculated control amount.

Claims

1. A method of operating a video display device, comprising:

acquiring a video associated with a user of the video display device;

recognizing a gesture of the user in the acquired video;

recognizing a gesture object and a reference object of the user based on the recognized gesture;

calculating a distance between the recognized gesture object and the recognized reference object;

calculating a control amount based on the calculated distance; and

performing a control operation corresponding to the recognized gesture and the calculated control amount,

wherein the calculating the control amount comprises;

recognizing the calculated control amount as a positive number when the gesture object is located in a first direction from the reference object and recognizing the calculated control amount as a negative number when the gesture object is located in the second direction from the reference object.

2. The method according to claim 1, wherein the recognizing the gesture object and the reference object comprises recognizing a position of the gesture object and a position of the reference object in the acquired video.

3. The method according to claim 1, wherein the calculating the distance comprises calculating the distance between the gesture object and the reference object based on one or more of an area, a size, and a length of each of the gesture object and the reference object.

4. The method according to claim 1, wherein the calculating the distance comprises calculating the distance between the gesture object and the reference object based on a ratio between the gesture object and the reference object.

5. The method according to claim 1, wherein the gesture object is an object corresponding to the gesture of the user.

6. The method according to claim 1, wherein the reference object is a reference for calculating the control amount.

7. The method according to claim 1, wherein the gesture object and the reference object are different objects from each other.

8. The method according to claim 1, wherein the recognizing the gesture of the user comprises comparing one or more of a shape and a movement of the recognized gesture with one or more of a shape and a movement of a previously stored gesture.

9. The method according to claim 1, wherein the performing the control operation comprises performing one or more control operations including a channel change operation, a volume control operation, a screen zoom-in operation, a screen zoom-out operation, a screen movement operation, a pointer movement operation, a screen setting operation, and a volume setting operation.

10. A video display device, comprising:

a video acquisition unit configured to acquire a video associated with a user of the video display device; and

a control unit configured to recognize a gesture of the user in the acquired video associated with the user, recognize a gesture object and a reference object of the user based on the recognized gesture, calculate a distance between the recognized gesture object and the recognized reference object, calculate a control amount based on the calculated distance, and perform a control operation corresponding to the recognized gesture and the calculated control amount,

wherein the control unit is further configured to recognize the calculated control amount as a positive number when the gesture object is located in a first direction from the reference object and recognize the calculated control amount as a negative number when the gesture object is located in a second direction from the reference object.

11. The video display device according to claim 10, wherein the control unit is further configured to calculate the distance between the gesture object and the reference object based on one or more of an area, a size, and a length of each of the gesture object and the reference object.

12. The video display device according to claim 10, wherein the control unit is further configured to calculate the distance between the gesture object and the reference object based on a ratio between the gesture object and the reference object.

13. The video display device according to claim 10, wherein the gesture object is an object corresponding to the gesture of the user.

14. The video display device according to claim 10, wherein the reference object is an object which is a reference for calculating the control amount.

15. The video display device according to claim 10, wherein the control unit is configured to perform one or more control operations including a channel change operation, a volume control operation, a screen zoon-in operation, a screen zoon-out operation, a screen movement operation, a pointer movement operation, a screen setting operation, and a volume setting operation of a video display device based on a recognized gesture and a calculated control amount.

16. The video display device according to claim 10, further comprising a storage unit storing one or more of a shape and a movement of a gesture mapped to the control amount.

17. The video display device according to claim 16, wherein the control unit is further configured to recognize the gesture of the user by comparing one or more of a shape and a movement of the recognized gesture with one or more of a shape and a movement of a previously stored gesture.