IMAGE DISPLAY APPARATUS AND OPERATION METHOD THEREOF

• US 20170139482A1
• Filed: 07/08/2014
• Published: 05/18/2017
• Est. Priority Date: 06/03/2014
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: KANG, Sangkyu, OH, Hyeongchul, PARK, Sewon, AHN, Wooseok
• Granted Patent: US 10,162,423 B2
• Time in Patent Office: Days
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/03 Arrangements for converting the position or the displacement of a member into a coded form
• CPC Class Codes: G06F 40/55 Rule-based translation
• CPC Class Codes: G06T 7/00 Image analysis
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/251 involving models
• CPC Class Codes: G06T 7/254 involving subtraction of images
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: G09B 21/009 Teaching or communicating with deaf persons G09B21/04 takes precedence; deaf and dumb persons G09B21/00
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4227 Providing Remote input by a user located remotely from the client device, e.g. at work
• CPC Class Codes: H04N 21/4383 Accessing a communication channel
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4852 : for modifying audio parameters, e.g. switching between mono and stereo
• CPC Class Codes: H04N 21/4854 : for modifying image parameters, e.g. image brightness, contrast

Abstract

A method of operating the video display device according to the embodiment of the present invention comprises acquiring a video of a video display device associated with a user; recognizing a gesture of the user in the acquired video; calculating a control amount with regard to the gesture based on the recognized gesture; and performing the control operation corresponding to the recognized gesture and the calculated control amount.

Claims

1. A method of operating a video display device, comprising:

acquiring a video associated with a user of the video display device;

recognizing a gesture of the user in the acquired video;

calculating a control amount with regard to the gesture based on the recognized gesture; and

performing a control operation corresponding to the recognized gesture and the calculated control amount.

2. The method according to claim 1, wherein the calculating of the control amount comprises

recognizing a gesture object and a reference object of the user based on the recognized gesture;

calculating a distance between the recognized gesture object and the recognized reference object; and

calculating the control amount based on the calculated distance.

3. The method according to claim 2, wherein the recognizing of the gesture object and the reference object comprises recognizing a position of the gesture object and a position of a reference object in the acquired video.

4. The method according to claim 2, wherein the calculating of the distance comprises calculating the distance between the gesture object and the reference object based on one or more of an area, a size, and a length of each of the gesture object and the reference object.

5. The method according to claim 2, wherein the calculating of the distance comprises calculating the distance between the gesture object and the reference object based on a ratio between the gesture object and the reference object.

6. The method according to claim 2, wherein the gesture object is an object corresponding to the gesture of the user.

7. The method according to claim 2, wherein the reference object is a reference for calculating the control amount.

8. The method according to claim 2, wherein the gesture object and the reference object are different objects from each other.

9. The method according to claim 1, wherein the recognizing of the gesture of the user comprises comparing one or more of a shape and a movement of the recognized gesture with one or more of a shape and a movement of a previously stored gesture.

10. The method according to claim 1, wherein the performing of the control operation comprises performing one or more of control operations including a channel change operation, a volume control operation, a screen zoom-in operation, a screen zoom-out operation, a screen movement operation, a pointer movement operation, a screen setting operation, and a volume setting operation.

11. The method according to claim 1, wherein the control amount is a positive number or a negative number.

12. A video display device, comprising:

a video acquisition unit configured to acquire a video associated with a user of the video display device; and

a control unit configured to recognize a gesture of the user in the acquired video associated with the user, calculate a control amount with regard to the gesture based on the recognized gesture, and perform a control operation corresponding to the recognized gesture and the calculated control amount.

13. The video display device according to claim 12, wherein the control unit recognizes a gesture object and a reference object of the user based on the recognized gesture, calculates a distance between the recognized gesture object and the recognized reference object, and calculates a control amount based on the calculated distance.

14. The video display device according to claim 13, wherein the control unit calculates the distance between the gesture object and the reference object based on one or more of an area, a size, and a length of each of the gesture object and the reference object.

15. The video display device according to claim 13, wherein the control unit calculates the distance between the gesture object and the reference object based on a ratio between the gesture object and the reference object.

16. The video display device according to claim 13, wherein the gesture object is an object corresponding to the gesture of the user.

17. The video display device according to claim 13, wherein the reference object is an object which is a reference for calculating the control amount.

18. The video display device according to claim 12, further comprising a storage unit of storing one or more of a shape and a movement of a gesture mapped to the control amount.

19. The video display device according to claim 18, wherein the control unit recognizes the gesture of the user by comparing one or more of a shape and a movement of the recognized gesture with one or more of a shape and a movement of a previously stored gesture.

20. The video display device according to claim 12, wherein the control unit performs one or more control operations including a channel change operation, a volume control operation, a screen zoom-in operation, a screen zoon-out operation, a screen movement operation, a pointer movement operation, a screen setting operation, and a volume setting operation of a video display device based on a recognized gesture and a calculated control amount.