System and method for control based on face or hand gesture detection

• US 8,614,673 B2
• Filed: 05/30/2012
• Issued: 12/24/2013
• Est. Priority Date: 05/21/2009
• Status: Active Grant

• Current Assignee: May Patents Ltd.
• Original Assignee: May Patents Ltd.
• Inventors: Binder, Yehuda
• Primary Examiner(s): Bukowski, Kenneth
• Application Number:
  US13/483,434
• Publication Number:
  US 20120235901A1
• Time in Patent Office: 573 Days
• Field of Search: 345156-158, 345/175, 382/103, 348/208.14
• US Class Current: 345/158
• CPC Class Codes: G01S 3/7864 T.V. type tracking systems
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 10/242 by image rotation, e.g. by 90 degrees
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: G09G 2330/027 Arrangements or methods related to powering off a display
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/10 Intensity circuits
• CPC Class Codes: H04B 1/38 Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
• CPC Class Codes: H04M 3/02 Calling substations, e.g. by ringing selective calling H04Q
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/4131 home appliance, e.g. lighting, air conditioning system, metering devices home automation data switching networks exchanging configuration information on appliance services H04L12/2807
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/43632 : involving a wired protocol, e.g. IEEE 1394 high-speed IEEE 1394 serial bus H04L12/40052
• CPC Class Codes: H04N 21/43635 : HDMI
• CPC Class Codes: H04N 21/44008 : involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4788 : communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 23/51 : Housings
• CPC Class Codes: H04N 23/611 : where the recognised objects include parts of the human body
• CPC Class Codes: H04N 25/75 : Circuitry for providing, modifying or processing image signals from the pixel array
• CPC Class Codes: H04N 5/63 : Generation or supply of power specially adapted for television receivers
• CPC Class Codes: H04N 5/645 : Mounting of picture tube on chassis or in housing
• CPC Class Codes: H04N 7/005 : using at least one opto-electrical conversion device
• CPC Class Codes: H04N 7/015 : High-definition television systems
• CPC Class Codes: H04N 7/0255 : Display systems therefor
• CPC Class Codes: H04N 7/104 : Switchers or splitters
• CPC Class Codes: H04N 7/163 : by receiver means only
• CPC Class Codes: H04N 9/3141 : Constructional details thereof details not peculiar to the presence of an electronic spatial light modulator G03B21/14
• CPC Class Codes: H04W 88/02 : Terminal devices

Abstract

System and method for control using face detection or hand gesture detection algorithms in a captured image. Based on the existence of a detected human face or a hand gesture in an image captured by a digital camera, a control signal is generated and provided to a device. The control may provide power or disconnect power supply to the device (or part of the device circuits). The location of the detected face in the image may be used to rotate a display screen to achieve a better line of sight with a viewing person. The difference between the location of the detected face and an optimum is the error to be corrected by rotating the display to the required angular position. A hand gesture detection can be used as a replacement to a remote control for to the controlled unit, such as a television set.

Claims

1. An apparatus for a human face detection based control of a device, said apparatus comprising:

a digital camera for capturing an image in a digital data form;

an image processor coupled to receive the image and for applying a face detection algorithm to detect the human face image in the captured image;

a controller coupled to said image processor for generating a first control signal in response to the detection or non-detection of the human face image in the captured image;

a first timer for signaling a first pre-set time period, said first timer coupled to said controller to cause the first control signal to be generated upon the detecting the human face in the captured image for the first pre-set period; and

a second timer for signaling a second pre-set time period, said second timer coupled to said controller to cause said controller to generate a second control signal in response to not detecting the human face image in the captured image for the second time period,

wherein the first control signal is effective to initiate supplying of power to at least part of the device, and the second control signal is effective to disconnect power from at least part of the device.

2. The apparatus according to claim 1, wherein said controller comprising firmware or software and a processor for executing said firmware or software.

3. The apparatus according to claim 1, wherein said digital camera is mechanically fixed to the device.

4. The apparatus according to claim 1, wherein said digital camera, said image processor and said controller are housed within a single enclosure.

5. The apparatus according to claim 1, further comprising a switch connected to be actuated by the first control signal.

6. The apparatus according to claim 5, wherein said switch is connected between a power source and the device, for powering the device in response to the first control signal.

7. The apparatus according to claim 6, operative to actuate said switch and to supply power to the device is response to the detection of the human face image in the captured image.

8. The apparatus according to claim 6, operative to actuate said switch and for supplying power to the device is response to not detecting a human face in the captured image.

9. The apparatus according to claim 5, wherein said camera, said image processor, said controller and said switch are housed within a single enclosure.

10. The apparatus according to claim claim 1, wherein the first control signal is effective to initiate supplying of power to the device, and the second control signal is effective to disconnect power from the device.

11. The apparatus according to claim 1, wherein said device is a display or a television set.

12. The apparatus according to claim 1, wherein the device has a display screen and said digital camera is positioned such that the image captured is substantially in front of the display screen.

13. An apparatus for a human face detection based control of a device, said apparatus comprising:

a digital camera for capturing an image in a digital data form;

an image processor coupled to receive the image and for applying a face detection algorithm to detect the human face image in the captured image;

a controller coupled to said image processor for generating a first control signal in response to the detection or non-detection of the human face image in the captured image;

a first timer for signaling a first pre-set time period, said first timer coupled to said controller to cause the first control signal to be generated upon the detecting the human face in the captured image for the first pre-set period; and

a second timer for signaling a second pre-set time period, said second timer coupled to said controller to cause said controller to generate a second control signal in response to not detecting the human face image in the captured image for the second time period,

wherein the device has a display, and said controller is operative to blank the display, by disconnecting power from the display, in response to not detecting the human face image in the captured image.