Gesture recognition device, electronic apparatus, gesture recognition device control method, control program, and recording medium

• US 9,304,600 B2
• Filed: 03/14/2012
• Issued: 04/05/2016
• Est. Priority Date: 09/15/2011
• Status: Active Grant

• Current Assignee: Omron Corporation
• Original Assignee: Omron Corporation
• Inventors: Yamamoto, Motoo, Abe, Yuichi, Hanzawa, Yuki, Takayama, Takahiro
• Primary Examiner(s): Haley, Joseph
• Assistant Examiner(s): Frank, Emily
• Application Number:
  US14/235,424
• Publication Number:
  US 20140225825A1
• Time in Patent Office: 1,483 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45

Abstract

A gesture recognition device that recognizes a gesture of a person from an image captured by a camera, and outputs information to an electronic apparatus in order to control the electronic apparatus based on the recognized gesture, has a person determination section that determines whether the person is included in the image, and an output section that outputs person out-of-view angle notification instruction information issuing an instruction to make a notification that the image of the person is not captured, when the person determination section determines that the person is not included in the image.

Claims

1. A gesture recognition device that recognizes a gesture of a person from an image captured by a camera, and outputs information to an electronic apparatus in order to control the electronic apparatus based on the recognized gesture, the gesture recognition device comprising a processor, the processor comprising:

a person determination section that determines whether the person is included in the image;

a timing determination section that determines whether a present time is an operation timing when the person wants to perform an operation with the gesture based on the present time and one or more history data; and

an output section that outputs person out-of-view angle notification instruction information issuing an instruction to make a notification that the image of the person is not captured, when the person determination section determines that the person is not included in the image,

wherein the output section outputs the person out-of-view angle notification instruction information, when the person determination section determines that the person is not included in the image, and when the timing determination section determines that the present time is the operation timing.

2. The gesture recognition device according to claim 1, wherein the timing determination section determines that the present time is the operation timing, when the present time is within a predetermined period since the gesture recognition device outputs the information based on the gesture recognition to the electronic apparatus.

3. The gesture recognition device according to claim 2, wherein the processor further comprises:

an operation target person determination section that determines whether the person, who is determined to be included in the image by the person determination section, is an operation target person who can operate the electronic apparatus with the gesture,

wherein the output section outputs a non-operation target person notification instruction information issuing an instruction to make a notification that the person is not the operation target person, when the operation target person determination section determines that the person is not the operation target person.

4. The gesture recognition device according to claim 1, wherein the timing determination section determines that the present time is the operation timing, when a predetermined period has elapsed since the gesture recognition device outputs the information based on the gesture recognition to the electronic apparatus.

5. The gesture recognition device according to claim 4, wherein the processor further comprises:

an operation target person determination section that determines whether the person, who is determined to be included in the image by the person determination section, is an operation target person who can operate the electronic apparatus with the gesture,

wherein the output section outputs a non-operation target person notification instruction information issuing an instruction to make a notification that the person is not the operation target person, when the operation target person determination section determines that the person is not the operation target person.

6. The gesture recognition device according to claim 1, wherein the timing determination section determines that the present time is the operation timing, when the electronic apparatus performs predetermined processing within a predetermined period.

7. The gesture recognition device according to claim 6, wherein the processor further comprises:

an operation target person determination section that determines whether the person, who is determined to be included in the image by the person determination section, is an operation target person who can operate the electronic apparatus with the gesture,

wherein the output section outputs a non-operation target person notification instruction information issuing an instruction to make a notification that the person is not the operation target person, when the operation target person determination section determines that the person is not the operation target person.

8. The gesture recognition device according to claim 1,

wherein the electronic apparatus is a television set, and

wherein the timing determination section determines that the present time is the operation timing, when a commercial is displayed on the television set.

9. The gesture recognition device according to claim 8, wherein the processor further comprises:

an operation target person determination section that determines whether the person, who is determined to be included in the image by the person determination section, is an operation target person who can operate the electronic apparatus with the gesture,

wherein the output section outputs a non-operation target person notification instruction information issuing an instruction to make a notification that the person is not the operation target person, when the operation target person determination section determines that the person is not the operation target person.

10. The gesture recognition device according to claim 1, wherein the processor further comprises:

an operation target person determination section that determines whether the person, who is determined to be included in the image by the person determination section, is an operation target person who can operate the electronic apparatus with the gesture,

wherein the output section outputs a non-operation target person notification instruction information issuing an instruction to make a notification that the person is not the operation target person, when the operation target person determination section determines that the person is not the operation target person.

11. The gesture recognition device according to claim 1, wherein the processor further comprises:

an operation target person determination section that determines whether the person, who is determined to be included in the image by the person determination section, is an operation target person who can operate the electronic apparatus with the gesture,

wherein the output section outputs a non-operation target person notification instruction information issuing an instruction to make a notification that the person is not the operation target person, when the operation target person determination section determines that the person is not the operation target person.

12. The gesture recognition device according to claim 11, wherein the processor further comprises:

an operation prohibited person determination section that determines whether the person, who is determined to be included in the image by the person determination section, is an operation prohibited person who is prohibited from operating the electronic apparatus with the gesture,

wherein the output section does not output the non-operation target person notification instruction information, when the operation prohibited person determination section determines that the person is the operation prohibited person.

13. The gesture recognition device according to claim 11, wherein the operation target person determination section determines a person previously set to the person who can operate the electronic apparatus with the gesture to be the operation target person.

14. The gesture recognition device according to claim 11, wherein the operation target person determination section determines a person who operates the electronic apparatus with the gesture predetermined times to be the operation target person.

15. The gesture recognition device according to claim 11, wherein the operation target person determination section determines a person who operates the electronic apparatus with the gesture within a predetermined period to be the operation target person.

16. The gesture recognition device according to claim 1, wherein the one or more history data comprises at least one selected from the list consisting of:

a time of a power on operation, a time of a volume change operation, a time of a channel change operation, and a time of a first gesture operation.

17. An electronic apparatus comprising:

the gesture recognition device according to claim 1; and

a notification section that notifies a person according to the information output from the output section.

18. A method for controlling a gesture recognition device that recognizes a gesture of a person from an image captured by a camera, and outputs information to an electronic apparatus in order to control the electronic apparatus based on the recognized gesture, the gesture recognition device control method comprising:

a person determination step of determining whether the person is included in the image;

a timing determination step that determines whether a present time is an operation timing when the person wants to perform an operation with the gesture based on the present time and one or more history data; and

an output step of outputting person out-of-view angle notification instruction information issuing an instruction to make a notification that the image of the person is not captured, when the person is determined to be not included in the image in the person determination step,

wherein the output step outputs the person out-of-view angle notification instruction information, when the person determination section determines that the person is not included in the image, and when the timing determination section determines that the present time is the operation timing.

19. A non-transitory computer-readable recording medium storing a control program that causes a computer to control a gesture recognition device that recognizes a gesture of a person from an image captured by a camera, and outputs information to an electronic apparatus in order to control the electronic apparatus based on the recognized gesture, the control program causing the computer to perform:

a person determination step of determining whether the person is included in the image; and

a timing determination step that determines whether a present time is an operation timing when the person wants to perform an operation with the gesture based on the present time and one or more history data; and

an output step of outputting person out-of-view angle notification instruction information issuing an instruction to make a notification that the image of the person is not captured, when the person is determined to be not included in the image in the person determination step,

wherein the output step outputs the person out-of-view angle notification instruction information, when the person determination section determines that the person is not included in the image, and when the timing determination section determines that the present time is the operation timing.