GESTURE RECOGNITION DEVICE, ELECTRONIC APPARATUS, GESTURE RECOGNITION DEVICE CONTROL METHOD, CONTROL PROGRAM, AND RECORDING MEDIUM

• US 20140152557A1
• Filed: 03/14/2012
• Published: 06/05/2014
• Est. Priority Date: 09/15/2011
• Status: Abandoned Application

• Current Assignee: Omron Corporation
• Original Assignee: Omron Corporation
• Inventors: Takayama, Takahiro, Yamamoto, Motoo, Abe, Yuichi, Hanzawa, Yuki
• Application Number:
  US14/234,597
• Publication Number:
  US 20140152557A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 10/22 by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
• CPC Class Codes: G06V 10/245 by locating a pattern; Special marks for positioning
• CPC Class Codes: G06V 10/56 relating to colour
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

A gesture recognition device that recognizes a gesture, which is of a motion or a shape of a gesture recognition target region of a person, from an image captured by a camera and outputs information to an electronic apparatus in order to control the electronic apparatus based on the recognized gesture, has a recognition target region determination section that determines whether the gesture recognition target region is included in the image, and an output section that outputs target region out-of-view angle notification instruction information issuing an instruction to make a notification that an image of the gesture recognition target region is not captured when the recognition target region determination section determines that the gesture recognition target region is not included in the image.

Claims

1. A gesture recognition device that recognizes a gesture, which is of a motion or a shape of a gesture recognition target region of a person, from an image captured by a camera and outputs information to an electronic apparatus in order to control the electronic apparatus based on the recognized gesture, the gesture recognition device comprising:

a recognition target region determination section that determines whether the gesture recognition target region is included in the image; and

an output section that outputs target region out-of-view angle notification instruction information issuing an instruction to make a notification that an image of the gesture recognition target region is not captured when the recognition target region determination section determines that the gesture recognition target region is not included in the image.

2. The gesture recognition device according to claim 1, further comprising:

a timing determination section that determines whether a present time is an operation timing which is when the person wants an operation with the gesture, based on the region of the person captured in the image,

wherein the output section outputs the target region out-of-view angle notification instruction information, when the recognition target region determination section determines that the gesture recognition target region is not included in the image and the timing determination section determines that the present time is the operation timing.

3. The gesture recognition device according to claim 2, wherein the timing determination section determines that the present time is the operation timing, when a target neighborhood region near the gesture recognition target region is included in the image.

4. The gesture recognition device according to claim 2, wherein the timing determination section determines that the present time is the operation timing, when a region working with target, which works with the gesture recognition target region during the gesture, makes a predetermined motion is detected from the image.

5. The gesture recognition device according to claim 1, further comprising:

an operation target person determination section that determines whether the person having the region in which the image is captured is an operation target person who can perform the operation of the electronic apparatus with the gesture,

wherein the output section outputs the target region out-of-view angle notification instruction information when the operation target person determination section determines that the person having the region in which the image is captured is the operation target person.

6. The gesture recognition device according to claim 1, further comprising:

an operation target person determination section that determines whether the person having the region in which the image is captured is an operation target person who can perform the operation of the electronic apparatus with the gesture,

wherein the output section outputs non-operation target person notification instruction information issuing an instruction to make a notification that the person is not the operation target person instead of the target region out-of-view angle notification instruction information when the operation target person determination section determines that the person having the region in which the image is captured is not the operation target person.

7. The gesture recognition device according to claim 6, further comprising:

an operation prohibited person determination section that determines whether the person having the region in which the image is captured is an operation prohibited person who is prohibited from operating the electronic apparatus with the gesture,

wherein the output section does not output the non-operation target person notification instruction information when the operation prohibited person determination section determines that the person having the region in which the image is captured is the operation prohibited person.

8. The gesture recognition device according to claim 6, wherein the operation target person determination section determines that a person previously set to the person who can perform the operation of the electronic apparatus with the gesture is the operation target person.

9. The gesture recognition device according to claim 6, wherein the operation target person determination section determines that a person who performs the operation of the electronic apparatus with the gesture predetermined times is the operation target person.

10. The gesture recognition device according to claim 6, wherein the operation target person determination section determines that a person who performs the operation of the electronic apparatus with the gesture within a predetermined period is the operation target person.

11. The gesture recognition device according to claim 1, further comprising:

a region identification section that identifies the region in which the image is captured;

a position identification section that identifies a position of the gesture recognition target region with respect to the region identified by the region identification section; and

a moving vector identification section that identifies a moving direction necessary for the gesture recognition target region to enter a view angle based on the position identified by the position identification section,

wherein the output section outputs direction notification instruction information issuing an instruction to make a notification that encourages the gesture recognition target region to move in the direction identified by the moving vector identification section instead of the target region out-of-view angle notification instruction information.

12. The gesture recognition device according to claim 11,

wherein the moving vector identification section calculates a travel distance necessary for the gesture recognition target region to enter the view angle while identifying the moving direction based on the position identified by the position identification section, and

wherein the output section outputs vector notification instruction information issuing an instruction to make a notification that encourages the gesture recognition target region to move in the direction identified by the moving vector identification section by the travel distance identified by the moving vector identification section instead of the direction notification instruction information.

13. The gesture recognition device according to claim 1, further comprising

a region identification section configured to identify the region in which the image is captured,

wherein the output section is configured to output gesture position notification instruction information issuing an instruction to make a notification that encourages the person to make the gesture in front of the region identified by the region identification section instead of the target region out-of-view angle notification instruction information.

14. The gesture recognition device according to claim 1, further comprising

an exit and entrance determination section that determines whether the gesture recognition target region exits from and enters the view angle of the camera based on a determination result of the recognition target region determination section,

wherein the recognition target region determination section makes the determination to a plurality of the images arrayed in time series, and

wherein the output section outputs target region exit and entrance notification instruction information issuing an instruction to make a notification that the gesture recognition target region exits from and enters the view angle of the camera when the exit and entrance determination section determines that the gesture recognition target region exits from and enters the view angle of the camera.

15. An electronic apparatus comprising:

the gesture recognition device according to claim 1; and

a notification section that makes a notification to a person according to the information output from the output section.

19. The gesture recognition device according to claim 2, further comprising:

an operation target person determination section that determines whether the person having the region in which the image is captured is an operation target person who can perform the operation of the electronic apparatus with the gesture,

wherein the output section outputs the target region out-of-view angle notification instruction information when the operation target person determination section determines that the person having the region in which the image is captured is the operation target person.

20. The gesture recognition device according to claim 3, further comprising:

an operation target person determination section that determines whether the person having the region in which the image is captured is an operation target person who can perform the operation of the electronic apparatus with the gesture,

wherein the output section outputs the target region out-of-view angle notification instruction information when the operation target person determination section determines that the person having the region in which the image is captured is the operation target person.

21. The gesture recognition device according to claim 4, further comprising:

an operation target person determination section that determines whether the person having the region in which the image is captured is an operation target person who can perform the operation of the electronic apparatus with the gesture,

wherein the output section outputs the target region out-of-view angle notification instruction information when the operation target person determination section determines that the person having the region in which the image is captured is the operation target person.

16. A method for controlling a gesture recognition device that recognizes a gesture, which is of a motion or a shape of a gesture recognition target region of a person, from an image captured by a camera and outputs information to an electronic apparatus in order to control the electronic apparatus based on the recognized gesture, the gesture recognition device control method comprising:

a recognition target region determination step of determining whether the image includes the gesture recognition target region; and

an output step of outputting target region out-of-view angle notification instruction information issuing instruction to make a notification that an image of the gesture recognition target region is not captured when the gesture recognition target region is determined to be not included in the image in the recognition target region determination step.

17. A non-transitory computer-readable medium storing a control program that causes a computer to control a gesture recognition device that recognizes a gesture, which is of a motion or a shape of a gesture recognition target region of a person, from an image captured by a camera and outputs information to an electronic apparatus in order to control the electronic apparatus based on the recognized gesture, the control program comprising:

a recognition target region determination step of determining whether the image includes the gesture recognition target region; and

an output step of outputting target region out-of-view angle notification instruction information issuing instruction to make a notification that an image of the gesture recognition target region is not captured when the gesture recognition target region is determined to be not included in the image in the recognition target region determination step.

18. (canceled)