INTERFACE APPARATUS, GESTURE RECOGNITION METHOD, AND GESTURE RECOGNITION PROGRAM

• US 20110262006A1
• Filed: 04/14/2011
• Published: 10/27/2011
• Est. Priority Date: 04/26/2010
• Status: Abandoned Application

• Current Assignee: Renesas Electronics Corporation
• Original Assignee: Renesas Electronics Corporation
• Inventors: NAKANO, Masataka
• Application Number:
  US13/086,789
• Publication Number:
  US 20110262006A1
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00

Abstract

An interface apparatus is configured to output an operation signal to a target apparatus operated in accordance with a gesture command. In the interface apparatus, a reference object detection unit detects a reference object having a feature similar to a predetermined reference feature value from an image captured by an image capture unit and generates reference information identifying the reference object. Based on the reference information, an operating object identifying unit identifies as the operating object a feature object included in the image and satisfying a predetermined identification condition in terms of a relative relationship with the reference object and extracts operating object information identifying the operating object. An operation signal generation unit starts detecting the gesture command according to a change in position of the identified operating object and generates the operation signal corresponding to the gesture command.

Claims

1. An interface apparatus configured to output an operation signal to a target apparatus operated in accordance with a gesture command, the interface apparatus comprising:

a reference object detection unit configured to detect a reference object having a feature similar to a predetermined reference feature value from an image taken by an image pickup unit and generate reference information identifying the reference object;

an operating object identifying unit configured to, based on the reference information, identify as the operating object a feature object included in the image and satisfying a predetermined identification condition in terms of a relative relationship with the reference object and extract operating object information identifying the operating object; and

an operation signal generation unit configured to start detecting the gesture command according to a change in position of the identified operating object and generate the operation signal corresponding to the gesture command.

2. The interface apparatus according to claim 1, wherein the operation signal generation unit registers the operating object information, extracts position information associated with the operating object from the image based on the operating object information, generates or updates position history information based on the extracted position information, and generates the operation signal based on the position history information.

3. The interface apparatus according to claim 1, wherein when the operating object satisfies a predetermined cancelation condition, the operation signal generation unit cancels the registration of the operating object.

4. The interface apparatus according to claim 1, wherein reference objects are a plurality of candidates who can be an operator,

wherein the reference feature values include a plurality of reference feature values associated with features of the respective candidates,

wherein the operating object identifying unit notifies the operation signal generation unit of the reference feature value of the reference object based on which the operating object is identified together with the operating object information associated with the operating object, and

wherein the operation signal generation unit outputs the reference feature value together with the reference feature value notified from the operation signal generation unit.

5. The interface apparatus according to claim 1, further comprising:

a frame memory configured to store the image on a frame-by-frame basis;

a position history information storage unit configured to store the position history information; and

an operating object information storage unit configured to store the operating object information,

wherein the reference object detection unit detects the reference object based on the image stored in the frame memory,

wherein the operating object identifying unit identifies the operating object and extracts the operating object information associated with the operating object based on a plurality of images at temporally different previous/following positions stored in the frame memory, and

wherein the operation signal generation unit updates the position history information based on the operating object information for each frame and generates the operation signal based on the position history information.

6. The interface apparatus according to claim 1, wherein the reference object detection unit and the operating object identifying unit respectively extract the reference information and the operating object information based on color information in the image.

7. The interface apparatus according to claim 1, wherein the operating object identifying unit identifies a feature object candidate that covers at least a part of the reference object as the operating object.

8. The interface apparatus according to claim 1, wherein the operating object identifying unit extracts at least one or more feature object candidates as candidates for the operating object from the image based on a predetermined candidate value associated with the operating object, and the operating object identifying unit identifies one of the feature object candidates as the operating object if the one of the feature object candidates satisfies the identification condition in terms of the positional relationship with the reference object.

9. The interface apparatus according to claim 7, wherein the operating object identifying unit ultimately identifies one of the feature object candidates as the operating object if the one of the feature object candidates satisfies a predetermined condition in terms of a change in position.

10. The interface apparatus according to claim 1, wherein the reference object is a face of a person and the operating object is a hand of the person.

11. The interface apparatus according to claim 1 provided in a target apparatus including the target apparatus control unit and a display unit configured to display a user interface image under the control of the target apparatus control unit.

12. A gesture recognition method in an interface apparatus configured to output an operation signal to a target apparatus operated in accordance with a gesture command, the method comprising:

detecting a reference object having a feature similar to a predetermined reference feature value from an image taken by an image pickup unit and generating reference information identifying the reference object;

based on the image and the reference information, identifying a feature object satisfying a predetermined identification condition in terms of a relative relationship with the reference object as an operating object;

extracting operating object information identifying the operating object;

starting detecting the gesture command based on a change in position of the identified operating object; and

generating the operation signal according to the gesture command.

13. A computer readable medium storing a gesture recognition program executable by an operation circuit configured to generate an operation signal to give an operation command to a target apparatus operated in accordance with a gesture command recognized based on an image taken by an image pickup unit, the program causing the operation circuit to execute a process comprising:

detecting a reference object having a feature similar to a predetermined reference feature value from the image captured by the image capture unit and generating reference information identifying the reference object;

based on the image and the reference information, identifying a feature object satisfying a predetermined identification condition in terms of a relative relationship with the reference object as an operating object;

extracting operating object information identifying the operating object; and

detecting the gesture command based on a change in position of the identified operating object,

the program causing the operation circuit to output the operation signal according to the gesture command.