Image recognition apparatus, image recognition processing method, and image recognition program

• US 7,623,688 B2
• Filed: 11/26/2007
• Issued: 11/24/2009
• Est. Priority Date: 09/13/2002
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Goto, Hiroshi, Watanabe, Toshihiro, Wenwu, Zhao, Murata, Makoto, Ihara, Keigo, Segawa, Machiko
• Primary Examiner(s): Carter, Aaron W
• Application Number:
  US11/944,929
• Publication Number:
  US 20080085037A1
• Time in Patent Office: 729 Days
• Field of Search: 382115-127, 382/181, 340/5.1, 340/5.2, 340/5.52, 340/5.53, 340 58- 586, 902/3, 713/186
• US Class Current: 382/118
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06V 30/242 Division of the character sequences into groups prior to recognition; Selection of dictionaries
• CPC Class Codes: G06V 40/172 Classification, e.g. identification

Abstract

An image recognition apparatus, method and program capable of discriminatively recognizing an object at an enhanced recognition rate despite an increase in the total number of reference images registered in image databases. When any individual person or public corporation for example is to be specified from the object image obtained by shooting the person or the like, one image database of the attribute corresponding to various situations, or familiarity to the object image is selected automatically, and then the person or corporation is specified from the shot image while referring to the reference images stored in the image database of the selected attribute. Therefore, even if the sum of the reference images is increased, since they are subdivided and classified corresponding to the attributes, the number of the reference images for each attribute can be reduced, and further the image database of the optimal attribute can be selected automatically in conformity to the situation of recognition such as date, time and so on. Thus, the number of the reference images can be minimized without the user'"'"'s intentional manipulation, and the reference images are narrowed down due to the additional information of the situation.

Claims

1. An image processing apparatus, comprising:

a plurality of attribute-classified image database means classified in accordance with a plurality of attributes corresponding to situations of the shooting performed by shooting means for shooting an object image to be discriminatively recognized and identified, and storing therein reference images classified by the attributes and a plurality of recognition ID'"'"'s attached uniquely to the reference images;

selection means for selecting, from the plurality of attribute-classified image database means, one image database means of the attribute corresponding to the present situation of the object recognition; and

object specifying means for specifying the recognition ID, which corresponds to the object image shot by said shooting means, with reference to the reference image stored in the attribute-classified image database means selected by said selection means.

2. The image processing apparatus according to claim 1, further comprising:

date-and-time count means for counting a present date and time, wherein said attribute-classified image database means are classified by attributes depending on a time shot by said shooting means, and said selection means automatically selects, on a basis of the present date and time counted by said date-and-time count means, one attribute-classified image database means corresponding to the present date and time from said plurality of attribute-classified image database means.

3. The image processing apparatus according to claim 1, further comprising:

position measuring means for measuring a present position of an object, wherein said attribute-classified image database means are classified by attributes depending on a position shot by said shooting means, and said selection means automatically selects, on a basis of the present position measured by said position measuring means, one attribute-classified image database means corresponding to the present position from said plurality of attribute-classified image database means.

4. The image processing apparatus according to claim 1, further comprising:

date-and-time count means for counting a present date and time; and

position measuring means for measuring a present position of an object, wherein said attribute-classified image database means are classified by attributes depending on the time and the position shot by said shooting means, and said selection means automatically selects, on a basis of the present date and time counted by said date-and-time count means and also the present position measured by said position measuring means, one attribute-classified image database means corresponding to the present date and time and the present position from said plurality of attribute-classified image database means.

5. The image processing apparatus according to claim 1, further comprising:

estimation means for estimating familiarity to the object image on a basis of an occupancy area ratio of the object image to an entire region shot by said shooting means, or on a basis of a number of times of specifying the object image by said object specifying means in the past, or on a basis of a combination of said occupancy area ratio and said number of times, wherein said attribute-classified image database means are classified by attributes depending on a familiarity to the object image estimated by said estimation means, and said selection means automatically selects, on a basis of the familiarity estimated by said estimation means, one attribute-classified image database means corresponding to the familiarity to the object image shot by said shooting means at present, from said plurality of attribute-classified image database means.

6. The image processing apparatus according to claim 5, further comprising:

date-and-time count means for counting a present date and time, wherein said attribute-classified image database means are classified by attributes depending on a familiarity to the object image estimated by said estimation means, and also by attributes depending on a time shot by said shooting means, and said selection means automatically selects, on a basis of the familiarity estimated by said estimation means and the present date and time counted by said date-and-time count means, one attribute-classified image database means corresponding to the familiarity to the object image shot by said shooting means at present and also corresponding to the present date and time, from said plurality of attribute-classified image database means.

7. The image processing apparatus according to claim 5, further comprising:

position measuring means for measuring a present position of an object, wherein said attribute-classified image database means are classified by attributes depending on a familiarity to the object image estimated by said estimation means, and also by attributes depending on a position shot by said shooting means, and said selection means automatically selects, on a basis of the familiarity estimated by said estimation means and the present position measured by said position measuring means, one attribute-classified image database means corresponding to the familiarity to the object image shot by said shooting means at present and also corresponding to the present position, from said plurality of attribute-classified image database means.

8. The image processing apparatus according to claim 5, further comprising:

date-and-time count means for counting a present date and time; and

position measuring means for measuring a present position of an object, wherein said attribute-classified image database means are classified by attributes depending on a familiarity to the object image estimated by said estimation means, and also by attributes depending on the time and the position shot by said shooting means, and said selection means automatically selects, on a basis of the familiarity estimated by said estimation means, the present date and time counted by said date-and-time count means, and also the present position measured by said position measuring means, one attribute-classified image database means corresponding to the familiarity to the object image shot by said shooting means at present, the present date and time, and also corresponding to the present position, from said plurality of attribute-classified image database means.

9. An image recognition processing method of an image recognition device, comprising:

a selection step of selecting, with a selector of the image recognition device, one attribute-classified image database corresponding to a present situation from a plurality of attribute-classified image databases, said plurality of attribute-classified image databases classified in accordance with a plurality of attributes corresponding to situations of a shooting performed by a shooting means with respect to an object image to be discriminatively recognized and identified, and storing in an electronic memory at least one reference image classified by the at least one attribute, and a plurality of recognition ID'"'"'s attached to the at least one reference image; and

an object specifying step of specifying, with an object specifying device of the image recognition device, the recognition ID which corresponds to the object image shot by said shooting means, with reference to the at least one reference image stored in the attribute-classified image database selected at said selection step.

10. A computer readable medium encoded with a computer program configured to cause an information processing apparatus to execute a method, the method comprising:

a selection step of selecting one attribute-classified image database corresponding to a present situation from a plurality of attribute-classified image databases specified in accordance with a plurality of attributes corresponding to situations of a shooting performed by a shooting means in respect of an object image to be discriminatively recognized and identified, and storing therein at least one reference image classified by the attributes and a plurality of recognition ID'"'"'s attached to the at least one reference image; and

an object specifying step of specifying the recognition ID, which corresponds to the object image shot by said shooting means, with reference to the at least one reference image stored in the attribute-classified image database selected at said selection step.

11. An image processing apparatus, comprising:

an image capture device configured to capture an object image to be discriminatively recognized and identified;

a plurality of attribute-classified image storage devices configured to store classified in accordance with a plurality of attributes corresponding to situations of the image capture devices, and storing therein at least one reference image classified by the attributes and a plurality of recognition ID'"'"'s attached to the at least one reference image,

a selector configured to select, from the plurality of attribute-classified image storage devices, one image storage device of the attribute corresponding to a object recognition presently recognized; and

an object specifying device configured to specify the recognition ID, which corresponds to the object image captured by said capture device, with reference to the at least one reference image stored in the attribute-classified image storage device selected by said selector.