Image recognition apparatus, image recognition processing method, and image recognition program

• US 7,340,079 B2
• Filed: 09/12/2003
• Issued: 03/04/2008
• Est. Priority Date: 09/13/2002
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Segawa, Machiko, Goto, Hiroshi, Watanabe, Toshihiro, Murata, Makoto, Wenwu, Zhao, Ihara, Keigo
• Primary Examiner(s): Carter, Aaron W
• Application Number:
  US10/660,641
• Publication Number:
  US 20040109587A1
• Time in Patent Office: 1,635 Days
• Field of Search: 382115-127, 382/181, 340/5.1, 340/5.2, 340/5.52, 340/5.53, 902/3, 713/186
• US Class Current: 382/118
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06V 30/242 Division of the character sequences into groups prior to recognition; Selection of dictionaries
• CPC Class Codes: G06V 40/172 Classification, e.g. identification

Abstract

An image recognition apparatus, method and program capable of discriminatively recognizing an object at an enhanced recognition rate despite an increase in the total number of reference images registered in image databases. When any individual person or public corporation for example is to be specified from the object image obtained by shooting the person or the like, one image database of the attribute corresponding to various situations, or familiarity to the object image is selected automatically, and then the person or corporation is specified from the shot image while referring to the reference images stored in the image database of the selected attribute. Therefore, even if the sum of the reference images is increased, since they are subdivided and classified corresponding to the attributes, the number of the reference images for each attribute can be reduced, and further the image database of the optimal attribute can be selected automatically in conformity to the situation of recognition such as date, time and so on. Thus, the number of the reference images can be minimized without the user'"'"'s intentional manipulation, and the reference images are narrowed down due to the additional information of the situation.

Claims

1. An image recognition apparatus comprising:

shooting means for shooting an object image to be discriminatively recognized and identified;

a plurality of attribute-classified image database means classified respectively in accordance with a plurality of attributes corresponding to various situations of the shooting performed by said shooting means, and storing therein at least one reference image classified by the attributes and also storing recognition ID attached uniquely to the at least one reference image respectively;

selection means for selecting, from the plurality of attribute-classified image database means, one image database means of the attribute corresponding to a face recognition presently recognized; and

object specifying means for specifying the recognition ID, which corresponds to the object image shot by said shooting means, with reference to the at least one reference image stored in the attribute-classified image database means selected by said selection means.

2. The image recognition apparatus according to claim 1, further comprising:

date-and-time count means for counting a present date and time;

wherein said attribute-classified image database means are classified by attributes depending on a time shot by said shooting means; and

wherein said selection means automatically selects, on a basis of the present date and time counted by said date-and-time count means, one attribute-classified image database means corresponding to the present date and time from said plurality of attribute-classified image database means.

3. The image recognition apparatus according to claim 1, further comprising:

position measuring means for measuring a present position, of an object,

wherein said attribute-classified image database means are classified by attributes depending on a position shot by said shooting means; and

said selection means automatically selects, on a basis of the present position measured by said position measuring means, one attribute-classified image database means corresponding to the present position from said plurality of attribute-classified image database means.

4. The image recognition apparatus according to claim 1, further comprising:

date-and-time count means for counting a present date and time, and

position measuring means for measuring a present position of an object;

wherein said attribute-classified image database means are classified by attributes depending on the time and the position shot by said shooting means; and

said selection means automatically selects, on a basis of the present date and time counted by said date-and-time count means and also the present position measured by said position measuring means, one attribute-classified image database means corresponding to the present date and time and the present position from said plurality of attribute-classified image database means.

5. The image recognition apparatus according to claim 1, further comprising:

estimation means for estimating familiarity to the object image on a basis of an occupancy area ratio of the object image to an entire region shot by said shooting means, or on a basis of a number of times of specifying the object image by said object specifying means in the past, or on a basis of a combination of said occupancy area ratio and said number of times;

wherein said attribute-classified image database means are classified by attributes depending on a familiarity to the object image estimated by said estimation means; and

said selection means automatically selects, on a basis of the familiarity estimated by said estimation means, one attribute-classified image database means corresponding to the familiarity to the object image shot by said shooting means at present, from said plurality of attribute-classified image database means.

6. The image recognition apparatus according to claim 5, further comprising:

date-and-time count means for counting a present date and time,

wherein said attribute-classified image database means are classified by attributes depending on a familiarity to the object image estimated by said estimation means, and also by attributes depending on a time shot by said shooting means; and

said selection means automatically selects, on a basis of the familiarity estimated by said estimation means and the present date and time counted by said date-and-time count means, one attribute-classified image database means corresponding to the familiarity to the object image shot by said shooting means at present and also corresponding to the present date and time, from said plurality of attribute-classified image database means.

7. The image recognition apparatus according to claim 5, further comprising:

position measuring means for measuring a present position of an object,

wherein said attribute-classified image database means are classified by attributes depending on a familiarity to the object image estimated by said estimation means, and also by attributes depending on a position shot by said shooting means;

and said selection means automatically selects, on a basis of the familiarity estimated by said estimation means and the present position measured by said position measuring means, one attribute-classified image database means corresponding to the familiarity to the object image shot by said shooting means at present and also corresponding to the present position, from said plurality of attribute-classified image database means.

8. The image recognition apparatus according to claim 5, further comprising:

date-and-time count means for counting a present date and time, and

position measuring means for measuring a present position of an object;

wherein said attribute-classified image database means are classified by attributes depending on a familiarity to the object image estimated by said estimation means, and also by attributes depending on the time and the position shot by said shooting means; and

said selection means automatically selects, on a basis of the familiarity estimated by said estimation means, the present date and time counted by said date-and-time count means, and also the present position measured by said position measuring means, one attribute-classified image database means corresponding to the familiarity to the object image shot by said shooting means at present, the present date and time, and also corresponding to the present position, from said plurality of attribute-classified image database means.

9. An image recognition processing method comprising:

a selection step of selecting one attribute-classified image database corresponding to a present situation from a plurality of attribute-classified image databases classified respectively in accordance with a plurality of attributes corresponding to various situations of a shooting performed by a shooting means in respect of an object image to be discriminatively recognized and identified, and storing therein at least one reference image classified by the at least one attribute and also storing recognition ID attached uniquely to the at least one reference image respectively; and

an object specifying step of specifying the recognition ID, which corresponds to the object image shot by said shooting means, with reference to the at least one reference image stored in the attribute-classified image database selected at said selection step.

10. The image recognition processing method according to claim 9, further comprising:

a date-and-time count step of counting a present date and time;

wherein said attribute-classified image databases are classified by attributes depending on a time shot by said shooting means; and

at said selection step, one attribute-classified image database corresponding to the present date and time is selected automatically from said plurality of attribute-classified image databases on a basis of the present date and time counted at said date-and-time count step.

11. The image recognition processing method according to claim 9, further comprising:

a position measuring step of measuring a present position of an object,

wherein said attribute-classified image databases are classified by attributes depending on a position shot by said shooting means; and

at said selection step, one attribute-classified image database corresponding to the present position is selected automatically from said plurality of attribute-classified image databases on a basis of the present position measured at said position measuring step.

12. The image recognition processing method according to claim 9, further comprising:

a date-and-time count step of counting a present date and time, and a position measuring step of measuring a present position of an object;

wherein said attribute-classified image databases are classified by attributes depending on the time and a position shot by said shooting means; and

at said selection step, one attribute-classified image database corresponding to the present date and time and the present position is selected automatically from said plurality of attribute-classified image databases on a basis of the present date and time counted by said date-and-time count step and also the present position measured by said position measuring step.

13. The image recognition processing method according to claim 9, further comprising:

an estimation step of estimating familiarity to the object image on a basis of a occupancy area ratio of the object image to an entire region shot by said shooting means, or on a basis of a number of times of specifying the object image at said object specifying step in the past, or on a basis of a combination of said occupancy area ratio and said number of times;

wherein said attribute-classified image databases are classified by attributes depending on the familiarity to the object image estimated at said estimation step; and

at said selection step, one attribute-classified image database corresponding to the familiarity to the object image shot by said shooting means at present is selected automatically from said plurality of attribute-classified image databases on a basis of the familiarity estimated by said estimation means.

14. The image recognition processing method according to claim 13, further comprising:

a date-and-time count step of counting a present date and time,

wherein said attribute-classified image databases are classified by attributes depending on the familiarity to the object image estimated by said estimation means, and also by attributes depending on a time shot by said shooting means; and

at said selection step, one attribute-classified image database, which corresponds to the familiarity to the object image shot by said shooting means at present and also corresponds to the present date and time, is selected automatically from said plurality of attribute-classified databases on a basis of the familiarity estimated at said estimation step and the present date and time counted at said date-and-time count step.

15. The image recognition processing method according to claim 13, further comprising:

a position measuring step of measuring a present position of an object,

wherein said attribute-classified image databases are classified by attributes depending on the familiarity to the object image estimated at by said estimation step, and also by attributes depending on the position shot by said shooting means; and

at said selection step, one attribute-classified image database, which corresponds to the familiarity to the object image shot by said shooting means at present and also corresponds to the present position, is selected automatically from said plurality of attribute-classified image databases on a basis of the familiarity estimated at said estimation step and the present position measured at said position measuring step.

16. The image recognition processing method according to claim 13, further comprising:

a date-and-time count step of counting a present date and time, and

a position measuring step of measuring the present position;

wherein said attribute-classified image databases are classified by attributes depending on the familiarity to the object image estimated by said estimation means, and also by attributes depending on a time and a position shot by said shooting means; and

at said selection step, one attribute-classified image database, which corresponds to the familiarity to the object image shot by said shooting means at present, the present date and time, and also corresponds to the present position, is selected automatically from said plurality of attribute-classified image databases on a basis of the familiarity estimated at said estimation step, the present date and time counted at said date-and-time count step, and also the present position measured at said position measuring step.

17. A computer readable medium encoded with a computer program configured to cause an information processing apparatus to execute a method, the method comprising:

a selection step of selecting one attribute-classified image database corresponding to a present situation from a plurality of attribute-classified image databases specified respectively in accordance with a plurality of attributes corresponding to various situations of a shooting performed by a shooting means in respect of an object image to be discriminatively recognized and identified, and storing therein at least one reference image classified by the attributes and also storing recognition ID attached uniquely to the at least one reference image respectively; and

an object specifying step of specifying the recognition ID, which corresponds to the object image shot by said shooting means, with reference to the at least one reference image stored in the attribute-classified image database selected at said selection step.

18. The image recognition program according to claim 17, further comprising:

a date-and-time count step of counting a present date and time;

wherein said attribute-classified image databases are classified by attributes depending on a time shot by said shooting means; and

at said selection step, one attribute-classified image database corresponding to the present date and time is selected automatically from said plurality of attribute-classified image databases on a basis of the present date and time counted at said date-and-time count step.

19. The image recognition program according to claim 17, further comprising:

a position measuring step of measuring a present position of an object,

wherein said attribute-classified image databases are classified by attributes depending on a position shot by said shooting means; and

at said selection step, one attribute-classified image database corresponding to a present position is selected automatically from said plurality of attribute-classified image databases on a basis of the present position measured at said position measuring step.

20. The image recognition program according to claim 17, further comprising:

a date-and-time count step of counting a present date and time, and a position measuring step of measuring a present position of an object;

wherein said attribute-classified image databases are classified by attributes depending on a time and a position shot by said shooting means; and

at said selection step, one attribute-classified image database corresponding to the present date and time and the present position is selected automatically from said plurality of attribute-classified image databases on a basis of the present date and time counted by said date-and-time count means and also the present position measured by said position measuring means.

21. The image recognition program according to claim 17, further comprising:

an estimation step of estimating a familiarity to the object image on a basis of an occupancy area ratio of the object image to an entire region shot by said shooting means, or on a basis of a number of times of specifying the object image at said object specifying step in the past, or on a basis of a combination of said occupancy area ratio and said number of times;

wherein said attribute-classified image databases are classified by attributes depending on the familiarity to the object image estimated at said estimation step; and

at said selection step, one attribute-classified image database corresponding to the familiarity to the object image shot by said shooting means at present is selected automatically from said plurality of attribute-classified image databases on a basis of the familiarity estimated by said estimation means.

22. The image recognition program according to claim 21, further comprising:

a date-and-time count step of counting a present date and time,

wherein said attribute-classified image databases are classified by attributes depending on the familiarity to the object image estimated by said estimation means, and also by attributes depending on a time shot by said shooting means; and

at said selection step, one attribute-classified image database, which corresponds to the familiarity to the object image shot by said shooting means at present and also corresponds to the present date and time, is selected automatically from said plurality of attribute-classified databases on a basis of the familiarity estimated at said estimation step and the present date and time counted at said date-and-time count step.

23. The image recognition program according to claim 21, further comprising:

a position measuring step of measuring a present position of an object,

wherein said attribute-classified image databases are classified by attributes depending on the familiarity to the object image estimated at by said estimation step, and also by attributes depending on the position shot by said shooting means; and

at said selection step, one attribute-classified image database, which corresponds to the familiarity to the object image shot by said shooting means at present and also corresponds to the present position, is selected automatically from said plurality of attribute-classified image databases on a basis of the familiarity estimated at said estimation step and the present position measured at said position measuring step.

24. The image recognition processing method according to claim 21, further comprising:

a date-and-time count step of counting a present date and time, and

a position measuring step of measuring a present position of an object;

wherein said attribute-classified image databases are classified by attributes depending on a familiarity to the object image estimated by said estimation means, and also by attributes depending on a time and a position shot by said shooting means; and

at said selection step, one attribute-classified image database, which corresponds to the familiarity to the object image shot by said shooting means at present, the present date and time, and also corresponds to the present position, is selected automatically from said plurality of attribute-classified image databases on a basis of the familiarity estimated at said estimation step, the present date and time counted at said date-and-time count step, and also the present position measured at said position measuring step.

25. An image recognition apparatus comprising:

an image capture device configured to capture an object image to be discriminatively recognized and identified;

a plurality of attribute-classified image storage devices configured to store classified respectively in accordance with a plurality of attributes corresponding to various situations of the image capture devices, and storing therein at least one reference image classified by the attributes and also storing recognition ID attached uniquely to the at least one reference image respectively;

a selector configured to select, from the plurality of attribute-classified image storage devices, one image storage device of the attribute corresponding to a face recognition presently recognized; and

an object specifying device configured to specify the recognition ID, which corresponds to the object image captured by said capture device, with reference to the at least one reference image stored in the attribute-classified image storage device selected by said selector.