Image recognition apparatus and its method

• US 20070053590A1
• Filed: 08/16/2006
• Published: 03/08/2007
• Est. Priority Date: 09/05/2005
• Status: Abandoned Application

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Kozakaya, Tatsuo
• Application Number:
  US11/504,597
• Publication Number:
  US 20070053590A1
• Time in Patent Office: Days
• US Class Current: 382/181
• CPC Class Codes: G06V 10/32 Normalisation of the pattern dimensions
• CPC Class Codes: G06V 10/76 based on eigen-space representations, e.g. from pose or different illumination conditions; Shape manifolds
• CPC Class Codes: G06V 40/172 Classification, e.g. identification

Abstract

An image recognition method or apparatus, the method comprising: inputting an image containing an object to be recognized; creating an input subspace from the inputted image; storing a model subspace to represent three-dimensional object models respectively for different environments; projectively transforming the input subspace in a manner to suppress an element common between the input subspace and the model subspace and thereby suppress influence due to environmental variation, into an environment-suppressing subspace; storing dictionary subspaces relating to registered objects; calculating a similarity between the environment-suppressing subspace and the dictionary subspace; and identifying the object to be recognized as one of the registered objects corresponding to the dictionary subspace having similarity exceeding a threshold.

Claims

1. An image recognition apparatus comprising:

an image input unit configured to input an image containing an object to be recognized;

an input subspace creation unit configured to create an input subspace from the input image;

an environment dictionary configured to store a model subspace to represent three-dimensional recognition object models under plural different environmental conditions;

an environment transformation unit configured to perform a projective transformation of the input subspace to suppress an element common between the input subspace and the model subspace and to obtain an environment suppression subspace in which an influence due to an environmental variation is suppressed;

a registration dictionary configured to store dictionary subspaces relating to registered objects;

a similarity calculation unit configured to calculate a similarity between the environment suppression subspace or a secondary environment-suppressing subspace derived therefrom and the dictionary subspace; and

a recognition unit configured to identify the object to be recognized as one of the registered object corresponding to the dictionary subspace having a similarity exceeding a threshold.

2. The apparatus according to claim 1, further comprising a dictionary transformation unit configured to perform a projective transformation of the environment suppression subspace to suppress an element common among the dictionary subspaces and to obtain the secondary environment-suppressing subspace in which a difference between the registered objects is exaggerated.

3. The apparatus according to claim 1, the input subspace creation unit comprising a feature point detection unit configured to extract a feature point of the object from the input image,

wherein the input subspace creation unit configured to create the input subspace from the feature point.

4. The apparatus according to claim 1, wherein the plural environmental conditions are related to variation of illumination and/or aging or time-wise change of the object.

5. The apparatus according to claim 1, wherein the similarity calculation unit employs an angle between the environment suppression subspace and the dictionary subspace as the similarity.

6. The apparatus according to claim 1, further comprising an environment perturbation unit configured to impart an environmental variation to the input image for creation of the input subspace and also to an image for creation of the dictionary subspace.

7. The apparatus according to claim 1, wherein the dictionary transformation unit obtains a projection matrix to enlarge a difference between the dictionary subspaces, uses this projection matrix to perform a projective transformation of the environment suppression subspace and obtains the secondary environment-suppressing subspace.

8. An image recognition method comprising:

inputting an image containing an object to be recognized;

creating an input subspace from the inputted image;

storing a model subspace to represent three-dimensional object models respectively for different environments;

projectively transforming the input subspace in a manner to suppress an element common between the input subspace and the model subspace and thereby suppress influence due to environmental variation, into an environment-suppressing subspace;

storing dictionary subspaces relating to registered objects;

calculating a similarity between the environment-suppressing subspace or a secondary environment-suppressing subspace derived therefrom and the dictionary subspace; and

identifying the object to be recognized as one of the registered objects corresponding to the dictionary subspace having similarity exceeding a threshold.

9. The method according to claim 8, further comprising:

projectively transforming the environment-suppressing subspace, in a manner to suppress an element common among the dictionary subspaces and thereby exaggerate difference among the registered objects, into a secondary environment-suppressing subspace, which is then used in said calculating of the similarity.

10. The method according to claim 8, said creating of the input subspace comprising:

extracting a feature point of the object from the inputted image, and creating the input subspace from the feature point.

11. The method according to claim 8, wherein the different environments are related to variation of illumination and/or aging or time-wise change of the object.

12. The method according to claim 8, wherein an angle between the environment-suppressing subspace and the dictionary subspace is taken as the similarity.

13. The method according to claim 8, wherein an environmental variation is imparted to the inputted image for creation of the input subspace and also to an image for creation of the dictionary subspace.

14. The method according to claim 8, further comprising;

obtaining a projection matrix enlarging a difference between the dictionary subspaces; and

projectively transforming the environment-suppressing subspace into the secondary environment-suppressing subspace by use of the projection matrix.

15. A program product for realizing image recognition by a computer, the program product comprising instructions of:

inputting an image containing an object to be recognized;

creating an input subspace from the inputted image;

storing a model subspace to represent three-dimensional object models respectively for different environments;

projectively transforming the input subspace in a manner to suppress an element common between the input subspace and the model subspace and thereby suppress influence due to environmental variation, into an environment-suppressing subspace;

calculating a similarity between the environment-suppressing subspace or a secondary environment-suppressing subspace derived therefrom and the dictionary subspace; and

identifying the object to be recognized as one of the registered objects corresponding to the dictionary subspace having similarity exceeding a threshold.

16. The program product according to claim 15, further comprising instruction of:

projectively transforming the environment-suppressing subspace, in a manner to suppress an element common among the dictionary subspaces and thereby exaggerate differences among the registered objects, into a secondary environment-suppressing subspace, which is then used in said calculating of the similarity.

17. The program product according to claim 15, said creating of the subspace comprising:

extracting a feature point of the object from the inputted image, and creating the input subspace from the feature point.

18. The image recognition program product according to claim 15, wherein the different environments are related to variation of illumination and/or aging or time-wise change of the object.

19. The image recognition program product according to claim 15, wherein an angle between the environment-suppressing subspace and the dictionary subspace is taken as the similarity.

20. The image recognition program product according to claim 15, wherein an environmental variation is imparted to the inputted image for creation of the input subspace and also to an image for creation of the dictionary subspace.

21. The image recognition program product according to claim 15, further comprising instructions of;

obtaining a projection matrix enlarging a difference between the dictionary subspaces; and

projectively transform the environment-suppressing subspace into the secondary environment-suppressing subspace by use of the projection matrix.