Method and system for classifying image orientation

• US 20060067591A1
• Filed: 09/26/2005
• Published: 03/30/2006
• Est. Priority Date: 09/24/2004
• Status: Abandoned Application

• Current Assignee: Isys-Intelligent System Soultions, Corp.
• Original Assignee: Isys-Intelligent System Soultions, Corp.
• Inventors: Pittman, Douglas, LeFeuvre, Edythe Patricia, Hale, Rodney, Guzzwell, John
• Application Number:
  US11/234,286
• Publication Number:
  US 20060067591A1
• Time in Patent Office: Days
• US Class Current: 382/289
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 10/242 by image rotation, e.g. by 90 degrees
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation

Abstract

The invention relates to a method, system and computer program product for identifying an orientation of an image having a plurality of features. It comprises (a) defining a plurality of feature kinds, wherein each feature in the plurality of features corresponds to an associated feature kind in the plurality of feature kinds; (b) providing a feature kind classification order for ordering the plurality of feature kinds; (c) searching the image to identify a feature set in the plurality of features in the image based on the feature kind classification order, wherein the feature set comprises at least one feature and each feature in the feature set corresponds to a defining feature kind; and (d) classifying the feature set to determine the orientation of the image.

Claims

1. A method of identifying an orientation of an image having a plurality of features, the method comprising:

a) defining a plurality of feature kinds, wherein each feature in the plurality of features corresponds to an associated feature kind in the plurality of feature kinds;

b) providing a feature kind classification order for ordering the plurality of feature kinds;

c) searching the image to identify a feature set in the plurality of features in the image based on the feature kind classification order, wherein the feature set comprises at least one feature and each feature in the feature set corresponds to a defining feature kind; and

d) classifying the feature set to determine the orientation of the image.

2. The method as defined in claim 1 wherein step d) comprises classifying the image based on the defining feature kind to determine the orientation of the image.

3. The method as defined in claim 1 wherein, when the plurality of features comprises, in addition to the feature set, at least one remaining feature corresponding to at least one associated feature kind different from the defining feature kind for each feature in the feature set,

the associated defining feature kind for the feature set precedes each of the at least one associated feature kind in the feature kind classification order.

4. The method as defined in claim 3 wherein step c) comprises searching the image for each feature kind in the plurality of feature kinds based on the feature kind classification order until the feature set is identified and then ceasing searching.

5. The method as defined in claim 3 wherein step c) comprises i) searching the image to identify the plurality of features in the image, and then ii) determining the feature set in the plurality of features based on the feature kind classification order.

6. The method as defined in claim 3 further comprising providing a plurality of feature templates corresponding to the plurality of feature kinds in the image, wherein step d) comprises classifying the image based on a feature template in the plurality of feature templates corresponding to the feature set.

7. The method as defined in claim 6 wherein, for each feature kind in the plurality of feature kinds, the corresponding feature template comprises a plurality of feature records at a plurality of stored orientations, each feature record corresponding to a stored orientation.

8. The method as defined in claim 7 wherein step d) comprises

classifying the image to determine the orientation of the image by comparing the image to the plurality of feature records in the corresponding feature template to determine a closest feature record in the plurality of feature records;

and,

determining the orientation of the image to be a stored orientation for a closest feature record.

9. The method as defined in claim 1 wherein step c) comprises resizing the image before searching the image to identify the feature set.

10. The method as defined in claim 1 wherein the plurality of feature kinds comprises at least two of i) a sky kind, ii) a flash kind, iii) an eye kind, iv) an upper face kind and v) a line kind.

11. A system for identifying an orientation of an image having a plurality of features, the system comprising:

a memory for storing (i) the image; and

(ii) a plurality of feature kinds, wherein each feature in the plurality of features corresponds to an associated feature kind in the plurality of feature kinds;

means for performing the steps of

a) accessing a feature kind classification order for ordering the plurality of feature kinds;

b) searching the image to identify a feature set in the plurality of features in the image based on the feature kind classification order, wherein the feature set comprises at least one feature and each feature in the feature set corresponds to a defining feature kind; and

c) classifying the feature set to determine the orientation of the image.

12. The system as defined in claim 11 wherein step c) comprises classifying the image based on the defining feature kind to determine the orientation of the image.

13. The system as defined in claim 11, wherein, when the plurality of features comprises, in addition to the feature set, at least one remaining feature corresponding to at least one associated feature kind different from the defining feature kind for each feature in the feature set,

the associated defining feature kind for the feature set precedes each of the at least one associated feature kind in the feature kind classification order.

14. The system as defined in claim 13 wherein step b) comprises searching the image for each feature kind in the plurality of feature kinds based on the feature kind classification order until the feature set is identified and then ceasing searching.

15. The system as defined in claim 13 wherein step b) comprises i) searching the image to identify the plurality of features in the image, and then ii) determining the feature set in the plurality of features based on the feature kind classification order.

16. The system as defined in claim 13 further comprising providing a plurality of feature templates corresponding to the plurality of feature kinds in the image stored on the memory, wherein step c) comprises classifying the image based on a feature template in the plurality of feature templates corresponding to the feature set.

17. The system as defined in claim 16 wherein, for each feature kind in the plurality of feature kinds, the corresponding feature template comprises a plurality of feature records at a plurality of stored orientations, each feature record corresponding to a stored orientation.

18. The system as defined in claim 17 wherein step c) comprises

classifying the image to determine the orientation of the image by comparing the image to the plurality of feature records in the corresponding feature template to determine a closest feature record in the plurality of feature records;

and,

determining the orientation of the image to be a stored orientation for a closest feature record.

19. The system as defined in claim 11 wherein step b) comprises resizing the image before searching the image to identify the feature set.

20. The system as defined in claim 11 wherein the plurality of feature kinds comprises at least two of i) a sky kind, ii) a flash kind, iii) an eye kind, iv) an upper face kind and v) a line kind.

21. The system as defined in claim 11, further comprising

a display for displaying one or more images;

and

input means for selecting an image for which an orientation is identified.

22. A computer program product for use on a computer system for identifying an orientation of an image having a plurality of features, the computer program product comprising:

a recording medium for recording (i) a plurality of feature kinds, wherein each feature in the plurality of features corresponds to an associated feature kind in the plurality of feature kinds; and

(ii) means for instructing the computer system to perform the steps of;

a) accessing a feature kind classification order for ordering the plurality of feature kinds;

b) searching the image to identify a feature set in the plurality of features in the image based on the feature kind classification order, wherein the feature set comprises at least one feature and each feature in the feature set corresponds to a defining feature kind; and

c) classifying the feature set to determine the orientation of the image.

23. The computer program product as defined in claim 22 wherein step c) comprises classifying the image based on the defining feature kind to determine the orientation of the image.

24. The computer program product as defined in claim 22, wherein, when the plurality of features comprises, in addition to the feature set, at least one remaining feature corresponding to at least one associated feature kind different from the defining feature kind for each feature in the feature set,

the associated defining feature kind for the feature set precedes each of the at least one associated feature kind in the feature kind classification order.

25. The computer program product as defined in claim 24 wherein step b) comprises searching the image for each feature kind in the plurality of feature kinds based on the feature kind classification order until the feature set is identified and then ceasing searching.

26. The computer program product as defined in claim 24 wherein step b) comprises i) searching the image to identify the plurality of features in the image, and then ii) determining the feature set in the plurality of features based on the feature kind classification order.

27. The computer program product as defined in claim 24 further comprising providing a plurality of feature templates corresponding to the plurality of feature kinds in the image, wherein step c) comprises classifying the image based on a feature template in the plurality of feature templates corresponding to the feature set.

28. The computer program product as defined in claim 27 wherein, for each feature kind in the plurality of feature kinds, the corresponding feature template comprises a plurality of feature records at a plurality of stored orientations, each feature record corresponding to a stored orientation.

29. The computer program product as defined in claim 28 wherein step c) comprises

classifying the image to determine the orientation of the image by comparing the image to the plurality of feature records in the corresponding feature template to determine a closest feature record in the plurality of feature records;

and,

determining the orientation of the image to be a stored orientation for a closest feature record.

30. The computer program product as defined in claim 22 wherein step b) comprises resizing the image before searching the image to identify the feature set.

31. The computer program product as defined in claim 22 wherein the plurality of feature kinds comprises at least two of i) a sky kind, ii) a flash kind, iii) an eye kind, iv) an upper face kind and v) a line kind.