Method and system for automated grouping of images

• US 20030059107A1
• Filed: 09/04/2001
• Published: 03/27/2003
• Est. Priority Date: 09/04/2001
• Status: Active Grant

• Current Assignee: Monument Peak Ventures, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: Eastman Kodak Company
• Inventors: Loui, Alexander C., Sun, Zhaohui
• Granted Patent: US 6,993,180 B2
• Time in Patent Office: Days
• US Class Current: 382/165
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

A method of automated content-based grouping of digital images without using auxiliary metadata and training data set, comprises the steps of computing a color correlogram from image pixel values for each of the digital images, grouping the color correlograms into groups within a hierarchical structure based on relative similarities of the color correlograms, and assigning the images to the groups based on the hierarchical structure of the color correlograms.

Claims

1. A method of automated grouping of digital images, comprising the steps of:

a) computing a color correlogram from image pixel values for each of the digital images;

b) grouping the color correlograms into groups within a hierarchical structure based on relative similarities of the color correlograms; and

c) assigning the images to the groups based on the hierarchical structure of the color correlograms.

2. The method claimed in claim 1, wherein the step of grouping the color correlograms comprises the steps of:

i) determining a relative distance between each pair of correlograms;

ii) merging the pair of correlograms with the smallest relative distance into a merged group;

iii) forming a correlogram representing the merged group; and

iv) repeating the steps of determining, merging and forming until a predetermined criterion is met.

3. The method claimed in claim 2, wherein the predetermined criterion is a specified number of groups.

4. The method claimed in claim 2, wherein the predetermined criterion is a relative distance between correlograms.

5. The method claimed in claim 2, wherein the predetermined criterion is that no group represents a single image.

6. The method claimed in claim 1, further comprising the step of low pass filtering and downsizing the digital images prior to the step of computing the color correlograms.

7. The method claimed in claim 1, further comprising the step of inspecting the hierarchical structure and manually effecting one or more operations on the groups.

8. The method claimed in claim 7, wherein the operations manually effected on the groups include one or more of adjusting membership of the groups, manually merging one or more of the groups, deleting one or more of the groups and assigning the images to another group, or manually creating one or more new groups.

9. The method claimed in claim 1, further comprising the step of browsing the images using the hierarchical structure.

10. The method claimed in claim 2, further comprising the step of determining the relative distance between one or more temporally adjacent pairs of correlograms if data identifying a temporal order of the images is also available.

11. The method claimed in claim 2, further comprising the step of determining the relative distance between one or more temporally adjacent pairs of correlograms if data identifying date and time of image capture is also available.

12. The method claimed in claim 2, wherein the color correlogram of a composite image obtained by merging groups of images together is computed from the corresponding color correlograms of the merged images without processing the image pixel values themselves.

13. The method claimed in claim 1, wherein the step of grouping the color correlograms into a hierarchical structure includes making adjustments on the image groups, such as adding a new group, removing an existing group, or changing image membership, which adjustments are carried out by manipulating the corresponding image color correlogram without referring back to the image pixel values or any other form of image content.

14. A method of operating on a pair of images comprising the steps of computing a color correlogram from image pixels for each of the digital images, merging the pair of correlograms and forming a correlogram representing the merged pair, whereby a composite image representation is obtained from the corresponding color correlograms of the merged images without processing the image pixel values themselves.

15. A computer program product for automatically grouping a plurality of digital images comprising:

a computer readable storage medium having a computer program stored thereon for performing the steps of;

a) computing a color correlogram from image pixel values for each of the digital images;

b) grouping the color correlograms into groups within a hierarchical structure based on relative similarities of the color correlograms; and

c) assigning the images to the groups based on the hierarchical structure of the color correlograms.

16. The computer program product claimed in claim 15, wherein the step of grouping the color correlograms comprises the steps of:

i) determining a relative distance between each pair of correlograms;

ii) merging the pair of correlograms with the smallest relative distance into a merged group;

iii) forming a correlogram representing the merged group; and

iv) repeating the steps of determining, merging and forming until a predetermined criterion is met.

17. The computer program product claimed in claim 15, further comprising the step of low pass filtering and downsizing the digital images prior to the step of computing the color correlograms.

18. The computer program product claimed in claim 16, further comprising the step of determining the relative distance between one or more temporally adjacent pairs of correlograms if data identifying a temporal order of the images is also available.

19. The computer program product claimed in claim 16, further comprising the step of determining the relative distance between one or more temporally adjacent pairs of correlograms if data identifying date and time of image capture is also available.

20. A system for automatically grouping a plurality of digital images comprising:

an input module for accessing a collection of unorganized digital images; and

a digital processor including a computation module for computing a color correlogram from image pixel values for each of the digital images, a grouping module for grouping the color correlograms into groups within a hierarchical structure based on relative similarities of the color correlograms, and an assignment module for assigning the images to the groups based on the hierarchical structure of the color correlograms.

21. The system claimed in claim 20, wherein the grouping module comprises:

means for determining a relative distance between each pair of correlograms;

means for merging the pair of correlograms with the smallest relative distance into a merged group;

means for forming a correlogram representing the merged group; and

means for repeating the preceding means for determining, merging and forming until a predetermined criterion is met.

22. The system claimed in claim 21, wherein the predetermined criterion is a specified number of groups, a relative distance between correlograms, or that no group represents a single image.

23. The system claimed in claim 20, further comprising a module for low pass filtering and downsizing the digital images prior to the step of computing the color correlograms.

24. The system claimed in claim 20, further comprising a user interface for inspecting the hierarchical structure and manually effecting one or more manual operations on the groups.