METHOD AND APPARATUS FOR REPRESENTING A GROUP OF IMAGES

• US 20080118146A1
• Filed: 10/30/2007
• Published: 05/22/2008
• Est. Priority Date: 07/04/2003
• Status: Active Grant

• Current Assignee: Rakuten Group, Inc.
• Original Assignee: Leszek Cieplinski
• Inventors: CIEPLINSKI, Leszek
• Granted Patent: US 7,715,621 B2
• Time in Patent Office: Days
• US Class Current: 382/165
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/7328 Query by example, e.g. a complete video frame or video sequence graphical querying G06F16/7335
• CPC Class Codes: G06F 16/785 using colour or luminescence
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 10/56 relating to colour

Abstract

A method of representing a group of images comprises determining the values of one or more dominant colours for the group of images and deriving a dominant colour representation expressing the group of images in terms of one or more of said dominant colour values.

Claims

1. A method of representing a group of images, the method comprising determining the values of one or more dominant colours for the group of images and deriving a dominant colour representation expressing the group of images in terms of one or more of said dominant colour values, wherein at least some of the images in the group of images are represented by a respective dominant colour representation in terms of one or more dominant colour values for the image, where each of the dominant colour representations has one or more components including at least one dominant colour value, and a variance indicating colour distribution variance of the image with respect to the dominant colour value, the method comprising combining a plurality of said dominant colour representations or selecting one of the dominant colour representations as representative of the group.

2. A method of claim 1 where the components of the dominant colour representations comprise one or more of a weight indicating the influence of the dominant colour in the image, the number of dominant colours in the image, and spatial homogeneity of pixels corresponding to the dominant colors in the image.

3. A method as claimed in claim 1 comprising combining one or more components of the representations based on proximity of dominant colours in colour space.

4. A method as claimed in claim 3 wherein one or more of the dominant colour values, variances and weights are combined.

5. A method as claimed in claim 4 wherein the combining involves calculating a weighted average of the dominant colour values, variances and weights.

6. A method as claimed in claim 3 comprising combining, in a first stage, components for which the distance between the respective dominant colours satisfies a predetermined condition such as being less than a predetermined threshold, and combining other components in a second stage.

7. A method as claimed in claim 1, the method comprising combining a plurality of images in the image/pixel or colour space/histogram domain or selecting one of the group of images as representative of the group, and determining the values of one or more dominant colours in the combined or selected image, to derive a dominant colour representation of the group of images in terms of one or more dominant colour values of the combined or selected image.

8. A method as claimed in claim 7 where the dominant colour representation has one or more components including at least one dominant colour value of the combined or selected image, and optionally for each dominant colour value, a variance indicating colour distribution variance with respect to the dominant colour value, a weight indicating the influence of the dominant colour in the combined or selected image, the number of dominant colours, and spatial homogeneity of pixels corresponding to the dominant colors in the combined or selected image.

9. A method as claimed in claim 7, wherein the step of combining the images involves calculating a sum, average, median or intersection of a plurality of images.

10. A method as claimed in claim 1 involving temporally or spatially subsampling the group of images.

11. A method as claimed in claim 10 wherein images are omitted or included depending on their similarity to other images in the group.

12. A method as claimed in claim 10 wherein the sub-sampling involves the steps of claim 4.

13. A method as claimed in claim 1 wherein the selection of the representative image or dominant colour representation involves a comparison or test involving at least one other image or representation in the group.

14. A method as claimed in claim 13, wherein the image or representation that is closest to all other images or representation in or for the group is selected.

15. A descriptor for a group of images derived by a method according to claim 1.

16. A method of searching for a group of images, the method comprising comparing a query dominant colour descriptor with a plurality of descriptors according to claim 15 using a matching procedure, and selecting one or more group of images for which the matching procedure indicates the closest match or matches.

17. An apparatus adapted to implement a method according to claim 1 or claim 16.

18. A computer-readable storage medium storing computer-executable process steps for implementing a method as claimed in claim 1 or claim 16.

19. A computer system programmed to operate according to a method as claimed in claim 1 or claim 16.