Method and apparatus for representing a group of images

• US 7,676,085 B2
• Filed: 10/30/2007
• Issued: 03/09/2010
• Est. Priority Date: 07/04/2003
• Status: Active Grant

• Current Assignee: Rakuten Group, Inc.
• Original Assignee: Mitsubishi Denki Kabushiki Kaisha (Mitsubishi Electric Corporation)
• Inventors: Cieplinski, Leszek
• Primary Examiner(s): Alavi; Amir
• Application Number:
  US11/929,207
• Publication Number:
  US 20080069455A1
• Time in Patent Office: 861 Days
• Field of Search: 382/162, 382/164, 382/165, 382/167, 382/168, 382/172, 382/173, 382/190, 382/218, 382/219, 382/254, 382/272, 382/305, 358/515, 358/518, 707/6, 345/549, 345/589, 345/591, 345600-604, 345/619
• US Class Current: 382/167
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/7328 Query by example, e.g. a complete video frame or video sequence graphical querying G06F16/7335
• CPC Class Codes: G06F 16/785 using colour or luminescence
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 10/56 relating to colour

Abstract

A method of representing a group of images comprises determining the values of one or more dominant colors for the group of images and deriving a dominant color representation expressing the group of images in terms of one or more of said dominant color values.

Claims

1. A method of representing a group of images using at least one processor to process signals corresponding to the images, the method comprising:

obtaining, using a processor, an image descriptor which is an image dominant colour representation for each image in the group of images, the image descriptors expressing the images in terms of one or more dominant colour values, and where each of the image descriptors has one or more components including at least one dominant colour value, and optionally for each dominant colour value, a variance indicating colour distribution variance of the image with respect to the dominant colour value, a weight indicating the influence of the dominant colour in the image, the number of dominant colours in the image, and spatial homogeneity of pixels corresponding to the dominant colors in the image;

deriving, using a processor, a group descriptor which is a group dominant colour representation expressing the group of images in terms of one or more of said dominant colour values by aggregating a plurality of said image descriptors by combining, in a first stage, components for which the distance between the respective image dominant colours satisfies a predetermined condition, and combining other components in a second stage; and

storing the group descriptor as a descriptor for the group of images,

wherein said first stage comprises a first iteration of merging dominant colour values, and said second stage comprises at least one further iteration of merging dominant colour values, thereby successively reducing the number of dominant colour values.

2. A method as claimed in claim 1 where the group dominant colour representation has one or more components including at least one dominant colour value of the combined or selected image, and optionally for each dominant colour value, a variance indicating colour distribution variance with respect to the dominant colour value, a weight indicating the influence of the dominant colour in the combined or selected image, the number of dominant colours, and spatial homogeneity of pixels corresponding to the dominant colors in the combined or selected image.

3. A method as claimed in claim 1 involving temporally or spatially subsampling the group of images.

4. A method as claimed in claim 3 wherein images are omitted or included depending on their similarity to other images in the group.

5. An apparatus comprising:

an image database storing images or groups of images;

a descriptor database storing descriptors for the images or groups of images in the image database; and

a processor configured to perform the method as claimed in claim 1.

6. A computer-readable storage medium storing computer-executable process steps for implementing a method as claimed in claim 1.

7. A computer system comprising:

an image database storing images or groups of images;

a descriptor database storing descriptors for the images or groups of images in the image database; and

a control unit programmed to perform the method as claimed in claim 1.