Method and apparatus for representing a group of images

• US 7,630,545 B2
• Filed: 06/25/2004
• Issued: 12/08/2009
• Est. Priority Date: 07/04/2003
• Status: Active Grant

• Current Assignee: Rakuten Group, Inc.
• Original Assignee: Mitsubshi Denki Kabushiki Kaisha
• Inventors: Cieplinski, Leszek
• Primary Examiner(s): Alavi; Amir
• Application Number:
  US10/875,237
• Publication Number:
  US 20050013491A1
• Time in Patent Office: 1,992 Days
• Field of Search: 382/162, 382/164, 382/165, 382/167, 382/168, 382/172, 382/173, 382218-220, 382/254, 382/272, 382/305, 382/224, 382/284, 358/515, 358/518, 358/523, 358/525, 358/530, 707/6, 345/589, 345600-604
• US Class Current: 382/167
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/7328 Query by example, e.g. a complete video frame or video sequence graphical querying G06F16/7335
• CPC Class Codes: G06F 16/785 using colour or luminescence
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 10/56 relating to colour

Abstract

A technique and system of representing a group of images, the technique includes determining the values of one or more dominant colors for the group of images and deriving a dominant color representation expressing the group of images in terms of one or more of said dominant color values. The inventive technique and system can be applied to any group of images, or image regions, including regions within image.

Claims

1. A method of representing a group of images using at least one processor to process signals corresponding to the images, the method comprising:

obtaining image dominant colour representations for each image in the group of images, the dominant colour representations expressing the images in terms of one or more of dominant colour values, and where each of the image dominant colour representations has one or more components including at least one image dominant colour value, and a variance indicating colour distribution variance of the image with respect to the dominant colour value, said variance being calculated for each image dominant colour using

${\mathrm{CV}}_j=\frac{1}{N}<br><br><br><br>\underset{k=0}{\overset{N-1}{\sum <br><br>}}<br><br><br><br>{\left(m_j-p_{\mathrm{kj}}\right)}^2$

where j indexes the color component, m_j is j-th component of the image dominant color, P_kj is j-th component of the k-th pixel value, and the summation is over N pixels corresponding to the image dominant color under consideration;

determining, using a processor, the values of one or more colours that are dominant for the group of images by combining the image dominant colour representations;

generating a group dominant colour representation for the group of images based on the combined image dominant colour representation.

2. A method of claim 1 where each of the image dominant colour representations has one or more components including optionally for each dominant colour value, a weight indicating the influence of the dominant colour in the image, the number of dominant colours in the image, and spatial homogeneity of pixels corresponding to the dominant colours in the image.

3. A method as claimed in claim 1 further comprising temporally or spatially sub-sampling the group of images.

4. A method as claimed in claim 3 wherein images are omitted or included depending on their similarity to other images in the group.

5. A descriptor for a group of images derived by a method according to claim 1.

6. A computer-readable storage medium storing computer-executable process steps for implementing a method as claimed in claim 1.

7. A computer system comprising:

an image database storing images or groups of images;

a descriptor database storing descriptors for the images or groups of images in the image database; and

a control unit programmed to perform the method as claimed in claim 1.

8. An apparatus for representing a group of images by deriving a group dominant colour representation of the group of images, wherein at least some of the images in the group of images are represented by a respective image dominant colour representation in terms of one or more dominant colour values for the image, and where each of the image dominant colour representation has one or more components including at least one image dominant colour value, and a variance indicating colour distribution variance of the image with respect to the dominant colour value calculated for each image dominant colour using

${\mathrm{CV}}_j=\frac{1}{N}$

⁢

∑

k = 0 N - 1 ⁢

⁢

( m j - p kj ) 2

where j indexes the color component, m_j is j-th component of the dominant color, P_kj is j-th component of the k-th pixel value, and the summation is over N pixels corresponding to the dominant color under consideration, the apparatus comprising a processor which derives a group dominant colour representation of the group of images by combining a plurality of said image dominant colour representations.

9. The apparatus of claim 8 further comprising a storage unit storing at least one of:

one or more groups of images, one or more image dominant colour representations, and one or more group dominant colour representations.