Method for dominant color setting of video region and data structure and method of confidence measure extraction

• US 7,760,935 B2
• Filed: 05/20/2005
• Issued: 07/20/2010
• Est. Priority Date: 01/29/1999
• Status: Expired due to Term

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Kim, Hyeon Jun
• Primary Examiner(s): Carter; Aaron W
• Application Number:
  US11/133,212
• Publication Number:
  US 20050220339A1
• Time in Patent Office: 1,887 Days
• Field of Search: 382/162, 382164-172, 382/305, 707/104.1
• US Class Current: 382/165
• CPC Class Codes: G06F 16/785 using colour or luminescence
• CPC Class Codes: G06V 10/56 relating to colour
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing

Abstract

A method for a dominant color setting of a video region and a data structure and a method of a confidence measure extraction are disclosed. The video region dominant color setting method is characterized in that a region dominant color descriptor is expressed by the number of dominant colors with respect to a certain region, a dominant color expressed, a frequency that the dominant color appears, and an accuracy of a color value representing the region in a region dominant color based on various region dominant color extraction methods, for thereby expressing a region dominant color using a plurality of colors with respect to a region dominant color value and a confidence value of a region dominant color information based on various region dominant color feature extracting methods.

Claims

1. A content-based retrieval method in a multimedia device, the method comprising:

searching in the multimedia device a specific region in a media object by using a dominant color descriptor, wherein the dominant color descriptor includes information quantifying a number of dominant colors with respect to a region of interest in visual data, information on at least one expressed dominant color, a frequency with which the dominant color appears in the region, and a coherency value which represents a concentration degree of pixels of a color with respect to the dominant color.

2. The method of claim 1, wherein the dominant color descriptor is a first dominant color descriptor formed based on one dominate color extraction method, wherein a second dominant color descriptor is further used for searching the visual data, wherein the second dominant color descriptor is formed by transforming data formed by another dominant color descriptor extraction method into a certain inherent data format in a different system based on the formalized description with respect to the extraction method of the region dominant color descriptor, and wherein the method further comprises comparing the first dominant color descriptor to the second dominant color descriptor.

3. The method of claim 1, wherein an expression accuracy of the dominant colors extracted by a certain method is obtained in accordance with a degree of confidence of the region dominant color descriptor.

4. The method of claim 1, wherein the dominant color descriptor further includes an accuracy information including or corresponding to confidence information determined based on a maximum color variation value in which the color which is recognized in accordance with an increase/decrease of the color expressed by a certain value is the same color.

5. The method of claim 1, wherein the dominant color descriptor further includes an accuracy information and when a certain color is mapped as a dominant color in an image region, color variance which is a difference between an accurate value of the color and the dominant color value is adapted to confidence information included in or corresponding to said accuracy information.

6. The method of claim 1, wherein the dominant color descriptor further includes an accuracy information, and the coherency value which is adapted to confidence information included in or corresponding to said accuracy information.

7. The method of claim 1, wherein the dominant color descriptor further includes an accuracy information and a size of the region that a dominant color covers in the image region is adapted to confidence information included in or corresponding to said accuracy information.

8. The method of claim 1, wherein the dominant color descriptor further includes an accuracy information and a position of each color pixel in the image region is adapted to confidence included in or corresponding to said accuracy information.

9. The method of claim 1, wherein the dominant color descriptor further includes an accuracy information including or corresponding to a confidence measure expressed by a vector value based on a normalized coherence average value, an average value with respect to a difference when a certain color is recognized as a dominant color, a value obtained by summing the size that the dominant color covers in all image regions, and an average value with respect to a position in a region of each color pixel.

10. The method of claim 1, wherein an interoperability between different feature extraction methods is implemented by comparing at least one confidence value expressed based on the region dominant color descriptor obtained by different region dominant color feature extraction methods with a region dominant color value.

11. The method of claim 1, wherein the dominant color descriptor further includes an accuracy information including or corresponding to a confidence measure expressed with respect to each dominant color of the region dominant color descriptor.

12. The method of claim 1, wherein the dominant color descriptor further includes an accuracy information including or corresponding to a confidence measure per each dominant color expressed by a vector that includes elements or a subset of the elements of spatial variance, color variance, the size of a region that the dominant color covers and a position of dominant color pixels in the region.

13. A method for searching visual data using dominant color in a multimedia device, the method comprising:

searching in the multimedia device a specific region of interest from a media object by using a dominant color descriptor for the region, said descriptor including;

a) information quantifying a number of dominant colors (N) selected for extraction from the region, where N≧

1;

b) information indicative of color values for the dominant colors in the region;

c) information indicative of frequencies with which the N dominant colors appear in the region; and

d) a coherency value which represents a concentration degree of pixels of a color with respect to the dominant color.

14. The method of claim 13, wherein the dominant color in b) are determined based on any one of the following extraction methods:

an average-color method;

a method of expressing only one most frequency appearing color in the region;

a method of expressing more than one most frequently appearing color in the region;

a method of determining which colors appear in the region more than a predetermined percentage of a threshold value; and

a histogram method.

15. The method of claim 13, wherein the information in c) is determined based on pixel counts for respective ones of the N colors.

16. The method of claim 13, wherein the color values in b) are defined by at least one of color space information, quantization information, color clustering information, and channel information.

17. A non-transitory computer-readable medium for searching visual data using dominant color, comprising computer-executable steps of:

searching a specific region in a media object by using a dominant color descriptor for the region, said descriptor including;

a) information quantifying a number of dominant colors (N) selected for extraction from a region of a media object, where N≧

1;

b) information indicative of color values for the dominant colors in the region;

c) information indicative of frequencies with which the N dominant colors appear in the region; and

d) a coherency value which represents a concentration degree of pixels of a color with respect to the dominant color.

18. The medium of claim 17, wherein the color values in b) are defined by at least one of color space information, quantization information, color clustering information, and channel information.