Method and apparatus for generating user preference data regarding color characteristic of image and method and apparatus for converting image color preference using the method and apparatus

• US 20080219548A1
• Filed: 08/22/2007
• Published: 09/11/2008
• Est. Priority Date: 12/12/2002
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Park, Du-sik, Lee, Seong-deok, Huh, Young-sik, Yoo, Ki-won, Kim, Sang-kyun, Choi, Won-hee
• Application Number:
  US11/892,400
• Publication Number:
  US 20080219548A1
• Time in Patent Office: Days
• US Class Current: 382/162
• CPC Class Codes: H04N 21/4318 by altering the content in the rendering process, e.g. blanking, blurring or masking an image region image enhancement or restoration in general G06T5/00
• CPC Class Codes: H04N 21/4854 for modifying image parameters, e.g. image brightness, contrast
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 5/57 Control of contrast or brightness
• CPC Class Codes: H04N 9/64 Circuits for processing colour signals H04N9/77 takes precedence; camera processing pipelines for processing colour signals H04N23/84
• CPC Class Codes: H04N 9/68 for controlling the amplitude of colour signals, e.g. automatic chroma control circuits H04N9/71, H04N9/73 take precedence; camera processing pipelines for controlling the colour saturation of colour signals H04N23/86
• CPC Class Codes: H04N 9/73 Colour balance circuits, e.g. white balance circuits or colour temperature control camera processing pipelines for colour balance H04N23/88

Abstract

A method and apparatus for generating user preference data regarding the color characteristic of an image and a method and apparatus for converting image color preference using the method and apparatus is provided. The method for generating user preference data comprises (a) obtaining an image color characteristic value of a preference image and a reference image, (b) generating {preference value, reference value} which corresponds to a pair of the preference value and the reference value, and (c) generating the pair {preference value, reference value} as preference meta-data having at least one feature block. The method for converting image color preference comprises calculating a color characteristic value with respect to an input image, generating preference meta-data having at least one feature block, the feature block comprising a block header including a feature identifier corresponding to information identifying a color characteristic and at least one feature descriptor including the preference value and the reference value, obtaining a color characteristic value with respect to the input image using the calculated color characteristic value of the input image and the color preference data, and converting the color characteristic of the input image so that the input image has the obtained color characteristic value.

Claims

1. A method for generating user preference data regarding a color characteristic of an image, when an image converted to have a color characteristic that a user prefers with respect to a predetermined reference image is referred to as a preference image, a color characteristic value of the preference image is referred to as a preference value and a color characteristic value of the reference image is referred to as a reference value, the method comprising:

(a) generating {preference value, reference value} which corresponds to a pair of the preference value and the reference value; and

(b) generating the pair {preference value, reference value} as preference meta-data having at least one feature block,

wherein the feature block comprises;

a block header including a feature identifier corresponding to information identifying a color characteristic; and

at least one feature descriptor including the preference value and the reference value.

2. The method of claim 1, wherein the color characteristic is at least one of color temperature, brightness, contrast, and saturation.

3. The method of claim 2, before step (a), further comprising:

providing a plurality of images having different color characteristic values with respect to a predetermined image; and

setting an image that the user has selected from the plurality of images as a preference image, setting an original image with respect to the preference image as a reference image, and generating {preference image, reference image} which corresponds to a pair of the preference image and the reference image.

4. The method of claim 2, before step (a), further comprising:

installing a unit for controlling a color characteristic of an image in an image display device; and

setting an image of which color characteristic is adjusted by a user using the unit for controlling a color characteristic, as a preference image, setting an original image of which color characteristic is not adjusted by the user, as a reference image, and generating {preference image, reference image} which corresponds to a pair of the preference image and the reference image.

5. The method of claim 3, wherein the generating {preference image, reference image} is, when the reference image has a contents identifier, generating {preference image, reference image, contents identifier} which corresponds to a combination of the preference image, the reference image, and contents identifier information.

6. The method of claim 4, wherein the generating {preference image, reference image} is, when the reference image has a contents identifier, generating {preference image, reference image, contents identifier} which corresponds to a combination of the preference image, the reference image, and contents identifier information.

7. The method of claim 2, wherein step (a) is, when the reference image has a contents identifier and when a color characteristic value of the preference image is referred to as a preference value and a color characteristic value of the reference image is referred to as a reference value, generating {preference value, reference value, contents identifier} which corresponds to a combination of the preference value, the reference value, and the contents identifier.

8. The method of claim 2, wherein a color temperature value is obtained by the following steps comprising:

extracting a highlight region from an input color image;

projecting the highlight region on a chromaticity coordinate and calculating geometric representation variables with respect to a shape distributed on the chromaticity coordinate;

estimating a color temperature from the input color image by perceptive light source estimation; and

selecting geometric representation variables around the estimated color temperature from the geometric representation variables and calculating a final color temperature using the selected geometric representation variables.

9. The method of claim 2, wherein a saturation value is obtained by the following steps comprising:

obtaining saturation of each pixel in a HSV color space from an RGB value of a pixel in the image; and

generating a value obtained by adding saturation of the pixels and dividing the added saturation by the number of pixels, as a saturation value.

10. The method of claim 9, wherein the saturation of the pixel is determined by the following steps comprising:

obtaining maximum and minimum values of the RGB value of the pixel; and

when the maximum value is equal to 0, setting the saturation of a corresponding pixel to 0, and when the maximum value is not equal to 0, setting a value obtained by dividing a difference between the maximum value and the minimum value by the maximum value, as the saturation of a corresponding pixel.

11. The method of claim 2, wherein a brightness value is determined by the following steps comprising:

obtaining luminance Y of each pixel in a YCbCr color space from an RGB value of a pixel in the image; and

generating a value obtained by adding luminance of the pixels and dividing the added luminance by the number of pixels, as a brightness value.

12. The method of claim 11, wherein the luminance Y of the pixel is determined by Y=0.299×

R+0.587×

G+0.114×

B.

13. The method of claim 2, wherein a contrast value CV is, when Yx is luminance of each pixel in the image and NumberofPixels is the number of pixels in the image, determined using equation:

$C<br><br><br><br>V=\sqrt{\frac{\left[\underset{x\in <br><br>\left(\mathrm{pixels}\right)}{\sum <br><br>}<br><br><br><br>{\left(Y_x-\mathrm{BV}\right)}^2\right]}{\mathrm{NumberOfPixels}}}$

14. The method of claim 2, wherein step (a) further comprising,

when {preference value, reference value} exists before {preference value, reference value} in step (a) is generated, comparing the pair {preference value, reference value} generated in step (a) with an existing pair {preference value, reference value} and updating the pair {preference value, reference value},

wherein the updating is, with respect to one preference value, when the reference value generated in step (a) is compared with the existing reference value and is the same as or similar to the existing reference value, removing the existing reference value.

15. The method of claim 7, wherein step (b) further comprising,

when {preference value, reference value} exists before {preference value, reference value} in step (b) is generated, comparing the pair {preference value, reference value} generated in step (b) with an existing pair {preference value, reference value} and updating the pair {preference value, reference value},

wherein the updating is, with respect to one preference value, when the reference value generated in step (b) is compared with the existing reference value and is the same as or similar to the existing reference value, removing the existing reference value.

16. The method of claim 14, wherein the updating is, when quantization levels of the two reference values are different, converting a value of high level into a value of low level and comparing with each other, and when image contents identifiers are added to the characteristic value pairs, even though the two reference values are the same as or similar to each other, if the image contents identifiers are different, without removing the existing reference value.

17. The method of claim 2, wherein the number of the feature blocks is four, and each of the feature blocks corresponds to the four characteristic values.

18. The method of claim 2, wherein the block header of the feature block represents color temperature if the value of the feature identifier is ‘

0’

, brightness if the value thereof is ‘

1’

, contrast if the value thereof is ‘

2’

, and saturation if the value thereof is ‘

3’

.

19. The method of claim 2, wherein the block header of the feature block further comprises a number-of-descriptors value indicating the number of feature descriptors contained in the feature block.

20. The method of claim 2, wherein the feature descriptor further comprises:

a Bin number indicating a quantization level of the characteristic value;

a contents ID flag indicating the presence of an image contents identifier; and

a contents identifier if the image contents identifier exists.

35. A computer readable recording medium on which the invention of claim 1 is recorded as an executable program code.

21. An apparatus for generating user preference data regarding a color characteristic of an image, when an image converted to have a color characteristic that a user prefers with respect to predetermined reference image is referred to as a preference image, a color characteristic value of the preference image is referred to as a preference value and a color characteristic value of the reference image is referred to as a preference value and a color characteristics value of the reference image is referred to as a reference value, the apparatus comprising:

a color characteristic calculating unit, which obtains an image color characteristic value of the preference image and the reference image, and generates {preference value, reference value} which corresponds to a pair of the preference value and the reference value; and

a meta-data generating unit, which generates the pair {preference value, reference value} generated in the color characteristic calculating unit as preference meta-data having at least one feature block,

wherein the feature block comprises;

a block header including a feature identifier corresponding to information identifying a color characteristic; and

at least one feature descriptor including the preference value and the reference value.

22. The apparatus of claim 21, wherein the color characteristic is at least one of color temperature, brightness, contrast, and saturation.

23. The apparatus of claim 21, further comprising a first sample image obtaining unit, which sets an image that the user has selected from a plurality of images having different color characteristic values with respect to a predetermined image, sets an original image with respect to the preference image as a reference image, generates {preference image, reference image} which corresponds to a pair of the preference image and the reference image, and outputs the pair to the color characteristic calculating unit.

24. The apparatus of claim 21, further comprising a second sample image obtaining unit, which, when a unit for controlling a color characteristic of an image is installed in an image display device, sets an image of which color characteristic is adjusted by a user using the unit for controlling a color characteristic, as a preference image, sets an original image of which color characteristic is not adjusted by the user, as a reference image, generates {preference image, reference image} which corresponds to a pair of the preference image and the reference image, and outputs the pair to the color characteristic calculating unit.

25. The apparatus of claim 23, wherein the generating {preference image, reference image} is, when the reference image has a contents identifier, generating {preference image, reference image, contents identifier} which corresponds to a combination of the preference image, the reference image, and contents identifier information.

26. The apparatus of claim 25, wherein the color characteristic calculating unit, when the reference image has a contents identifier, further comprises a contents identifier in the pair {preference value, reference value} and generates a combination {preference value, reference value, contents identifier}.

27. The apparatus of claim 22, wherein the color characteristic calculating unit comprises a color temperature value calculating portion, which obtains a color temperature value, and

wherein the color temperature value calculating portion comprises:

a highlight detecting part, which extracts a highlight region from an input color image;

a highlight variable calculating part, which projects the highlight region on a chromaticity coordinate and calculates geometric representation variables with respect to a shape distributed on the chromaticity coordinate;

a color temperature estimating part, which estimates a color temperature from the input color image by perceptive light source estimation; and

a color temperature calculating part, which selects geometric representation variables around the estimated color temperature from the geometric representation variables and calculates a final color temperature using the selected geometric representation variables.

28. The apparatus of claim 22, wherein the color characteristic calculating unit comprises a saturation value calculating portion, which obtains saturation of each pixel in a HSV color space from an RGB value of a pixel in the image and generates a value obtained by adding saturation of the pixels and dividing the added saturation by the number of pixels, as a saturation value, and

wherein the saturation of the pixel is determined by the following steps comprising:

obtaining maximum and minimum values of the RGB value of the pixel; and

when the maximum value is equal to 0, setting the saturation of a corresponding pixel to 0, and when the maximum value is not equal to 0, setting a value obtained by dividing a difference between the maximum value and the minimum value by the maximum value, as the saturation of a corresponding pixel.

29. The apparatus of claim 22, wherein the color characteristic calculating unit comprises a brightness value calculating portion, which obtains luminance Y of each pixel in a YCbCr color space from an RGB value of a pixel in the image and generates a value obtained by adding luminance of the pixels and dividing the added luminance by the number of pixels, as a brightness value, and

wherein the luminance Y of the pixel is determined by Y=0.299×

R+0.587×

G+0.114×

B.

30. The apparatus of claim 22, wherein the color characteristic calculating unit comprises a contrast value calculating portion, which, when Yx is luminance of each pixel in the image and NumberofPixels is the number of pixels in the image, calculates a contrast value determined using equation 3:

31. The apparatus of claim 22, further comprising a meta-data updating unit, which compares the pair {preference value, reference value} generated in the color characteristic calculating unit with an existing pair {preference value, reference value}, updates the pair {preference value, reference value}, and outputs the pair to the meta-data generating unit,

wherein the updating is, with respect to one preference value, when the reference value generated in step (b) is compared with the existing reference value and is the same as or similar to the existing reference value, removing the existing reference value, and the updating is, when quantization levels of the two reference values are different, converting a value of high level into a value of low level and comparing with each other, and when image contents identifiers are added to the characteristic value pairs, even though the two reference values are the same as or similar to each other, if the image contents identifiers are different, without removing the existing reference value.

32. The apparatus of claim 22, wherein the block header of the feature block further comprises a number-of-descriptors value indicating the number of feature descriptors contained in the feature block.

33. An image preference data recording medium on which, when an image converted to have a color characteristic that a user prefers with respect to a predetermined image is referred to as a preference image, the predetermined image is referred to as a reference image, a color characteristic value of the preference image is referred to as a preference value, and a color characteristic value of the reference image is referred to as a reference value, preference meta-data having at least one feature block, the feature block comprising a block header including a feature identifier corresponding to information identifying a color characteristic and at least one feature descriptor including the preference value and the reference value is recorded.

34. The recording medium of claim 33, wherein the block header of the feature block further comprises a number-of-descriptors value indicating the number of feature descriptors contained in the feature block, and

wherein the feature descriptor further comprises:

a Bin number indicating a quantization level of the characteristic value;

a contents ID flag indicating the presence of an image contents identifier; and

a contents identifier if the image contents identifier exists.