Primary and secondary color manipulations using hue, saturation, luminance and area isolation

• US 6,337,692 B1
• Filed: 03/31/1999
• Issued: 01/08/2002
• Est. Priority Date: 04/03/1998
• Status: Expired due to Term

• Current Assignee: Blackmagic Design Pty Limited
• Original Assignee: Da Vinci Intellectual Property (Blackmagic Design Pty Limited)
• Inventors: Gu, Xueming Henry, Taylor, Troy, Rai, Sanjay Devappa, Barton, Nicholas
• Primary Examiner(s): Luu, Matthew
• Assistant Examiner(s): GOOD JOHNSON, MOTILEWA
• Application Number:
  US09/282,400
• Time in Patent Office: 1,014 Days
• Field of Search: 345/150, 345/431, 348/153, 348/649, 348/650
• US Class Current: 345/594
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 5/94 based on local image properties, e.g. for local contrast enhancement
• CPC Class Codes: G11B 2220/90 Tape-like record carriers
• CPC Class Codes: G11B 27/024 on tapes G11B27/028, G11B27/029 take precedence
• CPC Class Codes: G11B 27/032 on tapes G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 1/62 Retouching, i.e. modification of isolated colours only or in isolated picture areas only
• CPC Class Codes: H04N 1/622 with simulation on a subsidiary picture reproducer
• CPC Class Codes: H04N 9/64 Circuits for processing colour signals H04N9/77 takes precedence; camera processing pipelines for processing colour signals H04N23/84

Abstract

A color correction system that implements scene-by-scene color manipulation in the primary color domain to color correction regions of a video image isolated in the hue domain using hue, saturation, and luminance qualification. The system may be configured as a number of color correction blocks arranged in series or parallel. Each correction block typically allows a colorist to define up to sixteen non-overlapping hue sectors with associated corrected color values and qualification curves. Each color correction block has two video inputs, a first connected to the output from the previous block, and a second connected to an unprocessed video signal. Each block includes a video multiplexer that operates as a switch allowing the colorist to select either the output of a previous block or the unprocessed video input signal as the input for a given block. Delay buffers are positioned in the unprocessed video signal between each color correction block to synchronize the unprocessed video signal with the output video signal from the preceding color correction block. Thus, the color correction blocks may be applied separately (i.e., in parallel) or in tandem (i.e., in series) for each scene processed. In addition, a particular colorist may select the number of blocks in the system in accordance with that colorist'"'"'s needs.

Claims

1. A computer-implemented method for selectively applying image processing to an image, the process carried out in a computer system coupled to an image source, comprising the steps of:

receiving an input signal from the image source in a primary color domain;

receiving a command selecting a sample of the input signal;

receiving a command identifying a color correction parameter in the primary color domain associated with the sample;

determining a hue-domain parameter associated with the sample;

defining a sector in the hue-domain about the hue-domain parameter associated with the sample;

defining a qualification curve corresponding to the sector; and

mixing the input signal and the color correction parameter within the sector in accordance with the qualification curve.

2. The method of claim 1, wherein:

the hue-domain parameter is selected from the group including hue, saturation, and luminance.

3. The method of claim 1, wherein the hue-domain parameter is a first hue-domain parameter and the qualification curve is a first qualification curve, and further comprising the steps of:

determining a second hue-domain parameter associated with the sample;

defining a second qualification curve about the second hue-domain parameter;

combining the first and second qualification curves to obtain a combined qualification curve; and

wherein

the step of mixing the input signal comprises the step of mixing the input signal and the color correction parameter in accordance with the combined qualification curve.

4. The method of claim 3, wherein:

the first and second hue-domain parameters are selected from the group including hue, saturation, and luminance.

5. The method of claim 3, further comprising the steps of:

determining a third hue-domain parameter associated with the sample;

defining a third qualification curve about the third hue-domain parameter and corresponding to the sector;

combining the first, second, and third qualification curves to obtain a total qualification curve; and

wherein

the step of mixing the input signal comprises the step of mixing the input signal the color correction parameter in accordance with the total qualification curve.

6. The method of claim 1 wherein:

the first, second, and third hue-domain parameters include hue, saturation, and luminance.

7. The method of claim 5, further comprising the steps of:

applying a filter to the total qualification curve to obtain an alpha qualification curve; and

wherein

the step of mixing the input signal comprises the step of mixing the input signal and the color correction parameter within the sector in accordance with the alpha qualification curve.

8. The method of claim 5, further comprising the steps of:

defining a geometric constraint corresponding to the input signal; and

mixing of the input signal and the color correction parameter in accordance with the geometric constraint.

9. A computer-implemented method for selectively applying image processing to a plurality of images defining a scene, the process carried out in a computer system coupled to an image source, comprising the steps of:

receiving an input signal defining the scene from the image source in a primary color domain;

receiving a command selecting a target frame of the scene;

receiving a command selecting a sample of the target frame;

receiving a command identifying a color correction parameter in the primary color domain associated with the sample;

determining a hue-domain parameter associated with the sample;

defining a sector in the hue-domain about the hue-domain parameter associated with the sample;

defining a qualification curve corresponding to the sector; and

for each image of the scene, mixing the input signal and the color correction parameter within the sector in accordance with the qualification curve.

10. The method of claim 9, wherein:

the hue-domain parameter is selected from the group including hue, saturation, and luminance.

11. The method of claim 10, wherein the hue-domain parameter is a first hue-domain parameter and the qualification curve is a first qualification curve, further comprising the steps of:

determining a second hue-domain parameter associated with the sample;

defining a second qualification curve about the second hue-domain parameter and corresponding to the sector;

combining the first and second qualification curves to obtain a combined qualification curve; and

wherein

the step of mixing the input signal comprises the step of mixing the input signal and the color correction parameter within the sector in accordance with the combined qualification curve.

12. The method of claim 11, wherein:

the first and second hue-domain parameters are selected from the group including hue, saturation, and luminance.

13. The method of claim 11, further comprising the steps of:

determining a third hue-domain parameter associated with the sample;

defining a third qualification curve about the third hue-domain parameter and corresponding to the sector;

combining the first, second, and third qualification curves to obtain a total qualification curve; and

wherein

the step of mixing the input signal comprises the step of mixing the input signal and the color correction parameter within the sector in accordance with the total qualification curve.

14. The method of claim 10 wherein:

the first, second, and third hue-domain parameters include hue, saturation, and luminance.

15. The method of claim 13, further comprising the steps of:

applying a filter to the total qualification curve to obtain an alpha qualification curve; and

wherein

the step of mixing the input signal comprises the step of mixing the input signal and the color correction parameter within the sector in accordance with the alpha qualification curve.

16. The method of claim 13, further comprising the steps of:

defining a geometric constraint corresponding to the input signal; and

limiting the mixing of the input signal and the color correction parameter in accordance with the geometric constraint.

17. An apparatus for selectively applying image processing to an image, comprising:

means for receiving an input signal corresponding to the image from an image source in a primary color domain;

means for receiving a command selecting a sample of the input signal;

means for receiving a command identifying a color correction parameter in the primary color domain associated with the sample;

means for determining a hue-domain parameter associated with the sample;

means defining a sector in the hue-domain about the hue-domain parameter associated with the sample;

means defining a qualification curve corresponding to the sector; and

a mixer operative for mixing the input signal and the color correction parameter within the sector in accordance with the qualification curve.

18. The apparatus of claim 17, wherein:

the hue-domain parameter is selected from the group including hue, saturation, and luminance.

19. The apparatus of claim 17, wherein the hue-domain parameter is a first hue-domain parameter and the qualification curve is a first qualification curve, and further comprising:

means for determining a second hue-domain parameter associated with the sample;

means defining a second qualification curve about the second hue-domain parameter and corresponding to the sector;

means for combining the first and second qualification curves to obtain a combined qualification curve; and

wherein

the mixer is operative for mixing the input signal and the color correction parameter within the sector in accordance with the combined qualification curve.

20. The apparatus of claim 19, wherein:

the first and second hue-domain parameters are selected from the group including hue, saturation, and luminance.

21. The apparatus of claim 19, further comprising:

means for determining a third hue-domain parameter associated with the sample;

means defining a third qualification curve about the third hue-domain parameter and corresponding to the sector;

means for combining the first, second, and third qualification curves to obtain a total qualification curve; and

wherein

the mixer is operative for mixing the input signal the color correction parameter within the sector in accordance with the total qualification curve.

22. The apparatus of claim 17, wherein:

the first, second, and third hue-domain parameters include hue, saturation, and luminance.

23. The apparatus of claim 21, further comprising:

an alphas filter operative upon the total qualification curve for obtaining an alpha qualification curve; and

wherein

the mixer is operative for mixing the input signal and the color correction parameter within the sector in accordance with the alpha qualification curve.

24. The apparatus of claim 21, further comprising:

means defining a geometric constraint corresponding to the input signal; and

means for limiting the mixing of the input signal and the color correction parameter in accordance with the geometric constraint.

25. An apparatus for selectively applying image processing to images in a plurality of frames defining a scene, comprising:

means for receiving an input signal defining images of a scene from an image source in a primary color domain;

means for receiving a command selecting a target frame of the scene;

means for receiving a command selecting a sample of the target frame;

means for receiving a command identifying a color correction parameter in the primary color domain associated with the sample;

means for determining a hue-domain parameter associated with the sample;

means defining a sector in the hue-domain about the hue-domain parameter associated with the sample;

means defining a qualification curve corresponding to the sector; and

a mixer for mixing the input signal and the color correction parameter within the sector in accordance with the qualification curve for each frame of the scene.

26. The apparatus of claim 25, wherein:

the hue-domain parameter is selected from the group including hue, saturation, and luminance.

27. The apparatus of claim 26, wherein the hue-domain parameter is a first hue-domain parameter and the qualification curve is a first qualification curve, and further comprising:

means for determining a second hue-domain parameter associated with the sample;

means defining a second qualification curve about the second hue-domain parameter and corresponding to the sector;

means for combining the first and second qualification curves to obtain a combined qualification curve; and

wherein

the mixer is operative for mixing the input signal and the color correction parameter within the sector in accordance with the combined qualification curve.

28. The apparatus of claim 27, wherein:

the first and second hue-domain parameters are selected from the group including hue, saturation, and luminance.

29. The apparatus of claim 27, further comprising:

means for determining a third hue-domain parameter associated with the sample;

means defining a third qualification curve about the third hue-domain parameter and corresponding to the sector;

means for combining the first, second, and third qualification curves to obtain a total qualification curve; and

wherein

the mixer is operative for mixing the input signal and the color correction parameter within the sector in accordance with the total qualification curve.

30. The apparatus of claim 29, wherein:

the first, second, and third hue-domain parameters include hue, saturation, and luminance.

31. The apparatus of claim 29, further comprising:

a filter for filtering the total qualification curve to obtain an alpha qualification curve; and

wherein

the mixer is operative for mixing the input signal and the color correction parameter within the sector in accordance with the alpha qualification curve.

32. The apparatus of claim 29, further comprising:

means defining a geometric constraint corresponding to the input signal; and

means for limiting the mixing of the input signal and the color correction parameter in accordance with the geometric constraint.

33. A method for selectively applying image processing to an image, the method carried out in a system coupled to an image source, comprising the steps of:

receiving an input signal from the image source, the input signal corresponding to the image;

receiving a color correction parameter for application to the image;

determining a hue-domain parameter associated with input signal;

defining a sector in the hue-domain corresponding to the hue-domain parameter;

defining a qualification curve corresponding to the sector; and

mixing the input signal and the color correction parameter in accordance with the qualification curve.

34. The method of claim 33, wherein the input signal is in a primary color domain, and the mixing of the input signal and the color correction parameter is in conducted in the primary color domain.

35. The method of claim 33, wherein:

the hue-domain parameter is selected from the group including hue, saturation, and luminance.

36. The method of claim 33, further comprising the steps of:

determining a second hue-domain parameter associated with the input signal;

defining a second qualification curve about the second hue-domain parameter and corresponding to the sector;

combining the first and second qualification curves to obtain a total qualification curve; and

wherein

the step of mixing the input signal comprises the step of mixing the input signal the color correction parameter within the sector in accordance with the total qualification curve.

37. The method of claim 36 wherein:

the first or second hue-domain parameters include hue, saturation, and luminance.

38. The method of claim 36, further comprising the steps of:

applying a filter to the total qualification curve to obtain an alpha qualification curve; and

wherein

the step of mixing the input signal comprises the step of mixing the input signal and the color correction parameter within the sector in accordance with the alpha qualification curve.

39. The method of claim 33, further comprising the steps of:

defining a geometric constraint corresponding to the input signal; and

mixing of the input signal and the color correction parameter in accordance with the geometric constraint.

40. A method for selectively applying image processing to a plurality of images defining a scene, the process carried out in a system coupled to an image source, comprising the steps of:

receiving an input signal corresponding to the images defining the scene from the image source;

receiving a color correction parameter for application to the images;

determining a hue-domain parameter associated with the input signal;

defining a sector in the hue-domain about the hue-domain parameter;

defining a qualification curve corresponding to the sector; and

for each image of the scene, mixing the input signal and the color correction parameter in accordance with the qualification curve.

41. The method of claim 40, wherein:

the hue-domain parameter is selected from the group including hue, saturation, and luminance.

42. The method of claim 41, wherein the hue-domain parameter is a first hue-domain parameter and the qualification curve is a first qualification curve, further comprising the steps of:

determining a second hue-domain parameter associated with the sample;

defining a second qualification curve about the second hue-domain parameter;

combining the first and second qualification curves to obtain a total qualification curve; and

wherein

the step of mixing the input signal comprises the step of mixing the input signal and the color correction parameter in accordance with the combined total curve.

43. The method of claim 42, wherein:

the first and second hue-domain parameters are selected from the group including hue, saturation, and luminance.

44. The method of claim 42, further comprising the steps of:

applying a filter to the total qualification curve to obtain an alpha qualification curve; and

wherein

the step of mixing the input signal comprises the step of mixing the input signal and the color correction parameter in accordance with the alpha qualification curve.

45. The method of claim 40, further comprising the steps of:

defining a geometric constraint corresponding to the input signal; and

mixing of the input signal and the color correction parameter in accordance with the geometric constraint.

46. A method for selectively applying image processing to an image, the method carried out in a system coupled to an image source, comprising the steps of:

receiving a primary domain input signal from the image source, the input signal corresponding to the image;

receiving a color correction parameter for application to the image;

defining a hue-domain qualifier for application of the color correction parameter;

defining a geometric qualifier for application of the color correction parameter; and

applying the color correction parameter to the input signal in accordance with the hue-domain qualifier and the geometric qualifier.

47. The method of claim 46, wherein the input signal is in a primary color domain, and the application of the color correction parameter is effected in the primary color domain, without conversion to another color domain.

48. The method of claim 46, wherein the input signal is in a primary color domain, and the mixing of the input signal and the color correction parameter is in conducted in the primary color domain.

49. The method of claim 46, wherein:

the hue-domain parameter is selected from the group including hue, saturation, and luminance.

50. The method of claim 46, wherein the hue-domain parameter is a first hue-domain parameter, and further comprising the steps of:

determining a second hue-domain parameter associated with the input signal;

defining a second qualification curve corresponding the second hue-domain parameter;

combining the first and second qualification curves to obtain a total qualification curve; and

wherein

the step of applying the color correction parameter to the input signal comprises applying the color correction parameter in accordance with the total qualification curve and the geometric qualifier.

51. The method of claim 46 wherein:

the first or second hue-domain parameters include hue, saturation, and luminance.

52. The method of claim 46, further comprising the steps of:

applying a filter to the total qualification curve to obtain an alpha qualification curve; and

wherein

the step of applying the color correction parameter to the input signal comprises applying the color correction parameter in accordance with the alpha qualification curve.

53. A system for selectively applying image processing to an image, comprising:

means for receiving a primary domain input signal from an image source, the input signal corresponding to the image;

means for receiving a color correction parameter for application to the image;

means defining a hue-domain qualifier for application of the color correction parameter;

means defining a geometric qualifier for application of the color correction parameter; and

a component for applying the color correction parameter to the input signal in accordance with the hue-domain qualifier and the geometric qualifier.

54. The system of claim 53, wherein the input signal is in a primary color domain, and the application of the color correction parameter is effected in the primary color domain, without conversion to another color domain.

55. The system of claim 53, wherein the input signal is in a primary color domain, and the mixing of the input signal and the color correction parameter is in conducted in the primary color domain.

56. The system of claim 53, wherein:

the hue-domain parameter is selected from the group including hue, saturation, and luminance.

57. The system of claim 53, wherein the hue-domain parameter is a first hue-domain parameter, and further comprising:

means for determining a second hue-domain parameter associated with the input signal;

means defining a second qualification curve corresponding the second hue-domain parameter;

a mixer for combining the first and second qualification curves to obtain a total qualification curve; and

wherein the component for applying the color correction parameter to the input signal is operative for applying the color correction parameter to the input signal in accordance with the total qualification curve and the geometric qualifier.

58. The system of claim 53 wherein:

the first or second hue-domain parameters include hue, saturation, and luminance.

59. The system of claim 53, further comprising:

a filter operative on the total qualification curve to obtain an alpha qualification curve; and

wherein the component for applying the color correction parameter to the input signal is operative for applying the color correction parameter in accordance with the alpha qualification curve.