Backing color and luminance nonuniformity compensation for linear image compositing

• US 5,424,781 A
• Filed: 08/12/1992
• Issued: 06/13/1995
• Est. Priority Date: 06/28/1988
• Status: Expired due to Term

• Current Assignee: iMatte, Inc.
• Original Assignee: Ultimatte Corporation (Blackmagic Design Pty Limited)
• Inventors: Vlahos, Petro
• Primary Examiner(s): Groody, James J.
• Assistant Examiner(s): Harvey, David E.
• Application Number:
  US07/928,887
• Time in Patent Office: 1,035 Days
• Field of Search: 358/22, 358/27, 358/28
• US Class Current: 348/587
• CPC Class Codes: H04N 9/75 Chroma key

Abstract

A linear image compositing system which corrects for nonuniform luminance and/or color of the colored backing without incurring the penalties of edge glow, edge darkening, loss of edge detail and other anomalies. A control signal is created directly proportional to the luminance of the colored backing and controls the level of the BG scene. Unless the control signal is corrected, the background scene will contain all the brightness and color variations occurring on the colored backing. Correction factors are developed by comparing the RGB video obtained from the backing before the subject is put in place, with the ideal values of RGB that would have been obtained from a perfect backing. These correction factors correct the RGB video when the scene is scanned with the subject in place. The control signal, being zero in the subject area, may be used to inhibit the corrections in the subject area.

Claims

1. In a system for accepting a foreground video signal, wherein said foreground video signal includes at least a red signal, a blue signal and a green signal generated by scanning a colored backing, and said system includes control logic means for generating a control signal for controlling the compositing of said foreground signal and a background signal, said control signal being formed from said foreground video signal, the improvement wherein said scanning selectively includes a subject and comprises:

for each of the three foreground color video signals, an additive amplifier means (42,42'"'"',42") for adding a correction signal to a respective one of said foreground color video signals, differential amplifier means (43,43'"'"',43") for generating a signal representing the difference between an ideal color video signal and the respective foreground color video signal, memory means (52,52'"'"',52") coupled to said differential amplifier means for storing said difference signal, clip circuit means (62,65,68,) for inhibiting the addition of said difference signal to the respective color video signal when the subject is being scanned, the output of said clip circuit means coupled to one input of a multiplier means (56,59), the other input of said multiplier means coupled to the output of said memory means, said multiplier means for selectively applying a multiplication of the output of said clip circuit means by the output of said memory means to said additive amplifier means;

whereby luminance and color non-uniformities in the backing for said red, blue and green signals are corrected.

2. The improvement defined by claim 1 further comprising OR gate means (60) having said control signal, including said subject, as one input and a logic signal which is "0" inside a predetermined window and "1" outside said predetermined window as a second input, the output of said OR gate means coupled to said clip circuit means so as to maintain corrections in areas outside the window.

3. The improvement defined by claim 1 wherein said multiplier means for each color video signal comprises a multiplier (59) whose output is coupled to a selector switch (56).

4. The improvement defined by claim 1 wherein said multiplier means for each color video signal comprises a multiplier (59) whose output and whose X input are coupled to a potentiometer.

5. In an electronic compositing method for compositing a foreground video signal and a background video signal, wherein said foreground video signal includes at least a red signal, a blue signal and a green signal generated by scanning a colored backing and a foreground subject, said method including the step of generating a control signal using said foreground signal for controlling the compositing of said foreground signal and said background signal, the improvement wherein said scanning selectively includes a subject and comprises the steps of:

generating (43,

     47) a signal representing the difference between a predetermined voltage level and the actual foreground color video signal level for each of said red, blue and green foreground video signals with said subject absent;

storing said difference signal for each of said red, blue and green video signal in a corresponding memory (52);

inhibiting (62, 65, 68,

     59) an addition of said difference signal to the corresponding one of said red, blue and green foreground video signals when the foreground subject is being scanned;

selectively (56) applying the output of said corresponding memory (52) multiplied (59) by an inhibiting signal (62) to a corresponding additive amplifier (42);

adding a correction signal to each of said red, blue and green foreground video signals by the corresponding additive amplifier (42);

whereby luminance and color non-uniformities in the backing for said red, blue and green signals are corrected.

6. The improvement defined by claim 5 further comprising the steps of:

creating (60) a logic signal which is "0" inside a predetermined window and "1" outside said predetermined window; and

using an OR gate (60) to substitute the "1" existing outside the window for control signal (18) when said control signal drops below "1" as when overscanning the blue backing.

7. A method of reducing non-uniformity of luminance and color of an illuminated backing employed in an image compositing apparatus, said apparatus adapted to accept at least red, green and blue foreground scene video signals, which signals selectively include a foreground subject, said method comprising the steps of:

(a) storing said red, green and blue foreground scene video signals, excluding the foreground subject, in a memory (52);

(b) generating red, green and blue reference voltages (47) representing video signal voltage levels which would be produced by a substantially ideal backing;

(c) comparing the video signals in said memory (52) with said reference voltages (47) to produce backing video correction signals;

(d) applying (42) said correction signals to said foreground scene video signals (17) to substantially eliminate nonuniformity of backing luminance and color present in said foreground scene video signals.

9. The method defined by claim 7 comprising the additional steps of:

(a) generating (18) an inhibit control signal from said foreground scene video signals;

(b) inhibiting (59) said correction signals by said inhibit control signal (18) thereby preventing backing corrections from being applied to said foreground scene video signals in areas occupied by the foreground subject.

8. A circuit for reducing nonuniformity of luminance and color of an illuminated backing employed in an image compositing apparatus, said apparatus adapted to accept at least red, green and blue foreground scene video signals, which signals selectively include a foreground subject, said circuit comprising:

(a) switch means (50) for storing red, green and blue foreground scene video signals (17) excluding the foreground subject in a memory (52);

(b) means (47) for generating red, green and blue reference voltages representing video signal voltage levels which would be produced by a substantially ideal backing;

(c) means (43) for comparing the video signals in said memory (52) with said reference voltage (47) to produce correction signals;

(d) means (42) for applying said correction signals to said foreground scene video signals (17) to substantially eliminate nonuniformity of backing luminance and color present in said foreground scene video signals.

10. The circuit defined by claim 8 further comprising:

(a) means (18) for generating an inhibit control signal from said foreground scene video signals;

(b) inhibit means (59) coupled to said applying means for inhibiting said correction signals from being applied to said foreground scene video signals in areas occupied by the foreground subject.

11. A method of reducing non-uniformity of luminance and color of an illuminated backing employed in an image compositing apparatus, said apparatus adapted to accept at least red, green and blue foreground scene video signals, which signals selectively include a foreground subject, said method comprising the steps of:

(a) storing said red, green and blue foreground scene video signals, excluding the foreground subject, in a memory (52);

(b) generating red, green and blue reference voltages (47) representing video signal voltage levels which would be produced by a substantially ideal backing;

(c) comparing the video signals in memory (52) with said reference voltages (47) to produce backing video correction signals;

(d) applying (42) said correction signals to said foreground scene video signals (17) to substantially eliminate nonuniformity of backing luminance and color present in said foreground scene video signals;

(e) generating (18) an inhibit control signal from said foreground scene video signals;

(f) limiting (62, 65,

     68) an upper level of said inhibit control signal (18) to hold it at constant level throughout a range of video levels representing the luminance and color variations of the backing;

(g) inhibiting (59) said correction signals (43) by said limited inhibit control signal (18) so as to enable corrections to be made to the unobscured backing area while fully inhibiting corrections in opaque subject area, thereby eliminating substantially all non-uniformity of luminance and color of the backing without contaminating the luminance and color of foreground subjects.

12. A circuit for reducing non-uniformity of luminance and color of an illuminated backing employed in an image compositing apparatus, said apparatus adapted to accept at least red, green and blue foreground scene video signals, which signals selectively include a foreground subject, said circuit comprising:

(a) means (50) for storing the red, green and blue foreground scene video signals, excluding the foreground subject, in a memory (52);

(b) means for generating red, green and blue reference voltages (47) representing video signal voltage levels which would be produced by a substantially ideal backing;

(c) means (43) for comparing the video signals in memory (52) with said reference voltages (47) to produce backing video correction signals;

(d) means (42) for applying said correction signals to said foreground scene video signals (17) to substantially eliminate nonuniformity of backing luminance and color present in said foreground scene video signals;

(e) means (18) for generating an inhibit control signal from foreground scene video signals;

(f) means (62, 65,

     68) for limiting upper level of said inhibit control signal (18) to hold it at constant level throughout a range of video levels representing the luminance and color variations of the backing;

(g) inhibit means (59) under control of limited inhibit control signal (18) for inhibiting (59) said correction signals (43) by said limited inhibited control signal (18) so as to enable corrections to be made to the unobscured backing area while fully inhibiting corrections in opaque subject area, thereby eliminating substantially all non-uniformity of luminance and color of the backing without contaminating the luminance and color of foreground subjects.

13. A method of reducing non-uniformity of luminance and color of an illuminated backing employed in an image compositing apparatus, said apparatus adapted to accept at least red, green and blue foreground scene video signals, which signals selectively include a foreground subject, said method comprising the steps of:

(a) storing said red, green and blue foreground scene video signals, excluding the foreground subject, in a memory (52);

(b) generating red, green and blue reference voltages (47) representing video signal voltage levels which would be produced by a substantially ideal backing;

(c) comparing the video signals in said memory (52) with said reference voltages (47) to produce backing video correction signals;

(d) applying said correction signals to said foreground scene video signals (17);

(e) generating (18) a first control signal E_c1 from said foreground scene video signals (17) representing the luminance and visibility of the backing;

(f) generating (72) a second control signal E_cm from said stored foreground scene video signals representing the luminance and visibility of the backing;

(g) comparing (85) said first (18) and second (72) control signals for identity to each other, and where no deviation is found, generating an inhibit control signal E_ci (62a) having a constant voltage, and when first control signal (18) drops to zero, correspondingly dropping said inhibit control signal E_ci (62A) to zero;

(h) utilizing said inhibit control signal E_ci to selectively inhibit (59) said correction signals (43) from being applied (42) to said foreground scene video signals (17), thereby eliminating all luminance and color non-uniformity of the backing in unobscured areas of the backing, in backing areas partially obscured by semi-transparent foreground subjects, and in backing areas covered by foreground subject shadows, while fully inhibiting corrections in areas occluded by opaque subjects.

15. The method of claim 13, further comprising the step of limiting (84) the lowest level of the second control signal E_cm (72) to a level above zero.

17. The method defined by claim 13 further comprising the step of dividing said first control signal E_c1 (18) by said second control signal E_cm (72) to obtain said inhibit control signal Eci, said inhibit control signal being a constant when E_c1 (18) is equal to E_cm (72), and said inhibit control signal falling to zero as said first control signal E_c1 (18) falls to zero.

14. A circuit for reducing non-uniformity of luminance and color of an illuminated backing employed in an image compositing apparatus, said apparatus adapted to accept at least red, green and blue foreground scene video signals, which signals selectively include a foreground subject, said circuit comprising:

(a) means 50 for storing said red, green and blue foreground scene video signals, excluding the foreground subject, in a memory (52);

(b) means for generating red, green and blue reference voltages (47) representing video signal voltage levels which would be produced by a substantially ideal backing;

(c) means (43) for comparing (43) the video signals in said memory (52) with said reference voltages (47) to produce backing video correction signals;

(d) means (42) for applying correction signals (43) to foreground scene video signals (17);

(e) means (18) for generating a first control signal E_c1 from said foreground scene video signals (17) representing the luminance and visibility of the backing;

(f) means (72) for generating a second control signal E_cm from memory (52) where said E_cm control signal is proportional to luminance and visibility of the backing;

(g) means (85) for comparing said first (18) and second (72) control signals for identity to each other, and where no deviation is found, generating an inhibit control signal E_ci having a constant voltage, and when said first control signal (18) drops to zero, correspondingly dropping said inhibit control signal E_ci to zero;

(h) means (59) for utilizing said inhibit control signal E_ci to selectively inhibit (59) said correction signals (43) from being applied (42) to said foreground scene video signals (17), thereby eliminating all luminance and color non-uniformity of the backing in unobscured areas of the backing, in backing areas partially obscured by semi-transparent foreground subjects, and in backing areas covered by foreground subject shadows, while fully inhibiting corrections in areas occluded by opaque subjects.

16. The circuit defined by claim 14 further comprising means (84) for limiting the lower level of said second control signal to a selected level above zero.

18. The circuit defined by claim 14 further comprising means (85) for determining the ratio of said first control signal (18) E_c1 to said second control signal (72) E_cm and producing said inhibit control signal E_ci, said inhibit control signal being unity when said first and second control signals are identical, and said inhibit control signal E_ci decreasing to zero as said first control signal (18) decreases to zero.

19. A method of reducing non-uniformity of luminance and color of an illuminated backing employed in an image compositing apparatus, said apparatus adapted to accept at least red, green and blue foreground scene video signals, which signals selectively include a foreground subject, said method comprising the steps of:

(a) generating red, green and blue reference voltages (47) representing video signal voltage levels which would be produced by a substantially ideal backing;

(b) comparing (43) the foreground scene video signals with said reference voltages (47) with the foreground subject absent to produce backing video correction signals;

(c) applying (42) said correction signals to said foreground scene video signals (17) to substantially eliminate nonuniformity of backing luminance and color present in said foreground scene video signals.