Video traveling matte system

• US 4,109,278 A
• Filed: 03/21/1975
• Issued: 08/22/1978
• Est. Priority Date: 03/21/1975
• Status: Expired due to Term

• Current Assignee: MENDRALA, JAMES A., 1048 HOLLISTER STREET, SAN FERNANDO 91340
• Original Assignee: Sonex International Corp. (Spectrum Brands Holdings, Inc.)
• Inventors: Mendrala, James A., Peterson, Harold L.
• Primary Examiner(s): Martin, John C.
• Application Number:
  US05/560,583
• Time in Patent Office: 1,250 Days
• Field of Search: 358/22, 358/37, 358/181, 358/183, 178/DIG. 6, 178/DIG. 34, 178/DIG. 39, 178/DIG. 23
• US Class Current: 348/587
• CPC Class Codes: H04N 9/75 Chroma key

Abstract

A video traveling matte system is disclosed in which the video signal from a foreground television camera is examined for the presence of a particular color by an arrangement employing multipliers to multiply the differences between the red and blue components of the video signal and a luminance signal derived from the video signal by the signals from a sine/cosine potentiometer. The combined signal from the outputs of the multipliers is fed to a first comparator for comparison with a reference value, and the resulting pulses are filtered by a 4-pole active Bessel filter and compared with a reference value in a second comparator to increase the width of the pulses by a selected amount. The pulses of increased width prevent the formation of a matte outline between foreground and background images as the true and complementary values thereof are applied to alternately gate the video signals from the foreground television camera and a background television camera to a common output. The effects of shadows in the foreground image are maintained despite substitution of the background image by utilizing the combined signal from the multipliers to modulate pulses from the second comparator prior to use of such pulses to gate the video signal from the background television camera to the common output. The effects of shadows are further enhanced by a logarithmic amplifier which introduces a predetermined logarithmic transfer characteristic into the modulation signal to compensate for the black stretch circuits used in most television cameras.

Claims

1. In an arrangement in which the video signal from a first source is processed and thereafter compared with a reference in comparator means to generate generally squarewave pulses, the pulses controlling the relative gating of the video signal from the first source and a video signal from a second source to an output, the improvement comprising means for increasing the width of each pulse generated by the comparator means by a selected amount to prevent formation of a matte outline in a composite image generated by the video signals from the first and second sources, and means associated with the means for increasing the width of the pulse controlling the width increase to a selected amount sufficient to expand an image created from one of said signals into a region normally occupied by the matte outline.

2. The invention defined in claim 1, wherein the means for increasing the width of each pulse generated by the comparator means comprises filter means coupled to alter the rise and fall times of each pulse generated by the comparator means and second comparator means coupled to compare each pulse as altered by the filter means with an adjustable reference to provide generally squarewave pulses.

3. The invention defined in claim 2, wherein the filter means comprises an active, four pole Bessel filter.

4. An arrangement for selectively gating the video signals from first and second video signal sources to an output comprising:

means for processing the video signal from the first source to emphasize selected signal components of the video signal;

comparator means for comparing the processed video signal with a reference, the comparator means generating pulses when the processed video signal exceeds the reference;

means response to each pulse generated by the comparator means for increasing the width of the pulse by a selected amount to prevent formation of a matte outline in a composite image derived from the video signals from the first and second sources, said selected amounts being sufficient to expand an image created from one of said signals into a region normally occupied by the matte outline.

5. The invention defined in claim 4, further including means response to the processed video signal for expanding the processed video signal, and means for applying the expanded processed video signal to modulate the pulses of increased width prior to gating of the video signals from the first source to the output.

6. The invention defined in claim 5, further including means responsive to the processed video signal for altering the processed video signal in accordance with a predetermined transfer characteristic prior to applying the processed video signal to the means for expanding.

7. An arrangement for seclectively gating video signals from foreground and background video signal sources to an output comprising:

means responsive to the video signal from the foreground source for generating a signal emphasizing selected video components of the video signal from the foreground source;

means for comparing the signal emphasizing the selected video components with a reference, the means for comparing generating a pulse whenever the signal emphasizing the selected video components exceeds the reference;

means for widening each pulse generated by the means for comparing by a selected amount;

first gating means coupled to control the passage of the video signal from the foreground source to the output in accordance with an input signal applied thereto;

means for applying the pulses from the means for widening as the input signal to the first gating means;

second gating means coupled to control the passage of video signals from the background source to the output in accordance with an input signal applied thereto; and

signal modifying means also receiving pulses from the means for widening, said signal modifying means limiting said pulses and applying the complement of the pulses from the means for widening as an input signal to said second gating means to control gating of the background video signal.

8. The invention defined in claim 7, wherein the signal modifying means for applying the pulses from the means for widening as the input signal to the first gating means comprises means for limiting the pulses from the means for widening in accordance with the signal emphasizing selected video components and means for applying the limited pulses as the input signal to the second gating means.

9. The invention defined in claim 8, further including a logarithmic amplifier coupled to amplify the signal emphasizing selected video components prior to application to the means for limiting.

10. The invention defined in claim 8, further including means for varying the level of the signal emphasizing selected video components prior to application to the means for limiting.

11. The invention defined in claim 8, further including means expanding the signal emphasizing selected video components prior to application to the means for limiting.

12. In an arrangement in which the video signal from a foreground television camera is processed to emphasize selected signal components of the video signal, the arrangement generating a color difference signal based on the emphasized selected signal components, the video signal as so processed being applied to first and second gating means to respectively gate the video signal from the foreground television camera to an output, the improvement comprising means responsive to the processed video signal for altering the processed video signal in accordance with a predetermined non-linear transfer characteristic selected so that the characteristics of the color difference signal and the non-linear transfer characteristic are algebraically combined to provide a signal with a linear characteristic, and means for applying the processed video signal as altered in accordance with a linear characteristic to limit the processed video signal as it is applied to the second gating means to gate the video signal from the background television camera.

13. The invention defined in claim 12, wherein the means for altering comprises a logarithmic amplifier.

14. An arrangement for selectively gating video signals from the foreground and background video signal sources to an output comprising:

means responsive to a video signal from the foreground source to emphasize selected signal components of the video signal from the foreground source;

means for comparing the signal emphasizing selected signal components of the video signal with a reference, the means for comparing generating a pulse whenever the signal emphasizing selected signal components exceeds the reference;

means responsive to each pulse generated by the means for comparing for generating a complementary pulse;

first gating means coupled to control the passage of the video signal from the foreground source to the output in accordance with the complementary pulse;

means for limiting each pulse generated by the means for comparing in accordance with the signal emphasizing selected signal components, said means for limiting pulses generates such limited pulses essentially simultaneously with the generation of the complementary pulses; and

second gating means coupled to control the passage of the video signal from the background source to the output in accordance with limited pulses from the means for limiting.

15. The invention defined in claim 14, further including a variable gain control coupled to vary the level of the signal emphasizing selected signal components of the video signal prior to limiting of pulses generated by the means for comparing.

16. The invention defined in claim 14, further including means for latering the signal emphasizing selected signal components of the video signal in accordance with a predetermined non-linear transfer characteristic prior to limiting of pulses generated by the means for comparing.

17. An arrangement for providing a composite video signal comprising:

a means for generating a foreground video signal;

a means for generating a background video signal;

means responsive to the foreground video signal for generating a signal to emphasize selected signal components in the foreground video signal, said means including means for matrixing components of the foreground video signal to provide a combined signal, sine/cosine potentiometer means for generating angularly related signals, multipliers for multiplying the differences between components of the foreground video signal and the combined signal by the angularly related signals, and means for combining outputs of the multipliers to provide the signal emphasizing the selected signal components in the foreground video signal;

first means for comparing the signal emphasizing the selected signal components with a reference, the first means for comparing generating a first generally squarewave pulse whenever the signal emphasizing the selected signal components exceeds the reference;

means for filtering each generally squarewave pulse to provide the pulse with selected rise and fall times;

second means responsive to each filtered generally squarewave pulse for comparing the filtered generally squarewave pulse with a reference pulse, the second means for comparing generating a second generally squarewave pulse and the complement thereof whenever the filtered generally squarewave pulse exceeds the reference;

second means for filtering the complement of each second generally squarewave pulse to provide the pulse with selected rise and fall times;

a common output;

a first gate coupled between the means for generating a foreground video signal and the common output, the first gate being operative to gate the video signal from the means for generating a foreground video signal to the common output in accordance with the complement of each second generally squarewave pulse as filtered by the second means for filtering;

means coupled to limit each second generally squarewave pulse in accordance with the signal emphasizing the selected signal components;

third means for filtering each generally squarewave pulse as limited by the means coupled to limit to provide the pulse with selected rise and fall times; and

a second gate coupled between the means for generating a background video signal and the common output, the second gate being operative to gate the video signal from the means for generating a background video signal to the common output in accordance with each second generally squarewave pulse as filtered by the third means for filtering.

18. The invention defined in claim 17, wherein the means coupled to limit each second generally squarewave pulse comprises first delay means for delaying the signal representing a selected color by a first amount, second delay means for delaying the signal representing a selected color as delayed by the first amount by a second amount, means for non-additively mixing the signal representing a selected color as delayed by the first amount with the signal representing a selected color as delayed by the first and second amounts to provide a limiting signal, means for adjusting the level of the limiting signal, and means for applying the adjusted limiting signal to limit each second generally squarewave pulse.

19. The invention defined in claim 18, further including a logarithmic amplifier coupled to amplify the signal representing a selected color prior to delay of the signal by the first delaying means.

20. A method in which the video signal from a first source is processed, thereafter comparing the processed video signal with a reference in a comparator means to generate generally squarewave pulses, using the pulses for controlling the relative gating of the video signal from the first source and a video signal from a second source to an output, increasing the width of each pulse generated by the comparator means by a selected amount to prevent an outline between the video signals from the first and second sources.

21. The method defined in claim 20 wherein the rise and fall times of each pulse generated by the comparator means is altered and each pulse as altered is compared with an adjustable reference to provide generally squarewave pulses.

22. The method in accordance with claim 20 wherein the video signals comprise first and second video signals from first and second video signal sources and which are selectively gated to an output, wherein:

the comparing of the processed video signal with said reference in said comparator means enables generation of pulses when the processed video signal exceeds the reference; and

alternately gating the video signals from the first and second sources to the output under control of the pulses of increased width.

23. The method defined in claim 22, further comprising expanding the processed video signal, and applying the expanded processed video signal to modulate the pulses of increased width prior to gating of the video signals from the first source to the output.

24. The method defined in claim 23 further including altering the processed video signal in accordance with a predetermined transfer characteristic prior to applying the processed video signal.

25. The method defined in claim 22 wherein the first signals are foreground signals and the second signals are background signals which are selectively gated from foreground and background video signal sources to an output, said method further comprising:

generating a signal identifying the presence of a selected color in the video signal from the foreground source;

the comparison operation comprising comparing the signal identifying the presence of a selected color with a reference and generating a comparison pulse whenever the signal identifying the presence of a selected color exceeds the reference;

controlling the passage of the video signal from the foreground source from a first gating means to the output in accordance with an input signal applied thereto;

applying the pulses of increased width as the input signal to the first gating means;

controlling the passage of video signals from the background source from a second gating means to the output in accordance with an input signal applied thereto; and

applying the complement of the pulses of increased width as the input signal to the second gating means.

26. The method defined in claim 25 wherein the method comprises limiting the pulses of increased width in accordance with the signal identifying the presence of a selected color, and applying the limited pulses as the input signal to the first gating means.

27. The method defined in claim 26 further including amplifying the signal identifying the presence of a selected color in a logarithmic amplifier prior to application of the limited pulses to the first gating means.

28. The method defined in claim 27 further including varying the level of the signal identifying the presence of a selected color prior to application of the limited pulses to the first gating means.

29. The method defined in claim 27 further including expanding the signal identifying the presence of a selected color prior to application of the limited pulses to the first gating means.

30. A method for selectively gating the video signals from first and second video signal sources to an output, comprising:

processing the video signal from the first source to to emphasize selected signal components of the video signal;

comparing the processed video signal with a reference in a comparator means and generating pulses when the processed video signal exceeds the reference;

increasing the width of each pulse by a selected amount in response to each pulse generated by the comparator means; and

alternately gating the video signals from the first and second sources to the output under control of the pulses of increased width.

31. An arrangement for selectively gating the video signals from first and second video signal sources to an output comprising:

means for processing the video signal from the first source to emphasize a selected signal component of the video signal;

comparator means for comparing the processed video signal with a reference, the comparator means generating pulses when the processed video signal exceeds the references;

means responsive to each pulse generated by the comparator means for producing pulses of increased width where the width of the pulse is increased by a selected amount to prevent formation of a matte outline in a composite image derived from the video signals from the first and second sources, said selected amount being sufficient to expand an image created from one of said signals into a region normally occupied by the matte outline;

first delay means for compensating for the pulses of increased width by a first delay amount, second delay means to delay the pulses from the first delay means by a second delay amount;

means for non-additively mixing pulses as delayed by a first delay amount with pulses as delayed by the second delay amount; and

gating means coupled to alternately gate the video signals from the first and second sources to the output under control of the pulses of increased width.

32. In an arrangement in which the video signal from a foreground television camera is processed to generate a color difference signal to emphasize selected signal components of the video signal, the arrangement generating a color difference signal based on the signal emphasizing selected signal components, the video signal as so processed being applied to first and second gating means to respectively gate the video signal from the foreground television camera and a video signal from a background television camera to an output, the improvement comprising means responsive to the processed video signal for altering the processed video signal in accordance with a predetermined non-linear transfer characteristic selected so that characteristics of the color difference signal and non-linear characteristics are algebraically combined to provide a signal with a linear characteristic, said last named means being operative with means for generating pulses of increased width, first delay means to compensate for the pulses of increased width by a first delay amount, second delay means to delay the pulses from the first delay means by a second amount;

said means for altering the processed video signal through said algebraically combining the characteristics of the color difference signal with the nonlinear transfer characteristic permits such combining in accordance with the delay by the first and second amounts to provide said signal with a linear characteristic; and

means for applying the processed video signal as altered in accordance with a linear characteristic to limit the processed video signal as it is applied to the second gating means to gate the video signal from the background television camera.

33. The invention defined in claim 32 further characterized in that said improvement comprises shadow intensity adjust means for adjusting the intensity of shadows caused by the video signal as processed.

34. An arrangement for selectively gating video signals from foreground and background video signal sources to an output comprising:

means responsive to the video signal from the foreground source for generating a signal to emphasize selected signal components in the video signal from the foreground source;

means for comparing the signal emphasizing selected signal components with a reference, the means for comparing generating a pulse whenever the signal emphasizing selected signal components exceeds the reference;

means responsive to each pulse generated by the means for comparing the generating a complementary pulse;

means responsive to the complementary pulse for increasing the width thereof by a selected amount to aid in prevention of matte outline;

first gating means coupled to control the passage of the video signal from the foreground source to the output in accordance with the complementary pulse as widened;

means for limiting each pulse generated by the means for comparing in accordance with the signal emphasizing selected signal components, said means for limiting each pulse generating the limited pulses essentially simultaneously with the generation of the complementary pulses; and

second gating means coupled to control the passage of the video signal from the background source to the output in accordance with limited pulses from the means for limiting.