Television picture stabilizing system

• US 4,403,256 A
• Filed: 11/10/1981
• Issued: 09/06/1983
• Est. Priority Date: 11/10/1981
• Status: Expired due to Term

• Current Assignee: CBS Incorporated (Paramount Global (f/k/a ViacomCBS Inc.))
• Original Assignee: CBS Incorporated (Paramount Global (f/k/a ViacomCBS Inc.))
• Inventors: Green, Richard R., Mahler, Henry W., Siau, John E.
• Primary Examiner(s): ORSINO JR, JOSEPH
• Application Number:
  US06/319,845
• Time in Patent Office: 665 Days
• Field of Search: 358/109, 358/222, 358/125, 358/105, 358/126
• US Class Current: 348/208.3
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 23/6815 by distinguishing pan or tilt from motion
• CPC Class Codes: H04N 23/683 performed by a processor, e.g. controlling the readout of an image memory
• CPC Class Codes: H04N 5/145 Movement estimation for video coding H04N19/51

Abstract

The disclosed picture stabilizing system detects and measures picture unsteadiness in recorded or live video caused by an unsteady television camera and automatically eliminates the unsteadiness without destroying intentional panning and tilting of the camera. This is accomplished by selecting camera motion references within the camera field of view consisting of one horizontal edge and one vertical edge of an object which will normally be stationary, such as a door, a window, or a piece of furniture. The stabilizer "locks" onto these edges, continually measuring their motion from field to field and utilizing a frame store, makes the necessary vertical and horizontal corrections to the overall picture to eliminate such motion. The system is able to correct for movement due to random unsteadiness without interfering with planned camera movement.

Claims

1. System for processing and producing from an input video signal exhibiting unsteadiness due to having been produced by an unsteady television camera, a corrected video signal essentially free of such unsteadiness, said system comprising, in combination:

means receiving said input video signal and for selecting therefrom a reference object within the camera field of view, which reference object but for said camera unsteadiness would normally be stationary, against which to measure picture motion;

means for measuring motion of said selected reference object and for producing a correction signal representative of such measured motion; and

means operative responsively to said correction signal for making the necessary corrections to the overall television picture represented by said input video signal to eliminate picture unsteadiness.

2. System according to claim 1,

wherein said reference object selecting means comprises means for separately selecting from said input video signal at least one of a horizontally disposed reference edge and a vertically disposed reference edge within the camera field of view against which to measure up and down and side-to-side motion, respectively;

wherein said measuring means comprises means for separately measuring motion of the selected one or ones of said horizontally and vertically disposed reference edges for producing vertical and horizontal correction signals, respectively; and

wherein said correction-making means is operative responsively to a selected one or ones of said correction signals.

3. System according to claim 2, wherein said correction-making means includes separate means for making vertical corrections to the television picture to eliminate up and down motion, which means comprises:

first delay means having a controllable delay time connected to receive said input video signal and operative responsively to said vertical correction signal to vary its delay time in integral line increments in a direction and by an amount necessary to substantially eliminate up and down motion of said horizontally disposed reference edge.

4. System according to claim 3, wherein said input video signal is a field-interlaced signal, and

wherein said first delay means is a digital store having a controllable delay time of at least one television field.

5. System according to claim 4, wherein said means for measuring the motion of said horizontally disposed reference edge comprises means for comparing the vertical position of said horizontally disposed reference edge in successive corresponding fields and producing for each such comparison a vertical correction signal indicative of the number of television lines of position change, if any;

and

wherein said digital store is operative responsively to said vertical correction signal to vary its delay in a direction and by an amount equal to the integral number of television lines sufficient to produce at the output of said store a vertically stabilized video signal in which said horizontally disposed reference edge is maintained at substantially the same vertical position.

6. System according to claim 2, wherein said means for selecting a reference edge comprises:

means for slicing said input video signal for producing signals representing a transition in contrast caused by an edge occurring within the camera field of view;

means including a television monitor for visually displaying said sliced video signal;

means for producing an electronic cursor positionable on said monitor by an operator to intersect an edge of interest in the displayed sliced video; and

means operative responsively to the intersection of said cursor with a selected edge for producing transition-indicating signals for use in measuring motion of the selected edge.

7. System according to claim 6,

wherein said input video signal is a color television signal containing luminance and chrominance components, and

wherein said slicing means includes means for substantially removing the chrominance component of said input video signal prior to slicing.

8. System according to claim 6, wherein said cursor-producing means includes means for producing a first vertically disposed cursor for selecting a horizontally disposed reference edge of interest, and means for producing a second horizontally disposed cursor for selecting a vertically disposed reference edge of interest.

9. System according to claim 8, wherein said means for measuring motion of a selected horizontally disposed reference edge comprises:

first counting means connected to be clocked at the line rate of said input video signal, to be successively reset at the field rate of said input video signal, and to be stopped by a transition-indicating signal for producing an output vertical position-indicating count indicative of the position of the line containing said selected reference edge, and

means for comparing each such vertical position-indicating count with the vertical position-indicating count produced in the next previous corresponding field and for each such comparison producing a vertical correction signal.

10. System according to claim 9, wherein said means for measuring motion of a selected horizontally disposed reference edge further comprises:

means operative responsively to the output count of said first counting means and to said vertical correction signal for producing a first tracking window which automatically locks onto and tracks the selected horizontally disposed reference edge and for predicting its position in the next succeeding corresponding field.

11. System according to claim 10, wherein said last-mentioned means further includes means for selectively changing the vertical height of said first tracking window.

12. System according to claim 9, wherein said means for measuring motion of a selected vertically disposed reference edge comprises:

second counting means connected to be clocked at a rate corresponding to the reciprocal of the picture element interval of said input video signal, to be successively reset at the line rate of said input video signal, and to be stopped by a transition-indicating signal for producing an output horizontal position-indicating count indicative of the position of the selected vertically disposed reference edge along a line selected by said horizontally disposed cursor, and

means for comparing each such horizontal position-indicating count with the horizontal position-indicating count produced in the next previous field and for each such comparison producing a horizontal correction signal.

13. System according to claim 12, wherein said means for measuring motion of a selected vertically disposed reference edge further comprises:

means operative responsively to the output count of said second counting means and to said horizontal correction signal for producing a second tracking window which automatically locks onto and tracks the selected vertically disposed reference edge and for predicting its position in the next succeeding field.

14. System according to claim 13, wherein said last-mentioned means includes means for selectively changing the horizontal length of said second tracking window.

15. System according to claim 13, wherein said input video signal is an NTSC television signal in which the phase of the color subcarrier has a four field sequence, and

wherein said means for measuring motion of a selected vertically disposed reference edge includes means for recycling the line selected by the horizontally disposed cursor in a four-field sequence for causing the color subcarrier at the vertically disposed reference edge to have the same phase in successive fields.

16. System according to claim 8, wherein said means for measuring motion of a selected vertically disposed reference edge comprises:

second counting means connected to be clocked at a rate corresponding to the reciprocal of the picture element interval of said input video signal, to be successively reset at the line rate of said input video signal, and to be stopped by a transition-indicating signal for producing an output horizontal position-indicating count indicative of the position of the selected vertically disposed reference edge along a line selected by said horizontally disposed cursor, and

means for comparing each such horizontal position-indicating count with the horizontal position-indicating count produced in the next previous field and for each such comparison producing a horizontal correction signal.

17. System according to claim 16, wherein said means for measuring motion of a selected vertically disposed reference edge further comprises:

means operative responsively to the output count of said second counting means and to said horizontal correction signal for producing a second tracking window which automatically locks onto and tracks the selected vertically disposed reference edge and for predicting its position in the next succeeding field.

18. System according to claim 17, wherein said last-mentioned means includes means for selectively changing the horizontal length of said second tracking window.

19. System according to claim 17, wherein said input video signal is an NTSC television signal in which the phase of the color subcarrier has a four field sequence, and

wherein said means for measuring motion of a selected vertically disposed reference edge includes means for recycling the line selected by the horizontally disposed cursor in a four-field sequence for causing the color subcarrier at the vertically disposed reference edge to have the same phase in successive fields.

20. System according to claim 3, wherein said correction-making means includes means for separately making horizontal corrections to the television picture to eliminate side-to-side motion, which means comprises:

second delay means having a controllable delay time and operative responsively to said horizontal correction signal to vary the delay thereof in system clock period increments in a direction and by an amount necessary to substantially eliminate side-to-side motion of said vertically disposed reference edge.

21. System according to claim 20, wherein the means for measuring motion of said vertically disposed reference edge comprises means for comparing the horizontal position of said vertically disposed reference edge in successive fields and for each comparison producing a horizontal correction signal indicative of the number of system clock intervals change of position, if any.

22. System according to claim 20, wherein said second delay means receives a vertically stabilized video signal from said first delay means for producing at its output a vertically and horizontally stabilized video signal.

23. System according to claim 4, wherein said correction-making means includes means for separately making horizontal corrections to the television picture to eliminate side-to-side motion, which means comprises:

second delay means having a controllable delay time and operative responsively to said horizontal correction signal to vary the delay thereof in system clock period increments in a direction and by an amount necessary to substantially eliminate side-to-side motion of said vertically disposed reference edge.

24. System according to claim 23, wherein the means for measuring motion of said vertically disposed reference edge comprises means for comparing the horizontal position of said vertically disposed reference edge in successive fields and for each comparison producing a horizontal correction signal indicative of the number of system clock intervals change of position, if any.

25. System according to claim 23, wherein said second delay means receives the vertically stabilized video signal from said first delay means for producing at its output a vertically and horizontally stabilized video signal.

26. System according to claim 5, wherein said correction-making means includes means for separately making horizontal corrections to the television picture to eliminate side-to-side motion, which means comprises:

second delay means having a controllable delay time and operative responsively to said horizontal correction signal to vary the delay thereof in system clock period increments in a direction and by an amount necessary to substantially eliminate side-to-side motion of said vertically disposed reference edge.

27. System according to claim 26, wherein the means for measuring motion of said vertically disposed reference edge comprises means for comparing the horizontal position of said vertically disposed reference edge in successive fields and for each comparison producing a horizontal correction signal indicative of the number of system clock intervals change of position, if any.

28. System according to claim 26, wherein said second delay means receives the vertically stabilized video signal from said first delay means for producing at its output a vertically and horizontally stabilized video signal.