Method for eliminating temporal and spacial distortion from interlaced video signals

• US 5,903,319 A
• Filed: 01/17/1995
• Issued: 05/11/1999
• Est. Priority Date: 05/13/1991
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Interactive Pictures Corp. (IPIX Corporation)
• Inventors: Tourville, Michael J., Busko, Nicholas, Martin, H. Lee, Grantham, H. Craig
• Primary Examiner(s): Burgess, Glenton B.
• Application Number:
  US08/373,434
• Time in Patent Office: 1,575 Days
• Field of Search: 348/36, 348/147, 348/578, 348/607, 348/222, 348/443, 382/44, 382/300, 382/275, 395/137-139
• US Class Current: 348/607
• CPC Class Codes: A61B 2090/0813 Accessories designed for easy sterilising, i.e. re-usable
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06T 3/047 Fisheye or wide-angle transformations
• CPC Class Codes: G06T 3/12 Panospheric to cylindrical image transformations
• CPC Class Codes: G08B 13/19628 of wide angled cameras and camera groups, e.g. omni-directional cameras, fish eye, single units having multiple cameras achieving a wide angle view
• CPC Class Codes: G08B 13/19676 Temporary storage, e.g. cyclic memory, buffer storage on pre-alarm
• CPC Class Codes: G08B 13/19689 Remote control of cameras, e.g. remote orientation or image zooming control for a PTZ camera
• CPC Class Codes: H04N 1/2158 using a detachable storage unit
• CPC Class Codes: H04N 1/217 Interfaces allowing access to a single user
• CPC Class Codes: H04N 23/58 Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 25/00 Circuitry of solid-state image sensors [SSIS]; Control thereof
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 7/002 Special television systems not provided for by H04N7/007 - H04N7/18 still pictures via a television channel H04N1/00098
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A method and apparatus for the elimination of temporal and spacial distortions from interlaced video signals, particularly those that occur in signals associated with affine transformations. This elimination is particularly of value for signals that have been magnified so as to prevent the visual appearance of reverse movement of moving images. The removal of these distortions is achieved by sequentially inputting the images fields into three field buffers, updating the data in a rotary manner. This data is withdrawn from any two of the field buffers, while the third field buffer is being updated, and averaging the data from the two. When such averaged data is displayed, there is no apparent reverse direction motion to the image. The method and apparatus are applied to a system wherein there is affine transformation to achieve selected pan, tilt, rotation and magnification of images during the correction of distorted images received from a wide angle lens.

Claims

1. A method for substantially eliminating temporal and spatial distortion from interlaced video signals, said method comprising:

converting said interlaced video signals to digital signals;

sequentially inputting said digital signals into three field buffers;

sequentially withdrawing said digital signals from two of said three field buffers during inputting of said digital signals into a third of said three field buffers;

averaging said digital signals withdrawn from said two of said three field buffers; and

converting said averaged signals into analog video signals.

2. The method of claim 1 wherein said averaging is according to the equation:

space="preserve" listing-type="equation">P.sub.out(u,v) = P.sub.in(x,y) +P.sub.in(x,y+1) !/2

where;

P_out(u,v) =Output pixel value for a pixel on line v at horizontal position u;

P_in(x,y) =Input pixel value for a pixel on line y at horizontal position x; and

P_in(x,y+1) =Input pixel value for a pixel on line y+1 at horizontal position x.

3. The method of claim 1 wherein, during said sequential withdrawal step, picture element values of vertically adjacent picture elements of temporally adjacent fields are successively addressed.

5. The method of claim 1 wherein said averaging is according to the equation:

space="preserve" listing-type="equation">P.sub.out(u,v) = P.sub.in(x,y) +P.sub.in(x,y+1) !/2

where;

P_out(u,v) =Output pixel value for a pixel on line v at horizontal position u;

P_in(x,y) =Input pixel value for a pixel on line y at horizontal position x; and

P_in(x,y+1) =Input pixel value for a pixel on line y+1 at horizontal position x.

4. A method for substantially eliminating temporal and spatial distortion from digitized interlaced video signals, said method comprising:

sequentially inputting said digitized signals into three field buffers in a rotating manner, overwriting data previously stored in each buffer;

sequentially withdrawing said digitized signals from two of said three field buffers during inputting of said digitized signals into a third of said three field buffers; and

averaging said digital signals withdrawn from said two of said three field buffers to provide output signals substantially without said temporal and spatial distortion.

6. The method of claim 4 wherein during said sequential withdrawal step, picture element values of vertically adjacent picture elements of temporally adjacent fields are successively addressed.

7. A method for substantially eliminating temporal and spatial distortion from distorted interlaced video signals obtained from a wide angle lens and intended for affine transformation to select pan, tilt, rotation and magnification for selected portions of said video signals, said method comprising:

converting said interlaced video signals to digital signals;

sequentially inputting said digital signals into three field buffers, continuously overwriting data in each of said three field buffers;

sequentially withdrawing said digital signals from two of said three field buffers during inputting of said digital signals into a third of said three field buffers, said withdrawal controlled by an algorithm for the affine transformation according to pan, tilt, rotation and magnification;

averaging said digital signals withdrawn from said two of said three field buffers; and

converting said averaged signals into analog video signals for the selected portion of input video signals.

8. The method of claim 7 wherein said algorithm is defined by one of the sets of a first set of the following equations:

##EQU2## or a second set of equations comprising polynomial approximations of the first set.

9. The method of claim 7 wherein said averaging is according to the equation:

space="preserve" listing-type="equation">P.sub.out(u,v) = P.sub.in(x,y) +P.sub.in(x,y+1) !/2

where;

P_out(u,v) =Output pixel value for a pixel on line u at horizontal position v;

P_in(x,y) =Input pixel value for a pixel on line y at horizontal position x; and

P_in(x,y+1) =Input pixel value for a pixel on line y+1 at horizontal position x.

10. Apparatus for substantially eliminating temporal and spatial distortion from interlaced video signals, said apparatus comprising:

a convertor circuit for converting said interlaced video signals to digital signals;

an input sequencer circuit for inputting said digital signals into three field buffers;

an output sequencer circuit for withdrawing said digital signals from two of said three field buffers during inputting of said digital signals into a third of said three field buffers;

an averager circuit for averaging said digital signals withdrawn from said two of said three field buffers; and

an output convertor circuit for converting said averaged signals into analog video signals.

11. The apparatus of claim 10 wherein said averager circuit averages said withdrawn digital signals according to the equation:

space="preserve" listing-type="equation">P.sub.out(u,v) = P.sub.in(x,y) +P.sub.in(x,y+1) !/2

where;

P_out(u,v) =Output pixel value f or a pixel on line v at horizontal position u;

P_in(x,y) =Input pixel value for a pixel on line y at horizontal position x; and

P_in(x,y+1) =Input pixel value for a pixel on line y+1 at horizontal position x.

12. The apparatus of claim 10 further comprising a visual display unit for displaying said analog video signals.

13. An integrated circuit for use in an imaging system comprising

a plurality of random access memories, at least two of which comprise memories for storing first and second fields of video data,

a random access memory multiplexer coupled to said random access memories, and

a plurality of input and output controllers coupled to said random access memories via said random access memory multiplexer, said output controllers comprising one of a dewarping logic circuit and a vertical line averaging circuit.

14. The integrated circuit of claim 13 further comprising

an output formatting circuit for outputting data in accordance with a predetermined format.

15. The integrated circuit of claim 13 wherein said input controller comprises means for inputting video data via the random access multiplexer into the random access memories.

16. The integrated circuit of claim 13, the dewarping logic circuit for correcting an image having a predetermined distortion introduced by an imaging system.

17. The integrated circuit of claim 13, the vertical line averaging circuit for correcting temporal and spatial distortion of an interlaced video image.