Method and apparatus for compensating for jitter in a digital video image
First Claim
1. A method of compensating for jitter in a digital image forming part of a video sequence of such digital images, the method comprising the steps of:
- providing a first plurality of motion vectors each corresponding to one of a plurality of image blocks making up the digital image, determining a jitter vector from the first plurality of motion vectors for the digital image and from a second plurality of motion vectors provided for a previous digital image in the video sequence;
adjusting the digital image using the jitter vector to compensate for jitter in the digital image to produce a jitter compensated digital image;
providing a second plurality of motion vectors including the steps of, for each image block in the jitter compensated digital image, determining a corresponding best matching image block in the digital image; and
utilizing the motion vector from the first plurality of motion vectors for the corresponding best matching image block and the jitter vector to determine a jitter-compensated motion vector for the image block in the jitter compensated digital image.
4 Assignments
0 Petitions
Accused Products
Abstract
Apparatus (10) for compensating for jitter in a digital image forming part of a video sequence of such digital images includes a first motion estimation unit (13) having an input for receiving sensed image data and an output for providing a first plurality of motion vectors, each corresponding to one of a plurality of image blocks making up the digital image. A jitter estimation unit (14) determines a jitter vector from the first plurality of motion vectors for the digital image and a jitter compensation unit (15) adjusts the digital image using the jitter vector to compensate for jitter in the digital image. A second motion estimation unit (16) provides a second plurality of motion vectors, each corresponding to one of a plurality of image blocks making up the jitter compensated digital image. The second plurality of motion vectors are determined by utilizing the first plurality of motion vectors and the jitter vector. The second plurality of motion vectors can be used in coding the jitter compensated image for storage and/or onward transmission.
-
Citations
16 Claims
-
1. A method of compensating for jitter in a digital image forming part of a video sequence of such digital images, the method comprising the steps of:
-
providing a first plurality of motion vectors each corresponding to one of a plurality of image blocks making up the digital image, determining a jitter vector from the first plurality of motion vectors for the digital image and from a second plurality of motion vectors provided for a previous digital image in the video sequence;
adjusting the digital image using the jitter vector to compensate for jitter in the digital image to produce a jitter compensated digital image;
providing a second plurality of motion vectors including the steps of, for each image block in the jitter compensated digital image, determining a corresponding best matching image block in the digital image; and
utilizing the motion vector from the first plurality of motion vectors for the corresponding best matching image block and the jitter vector to determine a jitter-compensated motion vector for the image block in the jitter compensated digital image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
determining a corresponding best matching image block in the previous digital image;
determining a displacement value between the location of the image block in the digital image and the location of the corresponding best matching image block in the previous digital image; and
utilizing the displacement value for the image block to determine a motion vector for that image block.
-
-
3. A method of compensating for jitter in a digital image according to claim 1, wherein the step of determining a jitter vector utilizes a plurality of motion vectors for at least one previous digital image.
-
4. A method of compensating for jitter in a digital image according to claim 1, wherein the step of determining a jitter vector utilizes a plurality of motion vectors for at least one subsequent digital image.
-
5. A method of compensating for jitter in a digital image according to claim 1, wherein the plurality of motion vectors relate to at least one component of jitter.
-
6. A method of compensating for jitter in a digital image according to claim 1, wherein the steps of providing a plurality of motion vectors, determining a jitter vector and adjusting the digital image are carried out for at least two separate components of jitter.
-
7. A method of compensating for jitter in a digital image according to claim 1, wherein the digital image is received from an image sensing device.
-
8. A method of compensating for jitter in a digital image according to claim 7, wherein the received digital image is corrected using the jitter vectors.
-
9. A method of compensating for jitter in a digital image according to claim 8, wherein the motion vectors are encoded for at least one of storage and onward transmission.
-
10. A method of compensating for jitter in a digital image according to claim 8, wherein the step of adjusting the digital image includes the step of:
cropping a received digital image to produce a smaller digital image where the location of the smaller digital image within the received digital image is dependent on the jitter vector.
-
11. A method of compensating for jitter in a digital image according to claim 10, further comprising the step of upsampling the smaller digital image to produce a digital image of a desired size.
-
12. Apparatus for compensating for jitter in a digital image forming part of a video sequence of such digital images, the apparatus comprising:
-
a first motion estimation unit having an input for receiving sensed image data and an output for providing a first plurality of motion vectors, each corresponding to one of a plurality of image blocks making up the digital image;
a jitter estimation unit coupled to the first motion estimation unit for determining a jitter vector from the first plurality of motion vectors for the digital image;
a jitter compensation unit coupled to the jitter estimation unit for adjusting the digital image using the jitter vector to compensate for jitter in the digital image to produce a jitter compensated digital image;
a second motion estimation unit having a first input coupled to the first motion estimating unit for receiving the first plurality of motion vectors, a second input coupled to the jitter estimation unit for receiving the jitter vector and a third input coupled to the jitter compensating unit for receiving the jitter compensated digital image, the second motion estimation unit having an output for providing a second plurality of motion vectors, each corresponding to one of a plurality of image blocks making up the jitter compensated digital image. - View Dependent Claims (13, 14, 15, 16)
-
Specification