Image movement vector detection apparatus

• US 6,034,723 A
• Filed: 11/17/1993
• Issued: 03/07/2000
• Est. Priority Date: 11/20/1992
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Fujimori, Yasuhiro
• Primary Examiner(s): Faile, Andrew I.
• Assistant Examiner(s): CHRISTENSEN, ANDREW BRUCE
• Application Number:
  US08/153,916
• Time in Patent Office: 2,302 Days
• Field of Search: 348/345, 348/349, 348/352, 348/354, 348/362, 348/208
• US Class Current: 348/207.99
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 23/684 performed by controlling the image sensor readout, e.g. by controlling the integration time
• CPC Class Codes: H04N 5/145 Movement estimation for video coding H04N19/51

Abstract

An image movement vector detection apparatus detects an image movement vector from an image signal produced by a video camera. The apparatus includes a vibration vector detector which detects a vibration vector from the image signal resulting from vibration of the video camera. An image movement vector detector detects an image movement vector representing movement of an object within the image signal based both on the image signal and the vibration vector.

Claims

1. An image movement vector detection apparatus for detecting an image movement vector from an image signal produced by a video camera, the image movement vector representing movement of an object within an image represented by the image signal, comprising:

vibration vector detecting means for detecting a vibration vector from the image signal resulting from vibration of the video camera; and

image movement vector detecting means for detecting an image movement vector representing movement of an object within an image represented by the image signal based on both the image signal and the vibration vector.

2. The image movement vector detection apparatus of claim 1, wherein the vibration vector detecting means is operative to detect the vibration vector from an image signal representing substantially the entire image area of a picture, and wherein said image movement vector detecting means is operative to detect the image movement vector based on a portion of said image signal representing a central part of the picture.

3. The image movement vector detection apparatus of claim 1, wherein the vibration vector detecting means comprises a plurality of macro vector detection means each for detecting a macro vector representing movement of an image in an associated macroblock area corresponding with a portion only of the picture and vibration vector producing means for producing the vibration vector based on the macro vectors produced by the plurality of macro vector detection means.

4. The image movement vector detection apparatus of claim 1, wherein the image movement vector detecting means includes a plurality of macro vector detecting means each for detecting a macro vector representing movement of an image in an associated macroblock area including a portion only of the picture, and image movement vector producing means for producing the image movement vector based on the macro vectors produced by the macro vector detecting means and the vibration vector.

5. The image movement vector detection apparatus of claim 4, wherein the image movement vector producing means is operative to produce the image movement vector based on the macro vectors with the exclusion of any thereof which is substantially the same as the vibration vector.

6. The image movement vector detection apparatus of claim 4, wherein the image movement vector detecting means is operative to produce the image movement vector as a vector corresponding with the most commonly occurring macro vector among those produced by the macro vector detecting means.

7. The image movement vector detection apparatus of claim 4, wherein the image movement vector detecting means is operative to produce the image movement vector as an average vector of those of the macro vectors which do not substantially correspond with the vibration vector.

8. The image movement vector detection apparatus of claim 4, wherein the image movement vector detecting means is operative to produce the image movement vector as an average vector of the macro vectors excluding any thereof differing from the most commonly occurring values of the macro vectors by an amount exceeding a predetermined threshold.

9. The image movement vector detection apparatus of claim 1, wherein the vibration vector detecting means comprises typical point memory means for storing typical point values of one of a frame and a field preceding a respective one of a current frame and a field of the image signal, means for producing difference data for each of a plurality of search areas within a plurality of macroblock areas of the respective one of the current frame and field by subtracting typical point data stored in the typical point memory means from data of corresponding search areas of the respective one of the current frame and field, means for producing a macro vector for each of the macroblock areas based on difference data of corresponding search areas and means for producing the vibration vector based on the detected macro vectors.

10. The image movement vector detection apparatus of claim 1, wherein the image movement vector detecting means comprises typical point memory means for storing typical point values of one of a frame and a field preceding a respective one of a current frame and a field of the image signal, means for producing difference data for each of a plurality of search areas within a plurality of macroblock areas of the respective one of the current frame and field, means for producing a macro vector for each of the macroblock areas and means for producing the image movement vector based on the detected macro vectors and the vibration vector.

11. The image movement vector detection apparatus of claim 10, wherein each of the macro vector detecting means is each operative to store difference data from overlapping search areas.

12. The image movement vector detection apparatus of claim 1, wherein the vibration vector detecting means is operative to detect the vibration vector based on portions of the image signal included in two successive ones of frames and fields thereof.

13. The image movement vector detection apparatus of claim 1, wherein the image movement vector detecting means is operative to detect the image movement vector based on portions of the image signal in two successive ones of frames and fields thereof.

14. The image movement vector detection apparatus of claim 1, wherein the vibration vector detecting means is operative to detect the vibration vector from a first portion of the image signal and the image movement vector detecting means is operative to detect the image movement vector from a second portion of the image signal differing at least in part from the first portion thereof.

15. The image movement vector detection apparatus of claim 14, wherein the first portion of the image signal overlaps with the second portion thereof.

16. The image movement vector detection apparatus of claim 14, wherein the vibration vector detecting means is operative to produce the vibration vector based on a first portion of the image signal representing a periphery of one of a frame and field thereof, and the image movement vector detecting means is operative to produce the image movement vector based on a second portion of the image signal representing a central area of said one of a frame and field thereof.

17. The image movement vector detection apparatus of claim 1, wherein the image movement vector detecting means is operative to detect the image movement vector based on block matching of a portion of a current frame with a portion of a preceding frame.

18. The image movement vector detection apparatus of claim 1, wherein the vibration vector detecting means and the image movement vector detecting means is operative to produce said vibration vector and said image movement vector, respectively, from a plurality of macro vectors each representing movement within a respective macroblock area and produced from correlation data representing differences between a plurality of typical point pixels of a preceding frame or field of the image signal and pixels of respective search areas of said respective macroblock areas, the search areas employed for producing said image movement vector encompassing relatively greater numbers of pixels than the search areas employed for producing said vibration vector.

19. A video camera for producing an image signal in response to a light image received thereby, comprising:

imaging means for producing an image signal from a light image by exposing the imaging means to the light image for a selectable exposure time;

vibration vector detecting means for detecting a vibration vector from the image signal resulting from vibration of the video camera;

image movement vector detecting means for detecting an image movement vector representing movement of an object within an image represented by the image signal based on both the image signal and the vibration vector; and

exposure time control means for setting the selectable exposure time of the imaging means based on the image movement vector.

20. The video camera of claim 19, wherein the imaging means comprises a charge coupled device.

21. The video camera of claim 19, wherein the charged coupled device is operative to select an exposure time therefor based on an electronic shutter input signal supplied thereto, and wherein the exposure time control means is operative to supply the electronic shutter input signal to said charge coupled device for selecting the exposure time thereof based on the image movement vector.

22. The video camera of claim 19, wherein the exposure time control means is operative to set the selectable exposure time based on a magnitude of the image movement vector.

23. A video camera for tracking a moving object imaged thereby, comprising:

imaging means for producing an image signal from a light image;

vibration vector detecting means for detecting a vibration vector from the image signal resulting from vibration of the video camera;

image movement vector detecting means for detecting an image movement vector representing movement of a moving object within an image represented by the image signal based on both the image signal and the vibration vector; and

servo means responsive to the image movement vector for adjusting a position of the video camera to track the moving object based on the image movement vector.