Image processing apparatus and image-processing method

• US 20020036692A1
• Filed: 09/10/2001
• Published: 03/28/2002
• Est. Priority Date: 09/28/2000
• Status: Active Grant

• Current Assignee: Toshiba Electronic Devices & Storage Corporation (Toshiba Corporation), Toshiba Infrastructure Systems & Solutions Corporation (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Okada, Ryuzo
• Granted Patent: US 7,015,952 B2
• Time in Patent Office: Days
• US Class Current: 348/208.99
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 23/682 Vibration or motion blur correction

Abstract

An image processing apparatus comprises an image capture device which generates a video image containing an image shake caused by a shake of the image capture device, a region selector which selects a given image region used for detecting the image shake, a shake detector which detects an amount of the image shake within the given image region, and an image compensator which compensates the video image based on the amount of the image shake to cancel the image shake.

Claims

1. An image processing apparatus, comprising:

an image capture device configured to generate a video image containing an image shake caused by a shake of the image capture device;

a region selector configured to select, from the video image, a given image region used for detecting the image shake;

a shake detector configured to detect an amount of the image shake within the given image region; and

an image compensator which compensates the video image based on the amount of the image shake to cancel the image shake.

2. An apparatus according to claim 1, wherein the region selector selects an image region including a vanishing point corresponding to an infinite distance of a direction in which the image capture device is moved as the given image region.

3. An image processing apparatus provided for a mobile object movable in real space, comprising:

an image capture device mounted on the mobile object and configured to generate a video image containing an image shake caused by a shake of the image capture device;

a region selector configured to select, from the video image, a given image region used for detecting the image shake;

a shake detector configured to detect an amount of the image shake within the given image region; and

an image compensator which compensates the video image based on the amount of the image shake to cancel the image shake.

4. An apparatus according to claim 3, wherein the region selector selects an image region including a vanishing point corresponding to an infinite distance of a direction in which the mobile object is running as the given image region.

5. An apparatus according to claim 3, wherein the region selector selects a region wherein the region selector selects a region that the variation of the image caused by translation of the mobile object other than the shake of the image capture device caused by the unevenness of a road surface or steering of the mobile object is minute.

6. An apparatus according to claim 3, wherein the shake detector detects a motion vector of each pixel in the image region selected by the region selector, and computes the amount of shake of the video image by analyzing the motion vector.

7. An apparatus according to claim 3, wherein the shake detector comprises a motion vector detector and a shake-amount computation device, the motion vector detector detecting a motion vector of each pixel in the given image region, using at least two frames of the video image, and the shake amount computation section computing the amount of image shake from the motion vector detected by the motion vector detector.

8. An apparatus according to claim 7, wherein the shake detector sets a reference frame to the video image, and the motion vector detector computes the motion vector of each pixel using the reference frame and a current frame of the video image.

9. An apparatus according to claim 8, wherein the reference frame is updated at least one of a time when a magnitude of the motion vector exceeds a predetermined value and a time when a difference between a current time and a time when the reference frame is captured becomes larger than a predetermined value.

10. An apparatus according to claim 3, wherein the image capture device comprises a television camera mounted on a vehicle as the mobile object.

11. An image processing method, comprising:

generating a video image containing an image shake;

selecting, from the video image, a given image region used for detecting the image shake;

detecting an amount of the image shake within the given image region; and

compensating the video image based on the amount of the image shake to cancel the image shake.

13. A method according to claim 12, wherein the step of selecting a given image region selects an image region including a vanishing point corresponding to an infinite distance of a direction in which the mobile object is running as the given image region.

14. A method according to claim 12, wherein the step of selecting a given image region selects a region wherein the region selector selects a region that the image shake accompanying parallel displacement of the mobile object other than the shake of the image capture device caused by the unevenness of a road surface or steering of the mobile object is minute.

15. A method according to claim 12, wherein the step of detecting an amount of the image shake includes detecting a motion vector of each pixel in the image region selected in the step of selecting a given image region, and computing the amount of shake of the video image by analyzing the motion vector.

16. A method according to claim 12, wherein the step of detecting an amount of the image shake includes detecting a motion vector of each pixel in the given image region, using at least two frames of the video image, and computing the amount of image shake from the motion vector detected by the motion vector detector.

12. An image processing method, comprising:

generating a video image containing an image shake caused by a shake of the image capture device mounted on a mobile object running a road;

selecting, from the video image, a given image region used for detecting the image shake caused by running of the mobile object;

detecting an amount of the image shake within the given image region; and

compensating the video image based on the amount of the image shake to cancel the image shake.

17. A computer readable program stored in an storing medium, the program comprising:

means for instructing a computer to input a video image containing an image shake caused by a shake of an image capture device mounted on a mobile object running a road;

means for instructing the computer to select, from the video image, a given image region used for detecting the image shake caused by running of the mobile object;

means for instructing the computer to detect an amount of the image shake within the given image region; and

means for instructing to compensate the video image based on the amount of the image shake to cancel the image shake.