Image stabilization apparatus, and control method and storage medium thereof

• US 10,397,480 B2
• Filed: 05/30/2017
• Issued: 08/27/2019
• Est. Priority Date: 06/01/2016
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Mukunashi, Masayuki
• Primary Examiner(s): Henn, Timothy J
• Application Number:
  US15/608,499
• Publication Number:
  US 20170353664A1
• Time in Patent Office: 819 Days
• CPC Class Codes: G02B 27/644 compensating for large deviations, e.g. maintaining a fixed line of sight while a vehicle on which the system is mounted changes course
• CPC Class Codes: G02B 27/646 compensating for small deviations, e.g. due to vibration or shake movement of one or more optical elements for control of motion blur in cameras, projectors or printers G03B2205/0007; image stabilisation in cameras peculiar to the presence or use of an electronic image sensor H04N23/68
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/681 Motion detection
• CPC Class Codes: H04N 23/6812 based on additional sensors, e.g. acceleration sensors
• CPC Class Codes: H04N 23/682 Vibration or motion blur correction
• CPC Class Codes: H04N 23/687 by shifting the lens or sensor position
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming

Abstract

An image stabilization apparatus includes: a first calculation unit configured to calculate an angular velocity of movement of an image capturing apparatus; a second calculation unit configured to calculate a moving amount of an object from a plurality of images; a third calculation unit configured to calculate an angular velocity of movement of the object; a determination unit configured to determine whether or not the object is walking; and a selection unit configured to select, based on a determination result of the determination unit, whether to perform control such that an image stabilization unit corrects image blur based on the angular velocities calculated by the first calculation unit and the third calculation unit, or such that the image stabilization unit corrects image blur based on the angular velocity calculated by the first calculation unit.

Claims

1. An image stabilization apparatus, comprising:

at least one processor and/or circuitry;

a first calculation unit configured to calculate an angular velocity of movement of an image capturing apparatus;

a second calculation unit configured to calculate a moving amount of an object from a plurality of images captured by an image capturing device of the image capturing apparatus;

a third calculation unit configured to calculate an angular velocity of movement of the object based on output of the first and second calculation units;

a determination unit configured to determine whether or not the object is walking; and

a selection unit configured to select, based on a determination result of the determination unit, whether to perform control such that an image stabilization device corrects image blur of the object based on the angular velocity of movement of the image capturing apparatus calculated by the first calculation unit and the angular velocity of movement of the object calculated by the third calculation unit, or such that the image stabilization device corrects image blur of the object based on the angular velocity of movement of the image capturing apparatus calculated by the first calculation unit,

wherein the first calculation unit, the second calculation unit, the third calculation unit, the determination unit and the selection unit are implemented by the at least one processor or the circuitry or a combination thereof.

2. The image stabilization apparatus according to claim 1,

wherein the selection unit, when determined by the determination unit that the object is walking, with respect to a traveling direction of the object, selects to perform control such that the image stabilization device corrects image blur of the object based on the angular velocity of movement of the image capturing apparatus calculated by the first calculation unit and the angular velocity of movement of the object calculated by the third calculation unit, and with respect to a direction orthogonal to the traveling direction of the object, selects to perform control such that the image stabilization device corrects image blur of the object based on the angular velocity of movement of the image capturing apparatus calculated by the first calculation unit.

3. The image stabilization apparatus according to claim 1,

wherein the selection unit, when determined by the determination unit that the object is not walking, with respect to both the traveling direction of the object and a direction orthogonal to the traveling direction of the object, selects to perform control such that the image stabilization device corrects image blur of the object based on the angular velocity of movement of the image capturing apparatus calculated by the first calculation unit and the angular velocity of movement of the object calculated by the third calculation unit.

4. The image stabilization apparatus according to claim 1,

wherein the determination unit determines that the object is not walking when, regarding a direction of shaking the image capturing apparatus to perform a panning shot, a direction perpendicular to the ground is dominant.

5. The image stabilization apparatus according to claim 1,

wherein the determination unit determines whether or not the object is walking from a history of movement shaking the image capturing apparatus to perform a panning shot.

6. The image stabilization apparatus according to claim 1,

wherein the determination unit determines a direction of shaking the image capturing apparatus to perform a panning shot, and then further determines whether or not the object is walking from a history of movement shaking the image capturing apparatus to perform a panning shot.

7. The image stabilization apparatus according to claim 1, wherein the at least one processor and/or circuitry further function as:

a human detection unit configured to detect a person as the object,

wherein the second calculation unit calculates a moving amount of the person from a plurality of images captured by the image capturing device.

8. The image stabilization apparatus according to claim 1, wherein the at least one processor and/or circuity further function as:

an attitude detection unit configured to detect an attitude of the image capturing apparatus.

9. The image stabilization apparatus according to claim 1,

wherein the image stabilization device is a shift lens provided in an image capturing optical system and configured to move in a direction different than the optical axis of the image capturing optical system.

10. The image stabilization apparatus according to claim 1,

wherein the image stabilization device has a driving device configured to move an image capturing element in a direction orthogonal to the optical axis of the image capturing optical system.

11. A control method of an image stabilization apparatus, comprising:

first calculation of calculating an angular velocity of movement of an image capturing apparatus;

second calculation of calculating a moving amount of an object from a plurality of images captured by an image capturing device of the image capturing apparatus;

third calculation of calculating an angular velocity of movement of the object based on output of the first calculation and the second calculation;

determining whether or not the object is walking; and

selecting, based on a determination result in the determining, whether to perform control such that an image stabilization device corrects image blur of the object based on the angular velocity of movement of the image capturing apparatus calculated by the first calculation and the angular velocity of movement of the object calculated by the third calculation, or such that the image stabilization device corrects image blur of the object based on the angular velocity of movement of the image capturing apparatus calculated by the first calculation.

12. A non-transitory computer-readable storage medium storing a program for causing a computer to execute a control method of an image stabilization apparatus, comprising:

first calculation of calculating an angular velocity of movement of an image capturing apparatus;

second calculation of calculating a moving amount of an object from a plurality of images captured by an image capturing device of the image capturing apparatus;

third calculation of calculating an angular velocity of movement of the object based on output of the first calculation and the second calculation;

determining whether or not the object is walking; and

selecting, based on a determination result in the determining, whether to perform control such that an image stabilization device corrects image blur of the object based on the angular velocity of movement of the image capturing apparatus calculated by the first calculation and the angular velocity of movement of the object calculated by the third calculation, or such that the image stabilization device corrects image blur of the object based on the angular velocity of movement of the image capturing apparatus calculated by the first calculation.