IMAGE BLUR CORRECTION APPARATUS, METHOD FOR CONTROLLING THE SAME, AND STORAGE MEDIUM

• US 20170155842A1
• Filed: 11/22/2016
• Published: 06/01/2017
• Est. Priority Date: 11/27/2015
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Takayanagi, Wataru
• Granted Patent: US 10,091,424 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/73 Deblurring; Sharpening
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 23/6815 by distinguishing pan or tilt from motion
• CPC Class Codes: H04N 23/683 performed by a processor, e.g. controlling the readout of an image memory
• CPC Class Codes: H04N 23/685 performed by mechanical compensation

Abstract

An image blur correction apparatus includes a first detection unit configured to detect motion vectors in plural different areas using a plurality of images, a determination unit configured to determine an amount of movement of a main object based on the motion vectors in the plural different areas detected by the first detection unit, and a control unit configured to correct an image blur of the main object based on the amount of movement of the main object determined by the determination unit. The determination unit determines a center of gravity or a peak movement amount of which value is included in a determination range near zero (0) among plural amounts of movement represented by the motion vectors in the plural different areas to be the amount of movement of the main object.

Claims

1. An image blur correction apparatus comprising:

a first detection unit configured to detect motion vectors in plural different areas using a plurality of images,

a determination unit configured to determine an amount of movement of a main object based on the motion vectors in the plural different areas detected by the first detection unit, and

a control unit configured to correct an image blur of the main object based on the amount of movement of the main object determined by the determination unit, wherein

the determination unit determines a center of gravity or a peak movement amount of which value is included in a determination range near zero (0) among plural amounts of movement represented by the motion vectors in the plural different areas to be the amount of movement of the main object.

2. The image blur correction apparatus according to claim 1, further comprising a second detection unit configured to detect a movement of an image capturing apparatus which captures the plurality of images, wherein

the determination unit changes the determination range depending on a detection result of the second detection unit.

3. The image blur correction apparatus according to claim 2, wherein the determination unit narrows the determination range as the detection result of the second detection unit shows that an amount of movement of the image capturing apparatus is smaller.

4. The image blur correction apparatus according to claim 1, wherein depending on distribution of the motion vectors in the plural different areas detected by the first detection unit, the determination unit switches between making the center of gravity of the movement amount included in the determination range be the amount of movement of the main object and making the peak of the movement amount included in the predetermined range be the amount of movement of the main object.

5. The image blur correction apparatus according to claim 4, wherein, if the movement amount included in the determination range has plural peaks, the determination unit makes the center of gravity of the movement amount included in the determination range to be the amount of movement of the main object.

6. The image blur correction apparatus according to claim 1,

further comprising a second detection unit configured to detect a movement of an image capturing apparatus which captures the plurality of images, wherein

the determination unit determines a movement amount which is not used for the determination of the amount of movement of the main object in the movement amount included in the determination range depending on a detection result of the second detection unit.

7. The image blur correction apparatus according to claim 6, wherein the determination unit specifies an amount of movement of a background depending on the detection result of the second detection unit, and does not use the amount of movement of the specified background for the determination of the amount of movement of the main object in the movement amount included in the determination range.

8. A method for controlling an image blur correction apparatus, the method comprising:

a first detection process to detect motion vectors of plural different areas using a plurality of images;

a determination process to determine an amount of movement of a main object based on the motion vectors of plural different areas detected in the first detection process; and

a control process to correct an image blur of the main object based on the amount of movement of the main object determined in the determination process, wherein

the determination process determines a center of gravity or a peak movement amount of which value is included in a determination range near zero (0) among plural amounts of movement represented by the motion vectors in the plural different areas to be the amount of movement of the main object.

9. A non-transitory computer readable storage medium configured to store a program causing a computer to execute each steps of:

a first detection process to detect motion vectors of plural different areas using a plurality of images;

a determination process to determine an amount of movement of a main object based on the motion vectors of plural different areas detected in the first detection process; and

a control process to correct an image blur of the main object based on the amount of movement of the main object determined in the determination process, wherein

the determination process determines a center of gravity or a peak movement amount of which value is included in a determination range near zero (0) among plural amounts of movement represented by the motion vectors in the plural different areas to be the amount of movement of the main object.