Image blur correction apparatus, method for controlling the same, and storage medium

• US 10,091,424 B2
• Filed: 11/22/2016
• Issued: 10/02/2018
• Est. Priority Date: 11/27/2015
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Takayanagi, Wataru
• Primary Examiner(s): Nazrul, Shahbaz
• Application Number:
  US15/359,067
• Publication Number:
  US 20170155842A1
• Time in Patent Office: 679 Days
• Field of Search: None
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/73 Deblurring; Sharpening
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 23/6815 by distinguishing pan or tilt from motion
• CPC Class Codes: H04N 23/683 performed by a processor, e.g. controlling the readout of an image memory
• CPC Class Codes: H04N 23/685 performed by mechanical compensation

Abstract

An image blur correction apparatus includes a first detection unit configured to detect motion vectors in plural different areas using a plurality of images, a determination unit configured to determine an amount of movement of a main object based on the motion vectors in the plural different areas detected by the first detection unit, and a control unit configured to correct an image blur of the main object based on the amount of movement of the main object determined by the determination unit. The determination unit determines a center of gravity or a peak movement amount of which value is included in a determination range near zero (0) among plural amounts of movement represented by the motion vectors in the plural different areas to be the amount of movement of the main object.

Claims

1. An image blur correction apparatus comprising:

at least one processor configured to function as;

a first detection unit configured to detect motion vectors in plural different areas using a plurality of images,

a determination unit configured to determine an amount of movement of a main object based on the motion vectors in the plural different areas detected by the first detection unit, and

a control unit configured to correct an image blur of the main object based on the amount of movement of the main object determined by the determination unit,

wherein the determination unit determines a center of gravity or a peak movement amount of which value is included in a determination range near zero (0) among plural amounts of movement represented by the motion vectors in the plural different areas to be the amount of movement of the main object.

2. The image blur correction apparatus according to claim 1, further comprising an angular velocity sensor configured to detect a movement of an image capturing apparatus which captures the plurality of images, wherein

the determination unit changes the determination range depending on a detection result of the angular velocity sensor.

3. The image blur correction apparatus according to claim 2, wherein the determination unit narrows the determination range as the detection result of the angular velocity sensor shows that an amount of movement of the image capturing apparatus is smaller.

4. The image blur correction apparatus according to claim 1, wherein depending on distribution of the motion vectors in the plural different areas detected by the first detection unit, the determination unit switches between making the center of gravity of the movement amount included in the determination range be the amount of movement of the main object and making the peak of the movement amount included in the predetermined range be the amount of movement of the main object.

5. The image blur correction apparatus according to claim 4, wherein, if the movement amount included in the determination range has plural peaks, the determination unit makes the center of gravity of the movement amount included in the determination range to be the amount of movement of the main object.

6. The image blur correction apparatus according to claim 1,

further comprising an angular velocity sensor configured to detect a movement of an image capturing apparatus which captures the plurality of images,

wherein the determination unit determines a movement amount which is not used for the determination of the amount of movement of the main object in the movement amount included in the determination range depending on a detection result of the velocity angular sensor.

7. The image blur correction apparatus according to claim 6, wherein the determination unit specifies an amount of movement of a background depending on the detection result of the velocity angular sensor, and does not use the amount of movement of the specified background for the determination of the amount of movement of the main object in the movement amount included in the determination range.

8. A method for controlling an image blur correction apparatus, the method comprising:

a first detection process to detect motion vectors of plural different areas using a plurality of images;

a determination process to determine an amount of movement of a main object based on the motion vectors of plural different areas detected in the first detection process; and

a control process to correct an image blur of the main object based on the amount of movement of the main object determined in the determination process, wherein

the determination process determines a center of gravity or a peak movement amount of which value is included in a determination range near zero (0) among plural amounts of movement represented by the motion vectors in the plural different areas to be the amount of movement of the main object.

9. A non-transitory computer readable storage medium configured to store a program causing a computer to execute each steps of:

a first detection process to detect motion vectors of plural different areas using a plurality of images;

a determination process to determine an amount of movement of a main object based on the motion vectors of plural different areas detected in the first detection process; and

a control process to correct an image blur of the main object based on the amount of movement of the main object determined in the determination process, wherein

the determination process determines a center of gravity or a peak movement amount of which value is included in a determination range near zero (0) among plural amounts of movement represented by the motion vectors in the plural different areas to be the amount of movement of the main object.

10. An image blur correction apparatus comprising:

at least one processor configured to function as;

a first detection unit configured to detect motion vectors in plural different areas using a plurality of images;

a determination unit configured to determine an amount of movement of a main object based on the motion vectors in the plural different areas detected by the first detection unit; and

a control unit configured to correct an image blur of the main object based on the amount of movement of the main object determined by the determination unit,

wherein the determination unit determines an amount of movement in a determination range among plural amounts of movement represented by the motion vectors in the plural different areas to be the amount of movement of the main object, and

wherein the determination unit determines the determination range based on a detection result of an angular velocity sensor which detects a movement of an image capturing apparatus which captures the plurality of images.

11. The image blur correction apparatus according to claim 10, wherein the determination unit changes a width of the determination range based on the detection result of the angular velocity sensor.

12. The image blur correction apparatus according to claim 11, wherein the determination unit makes the determination range narrower in a case where the detection result of the angular velocity sensor indicates that an amount of movement of the image capturing apparatus is a second value smaller than a first value than in a case where the detection result of the angular velocity sensor indicates that the amount of movement of the image capturing apparatus is the first value.

13. A method for controlling an image blur correction apparatus, the method comprising:

a first detection process to detect motion vectors of plural different areas using a plurality of images;

a determination process to determine an amount of movement of a main object based on the motion vectors of plural different areas detected in the first detection process; and

a control process to correct an image blur of the main object based on the amount of movement of the main object determined in the determination process,

wherein the determination process determines an amount of movement in a determination range among plural amounts of movement represented by the motion vectors in the plural different areas to be the amount of movement of the main object, and

wherein the determination process determines the determination range based on a detection result of an angular velocity sensor which detects a movement of an image capturing apparatus which captures the plurality of images.