MOTION VECTOR DETECTION APPARATUS AND METHOD OF CONTROLLING MOTION VECTOR DETECTION APPARATUS

• US 20170163997A1
• Filed: 11/28/2016
• Published: 06/08/2017
• Est. Priority Date: 12/03/2015
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: HARUNA, Kohta
• Granted Patent: US 10,218,996 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: H04N 19/167 Position within a video image, e.g. region of interest [ROI]
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/513 Processing of motion vectors

Abstract

Among motion vectors detected relative to a reference image for each of a plurality of areas of a base image, motion vectors related to a moving object are determined. Based on a point of interest and a movement direction of the moving object, one of more of the motion vectors related to the moving object are determined as candidate vector(s), and a representative vector of the moving object is calculated based on the candidate vector(s). A motion vector detection apparatus capable of calculating a motion vector that expresses an angular velocity at a specific position of an object, and a method of controlling the motion vector detection apparatus, are provided.

Claims

1. A motion vector detection apparatus, comprising:

a detecting unit adapted to detect, for each of a plurality of areas of a base image, a motion vector relative to a reference image;

a motion vector determining unit adapted to determine, among the motion vectors, motion vectors related to a moving object;

a candidate vector determining unit adapted to determine, based on a point of interest that is a position within an image and a movement direction of the moving object, one or more of the motion vectors related to the moving object as candidate vector(s); and

a calculating unit adapted to calculate a representative vector of the moving object based on the candidate vector(s).

2. The motion vector detection apparatus according to claim 1,

wherein the candidate vector determining unit determines, from among the motion vectors related to the moving object, one or more motion vectors each being detected in, among the plurality of areas, an area of which distance from the point of interest is less than a threshold value, as the candidate vector(s).

3. The motion vector detection apparatus according to claim 1,

wherein the candidate vector determining unit determines, from among the motion vectors related to the moving object, one or more motion vectors each being detected in, among the plurality of areas, either an area of which distance from the point of interest is less than a threshold value, or an area that exists in a direction orthogonal to the movement direction of the object from the area, as the candidate vector(s).

4. The motion vector detection apparatus according to claim 1,

wherein the candidate vector determining unit determines, from among the motion vectors related to the moving object, one or more motion vectors each being detected in, among the plurality of areas, an area that exists on an axis of interest that is orthogonal to the movement direction of the object and passes through the point of interest, as the candidate vector(s).

5. The motion vector detection apparatus according to claim 4,

wherein the candidate vector determining unit also determines, from among the motion vector related to the moving object, one or more motion vectors each being detected in, among the plurality of areas, an area where a distance from the axis of interest is less than a threshold value, as the candidate vector(s).

6. The motion vector detection apparatus according to claim 1,

wherein the candidate vector determining unit determines, from among motion vectors related to the moving object, one or motion vectors each being detected in, among the plurality of areas, an area that exists forward in the movement direction of the object, as the candidate vector(s).

7. The motion vector detection apparatus according to claim 1,

wherein the point of interest is any of a focus detection area used when performing capture of the base image or the reference image, a face area detected in the base image or the reference image, a position of a face area of a person recognized in the base image or the reference image, a position based on a depth map of the base image or the reference image, and a position designated by a user.

8. The motion vector detection apparatus according to claim 1,

wherein the motion vector determining unit determines the motion vectors related to the moving object using a frequency distribution of magnitude of the motion vectors.

9. The motion vector detection apparatus according to claim 8,

wherein the motion vector determining unit determines, among distributions in the frequency distribution, a second distribution in a section having a smaller range than a first distribution, to be a distribution of motion vectors related to the moving object.

10. An image capture apparatus, comprising:

a motion vector detection apparatus that comprises;

a detecting unit adapted to detect, for each of a plurality of areas of a base image, a motion vector relative to a reference image;

a motion vector determining unit adapted to determine, among the motion vectors, motion vectors related to a moving object;

a candidate vector determining unit adapted to determine, based on a point of interest that is a position within an image and a movement direction of the moving object, one or more of the motion vectors related to the moving object as candidate vector(s); and

a calculating unit adapted to calculate a representative vector of the moving object based on the candidate vector(s);

a converting unit adapted to convert the representative vector to an angular velocity; and

a correcting unit adapted to execute shake correction based on the angular velocity.

11. The image capture apparatus according to claim 10,

wherein the correcting unit executes the shake correction by moving at least one of a lens included in an imaging optical system and an image sensor included in the image capture apparatus in a direction being different from a direction of an optical axis of the imaging optical system according to the angular velocity.

12. The image capture apparatus according to claim 10,

wherein the correcting unit executes the shake correction by moving an area where an image is read out from an image sensor included in the image capture apparatus according to the angular velocity.

13. A method of controlling a motion vector detection apparatus, comprising:

detecting, for each of a plurality of areas of a base image, a motion vector relative to a reference image;

determining, among the motion vectors, motion vectors related to a moving object;

determining, based on a point of interest that is a position within an image and a movement direction of the moving object, one or more of the motion vectors related to the moving object as candidate vector(s); and

calculating a representative vector of the moving object based on the candidate vector(s).

14. A non-transitory computer-readable medium storing a program for causing a computer to function as a motion vector detection apparatus comprising:

a detecting unit adapted to detect, for each of a plurality of areas of a base image, a motion vector relative to a reference image;

a motion vector determining unit adapted to determine, among the motion vectors, motion vectors related to a moving object;

a candidate vector determining unit adapted to determine, based on a point of interest that is a position within an image and a movement direction of the moving object, one or more of the motion vectors related to the moving object as candidate vector(s); and

a calculating unit adapted to calculate a representative vector of the moving object based on the candidate vector(s).