Image capturing apparatus and image capturing method

• US 7,889,886 B2
• Filed: 07/21/2006
• Issued: 02/15/2011
• Est. Priority Date: 07/26/2005
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Matsugu, Masakazu, Kaneda, Yuji, Mori, Katsuhiko, Hayashi, Tadashi
• Primary Examiner(s): Le; Vu
• Assistant Examiner(s): LIEW, ALEX KOK SOON
• Application Number:
  US11/459,112
• Publication Number:
  US 20070025722A1
• Time in Patent Office: 1,670 Days
• Field of Search: 382/103, 382115-118, 382124-127, 348 61-161
• US Class Current: 382/103
• CPC Class Codes: G03B 17/16 for containing both motion-picture camera and still-picture camera
• CPC Class Codes: G06T 7/97 Determining parameters from multiple pictures depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships
• CPC Class Codes: G06V 40/176 Dynamic expression
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/67 Focus control based on electronic image sensor signals
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure

Abstract

In an image capturing apparatus, a video input unit (2) captures the image of an object and sequentially acquires image data associated with the image capturing, a model data memory (6) stores model data associated with the first feature quantity calculated from a feature point of the object in a model image, a principal object detection unit (3) calculates the second feature quantity from a feature point of the object in the acquired image data, a state change estimation unit (4) estimates, on the basis of the second feature quantity and the model data, the timing when the object satisfies a predetermined condition, and an image input processing control unit (7) stores the image data corresponding to the estimated timing in an image recording unit (5). This configuration makes the image capturing apparatus acquire an image in a more proper state without large-capacity memory.

Claims

1. An image capturing apparatus comprising:

an image capturing unit adapted to capture an image of an object and sequentially acquire image data associated with the image capturing;

a storage unit adapted to store model data associated with a first feature quantity calculated from a feature point of the object in a model image;

a calculation unit adapted to calculate a second feature quantity from a feature point of the object in each of the sequentially acquired image data;

a prediction unit adapted to predict, on the basis of (a) a transition of the second feature quantity and (b) the first feature quantity, a timing when a difference between the first feature quantity and the second feature quantity will satisfy a predetermined condition; and

a control unit adapted to store the image data acquired at the predicted timing in an image data storage unit.

2. The apparatus according to claim 1, wherein said control unit further controls, on the basis of the predicted timing, a timing when said image capturing unit acquires the image data.

3. The apparatus according to claim 1, wherein said prediction unit performs the prediction on changes of differences between the model data and the second feature quantities respectively calculated on the basis of the image data that are sequentially acquired.

4. The apparatus according to claim 1, further comprising:

an acquisition unit adapted to acquire a parameter for an environment in which the image of the object is captured; and

a determination unit adapted to determine, on the basis of the acquired parameter, an image capturing condition of said image capturing unit at the predicted timing,

wherein said image capturing unit captures the image at the predicted timing under the determined image capturing condition.

5. The apparatus according to claim 4, wherein the image capturing condition includes a control condition for at least one of focus adjustment, an exposure amount, white balance, a zoom ratio, and an image capturing direction.

6. The apparatus according to claim 4, further comprising:

a detection unit adapted to detect an area occupied by the object in the image data; and

a second estimation unit adapted to estimate, on the basis of the second feature quantity calculated by said calculation unit and the model data, at least one of parameters of a position of the detected area in the image data, and a size, representative luminance value, representative contrast, and velocity vector of the detected area,

wherein said determination unit determines the image capturing condition on the basis of the estimated parameter.

7. The apparatus according to claim 6, wherein said determination unit determines the image capturing condition so as to make a difference between said at least one parameter and a corresponding reference value fall within a predetermined range.

8. The apparatus according to claim 1, wherein the predetermined condition is that the object performs a predetermined motion.

9. The apparatus according to claim 8, wherein said image capturing unit increases an image capturing rate of an image at a timing when the object performs the predetermined motion that is predicted by said prediction unit.

10. The apparatus according to claim 1, wherein the object includes a human face, and

wherein the predetermined condition is that the face shows a predetermined facial expression.

12. A computer-readable storage medium storing a program which causes a computer to function as an image capturing apparatus as defined in claim 1.

11. A method of controlling an image capturing apparatus by a processor, the method comprising:

an image capturing step of capturing an image of an object and sequentially acquiring image data associated with the image capturing;

a storage step of storing, in a storage unit, model data associated with a first feature quantity calculated from a feature point of the object in a model image;

a calculation step of calculating a second feature quantity from a feature point of the object in each of the sequentially acquired image data;

a prediction step of predicting, on the basis of (a) a transition of the second feature quantity and (b) the first feature quantity, a timing when a difference between the first feature quantity and the second feature quantity will satisfy a predetermined condition; and

a control step of storing the image data acquired at the predicted timing in an image data storage unit.