Image capturing apparatus and image capturing method

• US 8,180,106 B2
• Filed: 01/21/2010
• Issued: 05/15/2012
• Est. Priority Date: 07/26/2005
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Matsugu, Masakazu, Mori, Katsuhiko, Kaneda, Yuji, Hayashi, Tadashi
• Primary Examiner(s): Liew, Alex
• Application Number:
  US12/691,072
• Publication Number:
  US 20100118163A1
• Time in Patent Office: 845 Days
• Field of Search: 382141-152, 382115-118, 382/103
• US Class Current: 382/103
• CPC Class Codes: G03B 17/16 for containing both motion-picture camera and still-picture camera
• CPC Class Codes: G06T 7/97 Determining parameters from multiple pictures depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships
• CPC Class Codes: G06V 40/176 Dynamic expression
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/67 Focus control based on electronic image sensor signals
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure

Abstract

In an image capturing apparatus, a video input unit (2) captures the image of an object and sequentially acquires image data associated with the image capturing, a model data memory (6) stores model data associated with the first feature quantity calculated from a feature point of the object in a model image, a principal object detection unit (3) calculates the second feature quantity from a feature point of the object in the acquired image data, a state change estimation unit (4) estimates, on the basis of the second feature quantity and the model data, the timing when the object satisfies a predetermined condition, and an image input processing control unit (7) stores the image data corresponding to the estimated timing in an image recording unit (5). This configuration makes the image capturing apparatus acquire an image in a more proper state without large-capacity memory.

Claims

1. An image capturing apparatus comprising:

an image capturing unit adapted to capture a moving image of an object and to acquire still image data and moving image data, wherein the still image data is acquired at the same time as a corresponding frame of the moving image data and wherein the still image data has at least one of a high resolution and multi-tone in comparison with the moving image data;

a holding control unit adapted to have a first buffer temporarily hold the still image data, and to have a second buffer temporarily hold the moving image data;

an analysis unit adapted to analyze a state of the object in a frame of the moving image data corresponding to still image data held in the first buffer; and

a recording control unit adapted (a) to control successively recording of the moving image data held in the second buffer on a recording medium, (b) to control recording of the still image data held in the first buffer on the recording medium if an analysis result of a corresponding frame of the moving image data by said analysis unit satisfies a capturing condition, and (c) to control discarding of the still image data held in the first buffer without recording on the recording medium if the analysis result of the corresponding frame of the moving image data does not satisfy the capturing condition.

2. The apparatus according to claim 1, wherein the first buffer and the second buffer comprise a plurality of first buffers and a plurality of second buffers, and

wherein a plurality of combinations of the still image data and the moving image data are held.

3. The apparatus according to claim 1, wherein the recording medium comprises a plurality of recording media, and

wherein the still image data is recorded on a first recording medium, and the moving image data is recorded on a second recording medium.

4. The apparatus according to claim 1, wherein said analysis unit executes at least one of person detection, personal identification, facial expression recognition, and shape identification for the moving image data.

5. The apparatus according to claim 1, further comprising:

a setting unit adapted to set a condition for executing analysis by said analysis unit; and

a designation unit adapted to designate the number of images to be recorded on the recording medium,

wherein the still image data which satisfy the condition are sequentially recorded on the recording medium, and when the still image data reach the number of images designated by said designation unit, recording of the still image data ends.

6. The apparatus according to claim 5, further comprising an instruction unit adapted to indicate a start of acquiring the still image data and the moving image data,

wherein the recording control unit controls, when no start of acquisition is indicated, not to record the still image data, but to record the moving image data on the recording medium, and

wherein the recording control unit controls, when the start of acquisition is indicated, to sequentially record the still image data which satisfy the condition on the recording medium, and when the still image data reach the number of images designated by said designation unit, to end recording of the still image data.

7. The apparatus according to claim 5, further comprising:

a notification unit adapted to make a notification that the still image data which satisfies the condition exists; and

a determination unit adapted to determine whether to record the still image data on the recording medium after the notification by said notification unit,

wherein when said determination unit indicates recording of the still image data, the still image data is recorded on the recording medium, and when said determination unit indicates discard of the still image data, the still image data is discarded.

8. The apparatus according to claim 7, further comprising a display unit adapted to display the still image data which satisfies the condition,

wherein when the still image data which satisfies the condition is not detected, said display unit displays the moving image data, and when the still image data which satisfies the condition is detected, said display unit distinguishably displays the still image data and the moving image data.

9. The apparatus according to claim 8, wherein when the still image data and the moving image data overlap each other and are displayed, said display unit lays out the still image data and the moving image data so as to minimize an area where the still image data and the moving image data overlap each other.

10. The apparatus according to claim 7, wherein when the recording is not indicated within a predetermined time, said determination unit determines that discard is indicated.

13. The apparatus according to claim 1, wherein the capturing condition relates to a smile condition of the corresponding frame of the moving image data.

14. The apparatus according to claim 1, wherein the capturing condition relates to a blink condition of the corresponding frame of the moving image data.

11. An image capturing method comprising:

an image capturing step of capturing a moving image of an object and acquiring still image data and moving image data, the still image data is acquired at the same time as a corresponding frame of the moving image data and the still image data has at least one of a high resolution and multi-tone in comparison with the moving image data;

a data holding step of temporarily holding the still image data in a first buffer, and temporarily holding the moving image data in a second buffer;

an analysis step of analyzing a state of the object in a frame of the moving image data corresponding to still image data held in the first buffer; and

a recording control step of (a) controlling to successively record the moving image data held in the second buffer on the recording medium, (b) controlling recording of the still image data held in the first buffer on the recording medium if an analysis result of a corresponding frame of the moving image data in the analysis step satisfies a capturing condition, and (c) controlling discarding of the still image data held in the first buffer without recording on the recording medium if the analysis result of the corresponding frame of the moving image data does not satisfy the capturing condition.

12. A computer-readable storage medium which stores a program which causes a computer to execute an image capturing method defined in claim 11.