Image capture apparatus and method for generating combined-image data

• US 8,553,138 B2
• Filed: 03/24/2009
• Issued: 10/08/2013
• Est. Priority Date: 03/25/2008
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Makii, Tatsuo
• Primary Examiner(s): Velez, Roberto
• Assistant Examiner(s): Quiett, Carramah J
• Application Number:
  US12/383,546
• Publication Number:
  US 20090244318A1
• Time in Patent Office: 1,659 Days
• Field of Search: 3482201-2221, 348/239, 348362-364, 348/224.1, 348/231.2, 348/231.3, 348/231.6, 348/231.9, 348/370, 348/371
• US Class Current: 348/362
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/71 Circuitry for evaluating the brightness variation
• CPC Class Codes: H04N 23/73 by influencing the exposure time
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 23/76 by influencing the image signals

Abstract

An image capture apparatus includes an image capture unit having a plurality of exposure adjustment functions including an electronic shutter function for changing an exposure time within a frame period and configured to capture an image of a subject to obtain image data, and an image-capture control unit configured to allow the image capture unit to execute an image capture operation of capturing a plurality of frames of image data having continuity in time at a fixed frame rate and configured to perform exposure adjustment control in accordance with a subject brightness level obtained during the execution of the image capture operation, the exposure adjustment control being performed using preferentially an exposure adjustment function other than the electronic shutter function.

Claims

1. An image capture apparatus comprising:

an image capture unit having a plurality of exposure adjustment functions including an electronic shutter function for changing an exposure time within a frame period and configured to capture an image of a subject to obtain image data; and

an image-capture control unit configured to allow the image capture unit to execute an image capture operation of capturing a plurality of frames of image data having continuity in time at a fixed frame rate and configured to perform exposure adjustment control in accordance with a subject brightness level obtained during the execution of the image capture operation, the exposure adjustment control being performed using preferentially an exposure adjustment function other than the electronic shutter function, the exposure adjustment control further being performed in response to a change in the subject brightness level detected after initiation of the image capture operation,

the exposure adjustment control comprises extracting at least one non-flash image from the plurality of frames, calculating an average brightness value for each of the extracted non-flash images, classifying the extracted non-flash images into a plurality of groups based on the average brightness values, designating one of the groups as a representative group, calculating an average value of average brightness values for the representative group, calculating a correction coefficient for each of the extracted non-flash images by comparing the average brightness value of the extracted non-flash image to the average value, and for each of the extracted non-flash images, multiplying all of the pixels of the extracted non-flash image by the correction coefficient.

2. The image capture apparatus according to claim 1, wherein the image capture unit includes an optical system including an aperture mechanism, and

wherein the exposure adjustment function other than the electronic shutter function includes an exposure adjustment function using the aperture mechanism.

3. The image capture apparatus according to claim 1, wherein the image capture unit includes an optical system including a light intensity filter mechanism, and

wherein the exposure adjustment function other than the electronic shutter function includes an exposure adjustment function using the light intensity filter mechanism.

4. The image capture apparatus according to claim 1, wherein the image capture unit includes an image capture signal processing system including a variable gain circuit function, and

wherein the exposure adjustment function other than the electronic shutter function includes an exposure adjustment function using the variable gain circuit function with respect to a captured image signal.

5. The image capture apparatus according to claim 1, wherein the image-capture control unit performs exposure adjustment control using the electronic shutter function only when the subject brightness level is to be further reduced after exposure adjustment control has been performed using all light exposure adjustment functions other than the electronic shutter function.

6. The image capture apparatus according to claim 1, further comprising a combination processing unit configured to perform a combination process using, as combination-use image data to be combined, the plurality of frames of image data having continuity in time captured by the image capture unit so as to generate combined-image data representing a still image.

7. The image capture apparatus according to claim 1, further comprising a recording unit configured to record the plurality of frames of image data having continuity in time captured by the image capture unit onto a recording medium as a sequence of image data used for a combination process.

8. The image capture apparatus according to claim 7, further comprising:

a pre-combination processing unit configured to read the plurality of frames of image data having continuity in time recorded onto the recording medium as combination-use image data to be combined; and

a combination processing unit configured to perform a combination process using the combination-use image data of the plurality of frames obtained by the pre-combination processing unit so as to generate combined-image data representing a still image.

9. The image capture apparatus according to claim 8, further comprising an operation detection unit configured to detect operation input information used for a combination process,

wherein the combination processing unit performs a combination process on combination-use image data of frames in a range on a time axis specified by the operation input information among the combination-use image data having continuity in time so as to generate combined-image data representing a still image.

10. The image capture apparatus according to claim 8, further comprising an operation detection unit configured to detect operation input information used for a combination process,

wherein the combination processing unit performs a combination process on combination-use image data of each of a plurality of frames using a weighting coefficient specified by the operation input information so as to generate combined-image data representing a still image.

11. The image capture apparatus according to claim 8, wherein the combination processing unit performs a combination process on combination-use image data of a plurality of frames using weighted averages so as to generate combined-image data representing a still image.

12. The image capture apparatus according to claim 8, further comprising a display control unit configured to output the combined-image data generated by the combination processing unit as image data used for display.

13. The image capture apparatus according to claim 8, wherein the recording unit records the combined-image data generated by the combination processing unit onto a recording medium.

14. The image capture apparatus according to claim 8, further comprising a sending unit configured to send the combined-image data generated by the combination processing unit to an external device.

15. An image capture apparatus comprising:

an image capture unit having an electronic shutter function for changing an exposure time and configured to capture an image of a subject to obtain image data; and

an image-capture control unit configured to perform a control process for allowing the image capture unit to execute an image capture operation of capturing a plurality of frames of image data having continuity in time at a fixed frame rate so that divisional exposure is continuously executed within an exposure period at the fixed frame rate using the electronic shutter function, and to combine a plurality of pieces of captured image data obtained using the divisional exposure to produce image data of one frame, an exposure period for the divisional exposure determined in response to a detection of a change in a subject brightness level during the image capture operation,

the control process comprises extracting at least one non-flash image from the plurality of frames, calculating an average brightness value for each of the extracted non-flash images, classifying the extracted non-flash images into a plurality of groups based on the average brightness values, designating one of the groups as a representative group, calculating an average value of average brightness values for the representative group, calculating a correction coefficient for each of the extracted non-flash images by comparing the average brightness value of the extracted non-flash image to the average value, and for each of the extracted non-flash images, multiplying all of the pixels of the extracted non-flash image by the correction coefficient.

16. An image capture method comprising the steps of:

executing an image capture operation of capturing a plurality of frames of image data having continuity in time at a fixed frame rate; and

performing exposure adjustment control in accordance with a subject brightness level obtained during the execution of the image capture operation, the exposure adjustment control being performed using preferentially an exposure adjustment function other than an electronic shutter function, the exposure adjustment control further being performed in response to a change in the subject brightness level detected after initiation of the image capture operation,

the exposure adjustment control comprises extracting at least one non-flash image from the plurality of frames, calculating an average brightness value for each of the extracted non-flash images, classifying the extracted non-flash images into a plurality of groups based on the average brightness values, designating one of the groups as a representative group, calculating an average value of average brightness values for the representative group, calculating a correction coefficient for each of the extracted non-flash images by comparing the average brightness value of the extracted non-flash image to the average value, and for each of the extracted non-flash images, multiplying all of the pixels of the extracted non-flash image by the correction coefficient.