System and method for acquiring moving images

• US 20090180022A1
• Filed: 01/07/2009
• Published: 07/16/2009
• Est. Priority Date: 01/16/2008
• Status: Active Grant

• Current Assignee: Samsung Electro-Mechanics Co., Ltd. (Samsung Group), Samsung Electronics Co. Ltd. (Samsung Group)
• Original Assignee: Samsung Electro-Mechanics Co., Ltd. (Samsung Group), Samsung Electronics Co. Ltd. (Samsung Group)
• Inventors: Cheo, Won-Hee, Kwon, Jae-Hyun, Lee, Seok, Song, Hyun-Chul, Lee, Kang-Eui
• Granted Patent: US 8,115,858 B2
• Time in Patent Office: Days
• US Class Current: 348/362
• CPC Class Codes: H04N 23/73 by influencing the exposure time

Abstract

A system and a method for acquiring a moving image are provided. The system includes an image capturing unit capturing two images having different exposure times at a predetermined time slot, an image storing unit storing at least one of two images which were captured at a time slot previous to the predetermined time slot and which have different exposure times, an output image generating unit generating an output image by synthesizing the two images captured at the predetermined time slot or by synthesizing any one of the two images captured at the predetermined time slot and any one of the two images captured and stored at the previous time slot, an exposure time calculating unit receiving the images captured at the predetermined time slot and setting exposure times for a next time slot, and an exposure time storing unit storing the exposure times for the next time slot.

Claims

1. A system for capturing a plurality of images having different exposure times at each time slot and generating a high dynamic range (HDR) moving image, the system comprising:

an image capturing unit capturing two images having different exposure times at a predetermined time slot;

an image storing unit storing at least one of two images which were captured at a time slot previous to the predetermined time slot and which have different exposure times;

an output image generating unit generating an output image by synthesizing the two images captured at the predetermined time slot or by synthesizing any one of the two images captured at the predetermined time slot and any one of the two images captured and stored at the previous time slot;

an exposure time calculating unit receiving the images captured at the predetermined time slot and setting exposure times for a next time slot; and

an exposure time storing unit storing the exposure times for the next time slot.

2. The system of claim 1, wherein the exposure times comprise user exposure times input by a user or device exposure times set by the exposure time calculating unit, wherein the user exposure times comprise a first user exposure time and a second user exposure time which are different in length, the device exposure times comprise a first device exposure time and a second exposure time which are different in length, the captured images comprise a first image corresponding to the first user exposure time or the first device exposure time and a second image corresponding to the second user exposure time or the second device exposure time.

3. The system of claim 2, wherein the image storing unit stores the second image captured at the previous time slot.

4. The system of claim 3, wherein the output image generating unit comprises:

a first motion estimator receiving the first and second images captured at the predetermined time slot and performing motion estimation to generate a first estimated image;

a second motion estimator receiving the first image captured at the predetermined time slot and the second image captured and stored at the previous time slot and performing motion estimation to generate a second estimated image; and

an image synthesizer generating an output image by synthesizing the first estimated image with any one of the first and second images captured at the predetermined time slot or by synthesizing the second estimated image with any one of the first image captured at the predetermined time slot and the second image captured and stored at the previous time slot.

5. The system of claim 4, wherein the first motion estimator and the second motion estimator perform probability-based motion estimation, and the image synthesizer performs luminance-based image synthesis.

6. The system of claim 2, wherein the exposure time calculating unit comprises:

an image information generator receiving the first and second images captured at the predetermined time slot and generating image information of the first and second images; and

an exposure time setter receiving the generated image information and setting the exposure times for the next time slot.

7. The system of claim 6, wherein the exposure time setter performs block-based exposure time setting.

8. An image pickup apparatus using the system of claim 1.

9. A method of capturing a plurality of images having different exposure times at each time slot and generating an HDR moving image, the method comprising:

capturing two images having different exposure times at a predetermined time slot;

storing at least one of two images which were captured at a time slot previous to the predetermined time slot and which have different exposure times;

generating an output image by synthesizing the two images captured at the predetermined time slot or by synthesizing any one of the two images captured at the predetermined time slot and any one of the two images captured and stored at the previous time slot;

receiving the images captured at the predetermined time slot and setting exposure times for a next time slot; and

storing the exposure times for the next time slot.

10. The method of claim 9, wherein the exposure times comprise user exposure times input by a user or device exposure times set by an exposure time calculating unit, wherein the user exposure times comprise a first user exposure time and a second user exposure time which are different in length, the device exposure times comprise a first device exposure time and a second exposure time which are different in length, the captured images comprise a first image corresponding to the first user exposure time or the first device exposure time and a second image corresponding to the second user exposure time or the second device exposure time.

11. The method of claim 10, wherein the storing of the at least one of the two images comprises storing the second image captured at the previous time slot.

12. The method of claim 11, wherein the generating of the output image comprises:

receiving the first and second images captured at the predetermined time slot and performing motion estimation to generate a first estimated image;

receiving the first image captured at the predetermined time slot and the second image captured and stored at the previous time slot and performing motion estimation to generate a second estimated image; and

generating an output image by synthesizing the first estimated image with any one of the first and second images captured at the predetermined time slot or by synthesizing the second estimated image with any one of the first image captured at the predetermined time slot and the second image captured and stored at the previous time slot.

13. The method of claim 12, wherein probability-based motion estimation is performed in the performing of the motion estimation first motion, and luminance-based image synthesis is performed in the synthesizing of the images.

14. The method of claim 10, wherein the calculating of the exposure times comprises:

receiving the first and second images captured at the predetermined time slot and generating image information of the first and second images; and

receiving the generated image information and setting the exposure times for the next time slot.

15. The method of claim 14, wherein block-based exposure time setting is performed in the setting of the exposure times.

16. A medium recording and executing the method of claim 9 on a computer.