GENERATION OF SIMULATED LONG EXPOSURE IMAGES IN RESPONSE TO MULTIPLE SHORT EXPOSURES

• US 20100265357A1
• Filed: 04/17/2009
• Published: 10/21/2010
• Est. Priority Date: 04/17/2009
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Inventors: Liu, Ming-Chang, Robertson, Mark
• Granted Patent: US 8,228,400 B2
• Time in Patent Office: Days
• US Class Current: 348/223.100
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20216 Image averaging
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: H04N 23/70 Circuitry for compensating brightness variation in the scene
• CPC Class Codes: H04N 23/741 by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors

Abstract

Simulating a long exposure-time image from a sequence of short exposure-time images captured at slightly different times. The sequence of images is combined in a temporal integration process to create a long exposure image that simulates the output from a still camera, steadied by a tripod, whose light-sensitive material has been exposed to the same scene from the time of the beginning of the first input image of the sequence to the last image of the input sequence. The method overcomes limitations of hand-held video and image recording devices, allowing the user to easily create effects normally associated with high-end digital still cameras under expert control.

Claims

1. A apparatus for simulating a long exposure-time image, comprising:

means for capturing a sequence of digital images;

a computer with memory coupled to said computer; and

programming adapted for execution on said computer for,

receiving a sequence of normal exposure images at a normal exposure time setting from said means for capturing, in which image capture duration of said normal exposure time setting is less than a desired long exposure interval over which a simulated long exposure time image is to be obtained,

selecting a set of sequential images, from within said sequence of images, which span the desired long exposure interval, and

combining the set of sequential images through temporal integration to create at least one long exposure image.

2. An apparatus as recited in claim 1, wherein said long exposure image can span any desired simulated exposure time.

3. An apparatus as recited in claim 1, wherein stable long exposure images are created by said apparatus without necessitating use of a tripod, or other camera mount.

4. An apparatus as recited in claim 1, wherein said sequence of images comprise frames of a video sequence.

5. An apparatus as recited in claim 1, wherein said long exposure image comprises a digital still photograph.

6. An apparatus as recited in claim 1, further comprising compensating for apparatus motion among said sequence of captured images prior to combining the set of sequential images.

7. An apparatus as recited in claim 1, further comprising:

compensating for apparatus motion among said sequence of captured images prior to combining the set of sequential images; and

wherein said compensating comprises performing global motion estimation (GME) and global motion compensation (GMC).

8. An apparatus as recited in claim 1, further comprising converting pixel values in said set of sequential images into linear light values prior to temporal integration when combining.

9. An apparatus as recited in claim 1, further comprising correcting for desired contrast and color balance after combining said sequence of images.

10. A camera configured for automatically creating still images having a simulated exposure time spanning a desired time period, comprising:

an electronic imaging element within a camera adapted for capturing a sequence of digital images;

a computer with memory coupled to said computer, said computer configured for controlling said electronic imaging element of said camera; and

programming adapted for execution on said computer for,

capturing, within said memory, a sequence of images spanning a desired time period,

selecting a set of sequential images which temporally span a desired long exposure interval within said sequence of images,

compensating for camera motion among said sequence of captured images,

converting pixel values in said set of sequential images into linear light values, and

combining the set of sequential images through temporal integration to create one or more simulated long exposure images.

11. An apparatus as recited in claim 10, wherein stable long exposure images are created by said camera without necessitating use of a tripod, or other camera mount.

12. An apparatus as recited in claim 10, wherein said sequence of images comprise frames of a video sequence.

13. An apparatus as recited in claim 10, wherein said long exposure images comprise long exposure digital still photographs.

14. An apparatus as recited in claim 10, wherein said compensating for camera motion comprises performing global motion estimation (GME) and global motion compensation (GMC).

15. An apparatus as recited in claim 10, further comprising correcting for desired contrast and color balance after combining said sequence of images.

16. A method of creating a long exposure time still photograph from a captured sequence of short exposure images, comprising:

capturing a set of sequential images with a digital image capturing device, said set of sequential images spanning a desired time frame for a long exposure time still photograph;

compensating for motion of the digital image capturing device among said set of sequential images; and

combining said set of sequential images through temporal integration to create at least one long exposure time still photograph having said desired time frame.

17. A method as recited in claim 16, further comprising converting pixel values in said set of sequential images into linear light values prior to performing temporal integration.

18. A method as recited in claim 16, wherein stable long exposure images are created by said method without necessitating mounting of the image capturing device on a tripod or other fixed mount.

19. A method as recited in claim 16, wherein said compensating for motion of the image capturing device comprises performing global motion estimation (GME) and global motion compensation (GMC).

20. A method as recited in claim 16, further comprising correcting for desired contrast and color balance after combining said sequence of images.