Method and apparatus for background replacement in still photographs

• US 8,134,576 B2
• Filed: 10/04/2010
• Issued: 03/13/2012
• Est. Priority Date: 04/03/2007
• Status: Active Grant

• Current Assignee: Shutterfly, LLC
• Original Assignee: Lifetouch Incorporated (Shutterfly, LLC)
• Inventors: Swanson, Richard Lee, Adolphi, Earl John, Surma, Michael John, Reinert Nash, John Robert
• Primary Examiner(s): Yang, Ryan R
• Application Number:
  US12/897,305
• Publication Number:
  US 20110134141A1
• Time in Patent Office: 526 Days
• Field of Search: 345/634, 348/207.99
• US Class Current: 345/634
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay

Abstract

A first digital image is acquired of a framed area while illuminating the background and foreground object under a first lighting condition. A second digital image is then acquired of the same framed area while illuminating the background and foreground object under a second lighting condition. Preferably, the first lighting condition illuminates the background without illuminating the foreground object so that a silhouette of the foreground object is acquired in the first image. The second lighting condition illuminates the foreground object (e.g., with frontal lights). Due to the difference in the illumination between the background and silhouette in the first image, an alpha mask can be created from the first acquired image. Using the mask, the background from the second image can be removed and replaced by virtually any other desired background image.

Claims

1. An imaging system for photographing a subject, the system comprising:

a background;

a foreground light source arranged and configured to illuminate the subject;

a background light source arranged and configured to illuminate the background;

a digital camera configured to capture still photographs of a subject arranged between the digital camera and the background; and

a controller configured to;

synchronize illumination of the background light source with a capture of a background illuminated image taken by the digital camera; and

after the illumination of the background light source, synchronize illumination of the foreground light source with a capture of a foreground illuminated image taken by the digital camera.

2. The imaging system of claim 1, wherein the controller is arranged and configured to capture the foreground illuminated image before complete decay of light from the illumination of the background light source.

3. The imaging system of claim 1, wherein the digital camera is arranged and configured to capture color photographs.

4. The imaging system of claim 1, wherein the digital camera is arranged and configured to detect visible light from the foreground light source and the background light source, and wherein the foreground light source and the background light source are positioned to provide visible light to the digital camera.

5. The imaging system of claim 1, wherein the digital camera comprises a lens, a mechanical shutter, and a charge-coupled device.

6. The imaging system of claim 5, wherein the mechanical shutter is synchronized to close after illumination of the foreground light source and during the digital camera'"'"'s capture of the foreground illuminated image.

7. The imaging system of claim 5, wherein the charge-coupled device is an interline-transfer charge-coupled device.

8. The imaging system of claim 7, wherein the interline-transfer charge-coupled device includes photodiodes and shift registers, wherein the photodiodes are configured to transfer electrons associated with the background illuminated image to the shift registers prior to capturing the foreground illuminated image using the photodiodes.

9. The imaging system of claim 1, further comprising a memory storage device, wherein the memory storage device stores the background illuminated image and the foreground illuminated image.

16. The imaging system of claim 1, wherein the controller generates a single trigger pulse, wherein a rising edge of the single trigger pulse triggers the illumination of the background light source and a falling edge of the single trigger pulse triggers the illumination of the foreground illuminated image.

17. The imaging system of claim 1, wherein the foreground light source and the background light source are flash light sources that generate visible light.

18. The imaging system of claim 1, wherein the foreground illuminated image and the background illuminated image are color images.

19. The imaging system of claim 1, wherein the digital camera outputs the foreground illuminated image and the background illuminated image as digital image files.

10. A method of photographing a subject arranged in front of a background, the method comprising:

synchronizing a flash of a background light source to occur while capturing a background illuminated image with a digital camera, the digital camera configured to capture still photographs, and the background light source positioned to illuminate the background; and

after the flash of the background light source, synchronizing a flash of a foreground light source to occur while capturing a foreground illuminated image with the digital camera.

11. The method of claim 10, wherein the flash of the foreground light source is timed to occur before complete decay of the flash of the background light source.

12. The method of claim 10, wherein the background illuminated image and the foreground illuminated image are color images.

13. The method of claim 10, further comprising timing the flash of the foreground light source to occur within a time interval of the flash of the background light source, wherein the time interval is computed according to the formula:

t =w_sd_t/(w_cv_t)

where v_t is a tolerated speed of a foreground object,

w_s is a width of the foreground illuminated image at the foreground object,

d_t is the number of pixels by which the background illuminated and the foreground illuminated images are permitted to be offset from each other,

w_c is the width (in pixels) of the background illuminated and the foreground illuminated images, and

t is the time to capture both of the background illuminated and the foreground illuminated images.

14. The method of claim 10, further comprising timing the flash of the foreground light source to occur within a time interval of the flash of the background light source, wherein the time interval is computed based on a number of pixels by which the background illuminated and the foreground illuminated images are permitted to be offset from each other, wherein the offset is less than a fraction of a pixel.

15. The method of claim 10, wherein the digital camera comprises a lens, a mechanical shutter, and a charge-coupled device, and further comprising closing the mechanical shutter during the capturing of the foreground illuminated image with the digital camera.