Background replacement for an image

• US 5,574,511 A
• Filed: 10/18/1995
• Issued: 11/12/1996
• Est. Priority Date: 10/18/1995
• Status: Expired due to Fees

• Current Assignee: Yama Capital, LLC
• Original Assignee: Polaroid Corporation (PLR IP Holdings LLC)
• Inventors: Yang, Yibing, Soini, F. Richard
• Primary Examiner(s): LEE, MICHAEL
• Application Number:
  US08/544,615
• Time in Patent Office: 391 Days
• Field of Search: 348/586, 348/587, 348/588, 348/590, 348/591, 348/592, 348/598, 348/164, 348/162
• US Class Current: 348/586
• CPC Class Codes: G03B 17/53 for automatically delivering a finished picture after a signal causing exposure has been given, e.g. by pushing a button, by inserting a coin
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay

Abstract

The present invention is useful in taking images for identification and other purposes without the requirement of a photobooth, regardless of the background of the image. The original background of the image is replaced with a preselected background. Two IR images with different intensities of IR illumination in the foreground and background regions of the scene, respectively, are compared for light intensity differences between corresponding pixels of the two images to form a mask differentiating between the foreground and background regions of the image. The mask is then applied to a visible light image of the scene and the preselected background is used to replace the original background.

Claims

1. A method of replacing an original background of a scene with a predetermined replacement background, said method comprising the steps of:

making a first infrared (IR) image of the scene at a first time with first IR radiation having a first intensity illuminating said original background;

measuring an intensity of IR radiation at each pixel of said first IR image;

making a second IR image of the scene at a second time after deactivating said first IR radiation, by illuminating a foreground of the scene with a second IR radiation having a second intensity less than said first intensity;

measuring an intensity of IR radiation at each pixel of said second IR image;

generating a mask distinguishing said foreground from said original background by comparing the intensities of IR radiation at each corresponding pixel between said first and second IR images;

making a digital visible light image of the scene at said second time by illuminating the scene with visible lighting; and

replacing, in said digital visible light image, said original background with said predetermined replacement background to produce a modified version of the digital visible light image by applying said mask to the digital visible light image.

2. The method of claim 1, wherein said second IR radiation originates from a front light.

3. The method of claim 1, wherein said second IR radiation originates from one or more foreground lights.

4. The method of claim 1, wherein said second IR radiation originates from ambient light.

5. The method of claim 1, wherein said first IR radiation originates from one or more background lights.

6. The method of claim 1, wherein said first IR radiation originates from ambient light.

7. The method of claim 1, wherein said first IR radiation and said second IR radiation both have wavelengths ranging from about 700 nanometers to about 1000 nanometers.

8. The method of claim 1, wherein a difference between said first time and said second time is about 1/30th of a second.

9. The method of claim 1, wherein a difference between said first time and said second time approximates a shutter speed of an imaging device used for taking said first IR image.

10. The method of claim 1, wherein a difference between said first time and said second time ensures negligible movement of objects within said scene while taking said first IR, second IR and visible light images so that said images will be in focus.

11. The method of claim 1, wherein both said first and second IR images are taken with a first digital imaging device, said digital visible light image is taken with a second digital imaging device, and said first and second digital imaging devices have the same virtual spatial location.

12. For a digital visible light image of a scene having a foreground and an original background, a method of replacing said original background with a predetermined replacement background, said method comprising the steps of:

illuminating only the original background of the scene with one or more background lights of infrared radiation (IR) having a first intensity by directing the background lights towards the original background;

taking a first IR image of the scene at a first time using a first digital imaging device;

measuring and storing an intensity of each pixel of the first IR image;

turning off the background lights, illuminating the scene with an active visible light source, and illuminating the scene with a front light of IR having a second intensity lesser than said first intensity;

taking a second IR image of the scene at a second time using said first digital imaging device;

measuring and storing an intensity of each pixel of the second IR image;

creating a mask differentiating said foreground from said original background by a pixel-by-pixel comparison between said first and second IR images of said measured intensities;

taking a visible light image at said second time with a second digital imaging device having the same virtual spatial location as said first digital imaging device for generating said digital visible light image; and

creating a modified said digital visible light image by applying said mask to said digital visible light image to differentiate said foreground from said original background, and replacing said original background with said predetermined replacement background.

13. The method of claim 12, wherein a difference between said first time and said second time is about 1/30th of a second.

14. The method of claim 12, wherein a difference between said first time and said second time approximates a shutter speed of the first digital imaging device.

15. The method of claim 12, wherein a difference between said first time and said second time ensures negligible movement of objects within said scene while taking said first IR, second IR and visible light images so that said images will be in focus.

16. The method of claim 12, wherein said infrared radiation has wavelengths ranging from about 700 to 1000 nanometers.

17. A system for taking a digital visible light image of a scene comprising a foreground and an original background, and replacing said original background with a predetermined replacement background, said system comprising:

visible lighting for illuminating said scene;

background IR (infrared) lighting for illuminating said original background with IR light having a first intensity;

foreground lighting for illuminating said foreground with IR light having a second intensity lesser than said first intensity;

a first imaging device for taking a first IR image of said scene at a first time when said background lighting is activated and said foreground lighting is deactivated, and for taking a second IR image of said scene at a second time when said background lighting is deactivated and said foreground lighting is activated;

a second imaging device for taking said digital visible light image at said second time when said visible lighting is activated; and

a processor for comparing corresponding pixels of said first and second IR images to create a mask differentiating said foreground from said original background in said digital visible light image, then replacing said original background with said predetermined replacement background after applying said mask to said digital visible light image.

18. The system of claim 17, further comprising a beam splitter for redirecting an optical axis of said second imaging device to an optical axis of said first imaging device.

19. The system of claim 17, wherein said visible lighting is ambient light.

20. The system of claim 17, wherein said visible lighting is one or more lamps.

21. The system of claim 17, wherein said background lighting is ambient light.

22. The system of claim 17, wherein said background lighting is one or more lamps.

23. The system of claim 22, further comprising a baffle for directing said background lighting.

24. The system of claim 17, wherein said foreground lighting is a front light.

25. The system of claim 17, wherein said foreground lighting is one or more foreground lights.

26. The system of claim 17, wherein said first and second imaging devices have the same virtual spatial location.

27. Apparatus for digitally replacing part of an image of an original scene with a substitute, said apparatus comprising:

means for illuminating different parts of a scene with different illumination sources which include infrared radiation during a predetermined time interval to create different contrast ratios among the different parts of the scene;

means for acquiring and storing digital images of the scene during said predetermined time interval while subject to illumination from said different illumination sources;

means for processing said digital images to identify the different parts on the basis of the variation in contrast ratios between the images;

means for selecting said substitute for one of said different pans; and

means for replacing said one of said different parts with said substitute in one of said digital images corresponding to a preselected one of said different illumination sources and generating a new digital image available for subsequent use.

28. The apparatus of claim 27, wherein said digital images of the scene comprise:

a first image having only a background part of the scene illuminated with infrared radiation from a first illumination source;

a second image having only a foreground part of the scene illuminated with infrared radiation from a second illumination source; and

a third image being illuminated with visible light from a third illumination source.

29. The apparatus of claim 28, wherein said means for illuminating comprises:

one or more background IR lamps with baffles for forming said first illumination source;

one or more foreground lamps with baffles for forming said second illumination source; and

one or more visible light lamps for forming said third illumination source.

30. The apparatus of claim 27, wherein said means for acquiring and storing comprises one or more electronic imaging devices responsive to both visible and infrared radiation and having the same virtual spatial location.

31. The apparatus of claim 27, wherein said predetermined time interval approximates a shutter speed of said means for acquiring and storing said digital images.

32. The apparatus of claim 27, wherein said predetermined time interval will ensure negligible movement of objects within said scene while said digital images are being acquired so that said acquired digital images will be in focus.