Electronic imaging system for generating a composite image using the difference of two images

• US 6,366,316 B1
• Filed: 01/11/1999
• Issued: 04/02/2002
• Est. Priority Date: 08/30/1996
• Status: Expired due to Term

• Current Assignee: Eastman Kodak Company
• Original Assignee: Eastman Kodak Company
• Inventors: Luo, Jiebo, Parulski, Kenneth A., Gindele, Edward B.
• Primary Examiner(s): Garber, Wendy R.
• Assistant Examiner(s): Vu, Ngoc-Yen, VU, NGOC YEN T
• Application Number:
  US09/228,903
• Time in Patent Office: 1,177 Days
• Field of Search: H04/N.5262, H04/N.974, 396/2, 396/3, 348/207, 348/222, 348/223, 348/224, 348/231-233, 348/239, 348/241, 348/250, 348/584, 348/585, 348/586, 348/589, 348/590, 348/552, 345/629, 345/630, 345/634, 345/636, 345/637, 352/44, 352/48
• US Class Current: 348/239
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay

Abstract

An electronic imaging system includes a portable electronic camera operable in a compositing mode and a separate processor for compositing images using the difference of two images.

Claims

1. An electronic imaging system including a portable electronic camera operable in a compositing mode and a separate processor for compositing images;

the portable electronic camera comprising;

an image sensor for capturing a first image of a foreground subject and a background, and a second image of the background only, and for producing first and second image signals representative of the first and second captured images, respectively, when the portable electronic camera is operating in the compositing mode;

means for converting the first and second image signals to first and second digital image signals, respectively;

means for subtracting the first and second digital image signals to produce a difference image;

means for processing the difference image to produce a foreground mask image signal;

a removable memory;

means for providing a first tag to identify the first digital image signal and a second tag to identify the foreground mask image signal, and for automatically applying the first and second tags to the first digital image signal and the foreground mask image signal, respectively, to produce first and second image files, respectively; and

means for storing the first and second image files in the removable memory, whereby the stored first and second image files are adapted to be subsequently used in the compositing of a new composite image; and

the separate processor comprising;

means for receiving the removable memory and being responsive to the first and second tags for automatically accessing the first and second image files stored in the removable memory;

means for extracting a foreground subject image from the first image file;

means for selecting a different background image; and

means for producing the composite image from the foreground subject image and the different background image.

2. An electronic imaging system as claimed in claim 1 wherein said camera captures a plurality of second images of the background and said system further includes means for averaging the plurality of second images in order to minimize noise in the background.

3. An electronic imaging system as claimed in claim 1 wherein said electronic camera captures color images each composed of separate color records, including a first color image of a subject plus background and a second color image of the background only, and said subtracting means subtracts the separate color records composing said first and second images to generate a difference image for each color record, and said processing means generates a foreground mask image for each color record.

4. The electronic imaging system as claimed in claim 1 wherein said processing means includes a noise reduction algorithm to reduce noise in the foreground mask image.

5. The electronic camera as claimed in claim 4 wherein the noise reduction algorithm includes a thresholding operation that is applied to image values in the difference image.

6. The electronic camera as claimed in claim 5 wherein the thresholding operation includes a threshold that is set to be a function of the noise in the difference image.

7. The electronic camera as claimed in claim 5 wherein the thresholding operation is stored in a lookup table.

8. The electronic imaging system as claimed in claim 7 wherein an output of the thresholding operation is applied to a despeckling filter to eliminate random noise in foreground mask image.

9. An electronic imaging system including a portable electronic camera operable in a compositing mode and a separate processor for compositing images;

the portable electronic camera comprising;

an image sensor for capturing a first image of a foreground subject and a background, and a second image of the background only, and for producing first and second image signals representative of the first and second captured images, respectively, when the portable electronic camera is operating in the compositing mode;

means for converting the first and second image signals to first and second digital image signals, respectively;

a removable memory;

means for providing a first tag to identify the first digital image and a second tag to identify the second digital image, and for applying the first and second tags to the first and second digital images, respectively, to produce first and second image files, respectively; and

means for storing the first and second image files in the removable memory, whereby the stored first and second image files are adapted to be subsequently used in the compositing of a new composite image; and

the separate processor comprising;

means for receiving the removable memory and being responsive to the first and second tags for automatically accessing the first and second image files stored in the removable memory;

means for subtracting the first and second digital images to produce a difference image;

means for processing the difference image to produce a foreground mask image;

means responsive to the foreground mask image for extracting a foreground subject image from the first image file;

means for selecting a different background image; and

means for producing the composite image from the foreground subject image and the different background image.