Method and apparatus for extracting and treating digital images for seamless compositing
First Claim
1. A method for extracting a digitized foreground image for compositing with an arbitrary background image, said method comprising the steps of:
- acquiring an image comprising a foreground subject and a background,obtaining data representing coloration of said background, said data comprising a plurality of values corresponding to color intensities,generating from said data a statistical range of color intensities for each of a selected group of colors,deriving an indication of average background color from said statistical range of color intensities,differentiating said foreground subject from said background by comparing color intensity values of said foreground subject with said indication of average background color,generating a control image comprised of values representing a distance in color of each color intensity value in said foreground subject from said average background color, andgenerating a second control image by dividing said first control image into a background region, a fringe region of variable width, and a foreground region, and mixing color into foreground pixels at locations corresponding to said fringe region of said second control image from nearby background pixels at locations corresponding to said background region of said second control image,wherein said second control image comprises a plurality of values corresponding to pixels at specific locations, and wherein said step of mixing color into foreground pixels at locations corresponding to said fringe region of said second control image from nearby background pixels at locations corresponding to said background region of said second control image comprises the steps of (a) identifying a pixel in said fringe region bordered by pixels from said background region, (b) changing a color of the corresponding pixel in said foreground image to reflect an average color of a plurality of background pixels in locations corresponding to said background region near said pixel, (c) associating said pixel no longer with said fringe region but instead with said background region, and (d) repeating steps (a) through (c) for a plurality of pixels in said fringe region.
2 Assignments
0 Petitions
Accused Products
Abstract
An image processing system for extracting and treating a digitized color subject image for seamless compositing against an arbitrary background includes the generation of a final control image from the image of a subject in front of a screen consisting of a range of colors. A sample of the background screen is captured and analyzed using filter kernels to determine a range of red, green and blue values which are stored in separate histograms. A first control image is generated by comparing mean histogram data with the subject image. A final control image is generated by dividing the first control image into separate background, foreground and fringe regions. A treated subject image is generated by leaking color from the local background region into the fringe regions of the subject image using filter kernels. The treated image is suitable for compositing against an arbitrary background image. The composite image may be touched up by using a software brush which on each pass of the brush expands the background region by eliminating immediately adjacent fringe pixels, causes other nearby fringe pixels to increase in translucence, and allows the boundary of the fringe region to encroach on the foreground region. Simultaneously, the brush may also cause fringe pixels to absorb some of the color of neighboring foreground pixels.
-
Citations
21 Claims
-
1. A method for extracting a digitized foreground image for compositing with an arbitrary background image, said method comprising the steps of:
-
acquiring an image comprising a foreground subject and a background, obtaining data representing coloration of said background, said data comprising a plurality of values corresponding to color intensities, generating from said data a statistical range of color intensities for each of a selected group of colors, deriving an indication of average background color from said statistical range of color intensities, differentiating said foreground subject from said background by comparing color intensity values of said foreground subject with said indication of average background color, generating a control image comprised of values representing a distance in color of each color intensity value in said foreground subject from said average background color, and generating a second control image by dividing said first control image into a background region, a fringe region of variable width, and a foreground region, and mixing color into foreground pixels at locations corresponding to said fringe region of said second control image from nearby background pixels at locations corresponding to said background region of said second control image, wherein said second control image comprises a plurality of values corresponding to pixels at specific locations, and wherein said step of mixing color into foreground pixels at locations corresponding to said fringe region of said second control image from nearby background pixels at locations corresponding to said background region of said second control image comprises the steps of (a) identifying a pixel in said fringe region bordered by pixels from said background region, (b) changing a color of the corresponding pixel in said foreground image to reflect an average color of a plurality of background pixels in locations corresponding to said background region near said pixel, (c) associating said pixel no longer with said fringe region but instead with said background region, and (d) repeating steps (a) through (c) for a plurality of pixels in said fringe region. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A method for touching up a digitally composited image comprising the steps of:
-
selecting a region of a composited image, said composited image comprising a foreground image and a background image bordered by a fringe region of variable width, wherein said step of selecting a region comprises the step of interactively placing a brush on a screen displaying said composited image, in a portion of said selected region corresponding to said fringe region and immediately bordered at least in part by said foreground region, replacing some of the color pixel values in said portion with color pixel values that are closer in proximity, within a color space, to said foreground region, and mixing a remaining color in said portion with a color of said foreground region. - View Dependent Claims (10)
-
-
11. A method for processing a digitized subject image, said method comprising the steps of:
-
acquiring an image of a subject in front of a background, said image comprising a plurality of color values at each of a plurality of pixel locations, measuring the color of said background by obtaining a plurality of color values at each of a plurality of pixel locations in said background, generating a plurality of histograms, one for each color of a select group of colors, from said color values of said background, calculating an average background color from said plurality of histograms, generating a first control image by comparing said average background color and said color values of said image, dividing said first control image into a plurality of regions so as to generate a second control image, said second control image defining a background region, a fringe region, and a foreground region, and modifying color values in a portion of said image corresponding to said fringe region, wherein each of said histograms comprises a plurality of average color values, said step of generating a plurality of histograms comprising the step of deriving each of said average color values by averaging the color values at a particular pixel location with the color values of a predefined group of surrounding pixels.
-
-
12. A method for processing a digitized subject image, said method comprising the steps of:
-
acquiring an image of a subject in front of a background, said image comprising a plurality of color values at each of a plurality of pixel locations, measuring the color of said background by obtaining a plurality of color values at each of a plurality of pixel locations in said background, generating a plurality of histograms, one for each color of a select group of colors, from said color values of said background, calculating an average background color from said plurality of histograms, generating a first control image by comparing said average background color and said color values of said image, dividing said first control image into a plurality of regions so as to generate a second control image, said second control image defining a background region, a fringe region, and a foreground region, modifying color values in a portion of said image corresponding to said fringe region, and adjusting a location of a first frontier between said background region and said fringe region, and a location of a second frontier between said fringe region and said foreground region.
-
-
13. A method for processing a digitized subject image, said method comprising the steps of:
-
acquiring an image of a subject in front of a background, said image comprising a plurality of color values at each of a plurality of pixel locations, measuring the color of said background by obtaining a plurality of color values at each of a plurality of pixel locations in said background, generating a plurality of histograms, one for each color of a select group of colors, from said color values of said background, calculating an average background color from said plurality of histograms, generating a first control image by comparing said average background color and said color values of said image, dividing said first control image into a plurality of regions so as to generate a second control image, said second control image defining a background region, a fringe region, and a foreground region, and modifying color values in a portion of said image corresponding to said fringe region, said step of modifying a portion of said image comprising the step of generating an intermediate image by adding color from said background region to said fringe region, wherein said step of generating said intermediate image comprises the steps of (a) identifying a pixel in said fringe region bordered by at least one pixel in said background region, (b) changing a color of said fringe pixel to reflect an average color of a plurality of pixels in said background region, (c) associated said fringe pixel no longer with said fringe region but instead with said background region, and (d) repeating steps (a) through (c) for a plurality of pixels in said fringe region. - View Dependent Claims (14, 15)
-
-
16. A method for processing a digitized subject image, said method comprising the steps of:
-
acquiring an image of a subject in front of a background, said image comprising a plurality of color values at each of a plurality of pixel locations, measuring the color of said background by obtaining a plurality of color values at each of a plurality of pixel locations in said background, generating a plurality of histograms, one for each color of a select group of colors, from said color values of said background, calculating an average background color from said plurality of histograms, generating a first control image by comparing said average background color and said color values of said image, dividing said first control image into a plurality of regions so as to generate a second control image, said second control image defining a background region, a fringe region, and a foreground region, modifying color values in a portion of said image corresponding to said fringe region, said step of modifying a portion of said image comprising the step of generating an intermediate image by adding color from said background region to said fringe region, and generating a treated image by removing at least a portion of said background color from said image, determining neighboring color pixel values in the remaining portions of said image, and leaking a local background color from adjacent background pixels into boundary pixels of each of said remaining portions. - View Dependent Claims (17, 18, 19, 20, 21)
-
Specification