Method for removing from an image the background surrounding a selected object
First Claim
1. A method for extracting a selected subject from an image, including those portions of the subject that are semitransparent, by removing all elements of the background surrounding the subject, and also removing those background elements visible through semitransparent areas of the subject, where said method comprises the steps of;
- a) drawing, on a display of said image, an inner boundary line on the subject near to an edge of said subject,b) drawing an outer boundary line on said display, on the background near to the subject, but spaced at a distance sufficient to avoid inclusion of any element of said subject,c) generating a Clear Frame by filling the area inside said outer boundary line with RGB levels generated by interpolation and/or extrapolation of the RGB levels existing on and/or outside said outer boundary line,d) generating an Expanded Subject Frame by replacing the RGB levels in the area bounded by said inner and outer boundary lines with RGB levels generated by extrapolation of the RGB levels existing on and/or inside said inner boundary line,e) calculating an estimated Percent Background RGB Contribution (Matte Signal) to each pixel in the bounded area using equation;
space="preserve" listing-type="equation">percentage background contribution=(F(pixRGB)-F(subRGB)) / (F(bgRGB)-F(subRGB)),where;
F is any linear function of the form, F(RGB)=k1 R+k2 G+k3 B,pixRGB is observed RGB at a pixel at a given address in the bounded area,subRGB is RGB obtained from the Expanded Subject Frame at said given address,bgRGB is RGB obtained from the Clear Frame at said given address,f) generating a Matte Frame by assigning a matte value of 1.0 to all pixels outside said outer boundary line, and assigning a matte value of 0.0 to all pixels inside said inner boundary line, and including the bounded area matte signal of step `e` to complete the full Matte Frame signal,g) multiplying RGB levels at each pixel in the Clear Frame by the matte signal at the corresponding pixel in the Matte Frame to form their product,h) subtracting said product from the RGB levels of the original image to result in a Processed Foreground image of the subject, where said subject appears to have been photographed against a black backing, with no residual elements of the background remaining in the background nor in semitransparent areas of the subject.
2 Assignments
0 Petitions
Accused Products
Abstract
A computer implemented method to extract a selected subject from its background, by removing the background, including that portion of the background visible through semi transparent areas of the subject, and generating a matte signal containing a record of background levels outside of and within semitransparent subject areas. The observed RGB signal levels of a pixel in the semitransparent transition between a subject and its background, are a mixture of color contributed by the subject, and by the background. The estimated subject color, and the estimated background color, and the observed color of a transition pixel (pixRGB), may be shown as three points in a three dimensional color space.
-
Citations
19 Claims
-
1. A method for extracting a selected subject from an image, including those portions of the subject that are semitransparent, by removing all elements of the background surrounding the subject, and also removing those background elements visible through semitransparent areas of the subject, where said method comprises the steps of;
-
a) drawing, on a display of said image, an inner boundary line on the subject near to an edge of said subject, b) drawing an outer boundary line on said display, on the background near to the subject, but spaced at a distance sufficient to avoid inclusion of any element of said subject, c) generating a Clear Frame by filling the area inside said outer boundary line with RGB levels generated by interpolation and/or extrapolation of the RGB levels existing on and/or outside said outer boundary line, d) generating an Expanded Subject Frame by replacing the RGB levels in the area bounded by said inner and outer boundary lines with RGB levels generated by extrapolation of the RGB levels existing on and/or inside said inner boundary line, e) calculating an estimated Percent Background RGB Contribution (Matte Signal) to each pixel in the bounded area using equation;
space="preserve" listing-type="equation">percentage background contribution=(F(pixRGB)-F(subRGB)) / (F(bgRGB)-F(subRGB)),where;
F is any linear function of the form, F(RGB)=k1 R+k2 G+k3 B,pixRGB is observed RGB at a pixel at a given address in the bounded area, subRGB is RGB obtained from the Expanded Subject Frame at said given address, bgRGB is RGB obtained from the Clear Frame at said given address, f) generating a Matte Frame by assigning a matte value of 1.0 to all pixels outside said outer boundary line, and assigning a matte value of 0.0 to all pixels inside said inner boundary line, and including the bounded area matte signal of step `e` to complete the full Matte Frame signal, g) multiplying RGB levels at each pixel in the Clear Frame by the matte signal at the corresponding pixel in the Matte Frame to form their product, h) subtracting said product from the RGB levels of the original image to result in a Processed Foreground image of the subject, where said subject appears to have been photographed against a black backing, with no residual elements of the background remaining in the background nor in semitransparent areas of the subject. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A method for extracting a selected subject from an image, including those portions of the subject that are semitransparent, by removing all elements of the background surrounding the subject, and also removing those background elements visible through semitransparent areas of the subject, when said background is busy, detailed, and in sharp focus, where said method comprises the steps of;
-
a) drawing, on a display of said image, an inner boundary line on the subject near to a edge of said subject, b) drawing an outer boundary line on said display, on the background near to the edge of said subject but spaced at a distance sufficient to avoid inclusion of any element of said subject, c) generating a Clear Frame by filling the area inside said outer boundary line with RGB levels generated by interpolation and/or extrapolation of the RGB levels existing on and/or outside said outer boundary line, d) generating an Expanded Subject Frame by replacing the RGB levels in the area bounded by said inner and outer boundary lines with RGB levels generated by extrapolation of the RGB levels existing on and/or inside said inner boundary line, e) calculating M1, an estimated Percent Background RGB Contribution to each pixel in the bounded area using the following equation;
space="preserve" listing-type="equation">percentage background contribution=(F(pixRGB)-F(subRGB)) / (F(bgRGB)-F(subRGB)),where; percentage background contribution is defined as matte signal M1, F is any linear function of the form, F(RGB)=k1 R+k2 G+k3 B, pixRGB is observed RGB at a pixel at a given address in the bounded area, subRGB is RGB obtained from the Expanded Subject Frame at said given address, bgRGB is RGB obtained from the Clear Frame at said given address, f) subtracting said matte signal M1 of step "e" from 1.0 to generate a Reversed Matte signal (1-M1), g) generating Processed Foreground 1, (PrFg1), where, PrFg1=(1-M1)*subRGB h) generating Processed Background 1, (PrBg1), where PrBg1=pixRGB-PrFg1 i) generating the reversed Clear Frame (bgRGB2), where reversed Clear Frame bgRGB 2=(1-M1)*bgRGB j) generating the Reversed Clear Frame bgRGB 3, where bgRGB 3=PrBg1+bgRGB 2 k) generating the Final Matte M2, where ##EQU6## l) generating Processed Foreground 2PrFg 2, where PrFg 2=pixRGB-(M2*bgRGB3) and said Processed Foreground 2 is the subject as though photographed against a black backing, with no remaining elements of a detailed, sharply focused background surrounding the subject nor any residual background in semitransparent areas of the subject. - View Dependent Claims (11)
-
-
12. A method for determining, in an image, an estimated contribution of background color to an observed color at a given pixel in a semitransparent area of a foreground subject, when the color of the background near said pixel in said semitransparent area is known, declared, or can be estimated, and the color of the subject near said pixel in said semitransparent area is known, declared, or can be estimated, said method comprising the steps of:
- a) representing said known, declared, or estimated background color RGB levels (bgRGB) as a point (9) in a three dimensional color space,
b) representing said known, declared or estimated foreground color RGB levels (subRGB) as a second point (11) in said color space, c) representing said given pixel observed color RGB levels (pixRGB) as a third point (10) in said color space, d) calculating an estimate of the percent contribution of the background color to the observed color of said given pixel by determining the ratio of the distance, in color space, from pixRGB to subRGB, divided by the distance, in color space, from bgRGB to subRGB, where said calculation of distance utilizes the numerical values of at least one linear functions of F(RGB), where F(RGB)=k1 R+k2 G+k3 B. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19)
- a) representing said known, declared, or estimated background color RGB levels (bgRGB) as a point (9) in a three dimensional color space,
Specification