Computer vision system for subject characterization
First Claim
1. A computer implemented method for characterizing a sub-image within an image, wherein an alpha image of the sub-image and a first characteristic of the sub-image is provided, comprising determining a second characteristic based upon the first characteristic, wherein the second characteristic is determined by way of a plurality of bounding boxes, the location of the sub-image is compared to the locations of the plurality of bounding boxes and eliminating a subset of the plurality of bounding boxes that are not substantially co-located with the sub-image, wherein a plurality of potential estimates of the second characteristic based in part upon the first characteristic exists such that a subset of the plurality of potential estimates are eliminated from the plurality of potential estimates because the subset is not capable of being an accurate estimate of the second characteristic, whereby the determination of a best estimate is simplified.
5 Assignments
0 Petitions
Accused Products
Abstract
Methods and apparatuses are disclosed for determining one or more characteristics of a sub-image within an electronic image.
In one embodiment, the present invention includes an alpha image generator and a characterizer. The alpha image generator provides an alpha image of the subject being characterized, separated from a background of the input image. In another embodiment, the alpha image generator also may provide a summed area table. The characterizer determines a characteristic of the subject from the alpha image.
In another embodiment, a first characteristic of the subject is derived from the alpha image. The characterizer determines a second characteristic based upon the first characteristic. In yet another embodiment, the determination of the second characteristic is simplified by eliminating all the unlikely estimates of the second characteristic in the overall potential estimates of the second characteristic. In one embodiment, simplification is accomplished by segmenting the alpha image and eliminating portions of the alpha image that do not correspond to the second characteristic. In a further embodiment, the remaining potential estimates are scored based upon the correlation of the alpha image with the estimate, the best estimate having the best score.
-
Citations
24 Claims
- 1. A computer implemented method for characterizing a sub-image within an image, wherein an alpha image of the sub-image and a first characteristic of the sub-image is provided, comprising determining a second characteristic based upon the first characteristic, wherein the second characteristic is determined by way of a plurality of bounding boxes, the location of the sub-image is compared to the locations of the plurality of bounding boxes and eliminating a subset of the plurality of bounding boxes that are not substantially co-located with the sub-image, wherein a plurality of potential estimates of the second characteristic based in part upon the first characteristic exists such that a subset of the plurality of potential estimates are eliminated from the plurality of potential estimates because the subset is not capable of being an accurate estimate of the second characteristic, whereby the determination of a best estimate is simplified.
-
9. A computer implemented method for characterizing a subject comprising:
-
electronically imaging a scene including a subject, whereby an electronic image of the scene and an alpha image of the subject is created, wherein the alpha image is comprised of a plurality of pixels; determining a first characteristic of from the alpha image, the first characteristic being indicative of the subject; and determining a second characteristic indicative of the subject, wherein a plurality of potential estimates exists for the second characteristic, the operation of eliminating the subset of potential estimates including, eliminating a subset of potential estimates from the plurality of potential estimates, whereby a reduced plurality of potential estimates is provided, bounding a portion of the alpha image associated with the second characteristic with a plurality of bounding boxes, determining that a first selected bounding box is empty bounding if the first selected bounding box does not contain any pixels of the portion of the alpha image associated with the second characteristic, wherein the subset of potential estimates eliminated from the plurality of potential estimates includes each estimate that corresponds to the first selected bounding box, determining that a second selected bounding box is partially empty if the second selected bounding box contains a number of pixels of the portion of the alpha image associated with the second characteristic that is less than a lower threshold, wherein the subset of potential estimates eliminated from the plurality of potential estimates includes each estimate that corresponds to the second selected bounding box, determining a score for a first estimate of the second characteristic from the reduced plurality of potential estimates, the score being indicative of the probability that the first estimate of the second characteristic is a best estimate, and repeating for each estimate of the reduced plurality of potential estimates, and comparing the scores of the reduced plurality of potential estimates and choosing the best estimate from the reduced plurality of potential estimates having the best score as the second characteristic.
-
-
10. A computer-implemented digital video subject characterizing method comprising:
-
creating a background model by examining a plurality of frames of an average background image; obtaining a frame of an input image that contains a subject to be characterized; creating an alpha image such that a value of each pixel in the alpha image is set according to a value corresponding to a pixel from the input image and a value corresponding to a pixel from the average background image; deriving a set of templates such that the set of templates comprises the shape of the subject being characterized; setting the values of pixels in the alpha image according to the set of templates such that portions of the alpha image contained within the templates are adjusted so that the pixels do not represent holes in the subject; deriving a first characteristic from a selected one of the set of templates of the alpha image; and blending the subject in the input image onto the destination image. - View Dependent Claims (11, 12, 13)
-
-
14. A computer implemented method for characterizing a subject such that the subject is represented in an electronic image, the method comprising:
-
electronically imaging a scene including a subject, wherein the electronic image of the scene and an alpha image of the subject is created, the alpha image being comprised of a plurality of pixels; determining a first characteristic from the alpha image, the first characteristic being indicative of the subject; deriving a plurality of potential estimates of a second characteristic indicative of the subject, based in part on the first characteristic; and determining a second characteristic indicative of the subject from the plurality of potential estimates, wherein determining the second characteristic includes; bounding a portion of the alpha image associated with the second characteristic with a plurality of bounding boxes; determining that a first selected bounding box is empty if the selected bounding box does not contain any pixels of the portion of the alpha image associated with the second characteristic; eliminating a subset of potential estimates from the plurality of potential estimates, wherein the subset of potential estimates eliminated from the plurality of potential estimates includes each estimate that corresponds to the first selected bounding box, whereby a reduced plurality of potential estimates is provided; and determining a best estimate from the reduced plurality of potential estimates. - View Dependent Claims (15, 16, 17)
-
-
18. A method as recited in 14, wherein the determination of whether the first selected bounding box is empty is made by utilizing a summed area table.
-
19. A computer implemented method for characterizing a subject such that the subject is represented in an electronic image, the method comprising:
-
electronically imaging a scene including a subject, wherein the electronic image of the scene and an alpha image of the subject is created, the alpha image being comprised of a plurality of pixels; determining a first characteristic from the alpha image, the first characteristic being indicative of the subject; deriving a plurality of potential estimates of a second characteristic indicative of the subject, based in part on the first characteristic; determining a second characteristic indicative of the subject from the plurality of potential estimates wherein determining the second characteristic includes; bounding a portion of the alpha image associated with the second characteristic with a plurality of bounding boxes; determining that a first selected bounding box is partially empty if the selected bounding box contains a number of pixels of the portion of the alpha image associated with the second characteristic that is less than a lower threshold; eliminating a subset of potential estimates from the plurality of potential estimates, wherein the subset of potential estimates eliminated from the plurality of potential estimates includes each estimate that corresponds to the second selected bounding box, whereby a reduced plurality of potential estimates is provided, and determining a best estimate from the reduced plurality of potential estimates. - View Dependent Claims (20)
-
-
21. A computer implemented method for characterizing a subject such that the subject is represented in an electronic image the method comprising:
-
electronically imaging a scene including a subject, wherein the electronic image of the scene and an alpha image of the subject is created, the alpha image being comprised of a plurality of pixels; determining a first characteristic from the alpha image, the first characteristic being indicative of the subject; deriving a plurality of potential estimates of a second characteristic indicative of the subject, based in part on the first characteristic; determining a second characteristic indicative of the subject from the plurality of potential estimates, wherein determining the second characteristic includes; determining a score for a first estimate of the second characteristic from the reduced plurality of potential estimates, the score being indicative of the probability that the first estimate of the second characteristic is a best estimate, and repeating for each estimate of the reduced plurality of potential estimates; comparing the scores of the reduced plurality of potential estimates; and choosing the best estimate having the best score as the second characteristic from the reduced plurality of potential estimates. - View Dependent Claims (22, 23, 24)
-
Specification