Region selection for image match
First Claim
1. A system, comprising:
- at least one processor; and
memory storing instructions that, when executed by the at least one processor, cause the system to;
obtain an image including a representation of an object, the object including an apparel item worn by a person, the image further including a region of a background color;
determine a foreground region by locating a boundary around the representation of the object in the image, a portion of the image outside the bounding region having the background color;
select a foreground swatch region from within the foreground region;
locate, using a first object detection algorithm, a representation of a face in the image;
determine a torso swatch region of the image based at least in part upon a location of the representation of the face in the image;
determine, using a second object detection algorithm, an upper body region of the image;
determine one or more skin regions in the image including pixels with color values corresponding to skin tones;
determine an apparel swatch region by locating a subset of the pixels positioned with respect to the one or more skin regions;
select at least one of the foreground swatch region, the torso swatch region, the upper body region, and the apparel swatch region;
collate data for the selection of the at least one of the foreground swatch region, the torso swatch region, the upper body region, and the apparel swatch region to generate a distribution of probabilities corresponding to pixel locations in the image;
determine, based at least in part upon the distribution of probabilities and the selection, a final swatch region corresponding to a subset of contiguous pixels in the image having at least a minimum probability level; and
provide a swatch image, corresponding to the final swatch region, to a matching component capable of using the swatch image to perform a matching process against a set of candidate images.
1 Assignment
0 Petitions
Accused Products
Abstract
The accuracy of an image matching process can be improved by determining relevant swatch regions of the images, where those regions contain representative patterns of the items of interest represented in those images. Various processes examine a set of visual cues to determine at least one candidate object region, and then collate these regions to determine one or more representative swatch images. For apparel items, this can include locating regions such as an upper body region, torso region, clothing region, foreground region, and the like. Processes such as regression analysis or probability mapping can be used on the collated region data (along with confidence and/or probability values) to determine the appropriate swatch regions.
-
Citations
20 Claims
-
1. A system, comprising:
-
at least one processor; and memory storing instructions that, when executed by the at least one processor, cause the system to; obtain an image including a representation of an object, the object including an apparel item worn by a person, the image further including a region of a background color; determine a foreground region by locating a boundary around the representation of the object in the image, a portion of the image outside the bounding region having the background color; select a foreground swatch region from within the foreground region; locate, using a first object detection algorithm, a representation of a face in the image; determine a torso swatch region of the image based at least in part upon a location of the representation of the face in the image; determine, using a second object detection algorithm, an upper body region of the image; determine one or more skin regions in the image including pixels with color values corresponding to skin tones; determine an apparel swatch region by locating a subset of the pixels positioned with respect to the one or more skin regions; select at least one of the foreground swatch region, the torso swatch region, the upper body region, and the apparel swatch region; collate data for the selection of the at least one of the foreground swatch region, the torso swatch region, the upper body region, and the apparel swatch region to generate a distribution of probabilities corresponding to pixel locations in the image; determine, based at least in part upon the distribution of probabilities and the selection, a final swatch region corresponding to a subset of contiguous pixels in the image having at least a minimum probability level; and provide a swatch image, corresponding to the final swatch region, to a matching component capable of using the swatch image to perform a matching process against a set of candidate images. - View Dependent Claims (2, 3, 4)
-
-
5. A computer-implemented method, comprising:
-
receiving, by one or more computer systems, an image containing a representation of an object;
determining a selection of an area of the image;analyzing the image to determine a set of candidate swatch regions based at least in part on the selection of the area of the image, each candidate swatch region of the set corresponding to a subset of pixels of the image determined to have at least a minimum probability of similarity to the representation of the object in the image; selecting at least one swatch region from the set of candidate swatch regions based at least in part on the minimum probability of similarity to the representation of the object in the image, the set of candidate swatch regions including at least two of a foreground swatch region, a torso swatch region, an upper body swatch region, or an apparel swatch region; collating data for the selection from the set of candidate swatch regions to determine a swatch region representative of at least one visual aspect of the object; and generating a swatch image using pixel values from within the swatch region, the swatch image used to perform an similarity matching process against a set of candidate images. - View Dependent Claims (6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A non-transitory computer readable storage medium storing instructions that, when executed by at least one processor of a computing system, causes the computing system to:
-
receive an image containing a representation of an object; determine a selection of an area of the image; analyze the image to determine a set of candidate swatch regions based at least in part on the selection of the area of the image, each candidate swatch region of the set corresponding to a subset of pixels of the image determined to have at least a minimum probability of similarity to the representation of the object in the image; select at least one swatch region from the set of candidate swatch regions based at least in part on the minimum probability of similarity to the representation of the object in the image, the set of candidate swatch regions including at least two of a foreground swatch region, a torso swatch region, an upper body swatch region, or an apparel swatch region; collate data for the selection from the set of candidate swatch regions to determine an object region in the image; select, from within the object region, a swatch region representative of at least one visual aspect of the object; and generate a swatch image using pixel values from within the swatch region, the swatch image used to perform an similarity matching process against a set of candidate images. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification