Identifying items in images using regions-of-interest
First Claim
1. A method comprising:
- storing first image data that depicts a user wearing at least a first top item of clothing and a first bottom item of clothing;
defining a first region of the first image data, the first region of the first image data substantially corresponding to pixel data that represents a torso of the user and pixel data that represents legs of the user;
defining a second region of the first image data, the second region of the first image data substantially corresponding to at least a portion of the pixel data that represents the torso of the user;
defining a third region of the first image data, the third region of the first image data substantially corresponding to at least a portion of the pixel data that represents the legs of the user;
storing second image data that depicts the user wearing a second top item of clothing and a second bottom item of clothing;
defining a first region of the second image data, the first region of the second image data substantially corresponding to pixel data that represents the torso of the user and pixel data that represents the legs of the user;
defining a second region of the second image data, the second region of the second image substantially corresponding to at least a portion of the pixel data that represents the torso of the user;
defining a third region of the second image data, the third region of the second image data substantially corresponding to at least a portion of the pixel data that represents the legs of the user;
receiving a request to identify at least one image that depicts an object represented in third image data, the object comprising the first top item of clothing;
analyzing features of the object represented in the third image data with respect to;
(i) features of the first region of the first image data;
(ii) features of the second region of the first image data, (iii) features of the third region of the first image data;
(iv) features of the first region of the second image data;
(v) features of the second region of the second image data, and (vi) features of the third region of the second image data;
determining the first region of the first image data depicts the object; and
outputting an indication that the first image data depicts the object depicted in the third image.
1 Assignment
0 Petitions
Accused Products
Abstract
The techniques described herein may identify images that likely depict one or more items by comparing features of the items to features of different regions-of-interest (ROIs) of the images. For instance, some of the images may include a user, and the techniques may define multiple regions within the image corresponding to different portions of the user. The techniques may then use a trained convolutional neural network or any other type of trained classifier to determine, for each region of the image, whether the region depicts a particular item. If so, the techniques may designate the corresponding image as depicting the item and may output an indication that the image depicts the item. The techniques may perform this process for multiple images, outputting an indication of each image deemed to depict the particular item.
-
Citations
20 Claims
-
1. A method comprising:
-
storing first image data that depicts a user wearing at least a first top item of clothing and a first bottom item of clothing; defining a first region of the first image data, the first region of the first image data substantially corresponding to pixel data that represents a torso of the user and pixel data that represents legs of the user; defining a second region of the first image data, the second region of the first image data substantially corresponding to at least a portion of the pixel data that represents the torso of the user; defining a third region of the first image data, the third region of the first image data substantially corresponding to at least a portion of the pixel data that represents the legs of the user; storing second image data that depicts the user wearing a second top item of clothing and a second bottom item of clothing; defining a first region of the second image data, the first region of the second image data substantially corresponding to pixel data that represents the torso of the user and pixel data that represents the legs of the user; defining a second region of the second image data, the second region of the second image substantially corresponding to at least a portion of the pixel data that represents the torso of the user; defining a third region of the second image data, the third region of the second image data substantially corresponding to at least a portion of the pixel data that represents the legs of the user; receiving a request to identify at least one image that depicts an object represented in third image data, the object comprising the first top item of clothing; analyzing features of the object represented in the third image data with respect to;
(i) features of the first region of the first image data;
(ii) features of the second region of the first image data, (iii) features of the third region of the first image data;
(iv) features of the first region of the second image data;
(v) features of the second region of the second image data, and (vi) features of the third region of the second image data;determining the first region of the first image data depicts the object; and outputting an indication that the first image data depicts the object depicted in the third image. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A method comprising:
-
receiving first image data from a client device, the first image data depicting a particular item; receiving a request to identify additional image data that depicts the particular item; analyzing pixel data from the first image data corresponding to the particular item relative to pixel data corresponding to a first region of second image data using a pre-trained classifier, the first region substantially corresponding to pixel data that represents a torso of a user depicted in the second image data; analyzing the pixel data from the first image data corresponding to the particular item relative to pixel data corresponding to a second region of the second image data using the pre-trained classifier, the second region substantially corresponding to pixel data that represents legs of the user depicted in the second image data; determining the first region depicts the particular item; and outputting an indication that the second image data depicts the particular item. - View Dependent Claims (7, 8, 9, 10, 11, 12, 13)
-
-
14. One or more computing devices comprising:
-
one or more processors; and one or more computer-readable media storing computer-executable instructions that, when executed, cause the one or more processors to perform acts comprising; receiving, from a client device, an indication of a selection of a representation of a particular item presented on a graphical user interface (GUI) of the client device; receiving a request to identify at least one image that depicts the particular item; analyzing pixel data corresponding to the particular item relative to pixel data corresponding to a first region of first image data using a pre-trained classifier, the first region substantially corresponding to at pixel data that represents a torso of a user depicted in the first image data; analyzing the pixel data corresponding to the particular item relative to pixel data corresponding to a second region of the first image data using the pre-trained classifier, the second region substantially corresponding to pixel data that represents legs of the user depicted in the first image data; determining that at least one of the first region or the second region depicts the particular item; and outputting an indication that the first image data depicts the particular item. - View Dependent Claims (15, 16, 17, 18, 19, 20)
-
Specification