Item recommendations based on image feature data

• US 10,740,660 B2
• Filed: 11/29/2018
• Issued: 08/11/2020
• Est. Priority Date: 09/30/2011
• Status: Active Grant

• Current Assignee: eBay Inc.
• Original Assignee: eBay Inc.
• Inventors: Bhardwaj, Anurag, Piramuthu, Robinson, Sundaresan, Neelakantan
• Primary Examiner(s): Dang, Duy M
• Application Number:
  US16/204,805
• Publication Number:
  US 20190114515A1
• Time in Patent Office: 621 Days
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/532 Query formulation, e.g. graphical querying
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 18/21 Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06Q 30/0629 for generating comparisons
• CPC Class Codes: G06Q 30/0631 Item recommendations
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 7/13 Edge detection
• CPC Class Codes: G06T 7/41 based on statistical description of texture
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 10/50 by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
• CPC Class Codes: G06V 10/507 Summing image-intensity values; Histogram projection analysis
• CPC Class Codes: G06V 10/56 relating to colour

Abstract

An apparatus and method to adjust item recommendations are disclosed herein. A first image attribute of a query image is compared to a second image attribute of each of a plurality of inventory images of a plurality of inventory items to identify the inventory items similar to the query image. Item recommendations comprising the identified inventory items in a first listing order are provided for display at a remote device. A second listing order of the identified inventory items is determined based on a user preference for a particular one of the identified inventory items. At least the second listing order is provided to the remote device for re-display of the item recommendations in accordance with the second listing order.

Claims

1. A method comprising:

receiving, by a networked system, a query image from a remote device;

performing, by the networked system, image processing to extract an image attribute of the query image;

comparing, using a processor of the networked system;

the extracted image attribute of the query image to an attribute associated with each of a plurality of items to identify items similar to the query image;

causing display of a plurality of item recommendations comprising at least a portion of the identified items on a user interface of the remote device, the plurality of item recommendations being displayed based on similarity between the extracted image attribute of the query image and the attribute associated with each of the identified items;

receiving, by the networked system from the remote device, a selection of a recommendation from the plurality of item recommendations;

in response to receiving the selection of the recommendation, determining, by the networked system, a set of updated recommendations based on the selected recommendation; and

causing display of item details of the selected recommendation and the set of updated recommendations on the remote device.

2. The method of claim 1, wherein the determining the set of updated recommendations comprises including at least one of the plurality of item recommendations not previously selected.

3. The method of claim 1, wherein the comparing the extracted image attribute of the query image to the attribute of each of the plurality of items comprises comparing a dominate color of the query image to a dominate color of each of the plurality of items.

4. The method of claim 1, wherein the comparing the extracted image attribute of the query image to the attribute of each of the plurality of items comprises comparing a pattern of the query image to a pattern of each of the plurality of items.

5. The method of claim 1, wherein the query image comprises an image captured by an application on the remote device.

6. The method of claim 1, wherein the causing display of the item details of the selected recommendation comprises causing display of an image of the selected recommendation in a larger size than when the image was displayed with the plurality of item recommendations.

7. The method of claim 1, further comprising providing an application for installation on the remote device, the application including camera capabilities that configure the remote device to capture the query image;

the application transmitting the query image to the networked system.

8. The method of claim 1, wherein:

the performing the image processing to extract the image attribute of the query image comprises automatically detecting a logo of a manufacturer; and

the comparing the extracted image attribute of the query image to an attribute of each of a plurality of items to identify items similar to the query image comprises identifying items from the same manufacturer.

9. The method of claim 1, wherein:

the performing the image processing to extract the image attribute of the query image comprises using an optical character recognition engine to detect text or alpha-numeric characters; and

the comparing the extracted image attribute of the query image to an attribute of each of a plurality of items to identify items similar to the query image comprises identifying items related to the text or alpha-numeric characters.

10. The method of claim 1, wherein the query image depicts an article of clothing or a portion of the article of clothing.

11. A system comprising:

one or more hardware processors; and

a storage device storing instructions that, when executed by the one or more hardware processors, causes the one or more hardware processors to perform operations comprising;

receiving a query image from a remote device;

performing image processing to extract an image attribute of the query image;

comparing the extracted image attribute of the query image to an attribute associated with each of a plurality of items to identify items similar to the query image;

causing display of a plurality of item recommendations comprising at least a portion of the identified items on a user interface of the remote device, the plurality of item recommendations being displayed based on similarity between the extracted image attribute of the query image and the attribute associated with each of the identified items;

receiving, from the remote device, a selection of a recommendation from the plurality of item recommendations;

in response to receiving the selection of the recommendation, determining a set of updated recommendations based on the selected recommendation; and

causing display of item details of the selected recommendation and the set of updated recommendations on the remote device.

12. The system of claim 11, wherein the determining the set of updated recommendations comprises including at least one of the plurality of item recommendations not previously selected.

13. The system of claim 11, wherein the comparing the extracted image attribute of the query image to the attribute of each of the plurality of items comprises comparing a dominate color of the query image to a dominate color of each of the plurality of items.

14. The system of claim 11, wherein the comparing the extracted image attribute of the query image to the attribute of each of the plurality of items comprises comparing a pattern of the query image to a pattern of each of the plurality of items.

15. The system of claim 11, wherein query image comprises an image captured by an application on the remote device.

16. The system of claim 11, wherein the causing display of the item details of the selected recommendation comprises causing display of an image of the selected recommendation in a larger size than when the image was displayed with the plurality of item recommendations.

17. The system of claim 11, wherein the operations further comprise providing an application for installation on the remote device, the application including camera capabilities that configure the remote device to capture the query image, the application transmitting the query image to the networked system.

18. The system of claim 11, wherein:

the performing the image processing to extract the image attribute of the query image comprises automatically detecting a logo of a manufacturer; and

the comparing the extracted image attribute of the query image to an attribute of each of a plurality of items to identify items similar to the query image comprises identifying items from the same manufacturer.

19. The system of claim 11, wherein:

the performing the image processing to extract the image attribute of the query image comprises using an optical character recognition engine to detect text or alpha-numeric characters; and

the comparing the extracted image attribute of the query image to an attribute of each of a plurality of items to identify items similar to the query image comprises identifying items related to the text or alpha-numeric characters.

20. A non-transitory machine-readable storage medium storing instructions that, when executed by the one or more hardware processors, causes the one or more hardware processors to perform operations comprising:

receiving a query image from a remote device;

performing image processing to extract an image attribute of the query image;

comparing the extracted image attribute of the query image to an attribute associated with each of a plurality of items to identify items similar to the query image;

causing display of a plurality of item recommendations comprising at least a portion of the identified items on a user interface of the remote device, the plurality of item recommendations being displayed based on similarity between the extracted image attribute of the query image and the attribute associated with each of the identified items;

receiving, from the remote device, a selection of a recommendation from the plurality of item recommendations;

in response to receiving the selection of the recommendation, determining a set of updated recommendations based on the selected recommendation; and

causing display of item details of the selected recommendation and the set of updated recommendations on the remote device.