PRODUCT IDENTIFICATION USING IMAGE ANALYSIS AND USER INTERACTION

• US 20100086192A1
• Filed: 10/02/2008
• Published: 04/08/2010
• Est. Priority Date: 10/02/2008
• Status: Active Grant

• Current Assignee: Dropbox, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Mishra, Sunil K., Grigsby, Travis M.
• Granted Patent: US 8,194,985 B2
• Time in Patent Office: Days
• US Class Current: 382/141
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/587 using geographical or spatial information, e.g. location
• CPC Class Codes: G06Q 30/0601 Electronic shopping [e-shopping]
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: G06V 20/95 Pattern authentication; Markers therefor; Forgery detection

Abstract

An apparatus, system, and method are disclosed for product identification using image analysis and user interaction. The method may include comparing a retail product image to a plurality of candidate retail product images. In addition, the method may include generating a candidate product set containing candidate retail product images satisfying image comparison criteria. The method may determine one or more product identity queries configured to solicit additional product identity information from a user. In addition, the product identity queries may eliminate one or more members of the candidate product set. The method may query the user with these inquiries and determine a product match based on the user'"'"'s response. Therefore a user may obtain information about a product using only a picture and a user'"'"'s knowledge of the product.

Claims

1. A method for facilitating product identification using image analysis and user interaction, the method comprising:

comparing a retail product image to a plurality of candidate retail product images, the retail product image comprising a pictorial likeness of a manufactured retail product;

generating a candidate product set comprising candidate retail product images satisfying image comparison criteria, each candidate retail product image representative of a retail product having a plurality of product characteristics; and

determining one or more product identity queries configured to solicit additional product identity information from a user, the product identity queries derived from the candidate retail product images in the candidate product set, the product identity queries configured to eliminate one or more members of the candidate product set.

2. The method of claim 1, further comprising querying the user with the one or more product identity inquiries.

3. The method of claim 2, further comprising determining a product match based on additional product identity information from the user in response to the one or more product identity inquiries.

4. The method of claim 3, further comprising presenting the product match to the user.

5. The method of claim 4, further comprising presenting the plurality of product characteristics associated with the product match to the user.

6. The method of claim 5, further comprising saving the product match, the plurality of product characteristics associated with the product match, and user information in a product inventory, the product inventory stored in a repository.

7. The method of claim 6, further comprising sending and receiving user product data through an interface to an independent web service.

8. The method of claim 2, further comprising presenting a potential match list to the user for the user to select a product match, the potential match list comprising two or more members of the candidate product set not eliminated by the product identity queries.

9. The method of claim 2, further comprising requesting one or more additional retail product images from the user, each retail product image comprising a pictorial likeness of the manufactured retail product from a certain perspective.

10. The method of claim 1, wherein comparing a retail product image further comprises obtaining candidate retail product images for comparison from a repository.

11. The method of claim 1, wherein comparing a retail product image further comprises obtaining candidate retail product images from a web crawler on the internet.

12. The method of claim 1, further comprising determining a product compatibility between the product match and one or more additional retail products.

13. An apparatus for product identification using image analysis and user interaction, the apparatus comprising:

a comparison module configured to compare a retail product image to a plurality of candidate retail product images, the retail product image comprising a pictorial likeness of a manufactured retail product;

a generation module configured to generate a candidate product set comprising candidate retail product images satisfying image comparison criteria, each candidate retail product image representative of a retail product having a plurality of product characteristics;

a query determination module configured to determine one or more product identity queries configured to solicit additional product identity information from a user, the product identity queries derived from the candidate retail product images in the candidate product set, the product identity queries configured to eliminate one or more members of the candidate product set.

a query module configured to query the user with the one or more product identity inquiries; and

a product determination module configured to determine a product match based on additional product identity information from the user in response to the one or more product identity inquiries.

14. The apparatus of claim 13, further comprising a presentation module configured to present the product match to the user.

15. The apparatus of claim 14, wherein the presentation module is further configured to present the plurality of product characteristics associated with the product match to the user.

16. The apparatus of claim 13, further comprising a storage module configured to store the product match, the plurality of product characteristics associated with the product match, and user information.

17. The apparatus of claim 16, further comprising an interface module configured to send and receive user product data with an independent web service through an interface.

18. The apparatus of claim 13, wherein the comparison module further comprises a web crawler module configured to obtain candidate retail product images from the internet.

19. The apparatus of claim 13, wherein the product identity information is selected from the group consisting of a purchase location, a receipt scan, a product packaging photo, an instruction manual scan, a product category, an RFID scan, a product description, and a product serial number.

20. A system for product identification using image analysis and user interaction, the system comprising:

a network configured to communicate data between a plurality of devices;

a client in communication with the network; and

a server in communication with the network, the server comprising;

a comparison module configured to compare a retail product image to a plurality of candidate retail product images, the retail product image comprising a pictorial likeness of a manufactured retail product;

a generation module configured to generate a candidate product set comprising candidate retail product images satisfying image comparison criteria, each candidate retail product image representative of a retail product having a plurality of product characteristics;

a query determination module configured to determine one or more product identity queries configured to solicit additional product identity information from a user, the product identity queries derived from the candidate retail product images in the candidate product set, the product identity queries configured to eliminate one or more members of the candidate product set.

a query module configured to query the user with the one or more product identity inquiries;

an input module configured to receive product information from the user in response to the one or more product identity inquiries; and

a product determination module configured to determine a product match based on the product information from the user.

21. The system of claim 20, further comprising a presentation module configured to present the plurality of product characteristics associated with the product match to the user.

22. The system of claim 20, wherein the comparison module is configured to obtain candidate retail product images for comparison from a repository.

23. The system of claim 20, wherein the comparison module further comprises a web crawler module configured to obtain candidate retail product images from the internet.

24. A computer program product for a product identification service using image analysis and user interaction, the computer program product comprising:

receiving a product identification request and a retail product image, the retail product image comprising a pictorial likeness of a manufactured retail product;

comparing the retail product image to a plurality of candidate retail product images;

generating a candidate product set comprising candidate retail product images satisfying image comparison criteria, each candidate retail product image representative of a retail product having a plurality of product characteristics; and

determining one or more product identity queries configured to solicit additional product identity information from a user, the product identity queries derived from the candidate retail product images in the candidate product set, the product identity queries configured to eliminate one or more members of the candidate product set.

querying the user with the one or more product identity inquiries; and

determining a product match based on additional product identity information from the user in response to the one or more product identity inquiries.

25. The computer program product of claim 24, further comprising returning the plurality of product characteristics associated with the product match in response to the user verifying the product match.