PROVIDING AUGMENTED REALITY INFORMATION

• US 20120062596A1
• Filed: 09/07/2011
• Published: 03/15/2012
• Est. Priority Date: 09/14/2010
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Ferre, Wilfredo, Bedi, Bharat V., Herve, Anthony, Yvon, Marc P.
• Granted Patent: US 8,866,847 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G06Q 30/0256 User search
• CPC Class Codes: G06Q 30/0267 Wireless devices
• CPC Class Codes: G06Q 30/0623 Item investigation
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers

Abstract

A system, method and computer program product for providing augmented reality information is disclosed. The method includes capturing an image of a set of items with an image capturing component coupled to a network-enabled computing device associated with a user identifier. The captured image is processed to identify each item of the set of items while a predefined list of user'"'"'s preferences is retrieved using the user identifier. For each identified item, checking is made if the item matches a condition related to the predefined list of user'"'"'s preferences. And based on the matching result, item information is conveyed to the network-enabled computing device and overlaid on the image.

Claims

1. A method for providing augmented reality information on a network-enabled computing device associated with a user identifier, the method comprising:

capturing an image of a set of items with an image capturing component coupled to the network-enabled computing device;

processing the image to identify each item of the set of items;

retrieving a predefined list of user preferences for the user using the user identifier;

for each identified item, checking if the item matches a condition related to the predefined list of user preferences;

based on the result of the matching, conveying item information to the network-enabled computing device; and

overlaying the item information on the image.

2. The method of claim 1, wherein the network-enabled computing device comprises a mobile device having an integrated camera, and wherein the user identifier is associated with an identifier of the user'"'"'s mobile device.

3. The method of claim 1, further comprising:

sending in a wireless mode the captured image to an image processing system.

4. The method of claim 1, wherein the processing further comprises:

performing a pixel analysis to define a set of pixel outlines; and

creating a respective set of image segments based on the set of pixel outlines.

5. The method of claim 4, further comprising:

identifying an item within each image segment of the set of image segments.

6. The method of claim 5, further comprising:

storing location and dimension information of each identified item.

7. The method of claim 1, wherein the checking further comprises:

comparing one or more properties of each identified item with the list of user preferences.

8. The method of claim 1, wherein the list of user preference is stored in a user preference store server remote from the image capturing component.

9. The method of claim 1, wherein the conveying item information comprises conveying information on at least one of items regularly consumed by the user or information on items recommended to the user.

10. The method of claim 9, wherein the overlaying item information further comprises:

overlaying on the image information on recommended items.

11. A system for providing augmented reality information on a network-enabled computing device associated with a user identifier, the system comprising:

a system for capturing an image of a set of items with an image capturing component coupled to the network-enabled computing device;

a system for processing the image to identify each item of the set of items;

a system for retrieving a predefined list of user preferences for the user using the user identifier;

a system for checking, for each identified item, if the item matches a condition related to the predefined list of user preferences;

a system for conveying item information, based on the result of the matching, to the network-enabled computing device; and

a system for overlaying the item information on the image.

12. The system of claim 11, wherein the network-enabled computing device comprises a mobile device having an integrated camera, and wherein the user identifier is associated with an identifier of the user'"'"'s mobile device.

13. The system of claim 11, further comprising:

a system for sending in a wireless mode the captured image to an image processing system.

14. The system of claim 11, wherein the system for processing further comprises:

a system for performing a pixel analysis to define a set of pixel outlines; and

a system for creating a respective set of image segments based on the set of pixel outlines.

15. The system of claim 14, further comprising:

a system for identifying an item within each image segment of the set of image segments.

16. The system of claim 15, further comprising:

a system for storing location and dimension information of each identified item.

17. The system of claim 11, wherein the system for checking further comprises:

a system for comparing one or more properties of each identified item with the list of user preferences.

18. The system of claim 11, wherein the list of user preference is stored in a user preference store server remote from the image capturing component.

19. The system of claim 11, wherein the system for conveying item information comprises conveying information on at least one of items regularly consumed by the user or information on items recommended to the user.

20. The system of claim 19, wherein the system for overlaying item information further comprises:

a system for overlaying on the image information on recommended items.

21. A computer readable medium having a computer program product stored thereon, which when executed by a computing device, performs a method for providing augmented reality information on a network-enabled computing device associated with a user identifier, the method comprising:

capturing an image of a set of items with an image capturing component coupled to the network-enabled computing device;

processing the image to identify each item of the set of items;

retrieving a predefined list of user preferences for the user using the user identifier;

for each identified item, checking if the item matches a condition related to the predefined list of user preferences;

based on the result of the matching, conveying item information to the network-enabled computing device; and

overlaying the item information on the image.