Providing augmented reality information

• US 8,866,847 B2
• Filed: 09/07/2011
• Issued: 10/21/2014
• Est. Priority Date: 09/14/2010
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Bedi, Bharat V., Ferre, Wilfredo, Herve, Anthony, Yvon, Marc P.
• Primary Examiner(s): Yang, Ryan R
• Application Number:
  US13/226,575
• Publication Number:
  US 20120062596A1
• Time in Patent Office: 1,140 Days
• Field of Search: None
• US Class Current: 345/633
• CPC Class Codes: G06Q 30/0256 User search
• CPC Class Codes: G06Q 30/0267 Wireless devices
• CPC Class Codes: G06Q 30/0623 Item investigation
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers

Abstract

A system, method and computer program product for providing augmented reality information is disclosed. The method includes capturing an image of a set of items with an image capturing component coupled to a network-enabled computing device associated with a user identifier. The captured image is processed to identify each item of the set of items while a predefined list of user'"'"'s preferences is retrieved using the user identifier. For each identified item, checking is made if the item matches a condition related to the predefined list of user'"'"'s preferences. And based on the matching result, item information is conveyed to the network-enabled computing device and overlaid on the image.

Claims

1. A method for providing augmented reality information on a network-enabled computing device associated with a user identifier of a user, the method comprising:

storing purchase information regarding items previously purchased by the user;

estimating a next required purchase date for each of the items previously purchased by the user based on the stored purchase information;

obtaining recommendation information for at least one item recommended to the user by at least one other user via a social network;

capturing an image of a plurality of items with an image capturing component coupled to the network-enabled computing device;

processing the image to identify each item of the plurality of items;

retrieving a predefined list of user preferences for the user using the user identifier;

for each identified item, checking if the item matches a condition related to the predefined list of user preferences;

for each item matching a condition related to the predefined list of user preferences;

conveying item information for the matching item to the network-enabled computing device;

overlaying the item information for the matching item on the image, the overlaying further comprising;

overlaying enriched information on the image for the matching item if the matching item is regularly consumed by the user based on the stored purchase information; and

overlaying enriched information on the image indicating to the user that the user be running out of the matching item based on the estimated next purchase date of the matching item; and

overlaying recommendation information on at least one identified item in the image that has been recommended to the user.

2. The method of claim 1, wherein the network-enabled computing device comprises a mobile device having an integrated camera, and wherein the user identifier is associated with an identifier of the user'"'"'s mobile device.

3. The method of claim 1, further comprising:

sending in a wireless mode the captured image to an image processing system.

4. The method of claim 1, wherein the processing further comprises:

performing a pixel analysis to define a set of pixel outlines; and

creating a respective set of image segments based on the set of pixel outlines.

5. The method of claim 4, further comprising:

identifying an item within each image segment of the set of image segments.

6. The method of claim 5, further comprising:

storing location and dimension information of each identified item.

7. The method of claim 1, wherein the checking further comprises:

comparing one or more properties of each identified item with the list of user preferences.

8. The method of claim 1, wherein the list of user preference is stored in a user preference store server remote from the image capturing component.

9. A system for providing augmented reality information on a network-enabled computing device associated with a user identifier of a user, the system comprising:

a system for storing purchase information regarding items previously purchased by the user;

a system for estimating a next required purchase date for each of the items previously purchased by the user based on the stored purchase information;

a system for obtaining recommendation information for at least one item recommended to the user by at least one other user via a social network;

a system for capturing an image of a plurality of items with an image capturing component coupled to the network-enabled computing device;

a system for processing the image to identify each item of the plurality of items;

a system for retrieving a predefined list of user preferences for the user using the user identifier;

a system for checking, for each identified item, if the item matches a condition related to the predefined list of user preferences;

a system for conveying, for each item matching a condition related to the predefined list of user preferences, item information for the matching item to the network-enabled computing device;

a system for overlaying, for each item matching a condition related to the predefined list of user preferences, the item information for the matching item on the image, the overlaying further comprising;

overlaying enriched information on the image for the matching item if the matching item is regularly consumed by the user based on the stored purchase information; and

overlaying enriched information on the image indicating to the user that the user be running out of the matching item based on the estimated next purchase date of the matching item; and

a system for overlaying recommendation information on at least one identified item in the image that has been recommended to the user.

10. The system of claim 9, wherein the network-enabled computing device comprises a mobile device having an integrated camera, and wherein the user identifier is associated with an identifier of the user'"'"'s mobile device.

11. The system of claim 9, further comprising:

a system for sending in a wireless mode the captured image to an image processing system.

12. The system of claim 9, wherein the system for processing further comprises:

a system for performing a pixel analysis to define a set of pixel outlines; and

a system for creating a respective set of image segments based on the set of pixel outlines.

13. The system of claim 12, further comprising:

a system for identifying an item within each image segment of the set of image segments.

14. The system of claim 13, further comprising:

a system for storing location and dimension information of each identified item.

15. The system of claim 9, wherein the system for checking further comprises:

a system for comparing one or more properties of each identified item with the list of user preferences.

16. The system of claim 9, wherein the list of user preference is stored in a user preference store server remote from the image capturing component.

17. A non-transitory computer readable medium having a computer program product stored thereon, which when executed by a computing device, performs a method for providing augmented reality information on a network-enabled computing device associated with a user identifier of a user, the method comprising:

storing purchase information regarding items previously purchased by the user;

estimating a next required purchase date for each of the items previously purchased by the user based on the stored purchase information;

obtaining recommendation information for at least one item recommended to the user by at least one other user via a social network;

capturing an image of a plurality of items with an image capturing component coupled to the network-enabled computing device;

processing the image to identify each item of the plurality of items;

retrieving a predefined list of user preferences for the user using the user identifier;

for each identified item, checking if the item matches a condition related to the predefined list of user preferences;

for each item matching a condition related to the predefined list of user preferences;

conveying item information for the matching item to the network-enabled computing device;

overlaying the item information for the matching item on the image, the overlaying further comprising;

overlaying enriched information on the image for the matching item if the matching item is regularly consumed by the user based on the stored purchase information; and

overlaying enriched information on the image indicating to the user that the user be running out of the matching item based on the estimated next purchase date of the matching item; and

overlaying recommendation information on at least one identified item in the image that has been recommended to the user.