Method and apparatus for augmented reality shopping assistant

• US 20090182499A1
• Filed: 01/11/2008
• Published: 07/16/2009
• Est. Priority Date: 01/11/2008
• Status: Active Grant

• Current Assignee: X Corp. (f/k/a Twitter, Inc.) (X Holdings Corp.)
• Original Assignee: NCR Corporation
• Inventors: Bravo, Luis Eduardo
• Granted Patent: US 8,626,611 B2
• Time in Patent Office: Days
• US Class Current: 701/207
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence

Abstract

An augmented reality shopping system in one embodiment includes a store communication network, a memory including program instructions for receiving a product location request, associating the received request with product information stored in a product database, determining the location of the product within the store, receiving shopper location information, determining a route between the determined location of the product and the shopper location based upon the shopper location information, generating route rendering data based upon the determined route, and transmitting the route rendering data through the store communication network. The system further includes a processor operably connected to the store communication network and to the memory for executing the program instructions and a mobile display device operably connected to the processor through the store communication network for rendering an overlay image using the transmitted route rendering data.

Claims

1. An augmented reality shopping system comprising:

a store communication network;

a memory including program instructions for

receiving a product location request,

associating the received request with product information stored in a product database,

determining the location of the product within the store,

receiving shopper location information,

determining a route between the determined location of the product and the shopper location based upon the shopper location information,

generating route rendering data based upon the determined route, and

transmitting the route rendering data through the store communication network;

a processor operably connected to the store communication network and to the memory for executing the program instructions; and

a mobile display device operably connected to the processor through the store communication network for rendering an overlay image using the transmitted route rendering data.

2. The system of claim 1, wherein:

the memory further comprises a stored model of at least a portion of the store; and

the mobile device is further operable to render an overlay image based upon the stored model.

3. The system of claim 1, wherein the network is a wireless network and the mobile display device is wirelessly integrated into the network.

4. The system of claim 3, wherein the mobile display device is a hands-free mobile display device.

5. The system of claim 4, wherein the mobile display device operates based upon voice commands.

6. The system of claim 4, wherein the mobile display device operates based upon eye tracking.

7. The system of claim 1, wherein:

the product database includes product availability information;

the memory further includes program instructions for transmitting product availability information through the store communication network; and

the mobile display device is operably connected to the processor through the store communication network for rendering an overlay image using the product availability information.

8. The system of claim 1, wherein:

the product database includes alternative product availability information;

the memory further includes program instructions for transmitting alternative product availability information through the store communication network; and

the mobile display device is operably connected to the processor through the store communication network for rendering an overlay image using the alternative product availability information.

9. A method of rendering an overlay image comprising:

receiving a product location request through a store communications network;

associating the received request with product information stored in a product database;

determining the location of the product within the store;

receiving shopper location information;

determining a route to the determined product location from a determined shopper location based upon the shopper location information;

transmitting route rendering data through the store communication network; and

rendering an overlay image using the transmitted route rendering data on a mobile display device.

10. The method of claim 9, further comprising:

storing a model of at least a portion of the store; and

wherein rendering comprises,

rendering an overlay image based upon the stored model.

11. The method of claim 9, further comprising:

transmitting the route rendering data to the mobile display device over a wireless network.

12. The method of claim 11, further comprising:

transmitting the product location request through a hands-free mobile display device.

13. The method of claim 12, wherein transmitting the product location request comprises:

transmitting the product location request based upon voice commands.

14. The method of claim 12, wherein receiving shopper location information further comprises:

receiving eye tracking data from the hands-free mobile display device.

15. The method of claim 9, further comprising:

transmitting product availability information through the store communication network; and

rendering an overlay image using the product availability information.

16. The method of claim 9, further comprising:

transmitting alternative product availability information through the store communication network; and

rendering an overlay image using the alternative product availability information.