SYSTEM AND METHOD FOR VISUALIZATION OF ITEMS IN AN ENVIRONMENT USING AUGMENTED REALITY

• US 20130106910A1
• Filed: 10/27/2011
• Published: 05/02/2013
• Est. Priority Date: 10/27/2011
• Status: Active Grant

• Current Assignee: eBay Inc.
• Original Assignee: eBay Inc.
• Inventors: Sacco, Nathan
• Granted Patent: US 9,449,342 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G06Q 30/0261 based on user location
• CPC Class Codes: G06Q 30/0631 Item recommendations
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

In various example embodiments, a system and method for visualization of an item in an environment using augmented reality is provided. In example embodiments, environment image data containing an image of an environment is received from a client device. A selection of an item that is under consideration for purchase and placement into an indicated location of the environment is received. An item image of the selected item is scaled to a scale that is based on dimensions determined from the environment image data for the environment. The scaled item image is augmented into the image of the environment at the indicated location to generate an augmented reality image.

Claims

1. A method comprising:

receiving, from a client device, environment image data containing an image of an environment;

receiving a selection of an item that is under consideration for purchase and placement into an indicated location of the environment;

scaling an item image of the selected item based on dimensions determined from the environment image data for the environment; and

augmenting, using at least one processor, the scaled item image into the image of the environment at the indicated location to generate an augmented reality image.

2. The method of claim 1, further comprising receiving an indication of the location where the scaled item image is to be augmented into the environment.

3. The method of claim 1, further comprising determining a distance in the environment to the indicated location, the distance being used to determine the dimensions.

4. The method of claim 1, further comprising determining the dimensions for the environment using a marker located in the environment.

5. The method of claim 1, further comprising:

determining an orientation of the indicated location; and

orienting the item image to the determined orientation of the indicated location.

6. The method of claim 1, wherein the image of the environment comprises a video of the environment, the scaling of the item image and the augmenting of the scaled item image being repeatedly performed for the video.

7. The method of claim 1, wherein the receiving of the selection of the item comprises receiving the item image for the item.

8. The method of claim 1, further comprising obtaining item data for the item from an item catalog, the item data including dimension data for the item.

9. The method of claim 1, further comprising extracting item data from a publication associated with the selection.

10. The method of claim 1, further comprising providing the augmented reality image to a display device of a user.

11. The method of claim 10, further comprising providing a selection associated with the augmented reality image, activation of the selection providing additional information for the item.

12. The method of claim 10, further comprising providing additional information for the item in conjunction with the augmented reality image.

13. The method of claim 12, wherein the additional information comprises at least one selection from the group consisting of shopping information, item description information, links to shopping sites, links to item listings, pricing information, and item recommendation information.

14. A system comprising:

a processor of a machine;

an imaging engine configured to receive, from a client device, environment image data containing an image of an environment;

a navigation engine configured to receive a selection of an item that is under consideration for purchase and placement into an indicated location of the environment;

a scaling module configured to scale an item image of the selected item based on dimensions determined from the environment image data for the environmental image data; and

an augmenting module configured to augment, using the processor, the scaled item image into the image of the environment at the indicated location to generate an augmented reality image.

15. The system of claim 14, further comprising a distance module configured to determine a distance in the environment to the indicated location.

16. The system of claim 14, further comprising a sizing module configured to determine the dimensions for the environment using a marker located in the environment.

17. The system of claim 14, further comprising an orientation module configured to:

determine an orientation of the indicated location, and orient the item image to the determined orientation of the indicated location.

18. The system of claim 14, further comprising a recommendation module configured to provide recommendations for other items as an alternative to the selected item.

19. The system of claim 14, further comprising an access module to obtain item data for the item from an item catalog, the item data including dimension data for the item.

20. A non-transitory machine-readable medium in communication with at least one processor, the non-transitory machine-readable medium storing instructions which, when executed by the at least one processor of a machine, causes the machine to perform operations comprising:

receiving, from a client device, environment image data containing an image of an environment;

receiving a selection of an item that is under consideration for purchase and placement into an indicated location of the environment;

scaling an item image of the selected item to a scale based on dimensions determined from the environment image data for the environment; and

augmenting, using at least one processor, the scaled item image into the image of the environment at the indicated location to generate an augmented reality image.