System and method for visualization of items in an environment using augmented reality

• US 10,147,134 B2
• Filed: 08/29/2016
• Issued: 12/04/2018
• Est. Priority Date: 10/27/2011
• Status: Active Grant

• Current Assignee: eBay Inc.
• Original Assignee: eBay Inc.
• Inventors: Sacco, Nathan
• Primary Examiner(s): Brier, Jeffery A
• Application Number:
  US15/250,588
• Publication Number:
  US 20160364793A1
• Time in Patent Office: 827 Days
• CPC Class Codes: G06Q 30/0261 based on user location
• CPC Class Codes: G06Q 30/0631 Item recommendations
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

Systems and methods for visualization of an item in an environment using augmented reality are provided. Environment image data containing an image of an environment is received. A selection of an item for placement into an indicated location of the environment is received. An item image of the selected item is scaled based on dimensions determined from the environment image data for the environment. The scaled item image is augmented into the image of the environment at the indicated location to generate an augmented reality image. The augmented reality image is displayed on a device of a user, whereby the scaled item image in the augmented reality image is selectable to cause display of information. A selection of the scaled item image is received. In response to the selection of the scaled item image, the information is presented on the device of the user.

Claims

1. A method comprising:

receiving environment image data containing an image of an environment;

receiving a selection of an item for placement into an indicated location of the image of the environment;

scaling an item image of the selected item based on dimensions determined from the environment image data for the environment;

augmenting, using at least one processor, the scaled item image into the image of the environment at the indicated location to generate an augmented reality image;

causing display of the augmented reality image on a device of a user, the scaled item image in the augmented reality image being selectable to cause display of information;

receiving a selection of the scaled item image in the augmented reality image; and

in response to the receiving the selection of the scaled item image, causing presentation of the information on the device of the user.

2. The method of claim 1, further comprising determining a distance to the indicated location, the scaling of the item image of the selected item being based on the dimensions and the determined distance.

3. The method of claim 2, wherein the determining the distance to the indicated location comprises using environment image data derived from a focus capability of an image capture device associated with the client device to determine the distance.

4. The method of claim 2, wherein the determining the distance to the indicated location comprises using environment image data based on an echo technique performed by a sound generator of the client device to determine the distance.

5. The method of claim 1, further comprising determining the dimensions for the environment using a marker located in the environment.

6. The method of claim 1, further comprising:

determining an orientation of the indicated location; and

orienting the scaled item image to the determined orientation of the indicated location.

7. The method of claim 1, wherein the image of the environment comprises a video of the environment, the scaling of the item image and the augmenting of the scaled item image being repeatedly performed for the video.

8. The method of claim 1, wherein the receiving of the selection of the item comprises receiving the item image for the selected item.

9. The method of claim 1, further comprising obtaining item data for the selected item from an item catalog, the item data including dimension data for the selected item.

10. The method of claim 1, wherein the causing presentation of the additional information in response to the receiving the selection of the scaled item image comprises causing presentation of at least one alternative recommendation, the least one alternative recommendation being a smaller or larger item.

11. The method of claim 1, wherein the causing the presentation of the additional information in response to the receiving the selection of the scaled item image comprises causing presentation of at least one alternative recommendation, the least one alternative recommendation being an item that is less expensive than the selected item.

12. The method of claim 1, wherein the causing presentation of the additional information in response to the receiving the selection of the scaled item image comprises causing presentation of one or more links to various marketplaces where the selected item may be purchased.

13. The method of claim 1, wherein the causing presentation of the additional information in response to the receiving the selection of the scaled item image comprises causing presentation of one or more of a dimension, weight, item identifier, or product description of the selected item.

14. The method of claim 1, wherein the causing the presentation of the additional information in response to the receiving the selection of the scaled item image comprises causing presentation of at least one alternative recommendation, the least one alternative recommendation being a newer version of the selected item.

15. The method of claim 1, wherein the causing the presentation of the additional information in response to the receiving the selection of the scaled item image comprises causing presentation of at least one alternative recommendation, the least one alternative recommendation being an item that ranks higher than the selected item.

16. A system comprising:

one or more hardware processors; and

a storage device storing instructions that, when executed by the one or more hardware processors, cause the one or more hardware processors to perform operations comprising;

receiving environment image data containing an image of an environment;

receiving a selection of an item for placement into an indicated location of the image of the environment;

scaling an item image of the selected item based on dimensions determined from the environment image data for the environment;

augmenting the scaled item image into the image of the environment at the indicated location to generate an augmented reality image;

causing display of the augmented reality image on a device of a user, the scaled item image in the augmented reality image being selectable to cause display of information;

receiving a selection of the scaled item image in the augmented reality image; and

in response to the receiving the selection of the scaled item image, causing presentation of the information on the device of the user.

17. The system of claim 16, wherein the causing the presentation of the additional information in response to the receiving the selection of the scaled item image comprises causing presentation of at least one alternative recommendation.

18. The system of claim 16, wherein the causing presentation of the additional information in response to the receiving the selection of the scaled item image comprises causing presentation of one or more links to various marketplaces where the selected item may be purchased.

19. The system of claim 16, wherein the causing presentation of the additional information in response to the receiving the selection of the scaled item image comprises causing presentation of one or more of a dimension, weight, item identifier, or product description of the selected item.

20. A machine-readable hardware device storing instructions which, when executed by the at least one processor of a machine, causes the machine to perform operations comprising:

receiving environment image data containing an image of an environment;

receiving a selection of an item for placement into an indicated location of the image of the environment;

scaling an item image of the selected item based on dimensions determined from the environment image data for the environment;

augmenting the scaled item image into the image of the environment at the indicated location to generate an augmented reality image;

causing display of the augmented reality image on a device of a user, the scaled item image in the augmented reality image being selectable to cause display of information;

receiving a selection of the scaled item image in the augmented reality image; and

in response to the receiving the selection of the scaled item image, causing presentation of the information on the device of the user.