ADAPTIVE ENVIRONMENT TARGETING

• US 20170039416A1
• Filed: 08/23/2016
• Published: 02/09/2017
• Est. Priority Date: 08/04/2015
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: ANTIPA, DAMIEN, CAPT, ALEXANDRE
• Granted Patent: US 10,740,591 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 10/56 relating to colour
• CPC Class Codes: G06V 10/759 Region-based matching
• CPC Class Codes: G06V 20/64 Three-dimensional objects

Abstract

Systems and methods provide adapted content to a visitor to a physical environment. An example method receives an image of a visitor to an environment. A visitor portion of the image is distinct from an environment portion of the image. The method detects one or more shapes in the visitor portion of the image using an automatic shape detection technique and defines an approximate boundary of the one or more shapes using a mask. The one or more shapes can be shapes of the visitor'"'"'s clothing items. The method then calculates an attribute for an area of the image within the mask and identifies electronic content based on the attribute for the area of the image within the mask. The attribute can be a color attribute for the area such as a median color or a dominant color. The method provides the identified electronic content for display in the environment.

Claims

1. A computer-implemented method comprising:

receiving, at a computing device, an image;

detecting, by the computing device, one or more shapes in the image;

defining, by the computing device, a mask for each of the one or more shapes;

calculating, by the computing device, one or more attributes for an area of the image within each defined mask;

identifying, by the computing device, electronic content based on the one or more attributes for the area of the image within each defined mask; and

providing the identified electronic content for display.

2. The method of claim 1, wherein the electronic content is displayed as a life-sized representation of a product.

3. The method of claim 1, wherein calculating an attribute for the area of the image within a defined mask comprises one or more of:

analyzing pixels of the area of the image within the mask to calculate a statistical median color for the area of the image within the mask;

analyzing pixels of the area of the image within the mask to determine a dominant color of the area of the image within the mask;

determining a shape of an item in the area of the image within the mask to determine an item type of the item; and

calculating dimensions of an item in the area of the image within the mask to determine an item size of the item.

4. The method of claim 1, wherein the image is an image of a user, and wherein detecting the one or more shapes comprises using an automatic shape detection technique to detect a clothing item in the image of the user.

5. The method of claim 4, further comprising:

comparing a shape of the clothing item in the image of the user to pre-defined shapes of clothing items.

6. The method of claim 1, wherein detecting the one or more shapes in the image comprises performing assistive clothing pattern recognition to detect a shape of a clothing item in the image.

7. The method of claim 1, wherein the identified electronic content comprises a plurality of images of a product.

8. The method of claim 7, wherein the identified electronic content comprises a three-dimensional (3D) product model depicting the product.

9. The method of claim 1, wherein the identified electronic content includes:

web content from a content management tool; and

an asset from an asset modeler, the method further comprising displaying the web content and the asset on a display of the computing device.

10. A system comprising:

a processing device;

a display device;

an input device;

at least one camera; and

a content management tool implemented on the processing device and configured to perform operations for adapting electronic content for presentation to a user, the operations comprising;

capturing, by the at least one camera, an image of the user;

detecting, by a shape detection module of the content management tool, one or more shapes in the image of the user;

defining, for each of the one or more shapes, a corresponding mask;

presenting, on the display device, electronic content items retrieved from a content repository;

receiving, via the input device, a selection of one or more of the presented electronic content items;

calculating one or more attributes for an area of the image within each defined mask;

identifying electronic content based at least in part on the selection and the one or more attributes for the area of the image within each defined mask; and

updating the content repository to include additional electronic content items having attributes similar to the one or more attributes.

11. The system of claim 10, wherein presenting the electronic content items comprises displaying life-sized representations of one or more products on the display device.

12. The system of claim 10, wherein the content repository includes electronic content relating to products.

13. The system of claim 10, wherein the content repository comprises three-dimensional (3D) product models depicting products.

14. The system of claim 10, wherein updating the content repository comprises including the additional electronic content items from a remote server, the remote server containing electronic content for products offered by a store.

15. The system of claim 10, wherein calculating the one ore more attributes for the area of the image within each defined mask comprises one or more of:

analyzing pixels of the area of the image within each defined mask to calculate respective statistical median colors for the area of the image within each defined mask; and

analyzing pixels of the area of the image within the mask to determine a respective dominant color of the area of the image within each defined mask.

16. A non-transitory computer readable storage medium having executable instructions stored thereon, that, if executed by a computing device, cause the computing device to perform operations, the instructions comprising:

instructions for receiving an image;

instructions for detecting one or more shapes in the image;

instructions for defining a mask for each of the one or more shapes;

instructions for calculating one or more attributes for an area of the image within each defined mask;

instructions for identifying electronic content based on the one or more attributes for the area of the image within each defined mask; and

instructions for providing the identified electronic content for display.

17. The non-transitory computer readable storage medium of claim 16, the instructions further comprising:

instructions for di splaying the identified electronic content; and

instructions for receiving input for manipulating a spatial orientation of the displayed electronic content.

18. The non-transitory computer readable storage medium of claim 17, the instructions further comprising:

instructions for receiving user input for manipulating attributes of the displayed electronic content, the attributes including one or more colors of the displayed electronic content.

19. The non-transitory computer readable storage medium of claim 16, wherein the image is an image of a user, and wherein the instructions for detecting one or more shapes in the image comprise instructions for using an automatic shape detection technique to detect a clothing item in the image of the user.

20. The non-transitory computer readable storage medium of claim 19, the instructions further comprising:

instructions for comparing a shape of the clothing item in the image of the user to pre-defined shapes of clothing items.