Planogram Extraction Based On Image Processing

• US 20090059270A1
• Filed: 08/31/2007
• Published: 03/05/2009
• Est. Priority Date: 08/31/2007
• Status: Active Grant

• Current Assignee: Accenture Global Services Limited (Accenture PLC)
• Original Assignee: Accenture Global Services Limited (Accenture PLC)
• Inventors: Fano, Andrew, Opalach, Agata, Linaker, Fredrik, Groenevelt, Robert Bernard (Robin)
• Granted Patent: US 8,189,855 B2
• Time in Patent Office: Days
• US Class Current: 358/1.150
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06Q 10/087 Inventory or stock management, e.g. order filling, procurement or balancing against orders
• CPC Class Codes: G06V 20/64 Three-dimensional objects

Abstract

Image analysis techniques, including object recognition analysis, are applied to images obtained by one or more image capture devices deployed within inventory environments. The object recognition analysis provides object recognition data (that may include one or more recognized product instances) based on stored product (training) images. In turn, a variety of functionalities may be enabled based on the object recognition data. For example, a planogram may be extracted and compared to a target planogram, or at least one product display parameter for a product can be determined and used to assess presence of the product within the inventory environment, or to determine compliance of display of the product with a promotional objective. In yet another embodiment, comparisons may be made within a single image or between multiple images over time to detect potential conditions requiring response. In this manner, efficiency and effectiveness of many previously manually-implemented tasks may be improved.

Claims

1. A method comprising:

receiving an image of at least one product within an inventory environment;

identifying at least one candidate product instance based on a configuration profile;

performing object recognition analysis on the image based on stored product images corresponding to the at least one candidate product instance to provide product recognition data; and

providing an extracted planogram based on the product recognition data.

2. The method of claim 1, further comprising:

identifying an image location of a product support device within the image; and

mapping the location of the product support device in the image into an actual location of the shelf within the inventory environment,

wherein the extracted planogram further illustrates the actual location of the product support device.

3. The method of claim 1, wherein the product recognition data includes at least one recognized product instance, and wherein extracted planogram includes for each of the at least one recognized product instance, a corresponding image of the recognized product instance.

4. The method of claim 3, further comprising, for each of the at least one recognized product instance:

identifying an image location of the recognized product instance within the image; and

mapping the location of the recognized product instance in the image into an actual location of the recognized product within the inventory environment,

wherein the extracted planogram further illustrates the actual location of the recognized product instance.

5. The method of claim 2 or 4, further comprising mapping the image location to the actual location based on position information of an image capture device within the inventory environment used to capture the image.

6. The method of claim 1, further comprising:

sending a request for the image to an image capture device within the inventory environment.

7. The method of claim 1, further comprising:

comparing the extracted planogram to a target planogram.

8. The method of claim 7, wherein the target planogram is either of a previously extracted planogram based on a previous image and an optimal planogram.

9. The method of claim 7, further comprising:

determining a cost associated with differences between the extracted planogram and the target planogram.

10. A processor-readable medium having stored thereon executable instructions that, when executed, cause a processing device to:

receive an image of at least one product within an inventory environment;

identify at least one candidate product instance based on a configuration profile;

perform object recognition analysis on the image based on stored product images corresponding to the at least one candidate product instance to provide product recognition data; and

provide an extracted planogram based on the product recognition data.

11. The processor-readable medium of claim 10, having stored thereon executable instruction that, when executed, further cause the processing device to:

identify an image location of a product support device within the image; and

map the location of the product support device in the image into an actual location of the product support device within the inventory environment,

wherein the extracted planogram further illustrates the actual location of the product support device.

12. The processor-readable medium of claim 10, having stored thereon executable instructions that, when executed, further cause the processing device to include, in the extracted planogram, a corresponding image for each of at least one recognized product instance in the product recognition data.

13. The processor-readable medium of claim 12, having stored thereon executable instruction that, when executed, further cause the processing device to:

identify an image location of the recognized product instance within the image; and

map the location of the recognized product instance in the image into an actual location of the recognized product instance within the inventory environment,

wherein the extracted planogram further illustrates the actual location of the recognized product instance.

14. The processor-readable medium of claim 11 or 13, having stored thereon executable instruction that, when executed, further cause the processing device to map the image location to the actual location based on position information of an image capture device within the inventory environment used to capture the image.

15. The processor-readable medium of claim 10, having stored thereon executable instruction that, when executed, further cause the processing device to:

sending a request for the image to an image capture device within the inventory environment.

16. The processor-readable medium of claim 10, having stored thereon executable instruction that, when executed, further cause the processing device to:

compare the extracted planogram to a target planogram.

17. The processor-readable medium of claim 16, wherein the target planogram is either of a previously extracted planogram based on a previous image and an optimal planogram.

18. The processor-readable medium of claim 16, having stored thereon executable instruction that, when executed, further cause the processing device to:

determining a cost associated with differences between the extracted planogram and the target planogram.

19. A system comprising:

an image capture device configured and disposed to capture an image of at least one product within an inventory environment; and

an automatic planogram generator, in communication with the image capture device, operative to identify at least one candidate product instance based on a configuration profile, to perform object recognition analysis on the image based on stored product images corresponding to the at least one candidate product instance to provide product recognition data and to provide an extracted planogram based on the product recognition data.