Detection of stock out conditions based on image processing

• US 8,630,924 B2
• Filed: 08/31/2007
• Issued: 01/14/2014
• Est. Priority Date: 08/31/2007
• Status: Active Grant

• Current Assignee: Accenture Global Services Limited (Accenture PLC)
• Original Assignee: Accenture Global Services Limited (Accenture PLC)
• Inventors: Groenevelt, Robert Bernard (Robin), Opalach, Agata, Fano, Andrew, Linaker, Fredrik
• Primary Examiner(s): Champagne, Luna
• Application Number:
  US11/849,180
• Publication Number:
  US 20090063307A1
• Time in Patent Office: 2,328 Days
• Field of Search: 705/28, 705/22, 705/23, 705/27, 340/825.49, 340/5.92, 211/90.01, 283/74, 283/79, 283/81
• US Class Current: 705/28
• CPC Class Codes: G06Q 10/087 Inventory or stock management, e.g. order filling, procurement or balancing against orders

Abstract

Image analysis techniques, including object recognition analysis, are applied to images obtained by one or more image capture devices deployed within inventory environments. The object recognition analysis provides object recognition data (that may include one or more recognized product instances) based on stored product (training) images. In turn, a variety of functionalities may be enabled based on the object recognition data. For example, a planogram may be extracted and compared to a target planogram, or at least one product display parameter for a product can be determined and used to assess presence of the product within the inventory environment, or to determine compliance of display of the product with a promotional objective. In yet another embodiment, comparisons may be made within a single image or between multiple images over time to detect potential conditions requiring response. In this manner, efficiency and effectiveness of many previously manually-implemented tasks may be improved.

Claims

1. A method comprising:

receiving, from an image capture device, an image of at least one product support device within an inventory environment;

analyzing the image, using at least one component performing image analysis and in communication with the image capture device, to detect at least one surface feature of the at least one product support device as at least one stock out feature; and

providing, by the at least one component, an indication of an at least partially depleted stock condition based on detection of the at least one stock out feature.

2. The method of claim 1, wherein the at least one stock out feature comprises a detectable pattern on at least one surface of the at least one product support device.

3. The method of claim 2, wherein the detectable pattern is configured and disposed on the at least one product support device so as to be occluded when at least one product is disposed on the at least one product support device.

4. The method of claim 2, wherein the detectable pattern encodes information concerning the at least one product.

5. The method of claim 1, wherein the at least one stock out feature comprises at least one region of the image matching at least one of colors, shapes and textures of the at least one product support device.

6. The method of claim 1, wherein the image capture device is distal relative to the at least one product support device.

7. The method of claim 1, wherein analyzing the image to detect the at least one stock out feature further comprises determining an extent to which the at least one stock out feature is detected, and wherein a magnitude of the at least partially depleted stock condition is proportional to the extent to which the at least one stock out feature is detected.

22. The method of claim 7, wherein providing the indication of the at least partially depleted stock condition further comprises providing the magnitude of the at least partially depleted stock condition.

8. An apparatus comprising at least one storage device comprising stored instructions and operably coupled to at least one processor, the at least one processor capable of executing the stored instructions that, when executed by the at least one processor, cause the apparatus to:

receive an image of at least one product support device within an inventory environment;

analyze the image to detect at least one surface feature of the at least one product support device as at least one stock out feature; and

provide an indication of an at least partially depleted stock condition based on detection of the at least one stock out feature.

9. The apparatus of claim 8, wherein the executable instructions that, when executed by the at least one processor, cause the apparatus to analyze the image to detect the at least one stock out feature are further operative to detect a detectable pattern on at least one surface of the at least one product support device.

10. The apparatus of claim 9, wherein the executable instructions that, when executed by the at least one processor, cause the apparatus to analyze the image to detect the at least one stock out feature are further operative to detect the detectable pattern that is configured and disposed on the at least one product support device so as to be occluded when at least one product is disposed on the at least one product support device.

11. The apparatus of claim 9, wherein the executable instructions that, when executed by the at least one processor, cause the apparatus to analyze the image to detect the at least one stock out feature are further operative to detect the detectable pattern that encodes information concerning the at least one product.

12. The apparatus of claim 8, wherein the executable instructions that, when executed by the at least one processor, cause the apparatus to analyze the image to detect the at least one stock out feature are further operative to detect at least one region of the image matching at least one of colors, shapes and textures of the at least one product support device.

13. The apparatus of claim 8, wherein the executable instructions that, when executed by the at least one processor, cause the apparatus to analyze the image to detect the at least one stock out feature are further operative to determine an extent to which the at least one stock out feature is detected, and wherein a magnitude of the at least partially depleted stock condition is proportional to the extent to which the at least one stock out feature is detected.

23. The apparatus of claim 13, wherein the executable instructions that, when executed by the at least one processor, cause the apparatus to provide the indication of the at least partially depleted stock condition are further operative to provide the magnitude of the at least partially depleted stock condition.

14. A system comprising:

at least one image capture device operative to provide an image of at least one product support device within an inventory environment; and

at least one component operative to receive the image from the image capture device, analyze the image to detect at least one surface feature of the at least one product support device as at least one stock out feature, and provide an indication of an at least partially depleted stock condition based on detection of the at least one stock out feature.

15. The system of claim 14, wherein the at least one component is further operative to detect a detectable pattern on at least one surface of the at least one product support device.

16. The system of claim 15, wherein the at least one component is further operative to detect the detectable pattern that is configured and disposed on the at least one product support device so as to be occluded when at least one product is disposed on the at least one product support device.

17. The system of claim 15, wherein the at least one component is further operative to detect the detectable pattern that encodes information concerning the at least one product.

18. The system of claim 14, wherein the at least one component is further operative to detect at least one region of the image matching at least one of colors, shapes and textures of the at least one product support device.

19. The system of claim 14, wherein the at least one component is further operative to determine an extent to which the at least one stock out feature is detected, and wherein a magnitude of the at least partially depleted stock condition is proportional to the extent to which the at least one stock out feature is detected.

20. The system of claim 14, further comprising:

an image server in communication with the at least one image capture device and the at least one component and operative to provide control signaling to the at least one image capture device to capture the image and to provide the image to the at least one component in response to a request.

21. The system of claim 14, further comprising:

at least one communication device, in communication with the at least one component, for receiving the indication of the at least partially depleted stock condition.

24. The system of claim 19, wherein the at least one component is further operative to provide, as part of the indication of the at least partially depleted stock condition, the magnitude of the at least partially depleted stock condition.