RESTOCKING SHELVES BASED ON IMAGE DATA
First Claim
1. A method of identifying spaces on shelves which are not full of objects, comprising:
- identifying a marker having known dimensions, the marker located proximate a shelf containing objects;
obtaining an image of the shelf including the marker, using a device having a camera;
executing software stored on non-transitory media using a processor of at least one of the device having a camera and a computer, the software configured toanalyze the image to identify the marker;
analyze the image to identify the shelf;
analyze the storage area of the shelf to identify vacant areas of the shelf represented by a lower light intensity relative to adjacent areas;
determine a location of the vacant areas with respect to the shelf;
determine the size of the vacant areas using the actual size of the marker and the size of the marker in the image, to generate a scale which can be applied to the vacant area; and
process the determined information and stored information pertaining to the objects to determine what objects are missing from the vacant areas.
1 Assignment
0 Petitions
Accused Products
Abstract
To identify spaces on shelves which are not full of product and need restocking, markers having a pattern are placed on or near shelves containing product. A camera obtains an image of the shelf, products, and markers. A processor executing software is used to analyze the image to identify the markers and the shelf. Next, storage areas on the shelf are analyzed to identify vacant areas represented by a lower light intensity relative to adjacent areas. The processor determines a location of the vacant areas, and determines the size of the vacant areas using the known marker size and the size of the marker in the image, to generate a scale which is applied to the vacant area. This information and stored product information is used to determine which products should be restocked. The marker pattern can be selected to be readily recognizable by an image processing algorithm.
-
Citations
20 Claims
-
1. A method of identifying spaces on shelves which are not full of objects, comprising:
-
identifying a marker having known dimensions, the marker located proximate a shelf containing objects; obtaining an image of the shelf including the marker, using a device having a camera; executing software stored on non-transitory media using a processor of at least one of the device having a camera and a computer, the software configured to analyze the image to identify the marker; analyze the image to identify the shelf; analyze the storage area of the shelf to identify vacant areas of the shelf represented by a lower light intensity relative to adjacent areas; determine a location of the vacant areas with respect to the shelf; determine the size of the vacant areas using the actual size of the marker and the size of the marker in the image, to generate a scale which can be applied to the vacant area; and process the determined information and stored information pertaining to the objects to determine what objects are missing from the vacant areas. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A method of identifying spaces on shelves which are not full of objects, comprising:
-
placing a marker bearing a pattern, the marker having known dimensions, proximate a shelf containing objects; obtaining an image of the shelf including the marker, using a device having a camera; executing software stored on non-transitory media using a processor of at least one of the device having a camera and a computer, the software configured to analyze the image to identify the marker; analyze the image to identify the shelf; identify areas of the shelf in relation to a planogram; analyze the storage area of the shelf to identify vacant areas of the shelf by comparing adjacent areas of the shelf with reference to the planogram, and if the planogram indicates adjacent areas are intended to contain the same product but the corresponding adjacent areas of the image appear different, determining that at least one row includes a vacant area; communicate the location of the vacant areas for subsequent restocking.
-
-
20. A method of restocking product on store display shelves, comprising:
-
identifying a marker proximate a shelf containing objects; at predetermined time intervals, obtaining an image of the shelf including the marker, using a device having a camera; executing software stored on non-transitory media using a processor, the software configured to analyze the image to identify the marker; use the marker location to identify areas corresponding to a planogram; compare stored image data of a product at an identified area that is fully stocked with image data obtained at a time interval, and if the stored image and the image data obtained at a the time interval are not the same, designating the identified area and product as requiring restocking.
-
Specification