Method for tracking placement of products on shelves in a store
First Claim
1. A method for tracking placement of products on shelves in a store comprising:
- accessing a first image comprising visual data recorded by a mobile robotic system at a first time, the first image associated with a first location and a first orientation of the mobile robotic system within the store at the first time;
detecting a first shelf represented proximal a first region of the first image;
determining an address of the first shelf based on the first location, the first orientation, and a vertical position of the first shelf within the first image;
based on the address of the first shelf, retrieving a first list of products assigned to the first shelf by a planogram of the store;
retrieving a first set of template images from a database of template images, each template image in the first set of template images comprising visual features of a product specified in the first list of products;
extracting a first set of features from the first region of the first image;
confirming presence of a unit of a first product, in the first list of products, on the first shelf in response to correlation between features in the first set of features and features in a first template image, in the first set of template images, representing the first product;
determining that a unit of the first product is improperly stocked on the first shelf in response to deviation between features in the first set of features and features in the first template image; and
in response to determining that the unit of the first product is improperly stocked on the first shelf, generating a first restocking prompt for the first product on the first shelf.
3 Assignments
0 Petitions
Accused Products
Abstract
One variation of a method for tracking placement of products in a store includes: accessing an image recorded by a mobile robotic system within a store; detecting a shelf in a region of the image; based on an address of the shelf, retrieving a list of products assigned to the shelf by a planogram of the store; retrieving a set of template images—from a database of template images—defining visual features of products specified in the list of products; extracting a set of features from the region of the image; determining that a unit of the product is mis-stocked on the shelf in response to deviation between the set of features and features in a template image, in the set of template images, representing the product; and in response to determining that the unit of the product is mis-stocked on the shelf, generating a restocking prompt for the product.
-
Citations
20 Claims
-
1. A method for tracking placement of products on shelves in a store comprising:
-
accessing a first image comprising visual data recorded by a mobile robotic system at a first time, the first image associated with a first location and a first orientation of the mobile robotic system within the store at the first time; detecting a first shelf represented proximal a first region of the first image; determining an address of the first shelf based on the first location, the first orientation, and a vertical position of the first shelf within the first image; based on the address of the first shelf, retrieving a first list of products assigned to the first shelf by a planogram of the store; retrieving a first set of template images from a database of template images, each template image in the first set of template images comprising visual features of a product specified in the first list of products; extracting a first set of features from the first region of the first image; confirming presence of a unit of a first product, in the first list of products, on the first shelf in response to correlation between features in the first set of features and features in a first template image, in the first set of template images, representing the first product; determining that a unit of the first product is improperly stocked on the first shelf in response to deviation between features in the first set of features and features in the first template image; and in response to determining that the unit of the first product is improperly stocked on the first shelf, generating a first restocking prompt for the first product on the first shelf. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20)
-
Specification