System and method for retail store promotional price tag detection
First Claim
1. A retail store promotional price tag (PPT) detection and classification system comprising:
- a store shelf image acquisition module configured to acquire images of a plurality of product display units located in a retail store, the plurality of product display units including a plurality of products arranged on one or more of the product display fixtures, and a plurality of PPTs attached to the product display fixtures, each PPT including one or more printed colors and product-related data including a barcode associated with a respective product proximately located on the product display fixture near the PPT;
a device characterization module configured to generate one or more color profiles associated with transforming a plurality of colors associated with the acquired image of the printed PPTs from an image acquisition color space to an original color space associated with a digital representation of the PPTs;
a PPT detection and classifier module configured to extract one or more heuristic attributes including color from the acquired images using the one or more color profiles and apply one or more predefined heuristic rules to the heuristic attributes to detect and classify each PPT detected in the acquired images as one of a plurality of PPT types;
a mobile base including an operatively associated navigation component configured to determine a location of the mobile base within the retail store;
an image capture assembly mounted on the mobile base, the assembly including a plurality of image capture devices for acquiring the images of the plurality of product display units; and
a master control unit configured to execute control unit instructions for processing the images of the plurality of product display units at a sequence of locations during a movement of the mobile base in the retail store and thereafter generating a store profile indicating locations of the products and/or PPTs throughout the retail store.
6 Assignments
0 Petitions
Accused Products
Abstract
A system to detect and maintain retail store promotional price tags (PPTs) includes a heuristic PPT description extractor module, a heuristic rule deriver module, a store shelf image acquisition system, a barcode locator and recognizer module, and a heuristic PPT classifier module. The heuristic PPT description extractor module extracts heuristic descriptions of PPTs. The heuristic rule deriver module derives a set of heuristic parameters for the PPTs. The barcode locator and recognizer module analyzes images acquired by the store shelf image acquisition system to localize and recognize barcodes. The heuristic PPT description classifier module extracts heuristic attributes from the images acquired by the store shelf image acquisition system using the set of PPT parameters supplied by the heuristic rule deriver module.
-
Citations
21 Claims
-
1. A retail store promotional price tag (PPT) detection and classification system comprising:
-
a store shelf image acquisition module configured to acquire images of a plurality of product display units located in a retail store, the plurality of product display units including a plurality of products arranged on one or more of the product display fixtures, and a plurality of PPTs attached to the product display fixtures, each PPT including one or more printed colors and product-related data including a barcode associated with a respective product proximately located on the product display fixture near the PPT; a device characterization module configured to generate one or more color profiles associated with transforming a plurality of colors associated with the acquired image of the printed PPTs from an image acquisition color space to an original color space associated with a digital representation of the PPTs; a PPT detection and classifier module configured to extract one or more heuristic attributes including color from the acquired images using the one or more color profiles and apply one or more predefined heuristic rules to the heuristic attributes to detect and classify each PPT detected in the acquired images as one of a plurality of PPT types; a mobile base including an operatively associated navigation component configured to determine a location of the mobile base within the retail store; an image capture assembly mounted on the mobile base, the assembly including a plurality of image capture devices for acquiring the images of the plurality of product display units; and a master control unit configured to execute control unit instructions for processing the images of the plurality of product display units at a sequence of locations during a movement of the mobile base in the retail store and thereafter generating a store profile indicating locations of the products and/or PPTs throughout the retail store. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A retail store promotional price tag (PPT) detection and classification system comprising:
-
a store shelf image acquisition model configured to acquire images from a plurality of image capture devices of a plurality of product display units located in a retail store, the plurality of product display units including a plurality of products arranged on one or more of the product display fixtures, and a plurality of printed PPTs attached to the product display fixtures, each PPT including product-related data including a barcode associated with a respective product proximately located on the product display fixture near the PPT; a device characterization module configured to generate one or more spatial profiles associated with transforming the acquired images to compensate for distortions associated with each image capture device and alignment of the acquired images; an image stitching module configured to access the one or more spatial profiles and stitch the acquired images to generate a panorama image; a PPT detection and classifier module configured to extract one or more heuristic attributes from the panorama image and apply one or more predefined heuristic rules to the heuristic attributes to detect and classify each PPT detected as one of a plurality of PPT types; a mobile base including an operatively associated navigation component configured to determine a location of the mobile base within the retail store; an image capture assembly mounted on the mobile base, the assembly including the plurality of image capture devices for acquiring the images of the plurality of product display units; and a master control unit configured to execute control unit instructions for processing the images of the plurality of product display units at a sequence of locations during a movement of the mobile base in the retail store and thereafter generating a store profile indicating locations of the products and/or PPTs throughout the retail store. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A retail store profile generation system comprising:
-
a mobile base including an operatively associated navigation component configured to determine a location of the mobile base within a retail store, the retail store including a plurality of product display units arranged in a plurality of aisles, each product display unit including a plurality of product display fixtures, a plurality of product arranged on one or more of the product display fixtures, and a plurality of tags attached to the product display fixtures, each tag including product-related data including a barcode associated with a respective product proximately located on the product display fixture near the tag; an image capture assembly mounted on the mobile base, the assembly including a plurality of vertically spaced image capture devices for acquiring images of the product display units; a master control unit including an operatively associated memory which stores instructions and a processor for executing the instructions, the control unit instructions including instructions for processing the images acquired by the plurality of image capture devices at a sequence of locations during a movement of the mobile base in the store, thereafter extracting the product-related data from the images of the product display units and generating a store profile indicating locations of the products and/or tags throughout the store based on the extracted product-related data, a spatial characterization of the image capture assembly, a color characterization associated with transforming a plurality of colors associated with the acquired images from an image acquisition color space to an original color space associated with a digital representation of the tags, and the locations of the mobile base at the sequence of locations provided by the navigation component during an interval of time that the images were acquired. - View Dependent Claims (20, 21)
-
Specification