Store shelf imaging system

• US 10,453,046 B2
• Filed: 06/13/2014
• Issued: 10/22/2019
• Est. Priority Date: 06/13/2014
• Status: Active Grant

• Current Assignee: Conduent Business Services, LLC (Conduent, Inc.)
• Original Assignee: Conduent Business Services, LLC (Conduent, Inc.)
• Inventors: Wu, Wencheng, Moore, Steven R., Wade, Thomas F., Venable, Dennis L., Cote, Adrien P., Paul, Peter
• Primary Examiner(s): Ludwig, Peter
• Application Number:
  US14/303,809
• Publication Number:
  US 20150363758A1
• Time in Patent Office: 1,957 Days
• Field of Search: 705 22, 705 23
• CPC Class Codes: G05D 1/0094 involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
• CPC Class Codes: G06Q 10/087 Inventory or stock management, e.g. order filling, procurement or balancing against orders
• CPC Class Codes: G06Q 20/201 Price look-up processing, e.g. updating
• CPC Class Codes: G06T 2207/20016 Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 10/22 by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59
• CPC Class Codes: G06V 30/2247 Characters composed of bars, e.g. CMC-7
• CPC Class Codes: G06V 30/414 Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text

Abstract

A store profile generation system includes a mobile base and an image capture assembly mounted on the base. The assembly includes at least one image capture device for acquiring images of product display units in a product facility, product labels being associated with the product display units which include product-related data. A control unit acquires the images captured by the at least one image capture device at a sequence of locations of the mobile base in the product facility. The control unit extracts the product-related data from the acquired images and constructs a store profile indicating locations of the product labels throughout the product facility, based on the extracted product-related data. The store profile can be used for generating new product labels for a sale in an appropriate order for a person to match to the appropriate locations in a single pass through the store.

Claims

1. A store profile generation system comprising:

a mobile base;

an image capture assembly mounted on the mobile base, the assembly comprising image capture devices which acquire images of associated product display units in a product facility, product labels being associated with the product display units which include product-related data, a first of the image capture devices capturing low resolution photographic images of the product display units and a second of the image capture devices capturing high resolution photographic images of the product display units at a higher resolution than the first image capture device, the low and high resolution images including pixels; and

a control unit comprising memory which stores instructions and a processor which executes the instructions, the control unit instructions including instructions which process the images captured by the image capture devices at a sequence of locations of the mobile base in the product facility, using the low resolution photographic images acquired from the first image capture device to identify candidate locations of the product labels, thereafter extracts the product-related data from the acquired high resolution photographic images of the product display units, in the candidate locations, captured by the second image capture device, and constructs a store profile indicating locations of the product labels throughout the product facility based on the extracted product-related data, a spatial characterization of the image capture assembly, and information on locations of the mobile base in the sequence of locations at a time that the low resolution or high resolution images were acquired.

2. The system of claim 1, wherein the product-related data comprises at least one of printed barcodes and text.

3. The system of claim 1, wherein at least one of the image capture devices has a first position and a second position, vertically-spaced from the first position, which acquires images of the product display units in the first and second positions.

4. The system of claim 3, wherein the at least one image capture device includes a plurality of image capture devices, each having a first position and a second position, vertically-spaced from the first position, which acquires images of the product display units in the first and second positions of each of the image capture devices.

5. The system of claim 1, wherein the control unit translates at least one of at least two vertically-spaced acquired images based on a computed spatial profile of each of the image capture devices.

6. The system of claim 5, wherein the control unit generates a composite image of one of the product display units from the least two vertically-spaced translated images.

7. The system of claim 5, wherein the computed spatial profile of the at least one image capture device includes a mapping between locations for pixels of an acquired image and locations in a real space.

8. The system of claim 1 wherein the control unit generates a packaging order or printing order for a set of replacement product labels based on the constructed store profile.

9. The system of claim 1, wherein the second of the image capture devices captures one of the high resolution photographic image of one of the product display units in a respective one of the candidate locations after the control unit has used the low resolution photographic images acquired from the first image capture device to identify the respective one of the candidate locations.