COMPARING PLANOGRAM COMPLIANCE TO CHECKOUT DATA

• US 20190236531A1
• Filed: 03/15/2019
• Published: 08/01/2019
• Est. Priority Date: 01/10/2018
• Status: Abandoned Application

• Current Assignee: Trax Technology Solutions Pte. Ltd. (Trax Technologies (SG) Pte Ltd.)
• Original Assignee: Trax Technology Solutions Pte. Ltd. (Trax Technologies (SG) Pte Ltd.)
• Inventors: Adato, Yair, Bronicki, Youval, Grubshtein, Alon, Peled, Galit, Cohen, Daniel Shimon, Dayan, Shlomi
• Application Number:
  US16/354,186
• Publication Number:
  US 20190236531A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/23 Updating
• CPC Class Codes: G06F 16/235 Update request formulation
• CPC Class Codes: G06F 16/288 Entity relationship models
• CPC Class Codes: G06F 16/55 Clustering; Classification
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/5846 using extracted text
• CPC Class Codes: G06F 16/90335 Query processing
• CPC Class Codes: G06F 17/18 for evaluating statistical data , e.g. average values, frequency distributions, probability functions, regression analysis forecasting specially adapted for a specific administrative, business or logistic context G06Q10/04
• CPC Class Codes: G06F 18/2115 by evaluating different subsets according to an optimisation criterion, e.g. class separability, forward selection or backward elimination
• CPC Class Codes: G06Q 10/06311 Scheduling, planning or task assignment for a person or group
• CPC Class Codes: G06Q 10/063112 Skill-based matching of a person or a group to a task
• CPC Class Codes: G06Q 10/06316 Sequencing of tasks or work
• CPC Class Codes: G06Q 10/0633 Workflow analysis
• CPC Class Codes: G06Q 10/08 Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
• CPC Class Codes: G06Q 10/087 Inventory or stock management, e.g. order filling, procurement or balancing against orders
• CPC Class Codes: G06Q 10/0875 Itemisation or classification of parts, supplies or services, e.g. bill of materials
• CPC Class Codes: G06Q 20/203 Inventory monitoring
• CPC Class Codes: G06Q 30/0201 Market modelling; Market analysis; Collecting market data
• CPC Class Codes: G06Q 30/0246 Traffic
• CPC Class Codes: G06Q 30/0629 for generating comparisons
• CPC Class Codes: G06Q 30/0639 : Item locations
• CPC Class Codes: G06Q 30/0643 : Graphical representation of items or shoppers
• CPC Class Codes: G06T 2207/30196 : Human being; Person
• CPC Class Codes: G06T 2207/30232 : Surveillance
• CPC Class Codes: G06T 2207/30242 : Counting objects in image
• CPC Class Codes: G06T 7/0002 : Inspection of images, e.g. flaw detection
• CPC Class Codes: G06T 7/13 : Edge detection
• CPC Class Codes: G06T 7/20 : Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/521 : from laser ranging, e.g. using interferometry; from the projection of structured light
• CPC Class Codes: G06T 7/55 : from multiple images
• CPC Class Codes: G06T 7/70 : Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06T 7/75 : involving models
• CPC Class Codes: G06V 20/00 : Scenes; Scene-specific elements control of digital cameras H04N23/60
• CPC Class Codes: G06V 20/10 : Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59
• CPC Class Codes: G06V 20/17 : taken from planes or by drones
• CPC Class Codes: G06V 20/20 : in augmented reality scenes
• CPC Class Codes: G06V 20/52 : Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/62 : Text, e.g. of license plates, overlay texts or captions on TV images
• CPC Class Codes: G06V 20/64 : Three-dimensional objects
• CPC Class Codes: G06V 20/68 : Food, e.g. fruit or vegetables
• CPC Class Codes: G06V 30/10 : Character recognition
• CPC Class Codes: G06V 40/10 : Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G08B 21/18 : Status alarms G08B21/02 takes precedence
• CPC Class Codes: G08B 21/182 : Level alarms, e.g. alarms responsive to variables exceeding a threshold
• CPC Class Codes: H04N 23/51 : Housings
• CPC Class Codes: H04N 23/54 : Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
• CPC Class Codes: H04N 23/611 : where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/66 : Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 23/80 : Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/90 : Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

The present disclosure relates to systems and methods for identifying products and monitoring planogram compliance using analysis of image data. In one implementation, the method may include accessing at least one planogram describing a desired placement of a plurality of product types on shelves of a plurality of retail stores; receiving image data from the plurality of retail stores; analyzing the image data to determine an actual placement of the plurality of product types on the shelves of the plurality of retail stores; determining at least one characteristic of planogram compliance based on detected differences between the at least one planogram and the actual placement of the plurality of product types on the shelves of the plurality of retail stores; and receiving checkout data from the plurality of retail stores reflecting sales of at least one product type from the plurality of product types.

Claims

1-260. -260. (canceled)

261. A method for identifying products and monitoring planogram compliance using analysis of image data, the method comprising:

accessing at least one planogram describing a desired placement of a plurality of product types on shelves of a plurality of retail stores;

receiving image data from the plurality of retail stores;

analyzing the image data to determine an actual placement of the plurality of product types on the shelves of the plurality of retail stores;

determining at least one characteristic of planogram compliance based on detected differences between the at least one planogram and the actual placement of the plurality of product types on the shelves of the plurality of retail stores;

receiving checkout data from the plurality of retail stores reflecting sales of at least one product type from the plurality of product types;

estimating, based on the determined at least one characteristic of planogram compliance and based on the received checkout data, an impact of the at least one characteristic of planogram compliance on the sales of the at least one product type;

based on the estimated impact, identifying an action, associated with the at least one characteristic of planogram compliance, for potentially increasing future sales of the at least one product type; and

providing information associated with the identified action to an entity.

262. The method of claim 261, wherein the characteristic of planogram compliance includes at least one of:

product facing, product placement, planogram compatibility, price correlation, promotion execution, product homogeneity, restocking rate, and planogram compliance of adjacent products.

263. The method of claim 261, wherein when the characteristic of planogram compliance is product facing, the method further comprising determining at least one value indicative of product facing compliance for the at least one product type, wherein the at least one value of product facing compliance is determined through image analysis and is associated with a number of products of the at least one product type being positioned differently than the desired placement described in the at least one planogram.

264. The method of claim 263, wherein the method further comprises identifying a retail store where the at least one value indicative of product facing compliance of the at least one product type is lower than a compliance threshold and the sales of the at least one product type are lower than a sales threshold.

265. The method of claim 264, wherein the compliance threshold is based on a function of values indicative of product facing compliance of the at least one product type at the plurality of retail stores, and the sales threshold is based on a function of the sales of the at least one product type at the plurality of retail stores.

266. The method of claim 264, wherein the compliance threshold is based on a contractual agreement of a retail store, and the sales threshold is based on marketing goals associated with the at least one product type.

267. The method of claim 261, wherein when the characteristic of planogram compliance is product placement, the method further comprising determining at least one value indicative of product placement compliance for the at least one product, wherein the at least one value indicative of product placement compliance is determined through image analysis and is associated with a number of products of the at least one product type being placed differently than the desired placement described in the at least one planogram.

268. The method of claim 261, wherein when the characteristic of planogram compliance is planogram compatibility, the method further comprising determining at least one value indicative of planogram compatibility compliance for the at least one product type, wherein the at least one value indicative of planogram compatibility compliance is determined through image analysis and is associated with a structural difference between a shelf size in the at least one planogram and physical dimensions of a shelf associated with the at least one product type.

269. The method of claim 261, wherein when the characteristic of planogram compliance is price correlation, the method further comprising determining at least one value indicative of price correlation compliance for the at least one product type, wherein the at least one value indicative of price correlation compliance is determined through image analysis and is associated with a difference between a displayed price for the at least one product type and a price identified in the at least one planogram.

270. The method of claim 261, wherein when the characteristic of planogram compliance is promotion execution, the method further comprising determining at least one value indicative of promotion execution compliance for the at least one product type, wherein the at least one value indicative of promotion execution compliance is determined through image analysis and is associated with promotions for the at least one product type other than a promotion plan included in the at least one planogram.

271. The method of claim 261, wherein when the characteristic of planogram compliance is product homogeneity, the method further comprising determining at least one value indicative of product homogeneity compliance for the at least one product type, wherein the at least one value indicative of product homogeneity compliance is determined through image analysis and is associated with a number of products not from the at least one product type found in at least one shelf associated with the at least one product type.

272. The method of claim 261, wherein when the characteristic of planogram compliance is restocking rate, the method further comprising determining at least one value indicative of restocking rate compliance for the at least one product type, wherein the at least one value indicative of restocking rate compliance is determined through image analysis and is associated with a level of vacancy over a period of time reflecting a restocking rate of at least one shelf associated with the at least one product type.

273. The method of claim 261, wherein the method further comprises determining the characteristic of planogram compliance for a product type based on a level of planogram compliance of products located adjacent to the product type in the at least one planogram.

274. The method of claim 261, wherein the method further comprises determining the characteristic of planogram compliance for the at least one product type based on a rate that the at least one planogram goes out of compliance.

275. The method of claim 261, wherein the method further comprises determining the characteristic of planogram compliance for the at least one product type based on a rate that the at least one planogram returns to compliance after having been out of compliance.

276. The method of claim 261, wherein the method further comprises:

accessing a plurality of planograms for different retail stores; and

accounting for differences in the plurality of planograms when determining the characteristic of planogram compliance for at least one retail store.

277. The method of claim 261, wherein the method further comprises:

receiving real-time image data from a plurality of image sensors fixedly mounted to store shelves; and

determining real-time planogram compliance for the at least one product type.

278. The method of claim 261, wherein the entity is a supplier of the at least one product, and the provided information includes a recommendation for execution of the at least one action in at least one retail store.

279. The method of claim 261, wherein the entity is a manager of a retail store selling the at least one product, and the provided information includes at least one of:

an image depicting an example of low planogram compliance, a video depicting an example of low planogram compliance, and details of an employee responsible for the low planogram compliance.

280. The method of claim 261, wherein the method further comprises:

determining a plurality of characteristics of planogram compliance for the at least one product type;

based on the checkout data, determining the impact of each of the plurality of characteristics of planogram compliance on the sales on the at least one product type; and

based on the determined impact, ranking an importance of each of the plurality of characteristics of planogram compliance for the at least one product type.

281. The method of claim 280, wherein the provided information includes data for prioritizing actions associated with planogram compliance based on the ranking of the plurality of characteristics of planogram compliance for the at least one product type.

282. The method of claim 281, wherein the actions associated with planogram compliance include at least two of:

rearranging products to change product facing, rearranging products to change product placement, rearranging products to change product homogeneity, rearranging products to change adjacent products compliance, changing restocking rate, changing promotion execution, and changing price labels.

283. A system for identifying products and monitoring planogram compliance using analysis of image data, the system comprising:

at least one processor configured to;

access at least one planogram describing a desired placement of a plurality of product types on shelves of a plurality of retail stores;

receive image data from the plurality of retail stores;

analyze the image data to determine an actual placement of the plurality of product types on the shelves of the plurality of retail stores;

determine at least one characteristic of planogram compliance based on detected differences between the at least one planogram and the actual placement of the plurality of product types on the shelves of the plurality of retail stores;

receive checkout data from the plurality of retail stores reflecting sales of at least one product type from the plurality of product types;

estimate, based on the determined at least one characteristic of planogram compliance and based on the received checkout data, an impact of the at least one characteristic of planogram compliance on the sales of the at least one product type;

based on the estimated impact, identify an action, associated with the at least one characteristic of planogram compliance, for potentially increasing future sales of the at least one product type; and

provide information associated with the identified action to an entity.

284. A computer program product for identifying products and monitoring planogram compliance using analysis of image data embodied in a non-transitory computer-readable medium and executable by at least one processor, the computer program product including instructions for causing the at least one processor to execute a method comprising:

accessing at least one planogram describing a desired placement of a plurality of product types on shelves of a plurality of retail stores;

receiving image data from the plurality of retail stores;

analyzing the image data to determine an actual placement of the plurality of product types on the shelves of the plurality of retail stores;

determining at least one characteristic of planogram compliance based on detected differences between the at least one planogram and the actual placement of the plurality of product types on the shelves of the plurality of retail stores;

receiving checkout data from the plurality of retail stores reflecting sales of at least one product type from the plurality of product types;

estimating, based on the determined at least one characteristic of planogram compliance and based on the received checkout data, an impact of the at least one characteristic of planogram compliance on the sales of the at least one product type;

based on the estimated impact, identifying an action, associated with the at least one characteristic of planogram compliance, for potentially increasing future sales of the at least one product type; and

providing information associated with the identified action to an entity associated with the at least one product type.