MARKETING AND COUPONING IN A RETAIL ENVIRONMENT USING COMPUTER VISION

• US 20190205933A1
• Filed: 01/03/2019
• Published: 07/04/2019
• Est. Priority Date: 01/03/2018
• Status: Active Grant

• Current Assignee: Grabango Co.
• Original Assignee: Grabango Co.
• Inventors: Glaser, William, Van Osdol, Brian
• Granted Patent: US 11,481,805 B2
• Time in Patent Office: Days
• CPC Class Codes: G06Q 30/0255 based on user history
• CPC Class Codes: G06Q 30/0267 Wireless devices
• CPC Class Codes: G06Q 30/0275 Auctions
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 20/00 Scenes; Scene-specific elements control of digital cameras H04N23/60
• CPC Class Codes: G06V 20/44 Event detection
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

A system and method for digital retail marketing and couponing in a physical retail environment that includes collecting image data across a retail environment; tracking a user within the retail environment; processing the image data and detecting a customer-item interaction event in association with the user; and based in part on the customer-item interaction event, delivering content to an output interface.

Claims

1. A method for digital retail marketing in a physical retail environment comprising:

with a set of image capture devices, collecting image data across a retail environment;

tracking a user within the retail environment;

processing the image data and detecting a customer-item interaction event in association with the user; and

based in part on the customer-item interaction event, delivering content to an output interface.

2. The method of claim 1, wherein delivering content to the output interface comprises delivering a digital message to an application instance operable on a computing device of the user.

3. The method of claim 2, wherein the digital message is a digital coupon.

4. The method of claim 1, wherein processing the image data and detecting a customer-item interaction event further comprises detecting the occurrence or non-occurrence of a customer-item interaction event selected from the set of interactions invents including detecting customer attention directed at an item, detecting an item pickup event, detecting item selection, and detecting an item put-back event.

5. The method of claim 1, further comprising:

wherein tracking the user comprises detecting customer proximity to an item;

monitoring a content delivery condition that is based in part on the customer-item interaction event and the customer proximity to the item; and

wherein delivering content to an output interface comprises delivering content to a computing device of the user and is initiated upon satisfying the content delivery condition.

6. The method of claim 5, wherein monitoring a content delivery condition comprises detecting occurrence of a first customer-item interaction event selected from user attention event, item pickup event, item selection event, and item put-back event.

7. The method of claim 6, wherein monitoring a content delivery condition further comprises detecting a sequence of item-level interaction events that includes the first item-level interaction event.

8. The method of claim 5, wherein monitoring a content delivery condition comprises detecting omission of a customer-item interaction event performed by the user when within a defined proximity to an item.

9. The method of claim 5, wherein delivering content to a computing device of the user comprises, prior to delivering the content, selecting the content from a set of content that is associated with the item.

10. The method of claim 9, wherein selecting the content is further selected based on cart contents of the customer.

11. The method of claim 1, further comprising initiating a content delivery auction which comprises selecting a set of auction bids, ranking the set of auction bids, and selecting content of the highest ranked auction bid for delivering.

12. The method of claim 11, wherein selecting of auction bids may comprises selecting auction bids associated with items in proximity to the item.

13. The method of claim 12, wherein selecting auction bids associated with items in proximity to the item comprises determining item proximity through processing image data.

14. The method of claim 11, further comprising tracking content delivery response and crediting a marketing account of the selected content according to content delivery response.

15. The method of claim 1, wherein tracking a user within the retail environment comprises of processing image data and thereby tracking location in the retail environment of a set of users, wherein the set of users includes at least the user.

16. The method of claim 1, further comprising tracking a content delivery response.

17. A system for digital retail marketing in a physical retail environment which comprises:

a computer vision monitoring system that comprises a set of imaging devices installed in the retail environment, and that is configured to;

collect image data from the set of imaging devices,

track a set of users within the retail environment,

for at least one user, process the image data and detect a customer-item interaction event in association with the user; and

a content marketing system configured to deliver content to an output interface, wherein the content is delivered in association with the customer-item interaction event.

18. The system of claim 17, further comprising an application operable on a computing device of the user, wherein the content is delivered to an instance of the application operable on the computing device.

19. The system of claim 17, further comprising a set of environment-installed computing devices;

and wherein the content management system is configured to select at least one computing device of the set of environment-installed computing devices based on device proximity to the one user or an item of the customer-item interaction event and deliver the content to the one computing device.

20. The system of claim 17, wherein the content marketing system includes a content auction marketplace that is configured to collect auction bids and initiate a content delivery auction used in the selection of content for delivery to the output interface.