Systems and methods for determining crowd traffic by detecting debris in floor mats

• US 10,489,935 B2
• Filed: 08/08/2017
• Issued: 11/26/2019
• Est. Priority Date: 08/16/2016
• Status: Active Grant

• Current Assignee: Walmart Apollo, LLC (WalMart Inc.)
• Original Assignee: Walmart Apollo, LLC (WalMart Inc.)
• Inventors: Jones, Nicholaus Adam, Taylor, Robert James, Vasgaard, Aaron James, Jones, Matthew Allen
• Primary Examiner(s): Lu, Tom Y
• Application Number:
  US15/671,937
• Publication Number:
  US 20180053323A1
• Time in Patent Office: 840 Days
• CPC Class Codes: G01N 21/59 Transmissivity G01N21/25 takes precedence
• CPC Class Codes: G01N 21/90 in a container or its contents G01N21/91 takes precedence
• CPC Class Codes: G01N 21/94 Investigating contamination, e.g. dust G01N21/85 takes precedence
• CPC Class Codes: G01N 2201/12 Circuits of general importance; Signal processing
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10148 Varying focus
• CPC Class Codes: G06T 2207/20012 Locally adaptive
• CPC Class Codes: G06T 2207/20076 Probabilistic image processing
• CPC Class Codes: G06T 2207/30242 Counting objects in image
• CPC Class Codes: G06T 7/97 Determining parameters from multiple pictures depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G07C 9/00 Individual registration on entry or exit
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

Described in detail herein are methods and systems for determining crowd traffic in a facility by detecting debris on floor mats. The system can include floor mats disposed in a facility to collect debris from objects passing over the floor mats. A computing system can detect and estimate the amount of objects causing the debris on the floor mat. The computing system can estimate the amount of objects entering and exiting the facility based on the quantity of objects passing over the floor mats.

Claims

1. A system for detecting crowd traffic, the system comprising:

a first floor mat disposed at a first location, the first floor mat configured to receive debris from objects passing over the first floor mat;

a first image capturing device positioned to include the first floor mat in a field of view of the first image capturing device, the first image capturing device being configured to capture a first image of the first floor mat including the debris from the objects passing over the first floor mat; and

a computing system operatively coupled to the first image capturing device, the computing system being programmed to analyze the first image to detect the amount debris on the first floor mat and to estimate a first quantity of objects that passed over the first floor mat based on the amount of the debris on the first floor mat.

2. The system in claim 1, further comprising a database storing a table associating the amount of debris in the first floor mat and the first quantity of objects expected to cause the amount of debris on the first floor mat.

3. The system in claim 2, wherein the computing system queries the database using the amount of debris on the first floor mat to determine the first quantity of object that passed over the first floor mat.

4. The system in claim 1, further comprising, a second floor mat configured to receive debris from objects passing over the second floor mat.

5. The system in claim 4, wherein the first image capturing device is positioned to include the first floor mat and the second floor mat in the field of view of the first image capturing device and is configured to capture, in the first image, the first floor mat and second floor mat.

6. The system in claim 5, wherein the computing system is programmed to analyze the first image and detect the first amount of debris on the first floor mat and a second amount of debris on the second floor mat and estimate the first quantity of objects passing over the first floor mat based on the first amount of debris and a second quantity of object passing over the second floor mat based on the second amount of debris.

7. A method for detecting crowd traffic, the method comprising:

receiving, on a first floor mat at a first location, debris from objects passing over the first floor mat;

capturing, via a first image capturing device positioned to include the first floor mat in a field of view of the first image capturing device, a first image of the first floor mat including the debris from the objects passing over the first floor mat;

analyzing, via a computing system operatively coupled to the first image capturing device, the first image to detect amount of debris on the first floor mat and estimate a first quantity of objects that passed over the first floor mat based on the amount of the debris on the first floor mat.

8. The method in claim 7, further comprising, storing, via a database coupled to the computing system, a table associating the amount of debris in the first floor mat and the first quantity of objects expected to cause the amount of debris on the first floor mat.

9. The method in claim 8, further comprising, querying the database, via the computing system, using the amount of debris on the first floor mat to determine the first quantity of object that passed over the first floor mat.

10. The method in claim 7, further comprising, receiving on a second floor mat debris from objects passing over the second floor mat.

11. The method in claim 10, wherein the first image capturing device positioned to include the first floor mat and the second floor mat in the field of view of the first image capturing device, and capturing the first image includes capturing the first floor mat and second floor mat in the first image.

12. The method in claim 11, further comprising:

analyzing, via the computing system, the first image to detect the first amount of debris on the first floor mat and a second amount of debris on the second floor mat and estimate a first quantity of objects passing over the first floor mat based on the first amount of debris and a second quantity of object passing over the second floor mat based on the second amount of debris.