System and method for detecting, tracking and counting human objects of interest using a counting system and a data capture device

• US 10,410,048 B2
• Filed: 08/04/2017
• Issued: 09/10/2019
• Est. Priority Date: 09/23/2011
• Status: Active Grant

• Current Assignee: Shoppertrak RCT LLC
• Original Assignee: Shoppertrak RCT Corporation (Johnson Controls International plc)
• Inventors: Marcheselli, Edward A., Dispensa, Gary, Stemen, Thomas D., Kastilahn, William C.
• Primary Examiner(s): Johns, Andrew W
• Application Number:
  US15/669,440
• Publication Number:
  US 20180032799A1
• Time in Patent Office: 767 Days
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 20/53 Recognition of crowd images, e.g. recognition of crowd congestion
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G07C 9/00 Individual registration on entry or exit
• CPC Class Codes: G07C 9/28 the pass enabling tracking or indicating presence

Abstract

A method for counting and tracking defined objects includes the step of receiving subset data with a data capturing device, wherein the subset data is associated with defined objects and includes a unique identifier, an entry time, an exit time, and location data for each defined object. The method further includes the steps of receiving subset data at a counting system, counting the defined objects, tracking the defined objects, associating a location of a defined object with a predefined area, and/or generating path data by plotting X and Y coordinates for the defined object within the predefined area at sequential time periods.

Claims

1. A method for tracking objects, comprising the steps of:

receiving a first data set at a data capturing device, wherein the first data set is associated with objects and for each of the objects the first data set includes a unique identifier, time data, and location data derived from a cellular signal associated with a mobile handset; and

generating path data for each of the objects by plotting X and Y coordinates from the location data for each of the respective objects.

2. The method of claim 1, wherein the cellular signal includes a signal selected from the group consisting of T-IMSI, CDMA, Wi-Fi, or Bluetooth signals.

3. The method of claim 1, further including the step of receiving a second data set from an independent system regarding characteristics of the objects.

4. The method of claim 3, wherein the independent system is a point of sale system.

5. The method of claim 3, wherein the independent system is a loyalty rewards system.

6. The method of claim 1, further including the step of using Z coordinates to further track objects within multiple floors.

7. A method for tracking objects, comprising the steps of:

receiving a first data set at a data capturing device, wherein the first data set is associated with objects and for each of the objects the first data set includes a unique identifier, time data, and location data derived from a cellular signal associated with a mobile handset; and

generating path data for each of the objects by plotting X and Y coordinates from the location data for each of the respective objects, wherein the path data also includes an entry time representative of the time the object enters the predefined area and an exit time representative of the time the object exists the predefined areas.

8. The method of claim 7, further including the step of using the first data set to generate reports showing at least one of a number of objects within one of the predefined area, a number of objects within the predefined area during a specific time period, a number of predefined areas that were visited by one or more objects, a number of visits by one or more objects to one or more predefined areas, or average dwell times within one or more predefined areas by one or more objects.

9. The method of claim 8, further including the step of using path data to aggregate most common paths taken by objects and to correlate the path data with the dwell times.

10. The method of claim 9, further including the step of generating a report that shows at least one of the following:

(a) the most common paths that objects take in a store, including corresponding dwell times;

(b) changes in shopping patterns by time period;

(c) changes in shopping patterns by season;

(d) traffic patterns for use by store security systems in determining a level of resource allocation to provide at a particular time; and

(e) traffic patterns for use by HVAC systems in determining a level of resource allocation to provide at a particular time.

11. A method for tracking objects, comprising the steps of:

receiving a first data set at a data capturing device, wherein the first data set is associated with objects and for each of the objects the first data set includes a unique identifier, time data, and location data derived from a cellular signal associated with a mobile handset; and

determining a dwell time for one of the objects within a predefined area by subtracting the entry time for the object into the predefined area from the exit time for the object from the respective predefined area.

12. The method of claim 11, wherein the cellular signal includes a signal selected from the group consisting of T-IMSI, CDMA, Wi-Fi, or Bluetooth signals.

13. The method of claim 11, further including the step of receiving a second data set from an independent system regarding characteristics of the objects, where the independent system is a point of sale system or a loyalty rewards system.

14. The method of claim 11, further including the step of using Z coordinates to further track objects within a predefined area defined by multiple floors.

15. The method of claim 11, further including the step of using the first data set to generate reports showing at least one of a number of objects within one of the predefined area, a number of objects within the predefined area during a specific time period, a number of predefined areas that were visited by one or more objects, a number of visits by one or more objects to one or more predefined areas, or average dwell times within one or more predefined areas by one or more objects.

16. The method of claim 11, further including the step of generating a report that shows at least one of the following:

(a) changes in shopping patterns by time period;

(b) changes in shopping patterns by season;

(c) traffic patterns for use by store security systems in determining a level of resource allocation to provide at a particular time; and

(d) traffic patterns for use by HVAC systems in determining a level of resource allocation to provide at a particular time.

17. A system for tracking objects, including:

a memory comprising an application program, which, when executed, causes the system to;

receive a first data set, wherein the first data set is associated with objects and for each of the objects the first data set includes a unique identifier, time data, and location data derived from a cellular signal associated with a mobile handset; and

wherein the system generates path data for each of the objects by plotting X and Y coordinates from the location data for each of the respective objects.

18. The system of claim 17, wherein the application program, when executed, further causes the system to receive a second data set from an independent system regarding characteristics of the objects, where the independent system is a point of sale system or a loyalty rewards system.

19. The system of claim 18, wherein the path data also includes an entry time representative of the time the object enters a predefined area and an exit time representative of the time the object exists the respective predefined area and wherein the system uses the first data set to generate reports showing at least one of a number of objects within one of the predefined area, a number of objects within the predefined area during a specific time period, a number of predefined areas that were visited by one or more objects, a number of visits by one or more objects to one or more predefined areas, or average dwell times within one or more predefined areas by one or more objects.

20. The system of claim 19, wherein the application program, when executed, further causes the system to aggregate path data to determine most common paths taken by objects, correlate the path data with the dwell times, and generate a report that shows at least one of the following:

(a) the most common paths that objects take in a store, including corresponding dwell times;

(b) changes in shopping patterns by time period;

(c) changes in shopping patterns by season;

(d) traffic patterns for use by store security systems in determining a level of resource allocation to provide at a particular time; and

(e) traffic patterns for use by HVAC systems in determining a level of resource allocation to provide at a particular time.