Systems and methods of tracking locations visited by mobile devices to quantify a change computed based on matching populations used in change measurement

• US 10,323,944 B2
• Filed: 06/06/2017
• Issued: 06/18/2019
• Est. Priority Date: 06/07/2016
• Status: Active Grant

• Current Assignee: InMarket Media, LLC
• Original Assignee: NinthDecimal, Inc. (InMarket Media, LLC)
• Inventors: D'Alberto, Paolo, Milenkiy, Veronica, Azizi, Ahmad Fairiz
• Primary Examiner(s): Perez-Gutierrez, Rafael
• Assistant Examiner(s): Pannell, Mark G.
• Application Number:
  US15/615,669
• Publication Number:
  US 20170353827A1
• Time in Patent Office: 742 Days
• Field of Search: 4554561
• CPC Class Codes: G06Q 30/0261 based on user location
• CPC Class Codes: G06Q 30/0267 Wireless devices
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/021 Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
• CPC Class Codes: H04W 4/029 Location-based management or tracking services
• CPC Class Codes: H04W 48/16 Discovering, processing access restriction or access information

Abstract

Systems and methods including mobile devices determining their locations using location determination units, such as GPS receivers. A computing device generates a statistical measurement of location pattern changes in relation to a predetermined region for a predetermined period of time. The measurement is generated from a difference between responses of exposed mobile devices and responses of non-exposed mobile devices, which devices are selected based on a cluster analysis to match the distributions of the exposed mobile devices and the non-exposed mobile devices in an attribute space. Each response of a mobile device can be computed based on applying, at a time instance, an anti-symmetric weight function having an exponential distribution to a time series of visitation measurements to generate a response corresponding to the time instance, and summing the responses corresponding to time instances falling within the predetermined period of time as the response of the mobile device.

Claims

1. A system, comprising:

a plurality of mobile devices, wherein each mobile device in the plurality of mobile devices determines locations of the mobile device at respective time instances when the mobile device is at the respective locations; and

a computing device in communication with the mobile devices to receive locations of the mobile devices at different time instances, wherein the computing device;

receives information identifying a time period during which at least one message related to a predetermined region is transmitted to a portion of the mobile devices at least once;

identifies a plurality of clusters of the plurality of mobile devices according to a set of attributes, wherein mobile devices in each of the plurality of clusters have values of the attributes that are close to each other in an attribute space defined by the set of attributes, the plurality of clusters comprising a first cluster and a second cluster;

selects a subset of the plurality of mobile devices based at least in part on identifications of the clusters in the attribute space;

identifies a plurality of first mobile devices in the subset, wherein each mobile device of the first mobile devices has a first status with respect to the message, wherein some of the first mobile devices are in the first cluster and some of the first mobile devices are in the second cluster;

identifies a plurality of second mobile devices in the subset, wherein each mobile device of the second mobile devices has a second status with respect to the message, wherein some of the second mobile devices are in the first cluster and some of the second mobile devices are in the second cluster;

for each respective mobile device in the first mobile devices and the second mobile devices, computes a response to the message of the respective mobile device based on counts of visitation to the predetermined region by the respective mobile device; and

calculates, separately for the first cluster and for the second cluster, a respective measurement of a location behavior change based on a difference between responses of the first mobile devices and responses of the second mobile devices.

2. The system of claim 1, wherein the counts of visitation to the predetermined region by the respective mobile device are determined based on whether or not each location, in a plurality of locations of the respective mobile device at a plurality of time instances respectively, is located within the predetermined region.

3. The system of claim 2, wherein each location in the plurality of locations has a respective set of coordinates, wherein to determine whether or not a location, in the plurality of locations of the respective mobile device, is located within the predetermined region, the computing device:

combines the coordinates of the location into an identifier of a cell among the plurality of cells in a grid reference system, wherein the cell contains the respective location on the surface of the Earth; and

searches a set of cell identifiers pre-associated with the predetermined region to identify a match;

wherein the location is determined to be within the predetermined region in response to the match being found in the set of cell identifiers pre-associated with the predetermined region; and

wherein the location is determined to be not within the predetermined region in response to the match not being found in the set of cell identifiers pre-associated with the predetermined region.

4. The system of claim 3, wherein the coordinates are combined to provide the identifier of the cell according to a predetermined function of the coordinates of the respective location.

5. The system of claim 3, wherein the coordinates are combined by:

generating two integers from the coordinates according to a precision level; and

combining the two integers to provide the identifier of the cell.

6. The system of claim 3, wherein the coordinates are combined by:

selecting digits from the coordinates in accordance with a cell resolution level; and

combining the digits selected from the coordinates into an integer representing the identifier of the cell.

7. The system of claim 1, wherein the first mobile devices are identified to have the first status for having received the message during the time period;

and the second mobile devices are identified to have the second status for having not received the message during the time period.

8. The system of claim 7, wherein the subset of the plurality of mobile devices is selected by excluding clusters that contain only mobile devices having the second status.

9. The system of claim 8, wherein the subset of the plurality of mobile devices is selected by further excluding clusters that contain only mobile devices having the first status.

10. The system of claim 9, wherein devices in the first mobile devices which are also in the first cluster comprise a population size that is different from a population size of devices in the second mobile devices which are also in the first cluster.

11. The system of claim 9, wherein a population size of the first mobile devices is different from a population size of the second mobile devices.

12. The system of claim 11, wherein for each respective cluster of the plurality of clusters that contains at least a portion of the first mobile devices and the second mobile devices, the computing device computes:

a first average of responses of devices that are in both the first mobile devices and in the respective cluster;

a second average of response of devices that are in both the second devices and in the respective cluster; and

a difference between the first average and the second average as a measurement for the respective cluster.

13. The system of claim 12, wherein the measurement of the location behavior change is computed from a weighted average of measurements computed for clusters that contain the first mobile devices and second mobile devices.

14. The system of claim 13, wherein the weighted average is based on weights assigned to the clusters that contain the first mobile devices and second mobile devices;

and the weights are proportional to sizes of the clusters that contain the first mobile devices and second mobile devices.

15. The system of claim 13, wherein the sizes of the clusters that contain the first mobile devices and second mobile devices are computed based on at least one of:

counts of devices that are in both the first mobile devices and the clusters that contain the first mobile devices and second mobile devices;

counts of devices that are in both the second mobile devices and the clusters that contain the first mobile devices and second mobile devices; and

counts of devices that are in either the first mobile devices or the second mobile devices and in the clusters that contain the first mobile devices and second mobile devices.

16. The system of claim 7, wherein the subset of the plurality of mobile devices is selected by further selecting each cluster having a first number of mobile devices having the first status and a second number of mobile devices having the second status;

and the first number is equal to the second number.

17. The system of claim 16, wherein the measurement of the location behavior change is computed by:

computing a first average of the responses of first mobile devices;

computing a second average of the responses of the second mobile devices; and

computing the measurement of the location behavior change from a difference between the first average and the second average.

18. A method implemented in a computing device, the method comprising:

receiving location information of a plurality of mobile devices, wherein each mobile device in the plurality of mobile devices determines locations of the mobile device at respective time instances when the mobile device is at the respective locations;

receiving information identifying a time period during which at least one message related to a predetermined region is transmitted to a portion of the mobile devices at least once;

identifying a plurality of clusters of the plurality of mobile devices according to a set of attributes, wherein mobile devices in each of the plurality of clusters have values of the attributes that are close to each other in an attribute space defined by the set of attributes, the plurality of clusters comprising a first cluster and a second cluster;

selecting a subset of the plurality of mobile devices based at least in part on identifications of the clusters in the attribute space;

identifying a plurality of first mobile devices in the subset, wherein each mobile device of the first mobile devices has a first status with respect to the message, wherein some of the first mobile devices are in the first cluster and some of the first mobile devices are in the second cluster;

identifying a plurality of second mobile devices in the subset, wherein each mobile device of the second mobile devices has a second status with respect to the message, wherein some of the second mobile devices are in the first cluster and some of the second mobile devices are in the second cluster;

for each respective mobile device in the first mobile devices and the second mobile devices, computing a response of the respective mobile device to the message based on counts of visitation to the predetermined region by the respective mobile device; and

calculating, separately for the first cluster and for the second cluster, a respective measurement of a location behavior change based on a difference between responses of the first mobile devices and responses of the second mobile devices.

19. The method of claim 18, wherein the calculating comprising:

for each respective cluster that contains at least a portion of the first mobile devices and the second mobile devices, computing a cluster-level measurement of the location behavior change from a difference between;

a first average of responses of devices that are both in the plurality of the first mobile devices and in the respective cluster; and

a second average of responses of devices that are both in the plurality of the second mobile devices and in the respective cluster; and

combining cluster-level measurements of the location behavior change of clusters that have mobile devices in the subset to generate the measurement of the location behavior change.

20. A non-transitory computer storage medium storing instructions which when executed by a computing device, cause the computing device to perform a method, the method comprising:

receiving location information of a plurality of mobile devices, wherein each mobile device in the plurality of mobile devices determines locations of the mobile device at respective time instances when the mobile device is at the respective locations;

receiving information identifying a time period during which at least one message related to a predetermined region is transmitted to a portion of the mobile devices at least once;

identifying a plurality of clusters of the plurality of mobile devices according to a set of attributes, wherein mobile devices in each of the plurality of clusters have values of the attributes that are close to each other in an attribute space defined by the set of attributes, the plurality of clusters comprising a first cluster and a second cluster;

selecting a subset of the plurality of mobile devices based at least in part on identifications of the clusters in the attribute space;

identifying a plurality of first mobile devices in the subset, wherein each mobile device of the first mobile devices has a first status with respect to the message, wherein some of the first mobile devices are in the first cluster and some of the first mobile devices are in the second cluster;

identifying a plurality of second mobile devices in the subset, wherein each mobile device of the second mobile devices has a second status with respect to the message, wherein some of the second mobile devices are in the first cluster and some of the second mobile devices are in the second cluster;

for each respective mobile device in the first mobile devices and the second mobile devices, computing a response of the respective mobile device to the message based on counts of visitation to the predetermined region by the respective mobile device; and

calculating, separately for the first cluster and the second cluster, a respective measurement of a location behavior change based on a difference between responses of the first mobile devices and responses of the second mobile devices.