System and method for data collection to validate location data

• US 10,204,137 B2
• Filed: 05/10/2013
• Issued: 02/12/2019
• Est. Priority Date: 02/24/2012
• Status: Active Grant

• Current Assignee: Foursquare Labs, Inc.
• Original Assignee: Snap, Inc.
• Inventors: Shim, David, Bicknell, Brad, Varghese, George, Gerner, Nick, Yi, Weilie
• Primary Examiner(s): Trujillo, James
• Assistant Examiner(s): Tessema, Aida Z
• Application Number:
  US13/892,201
• Publication Number:
  US 20130254227A1
• Time in Patent Office: 2,104 Days
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: H04W 4/029 Location-based management or tracking services

Abstract

A data collection system that provides the means to collect, store and make data available for a location analytics inference pipeline. The system incorporates a feedback mechanism enabling algorithms produced from the inference pipeline to drive the collection strategy to yield higher data quality and to produce reference data for model validation.

Claims

1. A method of tuning data collection strategies of an electronic device having a processor and a memory, the method comprising:

receiving, from the user, place query data that identifies a location of the user at an instance of time, wherein the place query data is based on information identifying multiple places of interest at the location at the instance of time;

causing an acoustic device at the location to emit a high frequency audio signal that identifies the location;

collecting the high frequency audio signal at a client device associated with the user in response to the receiving the place query data that identifies the location of the user;

validating the location of the user based on the high frequency audio signal;

assigning an indicator of data fidelity to the location of the user at the instance of time based on the place query data received from the user and the validating the location of the user based on the audio signal, wherein the indicator of data fidelity reflects a degree of accuracy of an aggregate of place query data for the location;

collecting observation data from the location of the user at a predetermined rate of data collection, wherein the observation data includes a measurement from at least one sensor coupled to the electronic device;

monitoring a battery life measurement of the electronic device; and

adjusting the predetermined rate of data collection of the observation data based on the indicator of data fidelity assigned to the location of the user at the instance of time, the observation data collected from the location of the user, and the battery life measurement.

2. The method of claim 1, wherein receiving the place query data includes receiving responses to a place survey from the user of the electronic device.

3. The method of claim 1, further comprising:

presenting a place survey to the user at a predetermined rate of survey collection, wherein the place survey prompts the user to select the place query data from a plurality of candidate places; and

decreasing the predetermined rate of survey collection when the indicator of data fidelity increases.

4. The method of claim 1, wherein the place query data is extracted from a third-party service.

5. The method of claim 1, wherein the place query data is derived from a query of an internet search engine by the user.

6. The method of claim 1, wherein the place query data is derived from one of the following:

a geo-tagged image, a user profile, email, calendar appointment, call log, or Short Message Service (SMS) activity.

7. The method of claim 1, wherein the at least one sensor coupled to the electronic device is one of the following:

accelerometer, digital compass, Global Positioning System (GPS), microphone, gyroscope, temperature, image sensor, or ambient light sensor.

8. The method of claim 1, wherein adjusting further includes increasing or decreasing the predetermined rate of data collection according to the battery life measurement.

9. The method of claim 1, wherein adjusting further includes increasing the predetermined rate of data collection when the observation data indicates an initial power-on of the electronic device.

10. The method of claim 1, wherein the at least one sensor includes an audio sensor which detects automobile sounds and wherein adjusting the predetermined rate of data collection further includes increasing the predetermined rate of data collection.

11. The method of claim 1, wherein at least one sensor includes a Wi-Fi detector and adjusting further includes increasing the predetermined rate of data collection when the observation data indicates a presence of more than a predetermined number of local area networks (LANs).

12. The method of claim 1, further comprising:

maintaining a history of place query data received from the user;

wherein the place query data received from the user matches a previously-received place query data on the history of place query data, and

wherein adjusting further includes decreasing the predetermined rate of data collection.

13. The method of claim 1, wherein the at least one sensor includes a highfrequency audio sensor to validate the place query data.

14. The method of claim 1, wherein the at least one sensor includes an accelerometer and adjusting further includes decreasing the predetermined rate of data collection when the observation data indicates a stationary electronic device for a predetermined period of time.

15. The method of claim 1, wherein the at least one sensor includes a Bluetooth device and adjusting further includes increasing the predetermined rate of data collection when the observation data indicates a plurality of other Bluetooth users.

16. The method of claim 1, wherein the at least one sensor includes a photodetector and adjusting further includes decreasing the predetermined rate of data collection when the observation data indicates a presence of fluorescent or halogen lighting.

17. The method of claim 1, wherein the at least one sensor includes an altimeter and adjusting further includes decreasing the predetermined rate of data collection when the observation data indicates an altitude above an altitude threshold.

18. A tangible computer-readable storage medium whose contents, when executed by a computing device, cause the computing device to perform operations for tuning data collection strategies, the operations comprising:

receiving, from the user, place query data that identifies a location of the user at an instance of time, wherein the place query data is based on information identifying multiple places of interest at the location at the instance of time;

causing an acoustic device at the location to emit a high frequency audio signal that identifies the location;

collecting the high frequency audio signal at a client device associated with the user in response to the receiving the place query data that identifies the location of the user;

validating the location of the user based on the high frequency audio signal;

assigning an indicator of data fidelity to the location of the user at the instance of time based on the place query data received from the user and the validating the location of the user based on the audio signal, wherein the indicator of data fidelity reflects a degree of accuracy of an aggregate of place query data for the location;

collecting observation data from the location of the user at a predetermined rate of data collection, wherein the observation data includes a measurement from at least one sensor coupled to the electronic device;

monitoring a battery life measurement of the electronic device; and

adjusting the predetermined rate of data collection of the observation data based on the indicator of data fidelity assigned to the location of the user at the instance of time, the observation data collected from the location of the user, and the battery life measurement.

19. An apparatus for tuning data collection strategies, the apparatus being wirelessly coupled to an electronic device over a network, the apparatus comprising:

at least one server computer configured to;

receive place query data that identifies a location of a user at an instance of time, wherein the place query data is based on information identifying multiple places of interest at the location at the instance of time;

cause an acoustic device at the location to emit a high frequency audio signal that identifies the location;

collect the high frequency audio signal at a client device associated with the user in response to the receiving the place query data that identifies the location of the user;

validate the location of the user based on the high frequency audio signal;

assign an indicator of data fidelity to the location of the user at the instance of time based on the place query data received from the user and the validating the location of the user based on the audio signal, wherein the indicator of data fidelity reflects a degree of accuracy of an aggregate of place query data for the location;

collect observation data at a first rate of data collection, wherein the observation data includes a measurement from at least one sensor coupled to the electronic device; and

adjust the first rate of data collection of the observation data based, at least in part, on the indicator of data fidelity assigned to the location of the user at the instance of time and the collected observation data.