System and method for indicating a state of a geographic area based on mobile device sensor measurements

• US 9,402,155 B2
• Filed: 03/03/2014
• Issued: 07/26/2016
• Est. Priority Date: 03/03/2014
• Status: Active Grant

• Current Assignee: Smith Micro Software Incorporated
• Original Assignee: Location Labs (Gen Digital Inc.)
• Inventors: Weiss, Andrew, Hotes, Scott
• Primary Examiner(s): Hu, Jinsong
• Assistant Examiner(s): Chang, Jean
• Application Number:
  US14/195,351
• Publication Number:
  US 20150249904A1
• Time in Patent Office: 876 Days
• Field of Search: 455/456.1
• US Class Current: 1/1
• CPC Class Codes: H04W 4/021 Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
• CPC Class Codes: H04W 4/023 using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds
• CPC Class Codes: H04W 4/026 using orientation information, e.g. compass
• CPC Class Codes: H04W 4/027 using movement velocity, acceleration information

Abstract

A method and corresponding system for providing an indication of one or more states of a geographic area. The method includes acquiring sensor data including sensor measurements taken by a plurality of mobile devices at a plurality of locations and acquiring location data corresponding to the plurality of locations of the sensor measurements. At least one processor determines one or more states of a geographic area corresponding to the plurality of locations based on the sensor data, and an indication is provided of the one or more states of the geographic area to a particular user.

Claims

1. A method for providing an indication of one or more states of a geographic area, the method comprising:

providing an application on a plurality of mobile devices enabling collection of measurements from sensors on the plurality of mobile devices;

acquiring via the application sensor data comprising audio data based on sensor measurements comprising sound measurements taken by the plurality of mobile devices at a plurality of locations;

acquiring location data corresponding to the plurality of locations of the sensor measurements;

determining, by at least one processor, a plurality of states of a geographic area corresponding to the plurality of locations based on the audio data and the location data, the plurality of states comprising a plurality of densities of people of the geographic area; and

providing via the application an indication of the plurality of states of the geographic area to a particular user of one of the plurality of mobile devices, the indication comprising a mapping of the plurality of densities of people in the geographic area.

2. The method of claim 1, wherein the sensor measurements include sound recordings from sensors on the plurality of mobile devices.

3. The method of claim 1, wherein the sensor measurements include acceleration measurements from sensors on the plurality of mobile devices;

the method further comprising;

determining a plurality of modes of transport in use in the geographic area based at least on the acceleration measurements; and

providing the indication of the plurality of states of the geographic area with a mapping of the plurality of modes of transport in the geographic area.

4. The method of claim 1, further comprising acquiring time stamps corresponding to the sensor data and the location data;

the method further comprising;

determining the plurality of densities of people in the geographic area over a particular time period; and

providing the indication of the plurality of geographic areas with a mapping of the plurality of densities of people in the geographic area over the particular time period.

5. The method of claim 1, further comprising applying a classifier to the sensor data to determine the plurality of states of the geographic area.

6. The method of claim 1, further comprising:

transmitting via the application by the plurality of mobile devices the sensor data and the location data via a network to a server system comprising the at least one processor; and

determining by the server the plurality of states of the geographic area based on the sensor data.

7. The method of claim 6, further comprising:

transmitting via the application to the server system by the plurality of mobile devices indications of at least one of a device type, a device operating system, and device settings corresponding respectively to the plurality of mobile devices; and

determining by the server the plurality of states of the geographic area further based on the at least one of the device type, the device operating system, and the device settings corresponding respectively to the plurality of mobile devices.

8. The method of claim 7, further comprising applying a classifier to the sensor data, the device type, the device operating system, and the device settings to determine the plurality of states of the geographic area.

9. The method of claim 7, wherein determining the plurality of states of the geographic area comprises determining a sound level of the geographic area based on the sound measurements and at least one of the device type, the device operating system, and device settings.

10. The method of claim 1, further comprising:

determining by the plurality of mobile devices aggregates based on the sensor measurements respectively taken by the plurality of mobile devices;

transmitting via the application the location data and the sensor data comprising the aggregates via a network to a server system comprising the at least one processor; and

determining by the at least one processor the plurality of states of the geographic area based on the aggregates.

11. The method of claim 1, further comprising:

determining at least one baseline value of sensor measurements of a particular mobile device taken over a period of time; and

comparing a particular sensor measurement from the particular mobile device with the at least one baseline value;

determining a normalized value for the particular sensor measurement based on the comparing of the particular sensor measurements with the baseline value; and

determining the plurality of states of the geographic area based on the normalized value.

12. The method of claim 1, wherein determining the plurality of states of the geographic area comprises determining categories corresponding to the sensor measurements taken by the plurality of mobile devices.

13. The method of claim 1, wherein the sensor measurements include sound recordings from sensors on the plurality of mobile devices, and wherein the sound recordings from the plurality of mobile devices are considered in aggregate to determine the plurality of states of the geographic area.

14. The method of claim 1, wherein the sensor measurements further comprise acceleration measurements from sensors on the plurality of mobile devices, and wherein acceleration measurements from the plurality of mobile devices are considered in aggregate to determine the plurality of states of the geographic area.

15. The method of claim 14, further comprising determining running by a plurality of users of the plurality of mobile devices based on the acceleration measurements, wherein determining the plurality of states of the geographic area comprises determining the existence of a disturbance at the geographic area based on the determination of running by the plurality of users.

16. The method of claim 1, wherein the sensor measurements further comprise acceleration measurements from sensors on the plurality of mobile devices, and wherein the acceleration measurements and sound measurements from the plurality of mobile devices are considered in aggregate to determine a type of the geographic area.

17. The method of claim 16, further comprising:

determining walking in a particular speed range and talking by a plurality of users of the plurality of mobile devices based on the acceleration measurements and the sound measurements; and

determining the type of the geographic area is a shopping mall based on determining the walking in the particular speed range and talking by the plurality of users.

18. The method of claim 1, wherein the sensor measurements further comprise acceleration measurements from sensors on the plurality of mobile devices, and wherein the sound measurements and the acceleration measurements from the plurality of mobile devices are considered in aggregate to determine the plurality of states of the geographic area at particular times, and wherein the indication comprises a mapping of the plurality of densities of people in the geographic area at particular times.

19. The method of claim 18, further comprising:

predicting the plurality of states of the geographic area at a future time based on the plurality of states of the geographic area at the particular times;

providing a plurality of indications comprising a plurality of mappings of the plurality of densities of people in the geographic area at particular times.

20. The method of claim 1, wherein determining the plurality of states of the geographic area comprises determining implicit categories corresponding to the sensor measurements taken by the plurality of mobile devices, wherein like sensor measurements correspond to like implicit categories, the method further comprising:

providing via the application an indication of the implicit categories to a plurality of users;

receiving descriptions corresponding to the implicit categories from the plurality of users; and

providing the indication of the plurality of states of the geographic area to the particular user including the descriptions corresponding to the implicit categories provided by the plurality of users.

21. The method of claim 20, wherein determining the implicit categories comprises applying a clusterization algorithm to the sensor measurements.

22. The method of claim 1, wherein providing the indication of the plurality of states comprises displaying a map of the geographic area comprising a visual representation of the plurality of states on the geographic area.

23. The method of claim 22, wherein the plurality of states corresponds to a plurality of sound levels over the geographic area.

24. The method of claim 22, further comprising displaying on the map differences in a value of the plurality of states corresponding to different times.

25. The method of claim 24, further comprising displaying on the map changes in a value of the plurality of states over a particular time period.

26. The method of claim 1, wherein determining the plurality of states of the geographic area comprises determining at least one category as a statistical likelihood.

27. The method of claim 26, wherein the statistical likelihood corresponds to a likelihood there exists a level of sound exceeding a particular threshold in the geographic area.

28. The method of claim 1, wherein determining the plurality of states of the geographic area comprises estimating a measure of activity in the geographic area based on the sensor data.

29. The method of claim 1, wherein the sensor measurements include sound measurements, and wherein determining the plurality of states of the geographic area comprises estimating factory production based on the sound measurements, and wherein providing the indication comprises providing an indication of the factory production.

30. The method of claim 1, wherein the sensor measurements further comprise acceleration measurements, wherein determining the plurality of states of the geographic area comprises:

determining sitting and standing of users of the plurality of mobile devices based on the sensor measurements; and

determining a level of crowd excitement based on the determination of sitting and standing of the users of the plurality of mobile devices;

wherein providing the indication comprises providing an indication of the level of crowd excitement.

31. The method of claim 1, wherein determining the plurality of states of the geographic area comprises estimating a position of an event based on the sensor data and the location data, and wherein providing the indication comprises providing the position of the event.

32. The method of claim 31, wherein determining the plurality of states of the geographic area comprises:

determining the event corresponds to a gunshot based on the sound measurements; and

estimating a position where the gunshot originated based on a sound level of at least two of the sensor measurements from at least two of the plurality of mobile devices respectively taken at at least two of the plurality of locations;

wherein providing the indication of the plurality of states of the geographic area comprises providing the estimated position where the gunshot originated.

33. The method of claim 1, wherein the sensor measurements further comprise motion measurements, wherein determining the plurality of states of the geographic area comprises determining a plurality of types of activity based on the sensor measurements, and wherein providing the indication to the user comprises providing an indication of the plurality of types of activity.

34. The method of claim 33, wherein providing the indication of the plurality of types of activity comprises displaying a map showing the types of activity over a period of time.

35. The method of claim 33, wherein determining the plurality of types of activity comprises determining driving and biking, wherein the types of activity displayed comprise driving and biking.

36. The method of claim 33, wherein determining the plurality of types of activity comprises determining walking and driving, wherein the types of activity displayed comprise walking and driving.

37. The method of claim 1, wherein the sensor data comprises at least one of sensor measurements and aggregates of sensor measurements.

38. A computing system comprising at least one non-transitory computer readable storage medium having encoded thereon instructions that, when executed by one or more processors of the system, cause the system to perform a process including:

providing an application on a plurality of mobile devices enabling collection of measurements from sensors on the plurality of mobile devices;

acquiring via the application sensor data comprising audio data based on sensor measurements comprising sound measurements taken by the plurality of mobile devices at a plurality of locations;

acquiring location data corresponding to the plurality of locations of the sensor measurements;

determining, by at least one processor, a plurality of states of a geographic area corresponding to the plurality of locations based on the audio data and the location data, the plurality of states comprising a plurality of densities of people of the geographic area; and

providing via the application an indication of the plurality of states of the geographic area to a particular user of one of the plurality of mobile devices, the indication comprising a mapping of the plurality of densities of people in the geographic area.

39. A computer network comprising a computing system and a plurality of mobile devices, the computing system configured for:

acquiring sensor data comprising audio data based on sensor measurements taken by the plurality of mobile devices at a plurality of locations;

acquiring location data corresponding to the plurality of locations of the sensor measurements;

determining, by at least one processor, a plurality of states of a geographic area corresponding to the plurality of locations based on the audio data and the location data, the plurality of states comprising a plurality of densities of people of the geographic area; and

providing an indication of the plurality of states of the geographic area to a particular user of one of the plurality of mobile devices, the indication comprising a mapping of the plurality of densities of people in the geographic area; and

the plurality of mobile devices comprising an application configured for;

taking sensor measurements via device sensors on mobile devices;

acquiring location data corresponding to the sensor measurements via location determining hardware on the plurality of mobile devices; and

transmitting the sensor data and location data to the computing system via a network.

40. A method for providing an indication of a plurality of states of a geographic area, the method comprising:

providing an application on a plurality of mobile devices enabling collection of measurements from sensors on the plurality of mobile devices;

acquiring via the application sensor data comprising audio data based on sensor measurements taken by the plurality of mobile devices at a plurality of locations;

acquiring via the application location data from the plurality of mobile devices corresponding to the plurality of locations of the sensor measurements;

determining, by at least one processor, a plurality of states of a geographic area corresponding to the plurality of locations based at least on the audio data and the location data;

assigning implicit categories to the plurality of states, wherein like sensor measurements correspond to like implicit categories;

providing via the application an indication of the implicit categories to a plurality of users of the plurality of mobile devices;

receiving descriptions corresponding to the implicit categories from the plurality of users; and

providing via the application to a particular user of one of the plurality of mobile devices an indication of the implicit categories and the corresponding descriptions from the plurality of users.

41. A method for reporting patron satisfaction at a particular venue comprising:

providing an application on a plurality of mobile devices enabling monitoring of sensors on the plurality of mobile devices;

acquiring via the application sensor data comprising audio data and acceleration data based on sensor measurements taken by the plurality of mobile devices at a plurality of locations at a particular venue;

acquiring via the application location data from the plurality of mobile devices corresponding to the plurality of locations of the sensor measurements;

determining sitting and standing of users of the plurality of mobile devices at the particular venue based on at least one of the audio data and acceleration data;

determining a sound level at the particular venue based at least on the audio data;

determining a level of crowd excitement at the particular venue over a particular time period based at least on the determination of sitting and standing of the users of the plurality of mobile devices and the sound level; and

providing via the application an indication of the level of crowd excitement over the particular time period.