Event detection using physical vibration and audio sensors on mobile devices

• US 10,295,556 B1
• Filed: 10/17/2013
• Issued: 05/21/2019
• Est. Priority Date: 10/17/2013
• Status: Active Grant

• Current Assignee: T-Mobile Innovations LLC (Deutsche Telekom AG)
• Original Assignee: Sprint Communications Company LP (Deutsche Telekom AG)
• Inventors: Paczkowski, Lyle W., Miller, Jeffrey Ryan, Nicolace, Quinton Anthony, Torrence, Brad Eugene, Hadavandifard, Nilofar, Thennarasu, Prabhakar
• Primary Examiner(s): Le, John H
• Application Number:
  US14/056,354
• Time in Patent Office: 2,042 Days
• Field of Search: 702 66, 702 71, 702 75, 702122, 702183, 702188, 702189, 702193, 370231, 705 263
• CPC Class Codes: A61B 2562/0204 Acoustic sensors
• CPC Class Codes: A61B 2562/0219 Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
• CPC Class Codes: A61B 5/0823 Detecting or evaluating cough events
• CPC Class Codes: G01N 2035/00881 network configurations
• CPC Class Codes: G01N 35/00871 Communications between instruments or with remote terminals

Abstract

Methods and systems are provided for detecting the occurrence of events utilizing data taken from multiple mobile devices in a wireless communications network. At least a first set and a second set of data is received at the network from a first and second mobile device. The first and second sets of data corresponding to vibration and audio data taken from the mobile devices is analyzed to determine that each set of data corresponds to the occurrence of an instance of an event. An action to perform is then determined based on the occurrences of the instances of the event.

Claims

1. A method for detecting an occurrence of an external event based on data taken by a plurality of mobile devices, the method comprising:

determining, using the processor, that each of a first set of data and a second set of data corresponds to the occurrence of an instance of the external event based on at least one harmonic characteristic of the first and second sets of data, wherein the first set of data comprises vibration and audio data taken from a vibrational sensor and an audio sensor of a first mobile device and the second set of data comprises vibration and audio data taken from a vibrational sensor and an audio sensor of a second mobile device;

determining that the first and second sets of data occurred simultaneously, and are both attributable to a single source;

discarding the second set of data and retaining the first set of data;

communicating information determined from the first and second sets of data to a network component in the wireless communications network, the communicated data including at least location and time information; and

based at least on the occurrences of the instances of the external event, determining, using the processor, an action to perform.

2. The method of claim 1, wherein the first set of data and the second set of data are received by a network component in a wireless communications network.

3. The method of claim 1, wherein each of the first mobile device and the second mobile device have an integrated vibrational sensor and an audio sensor for collecting the vibration and audio data.

4. The method of claim 1, wherein the external event corresponds to one or more of a cough, a sneeze, a scream, or a cry.

5. The method of claim 1, wherein the first set of data comprises a time stamp associated with the occurrence of the instance of the external event, frequency over time data of the occurrence of the instance of the external event, and location data.

6. The method of claim 1, further comprising anonymizing the first and the second sets of data so that the data is not traceable to a particular individual.

7. The method of claim 1, wherein the action to perform based at least on the occurrences of the instances of the external event is one or more of communicating a notification to a user of the first or the second mobile device, communicating a notification to a third party regarding the external event, or communicating the data to the third party.

8. The method of claim 1, further comprising:

receiving a plurality of sets of data from a plurality of other mobile devices;

based on the plurality of sets of data, determining that a threshold number of instances of the external event have occurred; and

determining that the action is to be performed upon the threshold number of instances of the external event having occurred.

9. Non-transitory computer-readable media having computer-executable instructions embodied thereon that, when executed, perform a method for detecting an occurrence of an external event based on data taken by a plurality of mobile devices, the method comprising:

determining that a first set of data received by a vibrational sensor and an audio sensor on the first mobile device corresponds to a first instance of an external event based on at least one harmonic characteristic of the first set of data, wherein the external event is a member of a class of events, wherein the at least one harmonic characteristic is unique and identifiable to the class of events;

receiving a second set of data from a second mobile device, the second set of data corresponding to a second instance of the external event, wherein the first and the second mobile devices communicate with one another by way of a wireless communications network;

determining that the second set of data corresponds to a second instance of the external event;

determining whether the second instance is duplicative of the first instance of the external event, such that,

(1) if the second instance is duplicative of the first instance, discarding the second set of data that corresponds to the second instance of the external event, and

(2) if the second instance is not duplicative of the first instance, retaining both the first set of data and the second set of data; and

communicating data associated with one or more of the first instance and the second instance of the external event to a network component in the wireless communications network, the communicated data including at least one of a time stamp associated with the occurrence of the instance of the event, frequency over time data, or location data, the network component analyzing the data associated with the one or more of the first instance and the second instance and the data received from a plurality of other mobile devices to determine an action to be performed based on the occurrence of the external event.

10. The media of claim 9, wherein the first mobile device and the second mobile device form a network to allow communication between the devices.

11. The media of claim 9, wherein if the first instance is duplicative of the second instance, the data associated with the second instance is not communicated to the network component.

12. The media of claim 11, wherein the first instance and the second instance are both determined to be one or more of a cough or a sneeze from a single individual.

13. The media of claim 9, wherein if the first instance is not duplicative of the second instance, the data associated with both the first and the second instances is communicated to the network component.

14. A method for detecting an occurrence of an event based on data taken by a plurality of mobile devices, the method comprising:

at a first mobile device, receiving data from a vibrational sensor and an acoustical sensor integrated with the first mobile device, the data representing the occurrence of a first instance of an event;

generating, using a processor, a representation of the data illustrating a waveform of frequency of one or more of sound or vibration over time;

based on the waveform, identifying, using the processor, at least one shape of the waveform, the at least one shape of the waveform being defined and determined such that at least 50% of the waveform is contained therein;

identifying, using the processor, the event based on the at least one shape of the waveform; and

communicating a portion of the data associated with the at least one shape of the waveform to a network component in the wireless communications network, the network component receiving from a plurality of mobile devices a plurality of data representing the occurrences of other instances of the event, wherein the network component analyzes the portion of the data and the plurality of data to determine an action to be performed based on the occurrences of the first instance and the other instances of the event.

15. The method of claim 14, wherein is defined and determined such that at 60% of the waveform is contained therein.

16. The method of claim 14, wherein at least the one shape is determined using a digital semaphore.

17. The method of claim 14, wherein a percentage of the waveform captured in the at least one shape is dynamic based on a desired sensitivity of the vibrational sensor and the acoustical sensor.

18. The method of claim 14, wherein the correspondence of the at least one shape of the waveform to the event is predetermined.