Audio detection using distributed mobile computing

• US 10,255,795 B2
• Filed: 09/19/2018
• Issued: 04/09/2019
• Est. Priority Date: 12/28/2006
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Couper, Christopher C., Katz, Neil A., Moore, Victor S.
• Primary Examiner(s): Lau, Hoi C
• Application Number:
  US16/135,220
• Publication Number:
  US 20190019400A1
• Time in Patent Office: 202 Days
• Field of Search: 340540, 34053913, 340565, 340621, 340517, 3405734, 34053911, 704231, 704236-240, 704243-250, 704270, 704273-274, 704E17001-E17016, 704E15001-E1505, 704E11001-E11007, 381 20, 381 56
• CPC Class Codes: G08B 13/1672 using sonic detecting means, e.g. a microphone operating in the audio frequency range
• CPC Class Codes: G08B 25/016 Personal emergency signalling and security systems emergency non-personal manually actuated alarm activators G08B25/12
• CPC Class Codes: G08B 25/08 using communication transmission lines G08B13/19658, G08B21/0286, G08B25/016 take precedence
• CPC Class Codes: G08B 25/10 using wireless transmission systems G08B25/009 takes precedence
• CPC Class Codes: G10L 15/00 Speech recognition G10L17/00 takes precedence
• CPC Class Codes: G10L 15/20 Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech G10L21/02 takes precedence
• CPC Class Codes: G10L 21/00 Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility G10L19/00 takes precedence
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: H04R 5/00 Stereophonic arrangements stereophonic pick-ups H04R9/16, H04R11/12, H04R17/08, H04R19/10
• CPC Class Codes: H04R 5/027 Spatial or constructional arrangements of microphones, e.g. in dummy heads
• CPC Class Codes: H04R 5/04 Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments combinations of amplifiers H03F3/68; stereophonic systems H04S

Abstract

A method of identifying incidents using mobile devices can include receiving a communication from each of a plurality of mobile devices. Each communication can specify information about a detected sound. Spatial and temporal information can be identified from each communication as well as an indication of a sound signature matching the detected sound. The communications can be compared with a policy specifying spatial and temporal requirements relating to the sound signature indicated by the communications. A notification can be selectively sent according to the comparison.

Claims

1. A method for use with a first mobile device having a first microphone and a second mobile device having a second microphone, comprising:

receiving, by the first mobile device, first audio signature pattern data corresponding to a sound of a gunshot;

receiving, by the second mobile device, the first audio signature pattern data;

receiving, by the first mobile device and through the first microphone, a first audio signal that corresponds to a first gunshot audio event;

receiving, by the second mobile device and through the second microphone, a second audio signal that corresponds to the first gunshot audio event;

determining, by the first mobile device, that the first audio signal matches the first audio signature pattern data;

sending, responsive to the determining that the first audio signal matches the first audio signature pattern data, from the first mobile device, over a communication network and to a server, a first communication including information indicative of;

(i) a time that the first audio signal was received, and

(ii) a location of the first mobile device at the time the first audio signal was received;

determining, by the second device, that the second audio signal matches the first audio signature pattern data;

sending, responsive to the determining that the second audio signal matches the first audio signature pattern data, from the second mobile device, over the communication network and to the server, a second communication including information indicative of;

(i) a time that the second audio signal was received, and

(ii) a location of the second mobile device at the time the first audio signal was received;

determining, by the server, that the first communication and the second communication relate to a common gunshot event based upon;

(i) the time that the first audio signal was received as indicated by the first communication, and

(ii) the time that the second audio signal was received as indicated by the second communication; and

triangulating, by the server and responsive to the determining that the first communication and the second communication relate to the common gunshot event, a location of the first gunshot event based upon;

(i) the location of the first mobile device as indicated by the first communication, and

(ii) the location of the second mobile device as indicated by the second communication.

2. The method of claim 1, further comprising

communicating, by the server over the communication network and to a device of emergency response personnel, a third communication including information indicative of:

(i) the first gunshot event has occurred, and

(ii) the location of the first gunshot event.

3. A gunshot detection system, comprising:

a first mobile device having a first microphone;

a second mobile device having a second microphone; and

a server connected to the first and second mobile device over a communication network, wherein

the first mobile device is configured to;

receive a first audio signature pattern data corresponding to a sound of a gunshot,

receive, through the first microphone, a first audio signal that corresponds to a first gunshot audio event,

determine that the first audio signal matches the first audio signature pattern data,

send, responsive to the determining that the first audio signal matches the first audio signature pattern data, over a communication network and to the server, a first communication including information indicative of;

(i) a time that the first audio signal was received, and

(ii) a location of the first mobile device at the time the first audio signal was received;

the second mobile device is configured to;

receive the first audio signature pattern data;

receive, through the second microphone, a second audio signal that corresponds to the first gunshot audio event;

determine that the second audio signal matches the first audio signature pattern data;

sending, responsive to the determining that the second audio signal matches the first audio signature pattern data, over the communication network and to the server, a second communication including information indicative of;

(i) a time that the second audio signal was received, and

(ii) a location of the second mobile device at the time the first audio signal was received; and

the server is configured to;

determine that the first communication and the second communication relate to a common gunshot event based upon;

(i) the time that the first audio signal was received as indicated by the first communication, and

(ii) the time that the second audio signal was received as indicated by the second communication; and

triangulate, responsive to the determining that the first communication and the second communication relate to the common gunshot event, a location of the first gunshot event based upon;

(i) the location of the first mobile device as indicated by the first communication, and

(ii) the location of the second mobile device as indicated by the second communication.

4. The system of claim 3, wherein the server is configured to

communicate, over the communication network and to a device of emergency response personnel, a third communication including information indicative of:

(i) the first gunshot event has occurred, and

(ii) the location of the first gunshot event.