Detecting events from ingested communication signals

• US 10,313,413 B2
• Filed: 08/10/2018
• Issued: 06/04/2019
• Est. Priority Date: 08/28/2017
• Status: Expired due to Fees

• Current Assignee: Banjo, Inc.
• Original Assignee: Banjo, Inc.
• Inventors: Mehta, Rish, Patton, Damien
• Primary Examiner(s): Pollack, Melvin H
• Application Number:
  US16/101,208
• Publication Number:
  US 20190068671A1
• Time in Patent Office: 298 Days
• Field of Search: 709219
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: G06F 9/542 Event management; Broadcasting; Multicasting; Notifications
• CPC Class Codes: H04L 65/75 Media network packet handling

Abstract

The present invention extends to methods, systems, and computer program products for detecting events from ingested communication streams. A communication (e.g., audio) stream is ingested. A communication (e.g., audio) clip is selected from within the ingested communication stream. A clip score indicating a likelihood of the communication stream including event information is computed. Computing resources are allocated to further process the communication clip based on the clip score indicating that further processing is warranted. An event score is computed from event parameters extracted from the communication clip. An event is detect based on the event score.

Claims

1. A computer implemented method comprising:

ingesting a communication stream associated with a geographic region;

selecting a communication clip from within the communication stream;

computing a clip score from characteristics of the communication clip, the clip score indicating a likelihood of the communication stream including event information related to an event type that occurs with less than a threshold frequency within the geographic region;

determining further processing of the communication clip is warranted based on the likelihood indicated by the clip score;

allocating computing resources to further process the communication clip;

extracting event parameters from the communication clip utilizing the allocated computing resources;

computing an event score from the extracted event parameters; and

detecting a previously unidentified event of the event type in the geographic region based on the event score.

2. The computer implemented method of claim 1, wherein selecting a communication clip comprises:

determining a beginning timestamp;

determining an ending timestamp; and

storing a time-bounded segment of the communication stream between the beginning timestamp and the ending timestamp in a computer memory.

3. The computer implemented method of claim 2, wherein determining a beginning timestamp comprises detecting a signal amplitude of the communication stream exceeding a threshold amplitude for a specified time period.

4. The computer implemented method of claim 2, wherein determining a beginning timestamp comprises detecting a communication stream frequency pattern matching a predetermined pattern.

5. The computer implemented method of claim 2, wherein determining an ending timestamp detecting a signal amplitude of the communication stream falling below a threshold amplitude for a specified time period.

6. The computer implemented method of claim 2, wherein determining an ending timestamp comprises detecting a communication stream frequency pattern matching a predetermined pattern.

7. The computer implemented method of claim 1, wherein selecting a communication clip comprises stitching multiple audio clips together into the communication clip.

8. The computer implemented method of claim 1, wherein computing a clip score comprises computing a classification or a probability.

9. The computer implemented method of claim 1, wherein computing a clip score comprises:

identifying a sub-clip within the communication clip having a requisite probability of including an event identifier;

detecting an event identifier in the sub-clip; and

computing the clip score based on the detected event identifier.

10. The computer implemented method of claim 1, wherein ingesting a communication stream comprises ingesting audio from radio communications in a jurisdiction;

and

wherein identifying a sub-clip within the communication clip comprises identifying a sub-clip based on a communication syntax used in the jurisdiction.

11. The computer implemented method of claim 1, wherein determining further processing of the communication clip is warranted based on the clip score comprises determining that the clip score exceeds a threshold clip score.

12. The computer implemented method of claim 1, wherein extracting event parameters from the communication clip comprises extracting one or more of:

an event location, an event time, an event context, or an event severity from the communication clip.

13. The computer implemented method of claim 12, further comprising, in response to detecting the event, performing one or more of:

(a) notifying an entity of the detected event and of the one or more extracted event parameters or (b) rerouting a delivery vehicle based on the one or more extracted event parameters.

14. The computer implemented method of claim 1, wherein computing an event score comprises computing the event score from one or more of:

historic event parameters associated with a location, event parameters extracted from communication signals concurrent with the communication stream, or auxiliary signals associated with a location.

15. The computer implemented method of claim 1, wherein detecting a previously unidentified event based on the event score comprises determining the event score exceeds an entity specific threshold event score.

16. The computer implemented method of claim 1, further comprising:

receiving an auxiliary signal from an auxiliary signal source; and

validating the detected event based on content contained in the auxiliary signal.

17. A system comprising:

a processor;

system memory coupled to the processor and storing instructions configured to cause the processor to;

ingest an audio stream broadcast over a communication channel in a geographic region;

select an audio clip from within the audio stream;

evaluate the audio clip for an event content probability, the event probability indicating evidence of the audio clip including event information related to an event type that occurs with less than a specified threshold frequency within the geographic region;

determine further processing of the audio clip is warranted based on the evidence indicated by the event content probability;

allocate computing resources to further process the audio clip;

extract event parameters from the audio clip utilizing the allocated computing resources; and

detect a previously unidentified event of the event type in the geographic region based on the extracted event parameters.

18. The system of claim 17, wherein instructions configured to cause the processor to select an audio clip from the audio stream comprise instructions configured to cause the processor to:

identify a first voice and a keyword in a first audio clip;

identify a second voice and the keyword in a second audio clip; and

stitch the first audio clip and the second audio clip together into the audio clip of a conversation.

19. The system of claim 18, wherein instructions configured to cause the processor to ingest an audio stream comprise instructions configured to cause the processor to ingest an audio stream from radio communications in a jurisdiction;

and

wherein instructions configured to cause the processor to evaluate the audio clip for an event content probability comprise instructions configured to cause the processor to;

identify a sub-clip within the communication clip having a requisite probability of including an event identifier based on communication syntax used in the jurisdiction;

detect an event identifier in the sub-clip; and

compute a clip score based on the detected event identifier; and

wherein instructions configured to cause the processor to determine further processing of the audio clip is warranted comprise instructions configured to cause the processor to determine further processing of the audio clip is warranted based on the clip score exceeding a threshold clip score.

20. The system of claim 17, wherein instructions configured to cause the processor to extract event parameters from the audio clip comprise instructions configured to cause the processor to extract one or more of:

an event location, an event time, an event context, or an event severity from the audio clip; and

further comprising instructions configured to cause the processor to, in response to detecting the event, perform one or more of;

(a) notify an entity of the detected event and of the one or more extracted event parameters or (b) reroute a vehicle based on the one or more extracted event parameters.