IP phone intruder security monitoring system

• US 8,107,625 B2
• Filed: 03/31/2005
• Issued: 01/31/2012
• Est. Priority Date: 03/31/2005
• Status: Active Grant

• Current Assignee: Avaya Incorporated
• Original Assignee: Avaya Incorporated
• Inventors: Boland, Simon Daniel, Choy, Jonathan R. Yee-Hang, McNamara, Paul Thomas
• Primary Examiner(s): Cervetti, David Garcia
• Application Number:
  US11/096,334
• Publication Number:
  US 20060219473A1
• Time in Patent Office: 2,497 Days
• Field of Search: 380/37
• US Class Current: 380/37
• CPC Class Codes: G08B 13/1672 using sonic detecting means, e.g. a microphone operating in the audio frequency range
• CPC Class Codes: G08B 25/08 using communication transmission lines G08B13/19658, G08B21/0286, G08B25/016 take precedence
• CPC Class Codes: H04L 63/0861 using biometrical features, e.g. fingerprint, retina-scan cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231
• CPC Class Codes: H04L 63/1408 by monitoring network traffic monitoring network traffic per se H04L43/00
• CPC Class Codes: H04M 11/04 with alarm systems, e.g. fire, police or burglar alarm systems

Abstract

A voice communications terminal is provided having a microphone to receive an audio stream and a voice activity detector to determine whether the audio stream comprises voice signals and when the audio stream comprises voice signals, notify a communications server and/or provide at least a portion of the audio stream to the communications server.

Claims

1. A method, comprising:

providing a plurality of voice communications terminals within a premises serviced by a contact processing switch or server, each of the voice communications terminals having a corresponding internal telephone extension, wherein the voice communications terminals are operable to receive incoming telephone calls to the internal telephone extensions and send outgoing telephone calls to the contact processing switch or server, wherein the contact processing switch or server directs incoming telephone calls to and receives outgoing telephone calls from the internal telephone extensions;

receiving, by a first selected voice communications terminal, an audio stream through a microphone when the first selected voice communications terminal is not engaged in a telephone call;

determining, by the first selected voice communications terminal, that the audio stream comprises nonbackground audio signals;

in response to determining that the audio stream comprises the nonbackground audio signals, at least one of notifying, by the first selected voice communications terminal, the contact processing switch or server and providing, by the first selected voice communications terminal, at least a portion of the audio stream to the contact processing switch or server;

receiving, by a second selected voice communications terminal, the audio stream through a microphone when the second selected voice communications terminal is not engaged in a telephone call;

determining, by the second selected voice communications terminal, that the audio stream comprises nonbackground audio signals;

in response to determining, by the second selected voice communications terminal, that the audio stream comprises the nonbackground audio signals, at least one of notifying, by the second selected voice communications terminal, the contact processing switch or server and providing, by the second selected voice communications terminal, at least a portion of the audio stream to the contact processing switch or server;

determining, by the contact processing switch or server, an approximate physical location of a source for the audio stream based on a first physical location of the first selected voice communications terminal and a second physical location of the second selected voice communications terminal;

forwarding, by the first selected voice communications terminal, at least a portion of the audio stream to the contact processing switch or server.

2. The method of claim 1, wherein, in the determining step, the first selected voice communications terminal performs voice activity detection on the audio stream, wherein a voice activity detector determines whether an audio stream comprises nonbackground signals by identifying audio signals that, based on the audio signal frequency range or distribution, are unusual, relative to background audio signals received over a determined time interval or the background audio signals having a signal strength greater than a selected decibel level, wherein the first selected voice communications terminal is a telephone, wherein the contact processing switch or server includes a call controller, and further comprising:

receiving, by the contact processing switch or server, the notification from the selected voice communications terminal; and

transmitting, by the contact processing switch or server, an alarm notification to a security provider.

3. The method of claim 1, further comprising:

receiving, by the first selected voice communications terminal, at least one of a text and audio message from the contact processing switch or server; and

broadcasting, by the first selected voice communications terminal, the at least one of a text and audio message through a speaker.

4. The method of claim 3, further comprising:

receiving, by the first selected voice communications server, a user identification signal in response to the broadcasting step; and

when the user identification signal identifies a subscriber, the contact processing switch or server disregarding the notification; and

at least one of when the user identification signal does not identify a subscriber and when the user identification signal is not received within a selected period of time, transmitting, by the contact processing switch or server, an alarm notification to a security provider.

5. The method of claim 1, further comprising:

determining the first physical location of the first selected voice communications terminal transmitting the notification;

determining the second physical location of the second selected voice communications terminal transmitting the notification; and

providing the first and second physical locations to a security provider.

6. The method of claim 1, further comprising:

the first selected voice communications terminal receiving a command from the switch or server;

the first selected voice communications terminal authenticating the contact processing switch or server;

when the first selected voice communications terminal is unsuccessfully authenticated, not performing the command; and

when the first selected voice communications terminal is successfully authenticated, performing the command, wherein the command is at least one of enable voice activity detection and disable voice activity detection, wherein voice activity detection is activated, and wherein, when voice activity detection is activated, the following steps are performed;

pre-processing the audio stream to form a pre-processed audio stream;

extracting features from a selected segment of the pre-processed audio stream, the extracted features including one or more of energy, zero crossing, a frequency-domain shape of the pre-processed audio stream, a periodicity measure, or a statistic of speech and background noise; and

comparing extracted features with selected thresholds to determine whether non-background noise is present or absent from the selected segment of the pre-processed audio stream.

7. The method of claim 1, wherein, in a monitoring mode, the first selected voice communications terminal performs claim 1 and does not perform interpersonal voice communications, and, in a communications mode, the first selected voice communications terminal performs interpersonal voice communications and does not perform claim 1.

8. A non-transitory computer readable medium comprising processor-executable instructions to perform claim 1 and wherein the nonbackground signal is a voice signal.

9. A voice communications terminal, comprising:

a microphone operable to receive an audio stream when the voice communications terminal is not engaged in a telephone call;

a corresponding internal telephone extension in a premises serviced by a contact processing server, wherein the voice communications terminal is operable to receive incoming telephone calls to the internal telephone extension and send outgoing telephone calls to the contact processing switch or server, the contact processing server directing incoming telephone calls to and receiving outgoing telephone calls from the internal extension;

a voice activity detector operable to determine that the audio stream comprises nonbackground signals and in response to determining that the audio stream comprises the nonbackground signals, at least one of notify the contact processing server and provide at least a portion of the audio stream to the contact processing server;

wherein the voice communications terminal has a known physical location within a building, wherein the known physical location is unique to the voice communications terminal and different from a known physical location of one or more other voice communications terminals in the building, and wherein an approximate location of the audio stream is determined based on the known physical location of at least two voice communication terminals;

an audio broadcasting agent operable to receive at least one of a text and audio message from the contact processing server and broadcast the at least one of a text and audio message through a speaker.

10. The voice communications terminal of claim 9, wherein a detected nonbackground signal is a voice signal, wherein, in the determining operation, a voice activity detection engine performs voice activity detection on the audio stream, wherein the voice activity detector determines whether an audio stream comprises nonbackground signals by identifying audio signals that, based on audio signal frequency range or distribution, are unusual relative to background audio signals received over a determined time interval or audio signals having a signal strength greater than a selected decibel level, wherein the voice communications terminal is a telephone, wherein the contact processing server includes a call controller and an alarm agent, and wherein the alarm agent is operable to receive the notification from the voice communications terminal and transmit an alarm notification to a security provider.

11. The voice communications terminal of claim 9, further comprising:

an audio sending agent operable to forward at least a portion of the audio stream to the contact processing server, wherein, in operation (a), the voice activity detector pre-processes the audio stream to form a pre-processed audio stream;

extracts features from a selected segment of the pre-processed audio stream, the extracted features including one or more of energy, zero crossing, a frequency-domain shape of the pre-processed audio stream, a periodicity measure, or a statistic of speech and background noise; and

compares extracted features with selected thresholds to determine whether non-background noise is present or absent from the selected segment of the pre-processed audio stream.

12. The voice communications terminal of claim 9, further comprising:

an authentication agent operable to authenticate a command from the contact processing server.

13. The voice communications terminal of claim 9, wherein, in a monitoring mode, the voice communications terminal performs the operations of claim 9 but does not receive incoming calls or initiate outgoing calls, and, in a communications mode, the voice communications terminal does not perform the operations of claim 9 but receives incoming calls and initiates outgoing calls.

14. The voice communications terminal of claim 9, wherein the contact processing server determines the known physical location of the voice communications terminal by mapping a corresponding extension of the voice communications terminal to a corresponding electronic network address and mapping the corresponding network address to determine the known physical location.

15. A communications system, comprising:

two or more voice communications terminals, wherein each voice communications terminal has a corresponding known physical location within a building, each voice communications terminal comprising;

an input operable to receive an audio stream when the voice communications terminal is not engaged in a telephone call;

a corresponding internal telephone extension in a premises serviced by a communications server, wherein the voice communications terminals are operable to receive incoming telephone calls to the internal telephone extension and send outgoing telephone calls to the communications server;

a voice activity detector operable to determine that the audio stream comprises voice signals and in response to determining that the audio stream comprises voice signals, operable to at least one of notify the communications server and provide at least a portion of the audio stream to the communications server, wherein the voice activity detector is operable to determine whether an audio stream comprises nonbackground signals by identifying audio signals that, based on the audio signal frequency range or distribution, are unusual relative to background audio signals received over a determined time interval or the background audio signals having a signal strength greater than a selected decibel level, wherein the two or more voice communications terminals are telephones, and further operable to determine a physical location of one of the two or more voice communications terminals by mapping a corresponding extension of the one of the two or more voice communications terminals to a corresponding electronic network address and mapping the corresponding network address to determine the physical location; and

the communications server in communication with the two or more voice communications terminals, the communications server operable to receive one or more notifications from one or more voice communications terminals, and operable to transmit an alarm notification to a security provider, the communications server comprising;

a call controller operable to direct incoming telephone calls to and receive outgoing telephone calls from the corresponding internal telephone extensions, operable to receive the notification from the voice communications terminals, and operable to transmit an alarm notification to a security provider.

16. The communication system of claim 15, wherein-the voice activity detector is operable to perform voice activity detection on the audio stream by pre-processing the audio stream to form a pre-processed audio stream;

extracting features from a selected segment of the pre-processed audio stream, the extracted features including one or more of energy, zero crossing, a frequency-domain shape of the pre-processed audio stream, a periodicity measure, or a statistic of speech and background noise; and

comparing extracted features with selected thresholds to determine whether non-background noise is present or absent from the selected segment of the pre-processed audio stream.

17. The communication system of claim 15, further comprising:

audio sending means for sending at least a portion of the audio stream to the communications server; and

audio broadcasting means for receiving at least one of a text and audio message from the communications server and broadcasting the at least one of a text and audio message through a speaker.

18. The communication system of claim 15, further comprising:

authentication means for authenticating a command from the communications server.

19. The communication system of claim 15, wherein, in a monitoring mode, the two or more voice communications terminals perform claim 15 but does not initiate outgoing calls or receive incoming calls, and, in a communications mode, the two or more voice communications terminals not perform claim 15 but initiates outgoing calls and receives incoming calls.