System and method for automatic identification of speech coding scheme

• US 8,959,025 B2
• Filed: 04/28/2011
• Issued: 02/17/2015
• Est. Priority Date: 04/28/2010
• Status: Active Grant

• Current Assignee: Cognyte Technologies Israel Ltd. (Cognyte Software Ltd.)
• Original Assignee: Verint Systems Limited (Verint Systems Incorporated)
• Inventors: Malinsky, Genady
• Primary Examiner(s): Shah, Paras D
• Assistant Examiner(s): Sharma, Neeraj
• Application Number:
  US13/096,148
• Publication Number:
  US 20110295601A1
• Time in Patent Office: 1,391 Days
• Field of Search: 704/262, 704/500, 704/214, 704/231, 704/210, 704/201, 704/213, 704/226, 340/10.2, 713/168, 455/7, 455/552.1, 714/751, 382/239
• US Class Current: 704/500
• CPC Class Codes: G10L 19/167 Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04L 69/22 Parsing or analysis of headers

Abstract

Methods and systems for extracting speech from such packet streams. The methods and systems analyze the encoded speech in a given packet stream, and automatically identify the actual speech coding scheme that was used to produce it. These techniques may be used, for example, in interception systems where the identity of the actual speech coding scheme is sometimes unavailable or inaccessible. For instance, the identity of the actual speech coding scheme may be sent in a separate signaling stream that is not intercepted. As another example, the identity of the actual speech coding scheme may be sent in the same packet stream as the encoded speech, but in encrypted form.

Claims

1. A method for speech decoding, comprising:

accepting communication packets that carry encoded speech, which was encoded in accordance with a speech coding scheme whose identity is not accessibly identified in the communication packets, wherein accepting the communication packets comprises accepting with each packet a respective time stamp indicating a reception time of the packet;

using a processor, processing the encoded speech so as to automatically identify the speech coding scheme that was used to encode the speech;

decoding the encoded speech using the identified speech coding scheme, wherein processing the encoded speech comprises decoding the encoded speech in accordance with the two or more possible speech coding schemes, so as to produce two or more respective output streams; and

deducing the identity of the speech coding scheme responsively to the output streams, wherein deducing the identity of the speech coding scheme comprises reconstructing occurrence times of speech activity in the output streams and matching the reconstructed occurrence times with the respective time stamps.

2. The method according to claim 1, wherein processing the encoded speech further comprises evaluating a characteristic of the encoded speech, and comparing the characteristic to respective characteristics of one or more possible speech coding schemes.

3. The method according to claim 1, wherein processing the encoded speech further comprises measuring a bit rate of the encoded speech, and comparing the measured bit rate to

respective bit rates of one or more possible speech coding schemes.

4. The method according to claim 1, wherein processing the encoded speech further comprises measuring a frame rate of the encoded speech, and comparing the measured frame rate to respective frame rates of one or more possible speech coding schemes.

5. The method according to claim 1, wherein processing the encoded speech further comprises comparing at least one frame size found in the encoded speech to respective characteristic frame sizes of one or more possible speech coding schemes.

6. The method according to claim 1, wherein the encoded speech occupies a given payload size in each of the communication packets, and wherein processing the encoded speech further comprises identifying a possible coding scheme having a frame size that is a divisor of the payload size.

7. The method according to claim 1, wherein deducing the identity of the speech coding scheme further comprises estimating a respective spectral range of at least one of the output streams, and determining the identity of the speech coding scheme based on the estimated spectral range.

8. The method according to claim 1, wherein deducing the identity of the speech coding scheme further comprises identifying silence periods in at least one of the output streams, and determining the identity of the speech coding scheme based on the identified silence periods.

9. The method according to claim 1, wherein decoding the encoded speech further comprises decoding first and second decoded speech corresponding to respective, opposite directions of a communication session, so as to produce first and second output streams, and wherein deducing the identity of the speech coding scheme further comprises matching silence periods in the first output stream with speech activity periods in the second output stream.

10. The method according to claim 1, and comprising reporting the identified speech coding scheme to an operator.

11. The method according to claim 1, wherein processing the encoded speech further comprises identifying two or more candidate speech coding schemes that are suspected of being used to encode the speech, and comprising reporting the candidate speech coding schemes to an operator.

12. The method according to claim 11, wherein identifying the candidate speech coding schemes comprises assigning the candidate speech coding schemes respective likelihoods of being used to encode the speech, and wherein reporting the candidate speech coding schemes comprises presenting the likelihoods to the operator.

13. The method according to claim 11, and comprising accepting from the operator feedback that indicates which of the candidate speech coding schemes was actually used to encode the speech, and adapting processing of subsequent encoded speech responsively to the feedback.

14. Apparatus for speech decoding, comprising:

an interface, which is configured to accept communication packets that carry encoded speech, which was encoded in accordance with a speech coding scheme whose identity is not accessibly identified in the communication packets, wherein accepting the communication packets comprises accepting with each packet a respective time stamp indicating a reception time of the packet; and

a processor, which is configured to process the encoded speech so as to automatically identify the speech coding scheme that was used to encode the speech, and to decode the encoded speech using the identified speech coding scheme, wherein processing the encoded speech comprises decoding the encoded speech in accordance with the two or more possible speech coding schemes, so as to produce two or more respective output streams, and deducing the identity of the speech coding scheme responsively to the output streams, wherein deducing the identity of the speech coding scheme comprises reconstructing occurrence times of speech activity in the output streams and matching the reconstructed occurrence times with the respective time stamps.

15. The apparatus according to claim 14, wherein the processor is further configured to identify the speech coding scheme by evaluating a characteristic of the encoded speech, and comparing the characteristic to respective characteristics of one or more possible speech coding schemes.

16. The apparatus according to claim 14, wherein the processor is further configured to identify the speech coding scheme by measuring a bit rate of the encoded speech, and comparing the measured bit rate to respective bit rates of one or more possible speech coding schemes.

17. The apparatus according to claim 14, wherein the processor is further configured to identify the speech coding scheme by measuring a frame rate of the encoded speech, and comparing the measured frame rate to respective frame rates of one or more possible speech coding schemes.

18. The apparatus according to claim 14, wherein the processor is further configured to identify the speech coding scheme by comparing at least one frame size found in the encoded speech to respective characteristic frame sizes of one or more possible speech coding schemes.

19. A method for speech decoding, comprising:

accepting communication packets that carry encoded speech, which was encoded in accordance with a speech coding scheme whose identity is not accessibly identified in the communication packets;

using a processor, processing the encoded speech so as to automatically identify the speech coding scheme that was used to encode the speech, wherein processing the encoded speech further comprises identifying two or more candidate speech coding schemes that are suspected of being used to encode the speech, wherein identifying the candidate speech coding schemes comprises assigning the candidate speech coding schemes respective likelihoods of being used to encode the speech;

decoding the encoded speech using the identified candidate speech coding scheme; and

reporting the candidate speech coding schemes to an operator, wherein reporting the candidate speech coding schemes comprises presenting the likelihoods to the operator.

20. The method according to claim 19, further comprising accepting from the operator feedback that indicates which of the candidate speech coding schemes was actually used to encode the speech, and adapting processing of subsequent encoded speech responsively to the feedback.