Apparatus and method for audio content analysis, marking and summing

• US 7,546,173 B2
• Filed: 08/18/2003
• Issued: 06/09/2009
• Est. Priority Date: 08/18/2003
• Status: Active Grant

• Current Assignee: Nice Systems Limited (Nice Ltd)
• Original Assignee: Nice Systems Limited (Nice Ltd)
• Inventors: Freedman, Ilan, Waserblat, Moshe, Aharoni, Gili, Eliam, Barak, Bachar, Aviv
• Primary Examiner(s): Kuntz; Curtis
• Assistant Examiner(s): Elbin; Jesse A
• Application Number:
  US10/481,438
• Publication Number:
  US 20060133624A1
• Time in Patent Office: 2,122 Days
• Field of Search: 379/112.01, 379/133, 379/88.2, 381/119, 704/246, 704/201, 700/94
• US Class Current: 700/94
• CPC Class Codes: H04H 60/04 Studio equipment; Interconnection of studios
• CPC Class Codes: H04S 1/007 in which the audio signals are in digital form data reduction aspects thereof based on psychoacoustics G10L19/02
• CPC Class Codes: H04S 7/00 Indicating arrangements; Control arrangements, e.g. balance control

Abstract

An apparatus and method for the analysis, marking and summing of audio channel content and control data, the apparatus and method generating a summed signal carrying combined audio content, marking and summing data in the summed signal.

Claims

1. An apparatus for the analysis, marking and summing of at least two separate time-synchronized audio channels delivering at least two separate signals carrying encoded audio content and control data, the apparatus comprising:

an at least one audio channel marking component to extract from at least one of the at least two separate time-synchronized audio channels, signal-specific characteristics and channel-specific control information, and to generate from the extracted control information and signal characteristics channel-specific marking data;

an at least one audio summing component to sum the at least two separate signals into a summed signal, and to generate signal summing control information; and

an at least one marking and summing embedding component to insert the generated marking data and summing control information into the summed signal, wherein said marking and summing embedding component embeds said control information by data hiding,

thereby generating a summed signal carrying combined audio content, marking data and summing control information into the summed signal.

2. The apparatus of claim 1 further comprising:

an at least one embedded marking and summing control data extraction component to extract marking data and summing data and signal-specific characteristics and channel-specific control information from the summed signal;

an at least one audio channel recognition component to identify at least one audio channel from the summed signal associated with the extracted marking and summing control data; and

an at least one audio channel separation component to separate the summed signal into the constituent separate time-synchronized channels thereof;

thereby enabling for the extraction and separation of previously generated summed signal.

3. The apparatus of claim 2 further comprising at least one digital signal processing device for content analysis, the at least one digital signal processing device is selected from the group consisting of:

a transcription component to transform speech elements of the audio content of the signal to text; and

a word spotting component to identify pre-defined words in the speech elements of the audio content.

4. The apparatus of claim 2 further comprising at least one content analysis server to provide for channel-specific content analysis of the signal carrying audio content and an at least one content analysis database to store the results of the content analysis.

5. The apparatus of claim 1 further comprising an at least one spectral features extraction component to analyze the signal delivered by the at least one audio channel and to generate spectral features vector data characterizing the audio content of the signal.

6. The apparatus of claim 1 further comprising a compressing component to process the summed audio signal including the embedded marking data and summing control information in order to generate a compressed signal.

7. The apparatus of claim 6 further comprising a decompression component to decompress the summed signal.

8. The apparatus of claim 1 further comprising an automatic number identification component to identify the origin of the at least one audio channel delivering the signal carrying encoded audio content.

9. The apparatus of claim 1 further comprising a dual tone multi frequency component to extract traffic control information from the signal delivered by the audio channel.

10. The apparatus of claim 1 further comprising an at least one group of digital signal processing devices to provide for audio content analysis of at least one of the at least two separate audio channels prior to the marking and summing of the signal, the group of digital signal processing devices comprising any one of the following components:

a talk analysis statistics component to generate talk statistics from the audio content carried by the signal;

an excitement detection component to identify emotional characteristics of the audio content carried by the signal;

an age detection component to identify the age of a speaker associated with a speech segment of the audio content carried by the signal; and

a gender detection component to identify the gender of a speaker associated with a speech segment of the audio content carried by the signal.

11. The apparatus of claim 1 further comprising at least one storage unit to store the summed signal carrying audio content and marking and summing control data.

12. A method for the analysis, marking, and summing of at least two separate time-synchronized audio channels delivering at least two separate signals carrying encoded audio content, and control data , the method comprising:

analyzing at least one of the at least two separate signals carrying audio content and traffic control data, to generate channel-specific control data, and signal-specific spectral characteristics;

generating channel-specific marking control data from the channel-specific control data and the signal-specific spectral characteristics;

summing the at least two separate signals carrying audio content into a summed signal and generating summation control data;

embedding the channel-specific control data, the summation control data, and the signal-specific spectral characteristics into the summed signal thereby generating a summed signal carrying combined audio content, channel-specific control data, segment-specific summation data, and spectral features vector data, and wherein said analyzing at least one of said two separate signals occurs before said step of summing; and

storing the summed signal carrying audio content and marking and summing control data on a storage device.

13. The method of claim 12 further comprising the steps of:

extracting the marking and summing data from the summed signal;

identifying an at least one channel-specific signal within the summed signal; and

separating the at least one channel-specific signal from the summed signal;

thereby providing a channel-specific signal carrying channel-specific audio content for audio content analysis.

14. The method of claim 13 wherein the separation of the summed signal is performed in accordance with the traffic control data carried by the at least one signal.

15. The method of claim 13 wherein the separation of the summed signal is accomplished through selectively marking speech segments included in the at least one signal associated with different speakers.

16. The method of claim 12 further comprising the step of compressing the summed signal in order to transform the signal to a compressed format signal.

17. The method of claim 12 further comprising the step of decompressing the summed and compressed signal.

18. The method of claim 12 further comprising the step of obtaining the summed signal from the storage device in order to perform audio channel separation and channel-specific content analysis;

and storing the results of the content analysis on a storage device to provide for data mining options for additional applications.

19. The method of claim 12 wherein the marking of the at least one audio channel is performed in accordance with the traffic control data carried by the at least one signal.

20. The method of claim 12 wherein generating marking data of the at least one audio channel is accomplished through selectively marking speech segments included in the at least one signal associated with different speakers.

21. The method of claim 12 wherein the embedding of the marking and summing control data in the summed signal is achieved via data hiding.

22. The method of claim 21 wherein data hiding is performed by pulse code modulation robbed-bit method.

23. The method of claim 22 wherein data hiding is performed by code excited linear prediction compression method.

24. The method of claim 12 further comprising the step of performing content analysis operations prior to marking and prior to summing the at least two separate signals.

25. The method of claim 12 further comprising the step of pre-processing for extracting at least one speech feature vector from at least one of the at least two separate signals.

26. The method of claim 12 further comprising the step of marking in at least one of the at least two separate signals, a beginning point or an end point of speech by one speaker.

27. A computer readable storage medium containing a set of instructions for a general purpose computer, the set of instructions comprising:

analyzing at least one of at least two signals carrying audio content and traffic control data delivered via at least two audio channels, to generate channel-specific control data, and signal-specific spectral characteristics;

generating channel-specific marking control data from the channel-specific control data and the signal-specific spectral characteristics;

summing the at least two separate signals carrying audio content into a summed signal and generating summation control data; and

embedding the channel-specific control data, the summation control data, and the signal-specific spectral characteristics into the summed signal;

wherein said analyzing said at least one of at least two signals occurs before said step of summing, thereby generating a summed signal carrying combined audio content, channel-specific control data, segment-specific summation data, and spectral features vector data; and

storing the summed signal carrying audio content and marking and summing control data on a storage device.

28. An apparatus for the analysis, marking, summing and separating of at least two separate time-synchronized audio channels delivering at least two separate signals carrying encoded audio content, and control data, the apparatus comprising:

an audio channel marking component to extract from at least one of the at least two separate time-synchronized audio channels, signal-specific characteristics and channel-specific control information, and to generate from the extracted control information and signal characteristics channel-specific marking data;

an audio summing component to sum the at least two separate signals into a summed signal, and to generate signal summing control information;

a marking and summing embedding component to insert the generated marking data and summing control information into the summed signal;

a compression component for compressing the summed audio signal including the embedded marking and summing information in order to generate a compressed signal;

a decompression component for decompressing the compressed signal in order to generate a decompressed summed signal;

an embedded marking and summing control data extraction component to extract marking data and summing data and signal-specific characteristics and channel-specific control information from the decompressed summed signal;

wherein said marking and summing embedding component embeds said control information by data hiding,

an audio channel recognition component to identify at least one audio channel from the decompressed summed signal associated with the extracted marking and summing control data; and

an audio channel separation component to separate the decompressed summed signal into the constituent separate time-synchronized channels thereof.

29. A method for the analysis, marking, summing and separating of at least two separate time-synchronized audio channels delivering at least two separate signals carrying encoded audio content, content and control data, the method comprising:

analyzing at least one of the at least two separate signals carrying audio content and traffic control data, to generate channel-specific control data, and signal-specific spectral characteristics;

generating channel-specific marking control data from the channel-specific control data and the signal-specific spectral characteristics;

summing the at least two separate signals carrying audio content into a summed signal and generating summation control data;

embedding the channel-specific control data, the summation control data, and the signal-specific spectral characteristics into the summed signal;

compressing the summed signal to obtain a summed compressed signal;

decompressing the summed compressed signal to obtain a decompressed summed signal;

extracting the marking and summing data from the decompressed summed signal;

identifying the channel-specific signal within the decompressed summed signal;

separating the channel-specific signal from the decompressed summed signal, wherein said analyzing said one of at least two separate signals occurs before said step of summing;

storing the summed signal carrying audio content and marking and summing control data on a storage device.