METHOD AND SYSTEM FOR MITIGATING DELAY IN RECEIVING AUDIO STREAM DURING PRODUCTION OF SOUND FROM AUDIO STREAM

• US 20140270196A1
• Filed: 03/15/2013
• Published: 09/18/2014
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Vocollect, Inc. (Honeywell International Inc.)
• Original Assignee: Vocollect, Inc. (Honeywell International Inc.)
• Inventors: Barr, Russell, Karabin, Josh, Braho, Keith
• Granted Patent: US 9,978,395 B2
• Time in Patent Office: Days
• US Class Current: 381/56
• CPC Class Codes: G10L 13/08 Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
• CPC Class Codes: G10L 21/047 characterised by the type of waveform to be thinned out or inserted
• CPC Class Codes: H04R 2201/107 Monophonic and stereophonic headphones with microphone for two-way hands free communication

Abstract

A communication component modifies production of an audio waveform at determined modification segments to thereby mitigate the effects of a delay in processing and/or receiving a subsequent audio waveform. The audio waveform and/or data associated with the audio waveform are analyzed to identify the modification segments based on characteristics of the audio waveform and/or data associated therewith. The modification segments show where the production of the audio waveform may be modified without substantially affecting the clarity of the sound or audio. In one embodiment, the invention modifies the sound production at the identified modification segments to extend production time and thereby mitigate the effects of delay in receiving and/or processing a subsequent audio waveform for production.

Claims

1. An apparatus comprising:

transceiver circuitry configured to receive an audio stream, the audio stream including an audio waveform;

a memory configured to store the received audio stream;

audio production circuitry configured to produce sound using the audio waveform;

processing circuitry configured to;

analyze the received audio stream and identify at least one modification segment of the audio waveform, where the modification segment corresponds to a segment of the audio waveform where production of the audio waveform may be modified to mitigate a delay in receiving the audio stream, and

drive production of sound using the audio waveform based at least in part on the at least one modification segment that was identified.

2. The apparatus of claim 1 wherein the processing circuitry is configured to extend the audio waveform at the at least one identified modification segment.

3. The apparatus of claim 2 wherein the processing circuitry is configured to analyze remaining time to produce sound using a received audio waveform and the expected time to receive a subsequent portion of an audio stream and to determine the duration for the extension of the audio waveform.

4. The apparatus of claim 1, wherein the identified modification segment corresponds to a segment of low amplitude in the audio waveform.

5. The apparatus of claim 2, wherein the processing circuitry is configured to extend the audio waveform by pausing production of sound at the identified modification segment of the audio waveform for a desired time period.

6. The apparatus of claim 1 wherein the processing circuitry is configured to drive production of sound by delaying production of sound until the modification segment is identified.

7. The apparatus of claim 1, wherein the identified modification segment corresponds to a segment of the audio waveform where the audio waveform is quasi-stationary.

8. The apparatus of claim 2, wherein the processing circuitry is configured to extend the audio waveform by repeating the identified modification segment to extend the sound represented by the identified modification segment.

9. The apparatus of claim 1, wherein the audio stream includes metadata associated with the audio waveform that indicates a position of a type of sound included in the audio waveform, and the processing circuitry is configured to analyze the associated metadata to identify at least one modification segment corresponding to the position of the type of sound.

10. The apparatus of claim 1, the processing circuitry being further configured to:

determine whether production of sound using the audio waveform will end before a subsequent portion of the audio stream is expected to be received, and

drive production of sound using the audio waveform based at least in part on the processing circuitry determining that the production of sound using the audio waveform will end before a subsequent portion of the audio stream is expected to be received.

11. The apparatus of claim 1, the processing circuitry being further configured to:

determine whether production of sound using the audio waveform will end before a subsequent portion of the audio stream with an identified modification segment is expected to be received, and

drive production of sound using the audio waveform based at least in part on the processing circuitry determining that the production of sound using the audio waveform will end before a subsequent portion of the audio stream with an identified modification segment is expected to be received.

12. A system comprising:

a transmitting device for transmitting an audio stream including an audio waveform;

a receiving device for receiving the audio stream including audio production circuitry configured to produce sound using the audio waveform of the audio stream;

processing circuitry of the transmitting device configured to analyze the audio stream and identify at least one modification segment of the audio waveform, where the modification segment corresponds to a segment of the audio waveform where production of the audio waveform may be modified to mitigate a delay when the receiving device receives the audio stream; and

processing circuitry of the receiving device configured for driving the production of sound using the audio waveform based at least in part on the at least one modification segment that was identified.

13. The system of claim 12 wherein the processing circuitry of the receiving device is configured to extend the audio waveform at the at least one identified modification segment.

14. The system of claim 12, wherein the identified modification segment corresponds to a segment of low amplitude in the audio waveform.

15. The system of claim 13, wherein the processing circuitry is configured to extend the audio waveform by pausing production of sound at the identified modification segment of the audio waveform for a desired time period.

16. The system of claim 12, wherein the identified modification segment corresponds to a segment of the audio waveform where the audio waveform is quasi-stationary.

17. The system of claim 13, wherein the processing circuitry is configured to extend the audio waveform by repeating the identified modification segment to extend the sound represented by the identified modification segment.

18. A method of producing sound from an audio waveform, the audio waveform being included in a received audio stream, the method comprising:

analyzing the audio stream to identify at least one modification segment of the audio waveform, where the modification segment corresponds to a segment of the audio waveform where production of the audio waveform may be modified to mitigate a delay in receiving the received the audio stream; and

producing sound using the audio waveform based at least in part on the at least one modification portion that was identified.

19. The method of claim 18 further comprising extending the audio waveform at the at least one indentified modification segment and producing sound using the extended audio waveform.

20. The method of claim 19 further comprising analyzing remaining time to produce sound using the received audio waveform and the expected time to receive a subsequent portion of an audio stream and to determine the duration for the extension of the audio waveform.

21. The method of claim 18, wherein analyzing the audio stream includes analyzing the audio waveform to determine a segment of the audio waveform having a low amplitude, and identifying a segment of low amplitude as a modification segment.

22. The method of claim 19 including pausing production of sound at the identified modification portion of the audio waveform for a desired time period to extend the audio waveform.

23. The method of claim 18, wherein analyzing the audio stream includes analyzing the audio waveform to determine a segment of the audio waveform where the audio waveform is quasi-stationary, and identifying a quasi-stationary segment as a modification segment.

24. The method of claim 19 including extending the waveform by repeating the identified modification segment to extend the sound represented by the identified modification segment.

25. The method of claim 18, wherein the audio stream includes metadata associated with the audio waveform that indicates a position of a type of sound included in the audio waveform, the method further comprising analyzing the associated metadata and identifying at least one modification segment corresponding to the position of the type of sound.

26. The method of claim 18, further comprising:

determining whether production of sound using the audio waveform of the received audio stream will end before a subsequent portion of the audio stream is expected to be received; and

producing the sound using the audio waveform based at least in part on whether production of sound using the audio waveform will end before a subsequent portion of the audio stream is expected to be received.