SYSTEM AND METHOD FOR DETECTING, ESTIMATING, AND COMPENSATING ACOUSTIC DELAY IN HIGH LATENCY ENVIRONMENTS

• US 20200133619A1
• Filed: 10/25/2018
• Published: 04/30/2020
• Est. Priority Date: 10/25/2018
• Status: Abandoned Application

• Current Assignee: Drivetime Incorporated
• Original Assignee: Drivetime Incorporated
• Inventors: JOHNSON, Nicholas Cory
• Application Number:
  US16/171,175
• Publication Number:
  US 20200133619A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06N 7/01 Probabilistic graphical models, e.g. probabilistic networks

Abstract

Systems and methods for detecting, estimating, and compensating acoustic delay in high latency environments are disclosed. A particular embodiment includes: receiving an audio output signal (OS) from a media system and passing the audio output signal (OS) to an audio buffer; receiving an audio input signal (IS) from an input system and passing the audio input signal (IS) to the audio buffer; converting the audio output signal (OS) and the audio input signal (IS) appropriately for comparison; comparing the converted audio output signal (OS) with the converted audio input signal (IS) to determine a probability and intensity of audio signal overlap between the converted audio output signal (OS) and the converted audio input signal (IS); generating audio overlap data (OD) from the probability and intensity of audio signal overlap, the audio overlap data (OD) representing a magnitude and offset of the audio signal overlap; and using the audio overlap data (OD) to perform an audio signal compensation function on the audio input signal (IS).

Claims

1. A method comprising:

receiving an audio output signal (OS) from a media system and passing the audio output signal (OS) to an audio buffer;

receiving an audio input signal (IS) from an input system and passing the audio input signal (IS) to the audio buffer;

converting the audio output signal (OS) and the audio input signal (IS) for comparison;

comparing the converted audio output signal (OS) stored in the audio buffer with the converted audio input signal (IS) stored in the audio buffer to determine a probability and intensity of audio signal overlap between the converted audio output signal (OS) and the converted audio input signal (IS), the comparing using signal processing to detect a magnitude and offset of any matching signals present in the audio buffer;

generating audio overlap data (OD) from the probability and intensity of audio signal overlap, the audio overlap data (OD) representing a magnitude and offset of the audio signal overlap; and

using the audio overlap data (OD) to perform an audio signal compensation function on the audio input signal (IS).

2. The method of claim 1 wherein the audio overlap data (OD) includes a maximum overlap strength (MOS) and a maximum overlap offset (MOO).

3. The method of claim 1 wherein the audio signal compensation function causes an offset to be applied to the audio input signal (IS), the offset corresponding to the audio overlap data (OD).

4. The method of claim 1 wherein the audio signal compensation function causes the audio input signal (IS) to be suppressed or attenuated.

5. The method of claim 1 including passing the audio overlap data (OD) and the audio input signal (IS), modified by the audio signal compensation function, to the media system.

6. The method of claim 5 including causing the media system to apply an offset to a display or data signal, the offset corresponding to the audio overlap data (OD).

7. The method of claim 1 including using a list or dataset of known output device characteristics to modify the audio overlap data (OD) in a manner corresponding to the known output device characteristics.

8. The method of claim 1 wherein the audio buffer is configured to store at least the previous one second of the audio output signal (OS) and the audio input signal (IS).

9. The method of claim 1 wherein converting the audio output signal (OS) and the audio input signal (IS) appropriately for comparison includes converting the audio output signal (OS) or the audio input signal (IS) into different mathematical frequency representations.

10. An audio signal processing system comprising:

a digital signal processor;

an audio buffer coupled to the digital signal processor;

an audio signal compensator coupled to the digital signal processor;

the audio signal processing system being configured to;

receive an audio output signal (OS) from a media system and pass the audio output signal (OS) to the audio buffer;

receive an audio input signal (IS) from an input system and pass the audio input signal (IS) to the audio buffer;

use the digital signal processor to convert the audio output signal (OS) and the audio input signal (IS) for comparison, compare the converted audio output signal (OS) stored in the audio buffer with the converted audio input signal (IS) stored in the audio buffer to determine a probability and intensity of audio signal overlap between the converted audio output signal (OS) and the converted audio input signal (IS), the comparing using signal processing to detect a magnitude and offset of any matching signals present in the audio buffer, and generate audio overlap data (OD) from the probability and intensity of audio signal overlap, the audio overlap data (OD) representing a magnitude and offset of the audio signal overlap; and

use the audio signal compensator to use the audio overlap data (OD) to perform an audio signal compensation function on the audio input signal (IS).

11. The audio signal processing system of claim 10 wherein the audio overlap data (OD) includes a maximum overlap strength (MOS) and a maximum overlap offset (MOO).

12. The audio signal processing system of claim 10 wherein the audio signal compensation function causes an offset to be applied to the audio input signal (IS), the offset corresponding to the audio overlap data (OD).

13. The audio signal processing system of claim 10 wherein the audio signal compensation function causes the audio input signal (IS) to be suppressed or attenuated.

14. The audio signal processing system of claim 10 being further configured to pass the audio overlap data (OD) and the audio input signal (IS), modified by the audio signal compensation function, to the media system.

15. The audio signal processing system of claim 14 being further configured to cause the media system to apply an offset to a display or data signal, the offset corresponding to the audio overlap data (OD).

16. The audio signal processing system of claim 10 being further configured to use a list or dataset of known output device characteristics to modify the audio overlap data (OD) in a manner corresponding to the known output device characteristics.

17. The audio signal processing system of claim 10 wherein the audio buffer is configured to store at least the previous one second of the audio output signal (OS) and the audio input signal (IS).

18. The audio signal processing system of claim 10 being further configured to convert the audio output signal (OS) or the audio input signal (IS) into different mathematical frequency representations.

19. A non-transitory machine-useable storage medium embodying instructions which, when executed by a machine, cause the machine to:

receive an audio output signal (OS) from a media system and pass the audio output signal (OS) to an audio buffer;

receive an audio input signal (IS) from an input system and pass the audio input signal (IS) to the audio buffer;

convert the audio output signal (OS) and the audio input signal (IS) for comparison;

compare the converted audio output signal (OS) stored in the audio buffer with the converted audio input signal (IS) stored in the audio buffer to determine a probability and intensity of audio signal overlap between the converted audio output signal (OS) and the converted audio input signal (IS), the comparing using signal processing to detect a magnitude and offset of any matching signals present in the audio buffer;

generate audio overlap data (OD) from the probability and intensity of audio signal overlap, the audio overlap data (OD) representing a magnitude and offset of the audio signal overlap; and

use the audio overlap data (OD) to perform an audio signal compensation function on the audio input signal (IS).

20. The non-transitory machine-useable storage medium of claim 19 wherein the audio signal compensation function causes an offset to be applied to the audio input signal (IS), the offset corresponding to the audio overlap data (OD).