Method and device for spectral expansion for an audio signal

• US 10,636,436 B2
• Filed: 07/27/2018
• Issued: 04/28/2020
• Est. Priority Date: 12/23/2013
• Status: Active Grant

• Current Assignee: Staton Techiya, LLC
• Original Assignee: Staton Techiya, LLC
• Inventors: Usher, John, Ellis, Dan
• Primary Examiner(s): Yang, Qian
• Application Number:
  US16/047,661
• Publication Number:
  US 20180336912A1
• Time in Patent Office: 641 Days
• Field of Search: None
• CPC Class Codes: G10L 21/038 using band spreading techniques

Abstract

A method and device for automatically increasing the spectral bandwidth of an audio signal including generating a “mapping” (or “prediction”) matrix based on the analysis of a reference wideband signal and a reference narrowband signal, the mapping matrix being a transformation matrix to predict high frequency energy from a low frequency energy envelope, generating an energy envelope analysis of an input narrowband audio signal, generating a resynthesized noise signal by processing a random noise signal with the mapping matrix and the envelope analysis, high-pass filtering the resynthesized noise signal, and summing the high-pass filtered resynthesized noise signal with the original an input narrowband audio signal. Other embodiments are disclosed.

Claims

1. A system, comprising:

a processor that performs operations comprising;

generating a mapping matrix based on an analysis of a reference wideband signal and a reference narrowband signal, wherein the mapping matrix is generated without using a linear predictive coefficient (LPC) method, wherein the mapping matrix is generated based on using a dB domain for performing a linear prediction;

generating a resynthesized noise signal by processing a random noise signal with the mapping matrix and an energy envelope analysis of an input narrowband audio signal; and

generating an output audio signal by summing a high-pass filtered version of the resynthesized noise signal with the input narrowband audio signal.

2. The system of claim 1, wherein the operations further comprise generating an audible output using the output audio signal.

3. The system of claim 1, wherein the operations further comprise performing the energy envelope analysis on the input narrowband audio signal.

4. The system of claim 1, wherein the operations further comprise conducting high-pass filtering on the resynthesized noise signal to generate the high-pass filtered version of the resynthesized noise signal.

5. The system of claim 1, wherein the operations further comprise obtaining the input narrowband audio signal from a microphone.

6. The system of claim 1, wherein the operations further comprise generating the reference wideband signal and the reference narrowband signal from a simultaneous recording of a phonetically balanced sentence made with an ambient microphone located in an earphone and an ear canal microphone located in the earphone.

7. The system of claim 1, wherein the operations further comprise directing the output audio signal to a speaker as output.

8. The system of claim 1, wherein the operations further comprise generating the mapping matrix from a least squares fit analysis of the reference wideband signal and the reference narrowband signal.

9. The system of claim 1, wherein the operations further comprise generating the mapping matrix by utilizing a linear regression model.

10. The system of claim 1, wherein the mapping matrix comprises a transformation matrix to predict high frequency energy from a lower frequency energy envelope.

11. A method, comprising:

generating, by utilizing a processor, a mapping matrix based on an analysis of a reference wideband signal and a reference narrowband signal, wherein the mapping matrix is generated without using a linear predictive coefficient (LPC) method, wherein the mapping matrix is generated based on using a dB domain for performing a linear prediction;

generating a resynthesized noise signal by processing a random noise signal with the mapping matrix and an energy envelope analysis of an input narrowband audio signal; and

generating an output audio signal by summing a high-pass filtered version of the resynthesized noise signal with the input narrowband audio signal.

12. The method of claim 11, further comprising transmitting the output audio signal to a device.

13. The method of claim 11, further comprising generating the reference wideband signal and the reference narrowband signal from a recording of a phonetically balanced sentence.

14. The method of claim 11, further comprising conducting high-pass filtering on the resynthesized noise signal to generate the high-pass filtered version of the resynthesized noise signal.

15. The method of claim 11, further comprising generating an audible output using the output audio signal.

16. The method of claim 11, further comprising expanding a spectral bandwidth of a speech signal based on the generating of the mapping matrix, the generating of the resynthesized noise signal, and the generating of the output audio signal.

17. The method of claim 11, further comprising conducting the energy envelope analysis on the input narrowband audio signal.

18. The method of claim 11, further comprising generating the mapping matrix by utilizing a linear regression model.

19. A non-transitory computer readable medium containing instructions, the execution of the instructions by a processor of a computer system causing the processor to perform operations comprising:

generating a mapping matrix based on an analysis of a reference wideband signal and a reference narrowband signal, wherein the mapping matrix is generated based on using a dB domain for performing a linear prediction;

generating a resynthesized noise signal by processing a random noise signal with the mapping matrix and an energy envelope analysis of an input narrowband audio signal; and

generating an output audio signal by summing a high-pass filtered version of the resynthesized noise signal with the input narrowband audio signal.

20. The non-transitory computer-readable medium of claim 19, wherein the operations further comprise conducting high-pass filtering on the resynthesized noise signal to generate the high-pass filtered version of the resynthesized noise signal.