Enhancing audio using a mobile device

• US 9,699,556 B2
• Filed: 05/17/2016
• Issued: 07/04/2017
• Est. Priority Date: 08/01/2013
• Status: Active Grant

• Current Assignee: Caavo Inc
• Original Assignee: Caavo Inc
• Inventors: Aggarwal, Ashish Dharmpal, Satheesh, Sharath Hariharpur
• Primary Examiner(s): Nguyen, Khai N
• Application Number:
  US15/157,131
• Publication Number:
  US 20160259621A1
• Time in Patent Office: 413 Days
• Field of Search: 381 941, 381 942, 381 95, 381 96, 381 99, 381103
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G10L 21/0232 Processing in the frequency domain
• CPC Class Codes: G10L 25/51 for comparison or discrimination
• CPC Class Codes: H03G 3/20 Automatic control H03G3/005 takes precedence; combined with volume compression or expansion H03G7/00
• CPC Class Codes: H03G 3/3005 in amplifiers suitable for low-frequencies, e.g. audio amplifiers H03G3/32, H03G3/34 take precedence
• CPC Class Codes: H03G 3/32 the control being dependent upon ambient noise level or sound level
• CPC Class Codes: H03G 5/005 of digital signals
• CPC Class Codes: H03G 5/165 Equalizers; Volume or gain control in limited frequency bands
• CPC Class Codes: H03G 7/002 in untuned or low-frequency amplifiers, e.g. audio amplifiers H03G7/007, H03G7/001, H03G7/008, H03G7/02, H03G7/06 take precedence
• CPC Class Codes: H03H 17/04 Recursive filters
• CPC Class Codes: H03H 2017/0472 based on allpass structures
• CPC Class Codes: H04R 1/08 Mouthpieces; Microphones; Attachments therefor
• CPC Class Codes: H04R 2430/01 Aspects of volume control, not necessarily automatic, in sound systems
• CPC Class Codes: H04R 2499/11 Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
• CPC Class Codes: H04R 25/50 Customised settings for obtaining desired overall acoustical characteristics
• CPC Class Codes: H04R 25/505 using digital signal processing
• CPC Class Codes: H04R 29/00 Monitoring arrangements; Testing arrangements for hearing aids H04R25/30; detection of loudspeaker connection H04R5/04; sound-field adaptation dependent on speaker detection H04S7/308
• CPC Class Codes: H04R 29/001 for loudspeakers H04R29/007 takes precedence
• CPC Class Codes: H04R 29/004 for microphones H04R29/007 takes precedence
• CPC Class Codes: H04R 3/00 Circuits for transducers , loudspeakers or microphones
• CPC Class Codes: H04R 3/04 : for correcting frequency response

Abstract

Embodiments disclosed herein enable detection and improvement of the quality of the audio signal using a mobile device by determining the loss in the audio signal and enhancing audio by streaming the remainder portion of audio. Embodiments disclosed herein enable an improvement in the sound quality rendered by rendering devices by emitting an test audio signal from the source device, measuring the test audio signal using microphones, detecting variation in the frequency response, loudness and timing characteristics using impulse responses and correcting for them. Embodiments disclosed herein also compensate for the noise in the acoustic space by determining the reverberation and ambient noise levels and their frequency characteristics and changing the digital filters and volumes of the source signal to compensate for the varying noise levels.

Claims

1. A method, performed by a mobile device, for obtaining a high quality version of a first audio signal that is generated by a first audio source and is being played back on an audio system that includes a source device and at least one rendering device, the method comprising:

identifying the first audio signal;

determining whether a quality of the first audio signal is below a quality threshold, said determining comprising;

obtaining a portion of a second audio signal having a higher quality than the first audio signal from a second audio source;

time aligning the obtained portion of the second audio signal and the identified first audio signal; and

calculating a metric based on a difference between the obtained portion of the second audio signal and the identified first audio signal, wherein the metric is calculated in accordance with;

Sq=(H*H+O*O)/(H−

O)*(H−

O)

where H is the obtained portion of the second audio signal, O is the identified first audio signal and Sq is the quality of the identified first audio signal; and

in response to determining that the quality of the first audio signal is below the quality threshold, providing a location of the second audio source or a portion of the second audio signal to the source device for streaming thereby.

2. The method of claim 1, wherein the identifying the first audio signal comprises:

detecting the first audio signal by at least one microphone; and

identifying the first audio signal based on audio fingerprinting.

3. The method of claim 1, wherein the location is remote with respect to the source device and the mobile device.

4. The method of claim 1, wherein the mobile device and the source device are the same device.

5. The method of claim 1, further comprising:

streaming the portion of the second audio signal from the location.

6. The method of claim 1, wherein the second audio source is a server coupled to the mobile device via a network.

7. The method of claim 1, wherein the mobile device is a mobile phone.

8. A computer program product comprising computer executable program code recorded on a computer readable non-transitory storage medium, said computer executable program code when executed, performing a method for obtaining a high quality version of a first audio signal that is generated by a first audio source and is being played back on an audio system that includes a source device and at least one rendering device, the method comprising:

identifying the first audio signal;

determining whether a quality of the first audio signal is below a quality threshold, wherein said determining comprises;

obtaining a portion of a second audio signal having a higher quality than the first audio signal from a second audio source;

time aligning the obtained portion of the second audio signal and the identified first audio signal;

calculating a metric based on a difference between the obtained portion of the second audio signal and the identified first audio signal, wherein the metric is calculated in accordance with;

Sq=(H*H+O*O)/(H−

O)*(H−

O)

where H is the obtained portion of the second audio signal, O is the identified first audio signal and Sq is the quality of the identified first audio signal; and

in response to determining that the quality of the first audio signal is below the quality threshold, providing a location of the second audio source or a portion of the second audio signal to the source device.

9. The computer program product of claim 8, wherein the identifying the first audio signal comprises:

detecting the first audio signal by at least one microphone; and

identifying the first audio signal based on audio fingerprinting.

10. The computer program product of claim 8, wherein the at least one microphone is included in a mobile device.

11. The computer program product of claim 10, wherein the second audio source is a server coupled to at least mobile device via a network.

12. The computer program product of claim 10, wherein the mobile device is a mobile phone.

13. The computer program product of claim 8, wherein the location is remote with respect to the source device and the mobile device.

14. The computer program product of claim 8, wherein the method further comprises streaming the portion of the second audio signal from the location.

15. A mobile device configured to obtain a high quality version of a first audio signal, comprising:

at least one microphone configured to detect the first audio signal that is generated by a first audio source and is being played back by at least one rendering device coupled to a source device; and

a processing unit configured to;

identify the first audio signal;

determine whether a quality of the first audio signal is below a quality threshold, wherein said processing unit is configured to determine whether the quality of the first audio signal is below a quality threshold by;

obtaining a portion of a second audio signal having a higher quality than the first audio signal from a second audio source;

time aligning the obtained portion of the second audio signal and the identified first audio signal;

calculating a metric based on a difference between the obtained portion of the second audio signal and the identified first audio signal, wherein the metric is calculated in accordance with;

Sq=(H*H+O*O)/(H−

O)*(H−

O)

where H is the obtained portion of the second audio signal, O is the identified first audio signal and Sq is the quality of the identified first audio signal; and

in response to a determination that the quality of the first audio signal is below the quality threshold, provide a location of the second audio source or a portion of the second audio signal to the source device.

16. The mobile device of claim 15, wherein the processing unit is configured to identify the first audio signal based on audio fingerprinting.

17. The mobile device of claim 15, wherein the location is remote with respect to the source device and the mobile device.

18. The mobile device of claim 15, wherein the processing unit is further configured to stream the portion of the second audio signal from the location.

19. The mobile device of claim 15, wherein the second audio source is a server coupled to the mobile device via a network.

20. The mobile device of claim 15, wherein the mobile device is a mobile phone.