Spatial calibration of surround sound systems including listener position estimation

• US 9,426,598 B2
• Filed: 07/15/2014
• Issued: 08/23/2016
• Est. Priority Date: 07/15/2013
• Status: Active Grant

• Current Assignee: DTS, Inc. (Adeia Inc.)
• Original Assignee: DTS, Inc. (Adeia Inc.)
• Inventors: Walsh, Martin, Shi, Guangji
• Primary Examiner(s): KIM, PAUL
• Application Number:
  US14/332,098
• Publication Number:
  US 20150016642A1
• Time in Patent Office: 770 Days
• Field of Search: 381/307, 381/303, 381/56, 381/58, 381/300, 381/92, 381/182, 381/17, 381/59, 381/91, 381/356, 381/26
• US Class Current: 1/1
• CPC Class Codes: H04R 1/26 Spatial arrangements of separate transducers responsive to two or more frequency ranges
• CPC Class Codes: H04R 1/406 microphones
• CPC Class Codes: H04R 2201/403 Linear arrays of transducers
• CPC Class Codes: H04S 7/301 Automatic calibration of stereophonic sound system, e.g. with test microphone
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation

Abstract

A method for calibrating a surround sound system is disclosed. The method utilizes a microphone array integrated in a front center loudspeaker of the surround sound system or a soundbar facing a listener. Positions of each loudspeaker relative to the microphone array can be estimated by playing a test signal at each loudspeaker and measuring the test signal received at the microphone array. The listener'"'"'s position can also be estimated by receiving the listener'"'"'s voice or other sound cues made by the listener using the microphone array. Once the positions of the loudspeakers and the listener'"'"'s position are estimated, spatial calibrations can be performed for each loudspeaker in the surround sound system so that listening experience is optimized.

Claims

1. A method for calibrating a multichannel surround sound system including a soundbar and one or more surround loudspeakers, the method comprising:

receiving, by microphone array integrated into the soundbar, a test signal played at a surround loudspeaker to be calibrated, the integrated microphone array comprising a plurality of microphones mounted in a relationship to the soundbar;

estimating a position of the surround loudspeaker relative to the integrated microphone array based on the received test signal at the plurality of microphones;

receiving, by the microphone array, a sound from a listener;

estimating a position of the listener relative to the integrated microphone array based on the received sound at the plurality of microphones;

deriving a distance and an angle between the surround loudspeaker and the listener based on the estimated position of the surround loudspeaker relative to the integrated microphone array and the estimated position of the listener relative to the integrated microphone array; and

performing a spatial calibration to the surround sound system based at least on the derived distance and angle between the surround loudspeaker and the listener.

2. The method of claim 1, wherein the integrated microphone array is mounted on the front center of the soundbar.

3. The method of claim 1, wherein the position of the surround loudspeaker and the position of the listener each includes a distance and an angle relative to the microphone array.

4. The method of claim 3, wherein the position of the loudspeaker is estimated based on a direct component of the received test signal.

5. The method of claim 3, wherein the angle of the loudspeaker is estimated using two or more microphones in the microphone array and based on a time difference of arrival (TDOA) of the test signal at the two or more microphones in the microphone array.

6. The method of claim 1, wherein the sound from the listener includes the listener'"'"'s voice or other sound cues made by the listener.

7. The method of claim 1, wherein the position of the listener is estimated using three or more microphones in the microphone array.

8. The method of claim 1, wherein performing the spatial calibration comprises:

adjusting delay and gain of a sound channel for the surround loudspeaker based on the estimated position of the surround loudspeaker and the listener; and

correcting spatial position of the sound channel by panning the sound channel to a desired position based on the estimated positions of the surround loudspeaker and the listener.

9. The method of claim 1, wherein performing the spatial calibration comprises panning a sound object to a desired position based on the estimated positions of the surround loudspeaker and the listener.

10. A method comprising:

receiving a request to calibrate a multichannel surround sound system including a soundbar with an integrated microphone array and one or more surround loudspeakers;

responsive to the request including estimating a position of a surround loudspeaker, playing a test signal at the surround loudspeaker; and

estimating the position of the surround loudspeaker relative to the integrated microphone array based on received test signal from the surround loudspeaker at the integrated microphone array;

responsive to the request including estimating a position of a listener, estimating the position of the listener relative to the integrated microphone array based on a received sound from the listener at the integrated microphone array;

deriving a distance and an angle between the surround loudspeaker and the listener based on the estimated position of the surround loudspeaker relative to the integrated microphone array and the estimated position of the listener relative to the integrated microphone array; and

performing a spatial calibration to the surround sound system based at least on the derived distance and angle between the surround loudspeaker and the listener.

11. An apparatus for calibrating a multichannel surround sound system including one or more loudspeakers, the apparatus comprising:

a microphone array with two or more microphones integrated in a front component of the surround sound system, wherein the integrated microphone array is configured for receiving a test signal played at a loudspeaker to be calibrated, and for receiving a sound from the listener;

an estimation module configured for;

estimating a position of the loudspeaker relative to the integrated microphone array based on the received test signal from the loudspeaker, and for estimating a position of the listener relative to the integrated microphone array based on the received sound from the listener; and

deriving a distance and an angle between the surround loudspeaker and the listener based on the estimated position of the surround loudspeaker relative to the integrated microphone array and the estimated position of the listener relative to the integrated microphone array; and

a calibration module configured for performing a spatial calibration to the surround sound system based at least on the derived distance and angle between the surround loudspeaker and the listener.

12. The apparatus of claim 11, wherein the front component of the surround sound system is one of a soundbar, a front loudspeaker and an A/V receiver.

13. The apparatus of claim 11, wherein the position of the loudspeaker and the position of the listener each includes a distance and an angle relative to the microphone array.

14. The apparatus of claim 13, wherein the position of the loudspeaker is estimated based on a direct component of the received test signal.

15. The apparatus of claim 13, wherein the angle of the loudspeaker is estimated using two or more microphones in the microphone array and based on a time difference of arrival (TDOA) of the test signal at the two or more microphones in the microphone array.

16. The apparatus of claim 11, wherein the position of the listener is estimated using three or more microphones in the microphone array.

17. The apparatus of claim 11, wherein performing the spatial calibration comprises:

adjusting delay and gain of a sound channel for the loudspeaker based on the estimated position of the loudspeaker and the listener; and

correcting spatial position of the sound channel by panning the sound channel to a desired position based on the estimated positions of the surround loudspeaker and the listener.

18. The apparatus of claim 11, wherein performing the spatial calibration comprises panning a sound object to a desired position based on the estimated positions of the surround loudspeaker and the listener.

19. A system for calibrating a multichannel surround sound system including one or more loudspeakers, the system comprising:

a microphone array with two or more microphones integrated in a front component of the surround sound system, wherein the microphone array is configured for receiving a test signal played at a loudspeaker to be calibrated and for receiving a sound from the listener;

an estimation module configured for;

estimating a position of the loudspeaker relative to the integrated microphone array based on the received test signal from the loudspeaker, and for estimating a position of the listener relative to the integrated microphone array based on the received sound from the listener; and

deriving a distance and an angle between the surround loudspeaker and the listener based on the estimated position of the surround loudspeaker relative to the integrated microphone array and the estimated position of the listener relative to the integrated microphone array; and

a calibration module configured for performing a spatial calibration to the surround sound system based at least on the derived distance and angle between the surround loudspeaker and the listener.

20. The system of claim 19, wherein the front component of the surround sound system is one of a soundbar, a front loudspeaker and an A/V receiver.