Sound field calibration using listener localization

• US 9,930,470 B2
• Filed: 06/01/2015
• Issued: 03/27/2018
• Est. Priority Date: 12/29/2011
• Status: Active Grant

• Current Assignee: Sonos, Inc.
• Original Assignee: Sonos, Inc.
• Inventors: Reilly, Jonathon, Van Erven, Niels
• Primary Examiner(s): CHIN, VIVIAN C
• Assistant Examiner(s): Suthers, Douglas
• Application Number:
  US14/726,921
• Publication Number:
  US 20150264508A1
• Time in Patent Office: 1,030 Days
• Field of Search: 381 81, 381 80, 381 77, 381 17, 381 58, 381 18, 381310
• CPC Class Codes: G01S 3/023 Monitoring or calibrating
• CPC Class Codes: G01S 3/80 using ultrasonic, sonic or infrasonic waves
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: H04R 2227/005 Audio distribution systems for home, i.e. multi-room use
• CPC Class Codes: H04R 2430/01 Aspects of volume control, not necessarily automatic, in sound systems
• CPC Class Codes: H04R 27/00 Public address systems circuits for preventing acoustic reaction H04R3/02; circuits for distributing signals to loudspeakers H04R3/12; monitoring or testing arrangements for public address systems H04R29/007; amplifiers H03F
• CPC Class Codes: H04R 29/001 for loudspeakers H04R29/007 takes precedence
• CPC Class Codes: H04R 29/008 Visual indication of individual signal levels visual indication of stereophonic sound image H04S7/40
• CPC Class Codes: H04R 3/04 for correcting frequency response
• CPC Class Codes: H04S 7/301 Automatic calibration of stereophonic sound system, e.g. with test microphone
• CPC Class Codes: H04S 7/302 Electronic adaptation of stereophonic sound system to listener position or orientation H04S7/301 takes precedence
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation
• CPC Class Codes: Y02B 20/40 Control techniques providing energy savings, e.g. smart controller or presence detection

Abstract

An example implementation involves a first device receiving, from a sensor, first location data that is associated with the first device, and, from a second device, second location data that is associated with the second device. The first device determines a first location of a listener relative to the first device based on the first and second location data. The first device generates a first sound field during media content playback based on the determined first location. The first device receives, from the sensor, third location data that is associated with the first device, and, from the second device, fourth location data associated with the second device. Based on the third and fourth location data, the first device determines a second location of the listener relative to the first device. Based on the second determined location, the first device generates a second sound field during media playback.

Claims

1. A first computing device comprising:

one or more sensors;

a processor; and

memory having stored thereon instructions executable by the processor to cause the first computing device to perform functions comprising;

receiving (i) first location data from the one or more sensors, the first location data associated with the first computing device, and (ii) second location data from a second computing device, the second location data associated with the second computing device;

based on the first location data and the second location data, determining a first location of a listener relative to the first computing device;

based on the determined first location, generating a first sound field during media content playback;

while generating the first sound field during media content playback and at a predetermined duration of time after receiving the first location data and the second location data, receiving (i) third location data from the one or more sensors, the third location data associated with the first computing device, and (ii) fourth location data from the second computing device, the fourth location data associated with the second computing device;

based on the third location data and the fourth location data, determining a second location of the listener relative to the first computing device, the second location different from the first location; and

based on the second determined location, generating a second sound field during media content playback.

2. The first computing device of claim 1, wherein the functions further comprise:

prior to receiving the first location data and the second location data, (i) transmitting to the one or more sensors, a request for the first location data, and (ii) transmitting to the second computing device, a request for the second location data; and

at a predetermined duration of time after transmitting the requests for the first location data and the second location data, and prior to receiving the third location data and the fourth location data, (i) transmitting to the one or more sensors, a request for the third location data, and (ii) transmitting to the second computing device, a request for the fourth location data.

3. The first computing device of claim 1, wherein the functions further comprise:

prior to receiving the third location data and the fourth location data, receiving from one or more of (a) the one or more sensors and (b) the second computing device, movement data indicating movement of the listener; and

responsive to receiving the movement data, (i) transmitting to the one or more sensors, a request for the third location data, and (ii) transmitting to the second computing device, a request for the fourth location data.

4. The first computing device of claim 1, wherein the functions further comprise:

prior to receiving the first location data and the second location data, receiving a command to play media content; and

responsive to receiving the command to play media content, (i) transmitting to the one or more sensors, a request for the third location data, and (ii) transmitting to the second computing device, a request for the fourth location data.

5. The first computing device of claim 1, wherein the functions further comprise:

responsive to determining the first location, facilitating the second computing device to generate a third sound field during media content playback; and

subsequently, responsive to determining the second location, facilitating the second computing device to generate a fourth sound field during media content playback.

6. The first computing device of claim 1, wherein when the first location is closer to the first computing device than the second location, generating the first sound field during media content playback comprises playing media content at a first volume, and generating the second sound field during media content playback comprises playing media content at a second volume higher than the first volume.

7. The first computing device of claim 6, wherein when the second location is closer to the second computing device than the first location, the functions further comprise:

responsive to determining the first location, facilitating the second computing device to play media content at a third volume; and

subsequently, responsive to determining the second location, facilitating the second computing device to play media content at a fourth volume lower than the third volume.

8. The first computing device of claim 1, wherein when the first location is at a distance closer to the first computing device than the second location, generating the first sound field during media content playback comprises playing media content at a first volume, and generating the second sound field during media content playback comprises playing media content at a second volume lower than the first volume.

9. The first computing device of claim 8, wherein when the second location is closer to the second computing device than the first location, the functions further comprise:

responsive to determining the first location, facilitating the second computing device to play media content at a third volume; and

subsequently, responsive to determining the second location, facilitating the second computing device to play media content at a fourth volume higher than the third volume.

10. A tangible non-transitory computer-readable medium having stored therein instructions executable by one or more processors to cause a first computing device to perform operations comprising:

receiving (i) first location data from one or more sensors, the first location data associated with the first computing device, and (ii) second location data from a second computing device, the second location data associated with the second computing device;

based on the first location data and the second location data, determining a first location of a listener relative to the first computing device;

based on the determined first location, generating a first sound field during media content playback;

while generating the first sound field during media content playback and at a predetermined duration of time after receiving the first location data and the second location data, receiving (i) third location data from the one or more sensors, the third location data associated with the first computing device, and (ii) fourth location data from the second computing device, the fourth location data associated with the second computing device;

based on the third location data and the fourth location data, determining a second location of the listener relative to the first computing device, the second location different from the first location; and

based on the second determined location, generating a second sound field during media content playback.

11. The tangible, non-transitory computer-readable medium of claim 10, wherein the operations further comprise:

prior to receiving the first location data and the second location data, (i) transmitting to the one or more sensors, a request for the first location data, and (ii) transmitting to the second computing device, a request for the second location data; and

at a predetermined duration of time after transmitting the requests for the first location data and the second location data, and prior to receiving the third location data and the fourth location data, (i) transmitting to the one or more sensors, a request for the third location data, and (ii) transmitting to the second computing device, a request for the fourth location data.

12. The tangible, non-transitory computer-readable medium of claim 10, wherein the operations further comprise:

prior to receiving the third location data and the fourth location data, receiving from one or more of (a) the one or more sensors and (b) the second computing device, movement data indicating movement of the listener; and

responsive to receiving the movement data, (i) transmitting to the one or more sensors, a request for the third location data, and (ii) transmitting to the second computing device, a request for the fourth location data.

13. The tangible, non-transitory computer-readable medium of claim 10, wherein the operations further comprise:

prior to receiving the first location data and the second location data, receiving a command to play media content; and

responsive to receiving the command to play media content, (i) transmitting to the one or more sensors, a request for the third location data, and (ii) transmitting to the second computing device, a request for the fourth location data.

14. The tangible, non-transitory computer-readable medium of claim 10, wherein the first location is closer to the first computing device than the second location, wherein generating the first sound field during media content playback comprises playing media content at a first volume, and wherein generating the second sound field during media content playback comprises playing media content at a second volume higher than the first volume.

15. The tangible, non-transitory computer-readable medium of claim 14, wherein the second location is closer to the second computing device than the first location, and wherein the operations further comprise:

responsive to determining the first location, facilitating the second computing device to play media content at a third volume; and

subsequently, responsive to determining the second location, facilitating the second computing device to play media content at a fourth volume lower than the third volume.

16. The tangible, non-transitory computer-readable medium of claim 10, wherein the first location is at a distance closer to the first computing device than the second location, wherein generating the first sound field during media content playback comprises playing media content at a first volume, and wherein generating the second sound field during media content playback comprises playing media content at a second volume lower than the first volume.

17. The tangible, non-transitory computer-readable medium of claim 16, wherein the second location is closer to the second computing device than the first location, and wherein the operations further comprise:

responsive to determining the first location, facilitating the second computing device to play media content at a third volume; and

subsequently, responsive to determining the second location, facilitating the second computing device to play media content at a fourth volume higher than the third volume.

18. A method comprising:

receiving, by a first computing device, (i) first location data from one or more sensors, the first location data associated with the first computing device, and (ii) second location data from a second computing device, the second location data associated with the second computing device;

based on the first location data and the second location data, determining a first location of a listener relative to the first computing device;

based on the determined first location, generating a first sound field during media content playback;

while generating the first sound field during media content playback and at a predetermined duration of time after receiving the first location data and the second location data, receiving (i) third location data from the one or more sensors, the third location data associated with the first computing device, and (ii) fourth location data from the second computing device, the fourth location data associated with the second computing device;

based on the third location data and the fourth location data, determining a second location of the listener relative to the first computing device, the second location different from the first location; and

based on the second determined location, generating a second sound field during media content playback.