SYSTEMS AND METHODS FOR LOCALIZING AUDIO STREAMS VIA ACOUSTIC LARGE SCALE SPEAKER ARRAYS

• US 20160302009A1
• Filed: 06/21/2016
• Published: 10/13/2016
• Est. Priority Date: 09/30/2014
• Status: Abandoned Application

• Current Assignee: WSOU Investments, LLC (WSOU Holdings, LLC)
• Original Assignee: Alcatel-Lucent SA (Nokia Corporation)
• Inventors: Saniee, Iraj, Marzetta, Thomas
• Application Number:
  US15/188,046
• Publication Number:
  US 20160302009A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G10L 19/167 Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes
• CPC Class Codes: H04R 1/403 loud-speakers
• CPC Class Codes: H04R 2201/403 Linear arrays of transducers
• CPC Class Codes: H04R 2400/01 Transducers used as a loudspeaker to generate sound aswell as a microphone to detect sound
• CPC Class Codes: H04R 2430/01 Aspects of volume control, not necessarily automatic, in sound systems
• CPC Class Codes: H04R 3/12 for distributing signals to two or more loudspeakers specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation

Abstract

System comprising a processing unit configured to compute transmit signals and an array of speakers in wired or wireless communication with the processing unit, each of the speakers of the array at different locations in a common setting. The speakers, upon receiving the transmit signals, simultaneously transmit both a first audio and a different second audio stream into the setting from the speakers. The first stream from the speakers aggregate in the vicinity of a first location in the setting to form an aggregated first stream that is audible to human hearing. The second stream transmitted from the speakers do not aggregate at the first location. The second stream from the speakers aggregate in the vicinity of a different second location in the setting to form an aggregated second stream that is audible to human hearing. The first stream transmitted from the speakers do not aggregate at the second location.

Claims

1. A system, comprising:

a processing unit configured to compute transmit signals; and

an array of speakers in wired or wireless communication with the processing unit, each of the speakers of the array installed at different locations in a common setting, wherein;

each of the speakers of the array, upon receiving the transmit signals, simultaneously transmit both a first audio stream and a different second audio stream into the setting from the speakers;

the first audio stream transmitted from the speakers aggregate in the vicinity of a first location in the setting to form an aggregated first audio stream that is audible to human hearing, and, the second audio stream transmitted from the speakers do not aggregate at the first location; and

the second audio stream transmitted from the speakers aggregate in the vicinity of a different second location in the setting to form an aggregated second audio stream that is audible to human hearing, and, the first audio stream transmitted from the speakers do not aggregate at the second location.

2. The system of claim 1, wherein each of the speakers further include a receiver to receive pilot audio signals transmitted from the first location and the second location.

3. The system of claim 1, wherein the processing unit computes the transmit signals upon receiving an audio stream request from the first location or the second location.

4. The system of claim 3, wherein the audio stream request is a wireless signal from the first location or the second location.

5. The system of claim 3, wherein the audio stream request is an optical signal from the first location or the second location.

6. The system of claim 1, wherein the first location and the second location each include separate electronic devices, the electronic devices each having a receiver to receive a training interval instruction from the processor, and, a transmitter to transmit a pilot audio signal upon receipt of the training interval instruction.

7. The system of claim 6, wherein the training interval instruction causes the transmitter of each of the electronic devices to simultaneously transmit the pilot audio signals.

8. The system of claim 6, wherein the simultaneously transmitted pilot audio signals are acoustic training signals that are mutually orthogonal over intervals of frequency such that acoustic channel frequency responses from the electronic devices are approximately constant.

9. The system of claim 6, wherein the electronic devices are mobile electronic devices and the first and second locations are non-fixed locations.

10. The system of claim 6, wherein the electronic devices are fixedly positioned and the first and second locations are fixed locations.

11. The system of claim 1, wherein the common setting is a shopping mall and the first and second locations correspond to different item-for-sale displays in the shopping mall.

12. The system of claim 1, wherein the common setting includes a first video screen presenting a first video broadcast associated with the first audio stream and second video screen presenting a second different video broadcast associated with the second audio stream.

13. The system of claim 1, wherein computation of the transmit signals includes:

computing, in the processing unit, audio channel state information based upon pilot audio signals transmitted from the first and second locations, received by each of the speakers and transmitted to the processing unit,

computing in the processing unit, a pre-code matrix based on the audio channel state information,

multiplying in the processing unit, an available first audio stream by the pre-code matrix to generate the first audio stream, and

multiplying in the processing unit, an available second audio stream by the pre-code matrix to generate the second audio stream.

14. The system of claim 13, wherein computing the audio channel state information includes computing an acoustic channel impulse response matrix between each of the speakers and at least one of the first location or the second location.

15. The system of claim 13, wherein the pre-code matrix is of either a conjugate beamforming type or a zero-forcing beamforming type.

16. The system of claim 1, wherein each one of the speakers includes separate ones of the processing units, each of the separate processing units configured to compute the transmit signals and then communicate the transmit signals to the respective speaker of the audio unit.

17. A method, comprising:

forming a plurality of localized audible audio streams, including;

computing, in a processing unit, transmit signals;

communicating the transmit signals from the processing unit to an array of speakers in wired or wireless communication with the processing unit, each of the speakers of the array installed at different locations in a common setting, wherein;

each of the speakers of the array, upon receiving the transmit signals, simultaneously transmit both a first audio stream and a different second audio stream into the setting from the speakers;

the first audio stream transmitted from the speakers aggregate in the vicinity of a first location in the setting to form an aggregated first audio stream that is audible to human hearing, and, the second audio stream transmitted from the speakers do not aggregate at the first location; and

the second audio stream transmitted from the speakers aggregate in the vicinity of a different second location in the setting to form an aggregated second audio stream that is audible to human hearing, and, the first audio stream transmitted from the speakers do not aggregate at the second location.

18. The method of claim 17, wherein computation of the transmit signals includes:

computing, in the processing unit, audio channel state information based upon pilot audio signals transmitted from the first and second locations, received by each of the speakers and transmitted to the processing unit,

computing in the processing unit, a pre-code gain matrix based on the audio channel state information,

multiplying in the processing unit, an available first audio stream by the pre-code matrix to generate the first audio stream, and

multiplying in the processing unit, an available second audio stream by the pre-code matrix to generate the second audio stream.

19. The method of claim 18, wherein computing the audio channel state information includes computing an acoustic channel impulse response matrix between each of the speakers and at least one of the first location or the second location.

20. The method of claim 18, wherein the pre-code matrix is of either a conjugate beamforming type or a zero-forcing beamforming type.