Device discovery and constellation selection

• US 9,277,321 B2
• Filed: 12/17/2012
• Issued: 03/01/2016
• Est. Priority Date: 12/17/2012
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Toivanen, Timo J., Saari, Jarmo I., Leppanen, Kari J.
• Primary Examiner(s): CHIN, VIVIAN C
• Assistant Examiner(s): Odunukwe, Ubachukwu
• Application Number:
  US13/716,660
• Publication Number:
  US 20140169569A1
• Time in Patent Office: 1,170 Days
• Field of Search: 381/1, 381/17, 381/93, 381/18, 381/310, 381/111, 381/121, 381/92, 381/77, 381/66, 381/71.11, 381/11, 381/2, 381/303, 381/58, 381/59, 381/56, 381/300, 381/61, 700/94, 708/322, 379/406.01, 379/406.08, 379/406.03, 379/32.01, 379/388.02, 379/392.01, 379/406.05, 704/201, 704/E21.002, 455/567, 455/575.1, 455/596.1, 455/450, 455/41.2
• US Class Current: 1/1
• CPC Class Codes: H04R 5/04 Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments combinations of amplifiers H03F3/68; stereophonic systems H04S
• CPC Class Codes: H04S 7/30 Control circuits for electronic adaptation of the sound field

Abstract

There is described discovery of a plurality of audio devices, and for the discovered audio devices are determined relative positions thereof and distances therebetween. The determined relative positions and distances are used to select a constellation of audio devices from the discovered plurality. This constellation is selected for playing or recording of a multi-channel audio file so as to present an audio effect such as a spatial audio effect. Channels for the multi-channel audio file are allocated to different audio devices of the selected constellation, which are controlled to synchronously play back or record their respectively allocated channel or channels of the multi-channel audio file. In a specific embodiment the determined distances are used to automatically select the constellation and include distance between each pair of audio devices of the plurality. Several embodiments are presented for determining the distances and relative positions.

Claims

1. A method comprising:

discovering a plurality of audio devices, including determining relative positions among respective audio devices of the plurality of audio devices and distances between the respective audio devices for each pair of the plurality;

using the determined relative positions and distances of the respective audio devices to select a constellation of audio devices from the discovered plurality for playing or recording of a multi-channel audio file so as to present an audio effect dependent on the determined relative positions and distances of the respective audio devices, wherein the determined distances are used to automatically select the constellation;

allocating channels for the multi-channel audio file to different audio devices of the selected constellation; and

controlling the audio devices of the selected constellation to synchronously play back or record their respectively allocated channel or channels of the multi-channel audio file.

2. The method according to claim 1, wherein the determined relative positions and distances are used to automatically select the constellation of audio devices from the discovered plurality which best fits an idealized spatial arrangement for playing or recording of the multi-channel audio file.

3. The method according to claim 1, wherein the plurality of audio devices are automatically discovered as part of a periodic or continuous dynamic search for discoverable audio devices.

4. The method according to claim 1, wherein the multi-channel audio file comprises a multi-channel audio-video file;

and further wherein;

the constellation of audio devices is selected from the discovered plurality for group recording of the multi-channel audio-video file;

the allocating comprises allocating audio channels and video channels of the multi-channel audio-video file to the different audio devices of the selected constellation; and

the audio devices of the selected constellation are controlled to synchronously record their respectively allocated audio and video channel or channels.

5. The method according to claim 1, wherein controlling the audio devices comprises at least one of transmitting a synchronization signal for the synchronous play back or recording;

and sending an indication of where to find a synchronization signal to use for the synchronous play back or recording.

6. The method according to claim 1, wherein discovering the plurality of audio devices comprises, for at least the distances between at least some of the audio devices, using wireless polling messages to determine power loss between transmit and received power, and computing the distance therebetween from the determined power loss.

7. The method according to claim 6, wherein the distance computed from the determined power loss is used to determine the relative positions between the said at least some of the audio devices.

8. The method according to claim 1, wherein discovering the plurality of audio devices, including at least some of the relative positions thereof and at least some of the distances therebetween, comprises using image recognition to identify at least some of the audio devices from a captured visual image.

9. The method according to claim 1, wherein discovering the plurality of audio devices, including at least some of the relative positions thereof and at least some of the distances therebetween, comprises receiving at a microphone audio calibration sequences from loudspeakers of at least some of the plurality of audio devices and computing distance and direction from differences in the received audio calibration sequences.

10. The method according to claim 9, wherein the audio calibration sequences are received at multiple microphones and the said at least some of the relative positions are determined by beamforming among the multiple microphones.

11. An apparatus comprising:

at least one processor; and

a memory storing a program of computer instructions;

in which the processor is configured with the memory and the program to cause the apparatus to;

discover a plurality of audio devices, including determine relative positions among respective audio devices of the plurality of audio devices and distances between the respective audio devices for each pair of the plurality;

use the determined relative positions and distances of the respective audio devices to select a constellation of audio devices from the discovered plurality for playing or recording of a multi-channel audio file so as to present an audio effect dependent on the determined relative positions and distances of the respective audio devices, wherein the determined distances are used to automatically select the constellation;

allocate channels for the multi-channel audio file to different audio devices of the selected constellation; and

control the audio devices of the selected constellation to synchronously play back or record their respectively allocated channel or channels of the multi-channel audio file.

12. The apparatus according to claim 11, wherein:

the multi-channel audio file comprises a multi-channel audio-video file;

the constellation of audio devices is selected from the discovered plurality for group recording of the multi-channel audio-video file;

allocating the channels comprises allocating audio channels and video channels of the multi-channel audio-video file to the different audio devices of the selected constellation; and

the audio devices of the selected constellation are controlled to synchronously record their respectively allocated audio and video channel or channels.

13. The apparatus according to claim 11, wherein the processor is configured with the memory and the program to cause an apparatus to discover the plurality of audio devices by, for at least the distances between at least some of the audio devices, using wireless polling messages to determine power loss between transmit and received power, and computing the distance therebetween from the determined power loss.

14. The apparatus according to claim 13, wherein the distance computed from the determined power loss is used to determine the relative positions between the said at least some of the audio devices.

15. The apparatus according to claim 11, wherein the processor is configured with the memory and the program to cause an apparatus to discover the plurality of audio devices, including at least some of the relative positions thereof and at least some of the distances therebetween, by using image recognition to identify at least some of the audio devices from a captured visual image.

16. The apparatus according to claim 11, wherein the processor is configured with the memory and the program to cause an apparatus to discover the plurality of audio devices, including at least some of the relative positions thereof and at least some of the distances therebetween, by receiving at a microphone of the apparatus audio calibration sequences from at least one loudspeaker of at least some of the plurality of audio devices and computing distance and direction from differences in the received audio calibration sequences.

17. A non-transitory computer readable memory storing a program of computer readable instructions which are executable by at least one processor, the program of computer readable instructions comprising:

code for discovering a plurality of audio devices, including determining relative positions among respective audio devices of the plurality of audio devices and distances between the respective audio devices for each pair of the plurality;

code for using the determined relative positions and distances of the respective audio devices to select a constellation of audio devices from the discovered plurality for playing or recording of a multi-channel audio file so as to present an audio effect dependent on the determined relative positions and distances of the respective audio devices, wherein the determined distances are used to automatically select the constellation;

code for allocating channels for the multi-channel audio file to different audio devices of the selected constellation; and

code for controlling the audio devices of the selected constellation to synchronously play back or record their respectively allocated channel or channels of the multi-channel audio file.

18. The memory according to claim 17, wherein the code for discovering the plurality of audio devices comprises, for at least the distances between at least some of the audio devices, code for using wireless polling messages to determine power loss between transmit and received power, and code for computing the distance therebetween from the determined power loss.