SYSTEM AND METHOD FOR PROVIDING SIMULATED SPATIAL SOUND IN GROUP VOICE COMMUNICATION SESSIONS ON A WIRELESS COMMUNICATION DEVICE

• US 20080187143A1
• Filed: 02/01/2007
• Published: 08/07/2008
• Est. Priority Date: 02/01/2007
• Status: Abandoned Application

• Current Assignee: Blackberry Limited
• Original Assignee: Research In Motion Limited (Blackberry Limited)
• Inventors: Mak-Fan, David
• Application Number:
  US11/670,033
• Publication Number:
  US 20080187143A1
• Time in Patent Office: Days
• US Class Current: 381/17
• CPC Class Codes: H04M 2207/18 wireless networks
• CPC Class Codes: H04M 3/56 Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities video conference systems H04N7/15
• CPC Class Codes: H04M 3/568 audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30
• CPC Class Codes: H04R 2227/003 Digital PA systems using, e.g. LAN or internet
• CPC Class Codes: H04R 2420/07 Applications of wireless loudspeakers or wireless microphones
• CPC Class Codes: H04R 27/00 Public address systems circuits for preventing acoustic reaction H04R3/02; circuits for distributing signals to loudspeakers H04R3/12; monitoring or testing arrangements for public address systems H04R29/007; amplifiers H03F
• CPC Class Codes: H04R 5/027 Spatial or constructional arrangements of microphones, e.g. in dummy heads
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 7/304 For headphones

Abstract

A system and method for providing simulated spatial sound in group voice communication sessions on a wireless communication device is provided. The wireless communication device is one of two or more in the system which are operatively connected to a wireless communications network. The wireless communication device comprises: a processor for controlling the operation of the wireless communication device; a communications subsystem operatively connected to the processor for communicating with the wireless communications network; a memory operatively connected to the processor; an audio input device operatively connected to the processor; a stereo audio output device operatively connected to the processor; a control module stored in the memory for execution by the processor to perform spatial sound simulation, the control module configuring the wireless communication device to: receive an audio input from a user of the wireless communication device; generate audio data packets from the audio input received from the user and transmit the audio data packets over the wireless communications network; receive spatial audio data packets; and reproduce the spatial audio data contained in the spatial audio data packets using the stereo audio output device.

Claims

1. A system for providing simulated spatial sound on a wireless communication device, the wireless communication device being one of two or more wireless communication devices operatively connected to a wireless communications network and engaged in a group voice communication session, the wireless communication device comprising:

a processor for controlling the operation of the wireless communication device;

a communications subsystem operatively connected to the processor for communicating with the wireless communications network;

a memory operatively connected to the processor;

an audio input device operatively connected to the processor;

a stereo audio output device operatively connected to the processor;

a control module stored in the memory for execution by the processor to facilitate spatial sound simulation, the control module configuring the wireless communication device to;

receive an audio input from a user of the wireless communication device;

generate audio data packets from the audio input received from the user and transmit the audio data packets over the wireless communications network;

receive spatial audio data packets; and

reproduce the spatial audio data contained in the spatial audio data packets using the stereo audio output device.

2. The system of claim 1, wherein the spatial audio data is simulated binaural or transaural audio data generated from audio data packets from one or more of the other wireless communications devices engaged in the group voice communication session by applying at least one spatial sound simulating algorithm to the audio data contained in the audio data packets using a virtual spatial position associated with the respective wireless communications devices.

3. The system of claim 2, wherein the at least one spatial sound simulating algorithm comprises a pair of Head-Related Transfer Functions (HRTFs).

4. The system of claim 3, wherein the spatial audio data is simulated binaural audio data.

5. The system of claim 1, wherein the control module of the wireless communication device configures the wireless communication device to receive a spatial audio data stream from the wireless communications network, the spatial audio data steam comprising a stream of spatial audio data packets.

6. The system of claim 5, wherein the spatial audio data packets are receive from a group communication control module of the wireless communications network.

7. The system of claim 1, wherein the audio data packets comprise digital monaural audio data.

8. The system of claim 1, wherein the audio data packets comprise at least an audio source identifier (ID) for identifying the respective audio data packet and an audio payload comprising source audio data.

9. The system of claim 8, wherein each audio data packet further comprises audio parameters including information for use in spatial sound simulation.

10. The system of claim 9, wherein the audio parameters include configuration information about the spatial positions associated with the respective wireless communications devices.

11. The system of claim 8, wherein the audio source ID of each audio data packet is associated with the spatial position of the respective wireless communications devices engaged in the group voice communication session.

12. The system of claim 1, wherein the group voice communication session is a conference call or group chat using push-to-talk (PTT) over cellular.

13. The system of claim 1, wherein the stereo audio output device is one or more of stereo speakers integrated in the wireless communication device, external stereo speakers connected to an output port of the wireless communication device, and stereo headphones connected to an output port of the wireless communication device.

14. The system of claim 1, wherein the audio input device is a microphone integrated in the wireless communication device or an external microphone coupled to an input port of the wireless communication device.

15. The system according to claim 1, wherein the wireless communications network further comprises:

a wireless network system for communicating with the wireless communication device through a wireless session using the communications subsystem of the wireless communication device;

a wireless network gateway module connected to the wireless network system for interfacing between a wireless portion of the wireless communications network and a wired portion of the wireless communications network; and

a network provider system connected to the wireless network gateway and to at least one further network, the network provider system having a processor and a memory connected to the processor, the network provider system for facilitating communications with the wireless communication device,

the network provider system running a central control module resident in the memory for execution by the processor, the central control module for facilitating the simulated spatial sound on the wireless communication device.

16. A method for providing simulated spatial sound on a wireless communication device, the wireless communication device being one of two or more wireless communication devices operatively connected to a wireless communications network and engaged in a group voice communication session, the method comprising the steps of:

determining a number of participants in the group voice communication session;

for each of the participants, determining a virtual spatial position for each of the other participants in the group voice communication session;

for each of the participants, generating simulated spatial audio data from source audio data of the other participants in the group voice communication session and the virtual spatial position determined for the respective participant using a spatial sound simulating algorithm; and

reproducing the simulated spatial audio data using a stereo audio output device of the wireless communication device.

17. The method of claim 16, wherein the spatial audio data is simulated binaural or transaural audio data generated from audio data from one or more of the other participants in the group voice communication session, the generating comprising applying at least one spatial sound simulating algorithm to the audio data using the virtual spatial position determined for the respective participant.

18. The method of claim 17, wherein the at least one spatial sound simulating algorithm comprises a pair of Head-Related Transform Functions (HRTFs).

19. The method of claim 18, wherein the spatial audio data is simulated binaural audio data.

20. The method of claim 16, further comprising the steps of:

determining if the number of participants has changed; and

if the number of participants in the conference call has changed, adjusting the virtual spatial positions for each of the other participants in the group voice communication session.

21. The method of claim 16, further comprising the steps of:

sending the simulated spatial audio data from a group communication control module in the wireless communications network to the wireless communication device; and

receiving the simulated spatial audio data on the wireless communication device.

22. The method of claim 16, wherein if there are three or more participants in the group voice communication session, the virtual spatial positions determined for at least some of the other participants in the group voice communication session are the same for at least some of the participants, thereby allowing the reuse of previously generated simulated spatial audio data.

23. The method of claim 16, wherein the virtual spatial positions are based on a two-dimensional (2D) or three-dimensional (3D) coordinate system.

24. The method of claim 23, wherein the virtual spatial positions are based on a 3D coordinate system.

25. The system of claim 16, wherein the group voice communication session is a conference call or group chat using push-to-talk (PTT) over cellular.

26. A system for providing simulated spatial sound on a wireless communication device, the wireless communication device being one of two or more wireless communication devices engaged in a group voice communication session, the wireless communication device comprising:

a microprocessor for controlling the operation of the wireless communication device;

an audio input device coupled to the microprocessor for accepting an input from a user of the wireless communication device;

a stereo audio output device coupled to the microprocessor for communicating an output to the user;

a communications subsystem coupled to the microprocessor for communicating with the other wireless communication devices engaged in the group voice communication;

a memory coupled to the microprocessor; and

a control module stored in the memory for execution by the processor to facilitate spatial sound simulation, the control module configuring the wireless communication device to;

receive an audio input from a user of the wireless communication device;

generate audio data packets from the audio input received from the user and transmit the audio data packets to the other wireless communication devices engaged in the group voice communication system;

receive spatial audio data packets; and

reproduce the spatial audio data contained in the spatial audio data packets using the stereo audio output device.

27. The method of claim 26, wherein the spatial audio data is simulated binaural or transaural audio data generated from audio data packets from one or more of the other wireless communications devices engaged in the group voice communication session by applying at least one spatial sound simulating algorithm to the audio data contained in the audio data packets using a virtual spatial position associated with the respective wireless communications devices.

28. The system of claim 27, wherein the at least one spatial sound simulating algorithm comprises a pair of Head-Related Transfer Functions (HRTFs).

29. The system of claim 28, wherein the spatial audio data is simulated binaural audio data.

30. A method for providing simulated spatial sound on a wireless communication device, the wireless communication device being one of two or more wireless communication devices engaged in a group voice communication session, the method comprising the steps of:

determining a number of participants in the group voice communication session;

for each of the participants, determining a virtual spatial position for each of the other participants in the group voice communication session;

for each of the participants, generating simulated spatial audio data from source audio data of the other participants in the group voice communication session and the virtual spatial position determined for the respective participant using a spatial sound simulating algorithm; and

reproducing the simulated spatial audio data using a stereo audio output device of the wireless communication device.

31. The method of claim 30, wherein the spatial audio data is simulated binaural or transaural audio data generated from audio data from one or more of the other participants in the group voice communication session, the generating comprising applying at least one spatial sound simulating algorithm to the audio data using the virtual spatial position determined for the respective participant.

32. The method of claim 31, wherein the at least one spatial sound simulating algorithm comprises a pair of Head-Related Transform Functions (HRTFs).

33. The method of claim 32, wherein the spatial audio data is simulated binaural audio data.