Method and system for processing directed sound in an acoustic virtual environment

• US 7,369,668 B1
• Filed: 03/22/1999
• Issued: 05/06/2008
• Est. Priority Date: 03/23/1998
• Status: Expired due to Fees

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Corporation
• Inventors: Väänänen, Riitta, Huopaniemi, Jyri
• Primary Examiner(s): Mei; Xu
• Application Number:
  US09/273,436
• Time in Patent Office: 3,333 Days
• Field of Search: 381/17, 381/18, 381/19, 381/22, 381/23, 381/310, 381/61, 381/309
• US Class Current: 381/310
• CPC Class Codes: G10K 15/02 Synthesis of acoustic waves synthesis of speech G10L13/00

Abstract

An acoustic virtual environment is processed in an electronic device. The acoustic virtual environment comprises at least one sound source (300). In order to model the manner in which the sound is directed, a direction dependent filtering arrangement (306, 307, 308, 309) is attached to the sound source, whereby the effect of the filtering arrangement on the sound depends on predetermined parameters. The directivity can depend on the frequency of the sound.

Claims

1. A method for processing directed sound in an acoustic virtual environment in an electronic device, said acoustic virtual environment comprising at least one sound source, the method comprising:

attaching a reference direction and a set of selected directions to the at least one sound source, each selected direction differing from said reference direction,

establishing a direction dependent filtering arrangement having at least one parameter disposed to at least partly determine a filtering effect of the direction dependent filtering arrangement, said at least one parameter enabling the direction dependent filtering arrangement to model that said at least one sound source radiates a different sound to said reference direction than to a direction that deviates from said reference direction,

for each selected direction defining at least one value for each of said at least one parameter, and

filtering, with the direction dependent filtering arrangement, a signal that represents sound propagating from said at least one sound source in said reference direction in order to produce a signal that represents sound propagating from said at least one sound source in said direction that deviates from said reference direction.

2. A method according to claim 1, wherein the establishing the direction dependent filtering arrangement comprises associating a filter with each selected direction so that a filtering effect of a filter relating to each selected direction depends on the at least one value of said at least one parameter relating to the selected direction in question.

3. A method according to claim 1, wherein the at least one value of said at least one parameter relating to a certain selected direction determines an amplification factor that is disposed to determine amplification of the signal representing the sound emitted by said at least one sound source when listened to from a direction corresponding with the selected direction in question.

4. A method according to claim 1, wherein the at least one value of said at least one parameter relating to a certain selected direction determine separate amplification factors that are disposed to determine amplifications for different frequencies of the signal representing the sound emitted by said at least one sound source when listened from a direction corresponding with the selected direction in question.

5. A method according to claim 1, wherein the values of said at least one parameter relating to a certain selected direction are the coefficients [b₀ b₁ a₁ b₂ a₂] of the quotient expression

$H$

( z ) = Y ⁡

( z ) X ⁡

( z ) = ∑

k = 0 M ⁢

b k ⁢

z - k 1 + ∑

k = 1 N ⁢

a k ⁢

z - k

that is disposed to determine a Z-transform of a transfer function of the direction dependent filtering arrangement, X representing the z-transform of the signal representing the sound emitted by said at least one sound source, Y representing the Z-transform of a signal representing the sound listened from a direction corresponding with the selected direction in question, M and N being upper limits for defining accuracy at which it is desired to define the transfer function, z representing a Z-transform variable, and k being a summation index.

6. A method according to claim 2, comprising interpolation between said filters in order to model how the sound emitted by said at least one sound source sounds when listened to from a direction that differs from the reference direction and each selected direction.

7. A method according to claim 1, comprising:

generating in a transmitting device said acoustic virtual environment comprising said at least one sound source,

performing in the transmitting device, defining the reference direction and the set of selected directions, establishing the direction dependent filtering arrangement having said at least one parameter, and the defining said at least one value of said at least one parameter for each selected direction,

transmitting from said transmitting device to a receiving device information about the direction dependent filtering arrangement,

receiving in the receiving device said information about the direction dependent filtering arrangement,

reconstructing in the receiving device the direction dependent filtering arrangement on the basis of said information, and

performing in the receiving device, filtering the signal representing the sound emitted by the at least one sound source with the direction dependent filtering arrangement.

8. A method according to claim 7, wherein the transmitting device transmits to the receiving device information about the direction dependent filtering arrangement as a part of a data stream according to the MPEG-4 standard.

9. A method according to claim 1, wherein at least one sound source is a real sound source.

10. A method according to claim 1, wherein at least one sound source is a reflection.

11. A system for processing directed sound in an acoustic virtual environment in an electronic device, said acoustic virtual environment comprising at least one sound source, the system comprising:

means for attaching a reference direction and a set selected directions to the at least one sound source, each selected direction differing from said reference direction,

a direction dependent filtering arrangement disposed to filter a signal that represents sound propagating from said at least one sound source in said reference direction in order to produce a signal that represents sound propagating from said at least one sound source in a direction that deviates from said reference direction, the direction dependent filtering arrangement having at least one parameter disposed to at least partly determine a filtering effect of the direction dependent filtering arrangement, said at least one parameter enabling the direction dependent filtering arrangement to model that said at least one sound source radiates a different sound to said reference direction than to said direction that deviates from said reference direction, and

means for associating a value for each of said at least one parameter with each selected direction.

12. A system according to claim 11, comprising a transmitting device and a receiving device and means for realizing an electrical communication between the transmitting device and the receiving device.

13. A system according to claim 12, comprising multiplexing means in the transmitting device for adding data describing the direction dependent filtering arrangement to a data stream according to the MPEG-4 standard, and de-multiplexing means in the receiving device for extracting said data describing the direction dependent filtering arrangement from the data stream according to the MPEG-4 standard.

14. A system according to claim 12, comprising multiplexing means in the transmitting device for adding data describing the direction dependent filtering arrangement to a data stream according to the extended VRML97 standard, and de-multiplexing means in the receiving device for extracting said data describing the direction dependent filtering arrangement from the data stream according to the extended VRML97 standard.

15. An electronic device for processing directed sound of an acoustic virtual environment, the acoustic virtual environment comprising at least one sound source, the electronic device comprising:

circuitry that attaches a reference direction and a set of selected directions to the at least one sound source, each selected direction differing from the reference direction,

a direction dependent filtering arrangement that filters a signal that represents sound propagating from the at least one sound source in the reference direction in order to produce a signal that represents sound propagating from the at least one sound source in a direction that deviates from the reference direction, the direction dependent filtering arrangement having at least one parameter that at least partly determines a filtering effect of the direction dependent filtering arrangement, the at least one parameter enabling the direction dependent filtering arrangement to model that the at least one sound source radiates a different sound to the reference direction than to the direction that deviates from the reference direction, and

circuitry that associates a value for each of said at least one parameter with each selected direction.

16. A system for processing directed sound in an acoustic virtual environment in an electronic device, the acoustic virtual environment comprising at least one sound source, the system comprising:

circuitry that attaches a reference direction and a set of selected directions to the at least one sound source, each selected direction differing from the reference direction,

a direction dependent filtering arrangement that filters a signal that represents sound propagating from the at least one sound source in the reference direction in order to produce a signal that represents sound propagating from the at least one sound source in a direction that deviates from the reference direction, the direction dependent filtering arrangement having at least one parameter disposed to at least partly determine a filtering effect of the direction dependent filtering arrangement, the at least one parameter enabling the direction dependent filtering arrangement to model that the at least one sound source radiates a different sound to the reference direction than to the direction that deviates from the reference direction, and

circuitry that associates a value for each of the at least one parameter with each selected direction.