Sound localization system based on analysis of the sound field

• US 7,492,908 B2
• Filed: 05/02/2003
• Issued: 02/17/2009
• Est. Priority Date: 05/03/2002
• Status: Active Grant

• Current Assignee: Harman International Industries Incorporated (Samsung Electronics Co. Ltd.)
• Original Assignee: Harman International Industries Incorporated (Samsung Electronics Co. Ltd.)
• Inventors: Griesinger, David H.
• Primary Examiner(s): Chin; Vivian
• Assistant Examiner(s): SUTHERS, DOUGLAS JOHN
• Application Number:
  US10/428,366
• Publication Number:
  US 20040022392A1
• Time in Patent Office: 2,118 Days
• Field of Search: 381/56, 381/58, 381/92, 381/91, 381/111, 381/112, 381/122, 381 17- 23
• US Class Current: 381/56
• CPC Class Codes: G01S 3/8083 determining direction of source
• CPC Class Codes: G01V 1/001 Acoustic presence detection

Abstract

The beginning detection, accommodation and frequency bias properties of the human hearing mechanism have been modeled to create systems that can detect directional transients (“sound events”) in a sound field and localize them. These systems break down a sound field into sound events and non-sound events and separately localize the sound events and non-sound events. Sound events are generally identified according to the frequency bias and beginning detection properties. Once detected, the sound events are generally localized according to differential steering angles (steering angles to which the steady-state signals have been accommodated) or ordinary steering angles, both of which reflect the direction of a sound event indicated during the rise-time of the sound event. When no sound events are detected, non-sound events are localized according to a steering angle that does not reflect rapid motion.

Claims

1. A method for localizing a sound in multiple audio channels, comprising:

analyzing power in multiple audio channels to determine a power angle of the power of the sound in the multiple audio channels;

determining whether to select a steering angle or the power angle to localize the sound; and

localizing the sound based on the determination whether to select the steering angle or the power angle to localize the sound.

2. The method of claim 1, further comprising detecting a sound event.

3. The method of claim 2, where, when the sound event is detected, localizing the sound comprises localizing the sound according to the power angle of the power of the sound.

4. The method of claim 3, where localizing the sound according to the power angle of the power of the sound comprises isolating the power angle of the power of the sound indicated during a predetermined rise time.

5. The method of claim 4, where the sound event comprises a sound event type and the predetermined rise time is that of the sound event type.

6. The method of claim 4, where the power angle of the power of the sound indicated during the predetermined rise time is used for a predetermined duration.

7. The method of claim 6, where the sound event comprises a sound event type and the predetermined duration is that of the sound event type.

8. The method of claim 2, where determining whether to select the steering angle or the power angle to localize the sound comprises determining whether the sound event is detected;

and

where, when it is determined that the sound event is not detected, localizing the sound comprises localizing the sound according to the steering angle of the sound.

9. The method of claim 8, where determining whether to select the steering angle or the power angle to localize the sound comprises determining whether a predetermined duration of a preceding sound event has just ended.

10. The method of claim 9, where the preceding sound event comprises a sound event type and the predetermined duration is that of the sound event type.

11. The method of claim 9, where determining whether to select the steering angle or the power angle to localize the sound comprises determining whether the preceding sound event has ended if the predetermined duration of the preceding sound event has just ended.

12. The method of claim 11, where localizing the sound further comprises immediately localizing the sound according to the power angle of the sound if the preceding sound event has just ended.

13. The method of claim 11, where localizing the sound further comprises decaying to the steering angle of the sound if the preceding sound event has not just ended.

14. The method of claim 9, where determining whether to select the steering angle or the power angle to localize the sound comprises determining if the predetermined duration of the preceding sound event has just ended;

and

where, if the predetermined duration of the preceding sound event has just ended, localizing the sound further includes decaying to the steering angle of the sound.

15. The method of claim 1, where determining whether to select the steering angle or the power angle to localize the sound comprises determining whether the sound exists.

16. The method of claim 1, further comprising detecting a plurality of sound event types, each sound event type distinguished from background noise based on at least one characteristic of the sound event type.

17. The method of claim 16, where, when one of the plurality of sound event types is detected, localizing the sound comprises localizing the sound according to the power angle of the power of the sound.

18. The method of claim 17, where the one of the plurality of sound event types that is detected defines a detected sound event type, and localizing the sound comprises isolating the power angle of the power of the sound indicated during a predetermined rise time of the detected sound event type.

19. The method of claim 18, where determining whether to select the steering angle or the power angle to localize the sound comprises determining if it is within a predetermined duration of the detected sound event type;

and

where localizing the sound based on the determination whether to select the steering angle or the power angle to localize the sound comprises using the power angle of the power of the sound indicated during the predetermined rise time of the detected sound event type for the predetermined duration of the detected sound event type.

20. The method of claim 16, where determining whether to select the steering angle or the power angle to localize the sound comprises determining whether one of the plurality of sound event types is not detected;

and

where, when one of the plurality of sound event types is not detected, localizing the sound comprises localizing the sound according to the steering angle of the sound.

21. The method of claim 1, where the power angle is represented in degrees.

22. The method of claim 1, where the multiple audio channels comprise a first audio channel and a second audio channel;

and

where the power angle is indicative of an amount of power in the first audio channel relative to the second channel.

23. The method of claim 1, where determining whether to select a steering angle or the power angle to localize the sound comprises analyzing at least one of the steering angle or the power angle in order to determine which of the steering angle or the power angle to select to localize the sound.

24. The method of claim 1, where determining whether to select a steering angle or the power angle to localize the sound comprises analyzing the power angle in order to determine which of the steering angle or the power angle to select to localize the sound.

25. A method for localizing a sound produced by a plurality of input channel pairs each comprising multiple audio channels, comprising:

analyzing power in one or more input channel pairs to determine a power angle of the power of the sound in the plurality of input channel pairs;

determining whether to select a steering angle or the power angle to localize the sound; and

localizing the sound in the plurality of input channel pairs based on the determination whether to select the steering angle or the power angle to localize the sound.

26. The method of claim 25, further comprising detecting a sound event.

27. The method of claim 26, where determining whether to select the steering angle or the power angle to localize the sound comprises determining if a sound event is detected;

and

where, when the sound event is detected, localizing the sound event comprises localizing the sound event according to the power of the sound.

28. The method of claim 26, where determining whether to select the steering angle or the power angle to localize the sound comprises when the sound event is detected, determining whether the power angle of the power of the sound is accurate.

29. The method of claim 28, where, if the power angle of the power of the sound is accurate, localizing the sound comprises localizing the sound according to the power angle of the power of the sound.

30. The method of claim 28, where, if the power angle of the power of the sound is not accurate, localizing the sound comprises localizing the sound according to the steering angle of the sound.

31. The method of claim 30, where localizing the sound further comprises isolating the steering angle of the sound indicated during a predetermined rise time.

32. The method of claim 31, where the sound event comprises a sound event type and the predetermined rise time is that of the sound event type.

33. The method of claim 32, where the steering angle of the sound indicated during the predetermined rise time is used for a predetermined duration.

34. The method of claim 33, where the predetermined duration is that of the sound event type.

35. The method of claim 25 further comprising detecting a plurality of sound event types, each sound event type distinguished from background noise based on at least one characteristic of the sound event type.

36. The method of claim 35, where, when one of the plurality of sound event types is detected, localizing the sound comprises localizing the sound according to the power angle of the power of the sound.

37. The method of claim 35, where determining whether to select the steering angle or the power angle to localize the sound comprises, when one of the plurality of sound event types is detected, determining whether the power angle of the power in the sound is accurate.

38. The method of claim 37, where the sound comprises a background signal and determining whether the power angle of the power in the sound is accurate comprises determining whether the background signal has dropped from that present during a previous sound event type.

39. The method of claim 37, where if the power angle of the power of the sound is accurate, localizing the sound comprises localizing the sound according to the power angle of the power of the sound.

40. The method of claim 37, where if the power angle of the power of the sound is not accurate, localizing the sound comprises localizing the sound according to the steering angle of the sound.

41. The method of claim 40, where the one of the plurality of sound event types that is detected defines a detected sound event type, and localizing the sound according to the power angle of the power of sound comprises isolating the power angle of the power of the sound indicated during a predetermined rise time of the detected sound event type.

42. The method of claim 41, where determining whether to select the steering angle or the power angle to localize the sound comprises determining if it is within a predetermined duration of the detected sound event type;

and

where localizing the sound based on the determination whether to select the steering angle or the power angle to localize the sound comprises using the power angle of the power of the sound indicated during the predetermined rise time of the detected sound event type for the predetermined duration of the detected sound event type.

43. A computer-readable medium comprising computer-executable instructions for localizing a sound, the computer-executable instructions comprising logic for performing the steps of:

determining a steering angle of the sound;

analyzing power in multiple audio channels to determine a power angle of the power of the sound in the multiple audio channels;

determining whether to select the steering angle or the power angle to localize the sound; and

localizing the sound based on the determination whether to select the steering angle or the power angle to localize the sound.

44. A computer-readable medium comprising computer-executable instructions for localizing a sound, the computer-executable instructions comprising logic for performing the steps of:

determining a steering angle of a sound in the plurality of input channel pairs;

analyzing power in one or more input channel pairs to determine a power angle of the power of the sound in the plurality of input channel pairs;

determining whether to select the steering angle or the power angle to localize the sound; and

localizing the sound in the plurality of input channel pairs based on the determination whether to select the steering angle or the power angle to localize the sound.

45. A sound localizer for localizing a sound produced by an input channel pair comprising multiple audio channels, comprising:

means for determining a steering angle of the sound, where the means for determining the direction is in communication with the input channel pair;

means for analyzing power in multiple audio channels to determine a power angle of the power of the sound, where the means for analyzing the power is in communication with the input channel pair;

means for determining whether to select the steering angle or the power angle to localize the sound; and

means for localizing the sound according to one of the means for determining the steering angle of the sound or the means for determining the power angle of the power of the sound based on the means for determining the steering angle or the power angle to localize the sound, where the means for localizing is coupled with the means for determining the steering angle of the sound, the means for determining the power angle of the power of the sound, and the means for determining whether to select the steering angle or the power angle to localize the sound.

46. The localizer of claim 45, where the localizer is implemented by computer logic according to computer-executable instructions stored in a computer-readable medium.