AUDIO SPATIAL RENDERING APPARATUS AND METHOD

• US 20150382127A1
• Filed: 01/30/2014
• Published: 12/31/2015
• Est. Priority Date: 02/22/2013
• Status: Active Grant

• Current Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Original Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Inventors: SUN, Xuejing, SPITTLE, Gary
• Granted Patent: US 9,854,378 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04S 2400/11 Positioning of individual sound objects, e.g. moving airplane, within a sound field H04S2420/13 takes precedence
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 7/30 Control circuits for electronic adaptation of the sound field

Abstract

An audio spatial rendering apparatus and method are disclosed. In one embodiment, The audio spatial rendering apparatus includes a rendering unit for spatially rendering an audio stream so that the reproduced far-end sound is perceived by a listener as originating from at least one virtual spatial position, a real position obtaining unit for obtaining a real spatial position of a real sound source, a comparator for comparing the real spatial position with the at least one virtual spatial position; and an adjusting unit for, where the real spatial position is within a predetermined range around at least one virtual spatial position, or vice versa, adjusting the parameters of the rendering unit so that the at least one virtual spatial position is changed.

Claims

1-33. -33. (canceled)

34. An audio spatial rendering apparatus comprising:

a rendering unit for spatially rendering an audio stream so that the reproduced far-end sound is perceived by a listener as originating from at least one virtual spatial position;

a real position obtaining unit for obtaining a real spatial position of a real sound source;

a comparator for comparing the real spatial position with the at least one virtual spatial position; and

an adjusting unit for, where the real spatial position is within a predetermined range around at least one virtual spatial position, or vice versa, adjusting the parameters of the rendering unit so that the at least one virtual spatial position is changed.

35. The audio spatial rendering apparatus according to claim 34, wherein the adjusting unit is configured to adjust the parameters of the rendering unit so that the at least one virtual spatial position is rotated around the listener away from the virtual spatial position, and/or the at least one virtual spatial position is moved to a position closer to the listener.

36. The audio spatial rendering apparatus according to claim 34, wherein the real position obtaining unit, the comparator and the adjusting unit are configured to work in a calibration stage of the audio spatial rendering apparatus or in real time.

37. The audio spatial rendering apparatus according to claim 34, further comprising a sound activity detector for detecting the start and end of a far-end sound in the audio stream, wherein the real position obtaining unit and/or the adjusting unit is configured to work when there is no far-end sound.

38. The audio spatial rendering apparatus according to claim 37, wherein the sound activity detector comprises a voice activity detector, and the real position obtaining unit and/or the adjusting unit is configured to work when there is no far-end speech.

39. The audio spatial rendering apparatus according to claim 34, wherein the adjusting unit is configured not to adjust the parameters of the rendering unit when the real spatial position is inside a predetermined spatial range.

40. The audio spatial rendering apparatus according to claim 34, further comprising an energy estimator for estimating the energy of the real sound source, wherein the adjusting unit is configured not to adjust the parameters of the rendering unit when the estimated energy is higher than a predetermined threshold.

41. The audio spatial rendering apparatus according to claim 34, further comprising a timer for determining a length of time of the lasting of the real sound source, wherein the adjusting unit is configured not to adjust the parameters of the rendering unit when the length of time is less than a predetermined threshold.

42. The audio spatial rendering apparatus according to claim 34, wherein the rendering unit is configured to spatially render the audio stream based on a head-related transfer function and/or an inter-aural time difference and/or an inter-aural intensity difference.

43. The audio spatial rendering apparatus according to claim 42, wherein the rendering unit is further configured to spatially render the audio stream based on ratio of direct-to-reverberation energy.

44. The audio spatial rendering apparatus according to claim 34, wherein the real position obtaining unit comprises a microphone array and is configured to estimate the real spatial position of the real sound source based on sounds captured by the microphone array and using a direction-of-arrival algorithm.

45. The audio spatial rendering apparatus according to claim 44, wherein the real position obtaining unit is configured to estimate the real spatial position of the real sound source using a generalized cross correlation-phase transform (GCC-PHAT) algorithm.

46. The audio spatial rendering apparatus according to claim 34, wherein the real position obtaining unit comprises an input unit via which the real spatial position of the real sound source is input.

47. An audio spatial rendering method comprising:

obtaining at least one virtual spatial position from which a reproduced far-end sound to be spatially rendered from an audio stream is perceived by a listener as originating;

obtaining a real spatial position of a real sound source;

comparing the real spatial position with the at least one virtual spatial position;

adjusting, where the real spatial position is within a predetermined range around the at least one virtual spatial position or vice versa, parameters for spatial rendering so that the at least one virtual spatial position is changed; and

spatially rendering the audio stream based on the parameters as adjusted.

48. A computer-readable medium having computer program instructions recorded thereon, when being executed by a processor, the instructions enabling the processor to execute an audio spatial rendering method comprising:

obtaining at least one virtual spatial position from which a reproduced far-end sound to be spatially rendered from an audio stream is perceived by a listener as originating;

obtaining a real spatial position of a real sound source;

comparing the real spatial position with the at least one virtual spatial position;

adjusting, where the real spatial position is within a predetermined range around the at least one virtual spatial position, parameters for spatial rendering so that the at least one virtual spatial position is changed; and

spatially rendering the audio stream based on the parameters as adjusted.