Spatial comfort noise

• US 10,224,046 B2
• Filed: 03/04/2014
• Issued: 03/05/2019
• Est. Priority Date: 03/14/2013
• Status: Active Grant

• Current Assignee: Dolby International AB (Dolby Laboratories Incorporated), Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Original Assignee: Dolby International AB (Dolby Laboratories Incorporated), Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Inventors: Dickins, Glenn N., Sun, Xuejing, Shue, Yen-Liang, Purnhagen, Heiko
• Primary Examiner(s): Shah, Bharatkumar S
• Application Number:
  US14/774,966
• Publication Number:
  US 20160027447A1
• Time in Patent Office: 1,827 Days
• Field of Search: 704228
• CPC Class Codes: G10L 19/008 Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
• CPC Class Codes: G10L 19/012 Comfort noise or silence coding
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: H04L 12/1813 for computer conferences, e.g. chat rooms instant messaging H04L51/04; protocols for multimedia communication H04L65/1101; arrangements for multi-party communication H04L65/403; telephonic conference arrangements H04M3/56; television conference systems H04N7/15
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04M 3/568 audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30

Abstract

A method, an apparatus, logic (e.g., executable instructions encoded in a non-transitory computer-readable medium to carry out a method), and a non-transitory computer-readable medium configured with such instructions. The method is to generate and spatially render spatial comfort noise at a receiving endpoint of a conference system, such that the comfort noise has target spectral characteristics typical of comfort noise, and at least one spatial property that at least substantially matches at least one target spatial property. On version includes receiving one or more or more audio signals from other endpoints, combining the received audio signals with the spatial comfort noise signals, and rendering the combination of the received audio signals and the spatial comfort noise signals to a set of output signals for loudspeakers, such that the spatial comfort noise signals are continually in the output signal sin addition to output from the received audio signals.

Claims

1. A method, in a receiving endpoint of a conference system, of providing spatial comfort noise, the method comprising:

receiving one or more audio signals for rendering at the receiving endpoint over a network connection to a server;

generating one or more noise signals;

adjusting the one or more noise signals to modified noise signals that have target spectral characteristics typical of comfort noise;

adjusting the modified noise signals to form a plurality of spatial comfort noise signals having at least one spatial property that at least substantially matches at least one target spatial property, the adjusting the modified noise signals comprising converting the one or more noise signals to a soundfield format;

combining the received audio signals with the plurality of spatial comfort noise signals; and

rendering the spatial comfort noise signals to a set of output signals for loudspeakers to be heard by one or more conferees at the receiving endpoint, wherein the rendering renders the combination of the received audio signals and the spatial comfort noise signals to the set of output signals for loudspeakers.

2. The method of claim 1,

wherein the spatial comfort noise signals are continually in the output signal in addition to the output from the received audio signals, whether or not speech is present in the received one or more audio signals.

3. The method of claim 1, wherein the generating generates a plurality of noise signals, and wherein the adjusting the modified noise signals further comprises spatially modifying according to a linear mapping defined by a warping matrix.

4. The method of claim 1, wherein the generating of the one or more noise signals and the adjusting the modified noise signals uses a pre-stored portion of typical room noise that was pre-recorded or sampled.

5. A non-transitory computer-readable medium configured with instructions that when executed by one or more processors of a processing system included in a receiving endpoint of a conference system, carry out a method of providing spatial comfort noise, the method comprising:

receiving one or more audio signals for rendering at the receiving endpoint over a network connection to a server;

generating one or more noise signals;

adjusting the one or more noise signals to modified noise signals that have target spectral characteristics typical of comfort noise;

adjusting the modified noise signals to form a plurality of spatial comfort noise signals having at least one spatial property that at least substantially matches at least one target spatial property, the adjusting the modified noise signals comprising converting the one or more noise signals to a soundfield format;

generating a combination of the plurality of spatial comfort noise signals and a plurality of audio signals received at the receiving endpoint from a sending endpoint;

and

rendering the combination of the received audio signals and the spatial comfort noise signals to a set of output signals for loudspeakers, wherein the rendering renders the combination of the received audio signals and the spatial comfort noise signals to the set of output signals for loudspeakers.