METHODS AND SYSTEMS FOR SELECTING LAYERS OF ENCODED AUDIO SIGNALS FOR TELECONFERENCING

• US 20150221319A1
• Filed: 09/11/2013
• Published: 08/06/2015
• Est. Priority Date: 09/21/2012
• Status: Active Grant

• Current Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Original Assignee: Dolby International AB (Dolby Laboratories Incorporated), Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Inventors: Dickins, Glenn, Cartwright, Richard James
• Granted Patent: US 9,858,936 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G10L 19/008 Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
• CPC Class Codes: G10L 19/012 Comfort noise or silence coding
• CPC Class Codes: G10L 19/02 using spectral analysis, e.g. transform vocoders or subband vocoders
• CPC Class Codes: G10L 19/0208 Subband vocoders
• CPC Class Codes: G10L 19/032 Quantisation or dequantisation of spectral components
• CPC Class Codes: G10L 19/22 Mode decision, i.e. based on audio signal content versus external parameters
• CPC Class Codes: G10L 19/24 Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
• CPC Class Codes: G10L 21/02 Speech enhancement, e.g. noise reduction or echo cancellation reducing echo effects in line transmission systems H04B3/20; echo suppression in hands-free telephones H04M9/08
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: G10L 21/0216 characterised by the method used for estimating noise
• CPC Class Codes: H04M 3/56 Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities video conference systems H04N7/15

Abstract

In some embodiments, a method for selecting at least one layer of a spatially layered, encoded audio signal. Typical embodiments are teleconferencing methods in which at least one of a set of nodes (endpoints, each of which is a telephone system, and optionally also a server) is configured to perform audio coding in response to soundfield audio data to generate spatially layered encoded audio including any of a number of different subsets of a set of layers, the set of layers including at least one monophonic layer, at least one soundfield layer, and optionally also at least one metadata layer comprising metadata indicative of at least one processing operation to be performed on the encoded audio. Other aspects are systems configured (e.g., programmed) to perform any embodiment of the method, and computer readable media which store code for implementing any embodiment of the method or steps thereof.

Claims

1-50. -50. (canceled)

51. A teleconferencing method in which nodes perform audio coding to generate spatially layered encoded audio, and at least some of the spatially layered encoded audio is transmitted from one of the nodes to at least another one of the nodes, said method including a step of:

(a) in at least one of the nodes which is configured to generate spatially layered encoded audio in response to soundfield audio data, said encoded audio including any of a number of different subsets of a set of layers, said set of layers including at least one monophonic layer and at least one soundfield layer, determining a first subset of the set of layers by performing at least one of downstream capability-driven layer selection, perceptually-driven layer selection, and endpoint-driven layer selection, said first subset including at least one of said monophonic layer or said soundfield layer.

52. The method of claim 51, wherein the nodes include endpoints, each of the endpoints is a telephone system, and step (a) is performed in one of the endpoints.

53. The method of claim 51, wherein the nodes include at least one server, and step (a) is performed in the server.

54. The method of claim 51, wherein the set of layers also includes at least one metadata layer comprising metadata indicative of at least one processing operation to be performed on the encoded audio, and wherein the first subset determined in step (a) includes at least one said metadata layer.

55. The method of claim 51, also including the step of:

(b) in said at least one of the nodes, generating first spatially layered encoded audio in response to soundfield audio data, wherein the first spatially layered encoded audio includes the first subset of the set of layers but does not include any layer of said set of layers which is not included in said first subset.

56. The method of claim 55, wherein the nodes include at least one monophonic endpoint, at least one soundfield endpoint, at least one server, step (b) is performed in one said soundfield endpoint, and said method also includes a step of transmitting the first spatially layered encoded audio to at least one of the server and one said monophonic endpoint.

57. The method of claim 51, also including the step of:

(b) in said at least one of the nodes, selecting said first subset of the set of layers from a spatially layered encoded audio signal, but not selecting any layer of the spatially layered encoded audio signal which is not included in said first subset.

58. The method of claim 57, wherein the nodes include at least one monophonic endpoint, at least one soundfield endpoint, and at least one server, and step (b) includes selecting said first subset of the set of layers, but not any layer of the spatially layered encoded audio signal which is not included in said first subset, for processing in one said monophonic endpoint.

59. A teleconferencing method in which nodes perform audio coding to generate spatially layered encoded audio, and at least some of the spatially layered encoded audio is transmitted from one of the nodes to at least another one of the nodes, said method including a step of:

(a) in at least one of the nodes which is configured to generate spatially layered encoded audio in response to soundfield audio data, said encoded audio including any of a number of different subsets of a set of layers, said set of layers including at least one monophonic layer and at least one soundfield layer, determining a first subset of the set of layers such that the first subset varies over time so as to determine a time-varying mix of soundfield and monophonic layers.

60. The method of claim 59, wherein the first subset of the set of layers varies over time in a continuous manner.

61. A teleconferencing system, including:

nodes configured to perform audio coding to generate spatially layered encoded audio, wherein each of the nodes is coupled to at least one other one of the nodes and configured to transmit at least some of the spatially layered encoded audio to said at least one other one of the nodes, and

wherein the nodes include a first node configured to generate spatially layered encoded audio in response to soundfield audio data, said encoded audio including any of a number of different subsets of a set of layers, said set of layers including at least one monophonic layer and at least one soundfield layer, and wherein the first node is configured to determine a first subset of the set of layers by performing at least one of downstream capability-driven layer selection, perceptually-driven layer selection, and endpoint-driven layer selection, said first subset including at least one of said monophonic layer or said soundfield layer.

62. The system of claim 61, wherein the nodes include endpoints, each of the endpoints is a telephone system, and the first node is one of the endpoints.

63. The system of claim 61, wherein the nodes include endpoints and at least one server, and the first node is the server.

64. The system of claim 61, wherein the set of layers also includes at least one metadata layer comprising metadata indicative of at least one processing operation to be performed on the encoded audio, and the first subset determined by the first node includes at least one said metadata layer.

65. The system of claim 61, wherein the first node is configured to generate first spatially layered encoded audio in response to soundfield audio data, wherein the first spatially layered encoded audio includes the first subset of the set of layers but does not include any layer of said set of layers which is not included in said first subset.

66. The system of claim 65, wherein the nodes include at least one monophonic endpoint, at least one soundfield endpoint, at least one server, the first node is one said soundfield endpoint, and the first node is coupled and configured to transmit the first spatially layered encoded audio to at least one of the server and one said monophonic endpoint.

67. The system of claim 61, the first node is configured to select said first subset of the set of layers from a spatially layered encoded audio signal, without selecting any layer of the spatially layered encoded audio signal which is not included in said first subset.

68. The system of claim 67, wherein the nodes include at least one monophonic endpoint, at least one soundfield endpoint, and at least one server, and the first node is configured to select said first subset of the set of layers, but not any layer of the spatially layered encoded audio signal which is not included in said first subset, for processing in one said monophonic endpoint.

69. The system of claim 67, wherein the nodes include at least one monophonic endpoint, at least one soundfield endpoint, and at least one server, and the first node is the server.

70. The system of claim 61, wherein at least one of the nodes is coupled and configured to transmit to said first node at least one data value indicative of at least one capability of at least one endpoint of the system, and wherein the first node is configured to perform said downstream capability-driven layer selection including by determining the first subset of the set of layers in response to said at least one data value.