Method and system for distributed audio transcoding in peer-to-peer systems

• US 8,392,201 B2
• Filed: 07/30/2010
• Issued: 03/05/2013
• Est. Priority Date: 07/30/2010
• Status: Active Grant

• Current Assignee: Deutsche Telekom AG, Board of Trustees of the Leland Stanford Junior University (Stanford University)
• Original Assignee: Deutsche Telekom AG, Board of Trustees of the Leland Stanford Junior University (Stanford University)
• Inventors: Noh, Jeonghun, Girod, Bernd, Singh, Jatinder Pal, Kim, Kyu-Han, Pogrzeba, Peter, Agarwal, Sachin Kumar
• Primary Examiner(s): Lerner, Martin
• Application Number:
  US12/847,480
• Publication Number:
  US 20120029911A1
• Time in Patent Office: 949 Days
• Field of Search: 704/205, 704/206, 704/500, 704/501, 370/469, 709/231
• US Class Current: 704/500
• CPC Class Codes: G10L 19/04 using predictive techniques
• CPC Class Codes: G10L 19/24 Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/756 adapting media to device capabilities
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 67/104 Peer-to-peer [P2P] networks
• CPC Class Codes: H04N 21/2335 involving reformatting operations of audio signals, e.g. by converting from one coding standard to another details of audio signal transcoding G10L19/173
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104

Abstract

A method for streaming audio data in a network, the audio data having a sequence of samples, includes encoding the sequence of samples into a plurality of coded base bitstreams, generating a plurality of enhancement streams, and transmitting the coded base bitstreams and the enhancement bitstreams to a receiver for decoding. Each of the enhancement bitstreams is generated from one of a plurality of non-overlapping portions of the sequence of samples.

Claims

1. A method for streaming audio data in a network, wherein the audio data include a sequence of samples, the method comprising:

encoding, by a processor, the sequence of samples into a plurality of coded base streams;

generating a plurality of enhancement streams, wherein each of the enhancement streams is generated from one of a plurality of non-overlapping portions of the sequence of samples;

transmitting the coded base streams and the enhancement streams to a receiver for decoding;

assigning an identifier to each of the plurality of coded base streams and each of the plurality of enhancement streams; and

selecting one of the non-overlapping portions of the sequence of samples for generating an enhancement stream based on the identifier of the enhancement stream.

2. The method of claim 1, wherein the plurality of coded base streams and the plurality of enhancement streams have the same number of streams, and each enhancement bitstream is transmitted with a respective coded base stream.

3. The method of claim 1, wherein the plurality of coded bitstreams carries substantially identical information of the audio data.

4. The method of claim 1, further including:

identifying a plurality of network nodes that provides the audio data;

requesting the audio data from the plurality of network nodes; and

generating at each of the plurality of network nodes one of the plurality of coded base streams and one of the plurality of enhancement streams.

5. The method of claim 1, wherein each of the plurality of coded base streams carries basic components of the entire sequence of samples and, when individually decoded, provides the entire sequence of samples with a basic quality, and

wherein each of the plurality of enhancement streams, when decoded with the associated coded base stream, provides the respective non-overlapping portion of the sequence of samples with an enhanced quality.

6. The method of claim 5, wherein the plurality of coded base streams carry information in a lower sub-band of the audio data, and the plurality of enhancement streams carry information in a higher sub-band of the audio data.

7. The method of claim 6, further including filtering the audio data into the lower and higher sub-bands.

8. The method of claim 1, further including selecting the each non-overlapping portion of the sequence of samples in time domain.

9. A method for streaming audio data in a network, wherein the audio data include a sequence of samples, the method comprising:

receiving a plurality of bitstreams, wherein each of the bitstreams includes a base stream and an enhancement stream, and each base stream includes information of the entire sequence of samples and each enhancement stream includes a non-overlapping portion of the sequence of samples;

decoding, by a processor, the plurality of bitstreams; and

assembling the decoded bitstreams into a reconstructed copy of the sequence of samples.

10. The method of claim 9, further including:

assigning an identifier to each of the plurality of bitstreams; and

assembling the decoded bitstreams based on the identifiers of the plurality of bitstreams.

11. The method of claim 10, further including:

detecting that at least a portion of a first one of the plurality of bitstreams is missing;

selecting a second one of the plurality of bitstreams; and

substituting a corresponding portion of the second bitstream for the missing portion of the first bitstream.

12. The method of claim 11, wherein the second one of the plurality of bitstreams is selected based on the identifier of the first bitstream.

13. The method of claim 9, further including:

identifying a plurality of network nodes having the audio data;

requesting that each of the plurality of network nodes generate one of the plurality of bitstreams.

14. The method of claim 13, further including:

detecting that one of the plurality of network nodes becomes unavailable; and

substituting a bitstream generated by one of the remaining network nodes for the bitstream generated by the unavailable network node.

15. The method of claim 9, further including:

decoding the base stream; and

decoding the enhancement stream based on the decoded base stream.

16. A system for streaming audio data in a network, the audio data including a sequence of samples, the system comprising:

at least one parent node configured to encode the sequence of samples into a plurality of bitstreams using a processor, each of the bitstreams including a base stream and an enhancement stream, wherein each base stream carries information of the entire sequence of samples, and each enhancement stream carries one of a plurality of non-overlapping portions of the sequence of samples, the at least one parent node further configured to transmit the plurality of bitstreams; and

a receiving node configured to receive and decode the plurality of base streams and the plurality of enhancement streams, the receiving node further configured to assemble the decoded base streams and enhancement streams into a reconstructed copy of the sequence of samples.

17. The system of claim 16, wherein the receiving node is further configured to identify the at least one parent node that has the audio data stored thereon and request the at least one parent node transmit the audio data to the receiving node.

18. The system of claim 17, wherein the at least one parent node includes a plurality of parent nodes, each of the parent nodes being configured to generate one of the plurality of base streams and one of the plurality of enhancement streams, and the receiving node is configured to assign an identifier to each of the plurality of parent nodes.

19. The system of claim 18, wherein each of the plurality of parent nodes is configured to generate the respective enhancement stream based on its identifier.

20. The system of claim 19, wherein each of the plurality of parent nodes is configured to select at least one sample from the sequence of samples based on its identifier.

21. The system of claim 18, wherein the receiving node is further configured to assemble the decoded base streams and enhancement streams based on the identifiers of the plurality of parent nodes transmitting the base streams and the enhancement streams.

22. The system of claim 21, wherein the receiving node is configured to select a base stream and an enhancement stream so as to generate a reconstructed copy of a sample based on a mapping relationship between the position of the sample within the sequence of sample and the identifier of the parent node transmitting the base stream and the enhancement stream.

23. The system of claim 18, wherein the receiving node is further configured to detect that at least a portion of a first one of the plurality of bitstreams is missing and to select a second one of the plurality of bitstreams to substitute for the missing portion of the first bitstream.

24. The system of claim 23, wherein the receiving node is configured to select the second one of the plurality of bitstreams based on the identifier of the parent node transmitting the first one of the plurality of bitstreams.

25. The system of claim 18, wherein the receiving node is further configured to detect that one of the plurality of parent nodes is unavailable and to select another one of the plurality of parent nodes to substitute for the missing parent node.

26. The system of claim 25, wherein the receiving node is configured to select the another one of the plurality of parent nodes based on the identifier of the unavailable parent node.

27. A computer readable medium comprising computer codes, when executed by one or more digital processors, the computer codes instructing the one or more digital processors to provide audio data streaming in a network, wherein the audio data include a sequence of samples, the computer codes comprising:

instructions for encoding the sequence of samples into a plurality of coded base bitstreams;

instructions for generating a plurality of enhancement streams, wherein each of the enhancement streams is generated from one of a plurality of non-overlapping portions of the sequence of samples;

instructions for transmitting the coded base streams and the enhancement streams to a receiver for decoding;

instructions for assigning an identifier to each of the plurality of coded base streams and each of the plurality of enhancement stream; and

instructions for selecting one of the non-overlapping portions of the sequence of samples for generating an enhancement stream based on the identifier of the enhancement stream.

28. The computer readable medium of claim 27, the computer codes further comprising:

instructions for identifying a plurality of network nodes that provides the audio data;

instructions for requesting the audio data from the plurality of network nodes; and

instructions for generating at each of the plurality of network nodes one of the plurality of coded base streams and one of the plurality of enhancement streams.

29. A computer readable medium comprising computer codes, when executed by one or more digital processors, the computer codes instructing the one or more digital processors to provide audio data streaming in a network, wherein the audio data include a sequence of samples, the computer codes comprising:

instructions for receiving a plurality of bitstreams, wherein each of the bitstreams includes a base stream and an enhancement stream, and each base stream includes information of the entire sequence of samples and each enhancement stream includes a non-overlapping portion of the sequence of samples;

instructions for decoding the plurality of bitstreams; and

instructions for assembling the decoded bitstreams into a reconstructed copy of the sequence of samples.

30. The computer readable medium of claim 29, the computer codes further comprising:

instructions for assigning an identifier to each of the plurality of bitstreams, and

instructions for assembling the decoded bitstreams based on the identifiers of the plurality of bitstreams.

31. The computer readable medium of claim 29, the computer codes further comprising:

instructions for detecting that at least a portion of a first one of the plurality of bitstreams is missing;

instructions for selecting a second one of the plurality of bitstreams; and

instructions for substituting a corresponding portion of the second bitstream for the missing portion of the first bitstream.

32. The computer readable medium of claim 29, the computer codes further comprising:

instructions for identifying a plurality of network nodes having the audio data;

instructions for requesting that each of the plurality of network nodes generate one of the plurality of bitstreams.

33. The computer readable medium of claim 32, the computer codes further including:

instructions for detecting that one of the plurality of network nodes becomes unavailable; and

instructions for substituting a bitstream generated by one of the remaining network nodes for the bitstream generated by the unavailable network node.