Decoder architecture for optimized error management in streaming multimedia

• US 20060282737A1
• Filed: 03/10/2006
• Published: 12/14/2006
• Est. Priority Date: 03/10/2005
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Sethi, Sumeet Singh, Oguz, Seyfullah Halit, Shi, Fang, Raveendran, Vijayalakshmi R.
• Granted Patent: US 7,886,201 B2
• Time in Patent Office: Days
• US Class Current: 714/746
• CPC Class Codes: H03M 13/15 Cyclic codes, i.e. cyclic shifts of codewords produce other codewords, e.g. codes defined by a generator polynomial, Bose-Chaudhuri-Hocquenghem [BCH] codes H03M13/17 takes precedence
• CPC Class Codes: H03M 13/1515 Reed-Solomon codes
• CPC Class Codes: H03M 13/2966 Turbo codes concatenated with another code, e.g. an outer block code
• CPC Class Codes: H04L 1/0045 Arrangements at the receiver end
• CPC Class Codes: H04L 1/0057 Block codes H04L1/0061, H04L1/0064 take precedence
• CPC Class Codes: H04L 1/0066 Parallel concatenated codes
• CPC Class Codes: H04N 19/89 involving methods or arrangements for detection of transmission errors at the decoder
• CPC Class Codes: H04N 19/895 in combination with error concealment
• CPC Class Codes: H04N 21/4305 Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets arrangements for synchronising receiver with transmitter by comparing receiver clock with transmitter clock H04L7/0012; arrangements for synchronising receiver with transmitter wherein the receiver takes measures against momentary loss of synchronisation H04L7/0083
• CPC Class Codes: H04N 21/440227 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/44209 Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/4425 Monitoring of client processing errors or hardware failure
• CPC Class Codes: H04N 21/64792 Controlling the complexity of the content stream, e.g. by dropping packets intermediate media network packet handling H04L65/765; proxy provisioning conversion or adaptation for reducing the amount or size of exchanged application data H04L67/5651; negotiation of resources in wireless networks H04W28/16
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content

Abstract

A method and apparatus for multi-layer integration for use in error recovery is disclosed. An error is detected in a multimedia data based on a first layer protocol and the detected error in the multimedia data is concealed based on a second layer protocol. In one aspect, the error in a multimedia data is detected based on a communication layer protocol and controlled based on a transport layer protocol. An error distribution of the controlled error is then determined based on a sync layer protocol and the detected error in the multimedia data is concealed based on an application layer protocol. In another aspect, a method and apparatus for multimedia data processing comprises error recovery as well as scalability. Finally, a method and apparatus as disclosed allows processing of multimedia stream by receiving multiple streams of encoded multimedia data, performing error recovery on an erroneous portion of a stream, and reconstructing the multimedia data from the multiple streams.

Claims

1. A method for multi-layer integration for use in error recovery, comprising:

detecting an error in a multimedia data based on a first layer protocol; and

concealing the detected error in the multimedia data based on a second layer protocol.

2. The method of claim 1, wherein the first layer comprises a communication layer.

3. The method of claim 2, wherein the communication layer comprises either one or a combination of a physical layer, a MAC layer and a transport layer.

4. The method of claim 1, further comprising:

controlling the detected error based on a transport layer protocol.

5. The method of claim 4, wherein controlling the detected error comprises:

localizing the detected error.

6. The method of claim 1, further comprising:

determining an error distribution of the detected error based on a sync layer protocol.

7. The method of claim 1, wherein the second layer comprises an application layer.

8. An apparatus for multi-layer integration for use in error recovery, comprising:

means for detecting an error in a multimedia data based on a first layer protocol; and

means for concealing the detected error in the multimedia data based on a second layer protocol.

9. The apparatus of claim 8, wherein the first layer comprises a communication layer.

10. The apparatus of claim 9, wherein the communication layer comprises either one or a combination of a physical layer, a MAC layer and a transport layer.

11. The apparatus of claim 8, further comprising:

means for controlling the detected error based on a transport layer protocol.

12. The apparatus of claim 11, wherein the controlling means comprises:

means for localizing the detected error.

13. The apparatus of claim 8, further comprising:

means for determining an error distribution of the detected error based on a sync layer protocol.

14. The apparatus of claim 8, wherein the second layer comprises an application layer.

15. An apparatus for multi-layer integration for use in error recovery, comprising:

a detector to detect an error in a multimedia data based on a first layer protocol; and

a concealer to conceal the detected error in the multimedia data based on a second layer protocol.

16. The apparatus of claim 15, wherein the first layer comprises a communication layer.

17. The apparatus of claim 16, wherein the communication layer comprises either one or a combination of a physical layer, a MAC layer and a transport layer.

18. The apparatus of claim 15, further comprising:

a controller to control the detected error based on a transport layer protocol.

19. The apparatus of claim 18, wherein the controller localizes the detected error.

20. The apparatus of claim 15, further comprising:

a determiner to determine an error distribution of the detected error based on a sync layer protocol.

21. The apparatus of claim 15, wherein the second layer comprises an application layer.

22. A processor for multi-layer integration for use in error recovery, the processor configured to:

detect an error in a multimedia data based on a first layer protocol; and

conceal the detected error in the multimedia data based on a second layer protocol.

23. The processor of claim 22, wherein the first layer comprises a communication layer.

24. The processor of claim 23, wherein the communication layer comprises either one or a combination of a physical layer, a MAC layer and a transport layer.

25. The processor of claim 22, further configured to:

control the detected error based on a transport layer protocol.

26. The processor of claim 25, wherein the controller localizes the detected error.

27. The processor of claim 22, further configured to:

determine an error distribution of the detected error based on a sync layer protocol.

28. The processor of claim 22, wherein the second layer comprises an application layer.

29. A computer readable medium embodying a method for multi-layer integration for use in error recovery, the method comprising:

detecting an error in a multimedia data based on a first layer protocol; and

concealing the detected error in the multimedia data based on a second layer protocol.

30. The computer readable medium of claim 29, wherein the first layer comprises a communication layer.

31. The computer readable medium of claim 30, wherein the communication layer comprises either one or a combination of a physical layer, a MAC layer and a transport layer.

32. The computer readable medium of claim 29, wherein the method further comprises:

controlling the detected error based on a transport layer protocol.

33. The computer readable medium of claim 32, wherein controlling the detected error comprises:

localizing the detected error.

34. The computer readable medium of claim 29, wherein the method further comprises:

determining an error distribution of the detected error based on a sync layer protocol.

35. The computer readable medium of claim 29, wherein the second layer comprises an application layer.

36. A method for multi-layer integration for use in error recovery, comprising:

detecting an error in a multimedia data based on a communication layer protocol;

controlling the detected error based on a transport layer protocol;

determining an error distribution of the controlled error based on a sync layer protocol; and

concealing the detected error in the multimedia data based on an application layer protocol.

37. An apparatus for multi-layer integration for use in error recovery, comprising:

means for detecting an error in a multimedia data based on a communication layer protocol;

means for controlling the detected error based on a transport layer protocol;

means for determining an error distribution of the controlled error based on a sync layer protocol; and

means for concealing the detected error in the multimedia data based on an application layer protocol.

38. An apparatus for multi-layer integration for use in error recovery, comprising:

a detector to detect an error in a multimedia data based on a communication layer protocol;

a controller to control the detected error based on a transport layer protocol;

a determiner to determine an error distribution of the controlled error based on a sync layer protocol; and

a concealer to conceal the detected error in the multimedia data based on an application layer protocol.

39. A processor for multi-layer integration for use in error recovery, the processor configured to:

detect an error in a multimedia data based on a communication layer protocol;

control the detected error based on a transport layer protocol;

determine an error distribution of the controlled error based on a sync layer protocol; and

conceal the detected error in the multimedia data based on an application layer protocol.

40. A computer readable medium embodying a method for multi-layer integration for use in error recovery, the method comprising:

detecting an error in a multimedia data based on a communication layer protocol;

controlling the detected error based on a transport layer protocol;

determining an error distribution of the controlled error based on a sync layer protocol; and

concealing the detected error in the multimedia data based on an application layer protocol.

41. A method for use in multimedia data processing, comprising:

performing error recovery of an encoded multimedia data; and

supporting scalability of the encoded multimedia data.

42. The method of claim 41, wherein the scalability comprises either one or both spatial and temporal scalability.

43. The method of claim 41, wherein the error recovery comprises either one or a combination of temporal error concealment, spatial error concealment and frame rate up conversion.

44. An apparatus for use in multimedia data processing, comprising:

means for performing error recovery of an encoded multimedia data; and

means for supporting scalability of the encoded multimedia data.

45. The apparatus of claim 44, wherein the scalability comprises either one or both spatial and temporal scalability.

46. The apparatus of claim 44, wherein the error recovery comprises either one or a combination of temporal error concealment, spatial error concealment and frame rate up conversion.

47. An apparatus for use in multimedia data processing, comprising:

an error recovery component to perform error recovery of an encoded multimedia data; and

a scalability component to support scalability of the encoded multimedia data.

48. The apparatus of claim 47, wherein the scalability comprises either one or both spatial and temporal scalability.

49. The apparatus of claim 47, wherein the error recovery comprises either one or a combination of temporal error concealment, spatial error concealment and frame rate up conversion.

50. A processor for use in multimedia data processing, the processor configured to:

perform error recovery of an encoded multimedia data; and

support scalability of the encoded multimedia data.

51. The processor of claim 50, wherein the scalability comprises either one or both spatial and temporal scalability.

52. The processor of claim 50, wherein the error recovery comprises either one or a combination of temporal error concealment, spatial error concealment and frame rate up conversion.

53. A computer readable medium embodying a method for use in multimedia data processing, the method comprising:

performing error recovery of an encoded multimedia data; and

supporting scalability of the encoded multimedia data.

54. The computer readable medium of claim 53, wherein the scalability comprises either one or both spatial and temporal scalability.

55. The computer readable medium of claim 53, wherein the error recovery comprises either one or a combination of temporal error concealment, spatial error concealment and frame rate up conversion.

56. A method for use in multimedia stream processing, comprising:

receiving multiple streams of encoded multimedia data;

performing error recovery on an erroneous portion of a stream; and

reconstructing the multimedia data from the multiple streams.

57. The method of claim 56, wherein the error recovery comprises either one or a combination of temporal error concealment, spatial error concealment and frame rate up conversion.

58. An apparatus for use in multimedia stream processing, comprising:

means for receiving multiple stream of encoded multimedia data;

means for performing error recovery on an erroneous portion of a stream; and

means for reconstructing the multimedia data from the multiple streams.

59. The apparatus of claim 58, wherein the error recovery comprises either one or a combination of temporal error concealment, spatial error concealment and frame rate up conversion.

60. An apparatus for use in multimedia stream processing, comprising:

a receiver to receive multiple streams of encoded multimedia data;

an error recovery component to perform error recovery on an erroneous portion of a stream; and

a reconstructor to reconstruct the multimedia data from the multiple streams.

61. The apparatus of claim 60, wherein the error recovery comprises either one or a combination of temporal error concealment, spatial error concealment and frame rate up conversion.

62. A processor for use in multimedia stream processing, the processor configured to:

receive multiple streams of encoded multimedia data;

perform error recovery on an erroneous portion of a stream; and

reconstruct the multimedia data from the multiple streams.

63. The processor of claim 62, wherein the error recovery comprises either one or a combination of temporal error concealment, spatial error concealment and frame rate up conversion.

64. A computer readable medium embodying a method for use in multimedia stream processing, the method comprising:

receiving multiple streams of encoded multimedia data;

performing error recovery on an erroneous portion of a stream; and

reconstructing the multimedia data from the multiple streams.

65. The computer readable medium of claim 64, wherein the error recovery comprises either one or a combination of temporal error concealment, spatial error concealment and frame rate up conversion.