System and method for indicating track relationships in media files

• US 8,365,060 B2
• Filed: 08/23/2007
• Issued: 01/29/2013
• Est. Priority Date: 08/24/2006
• Status: Active Grant

• Current Assignee: RPX Corporation
• Original Assignee: Nokia Corporation
• Inventors: Wang, Ye-Kui, Hannuksela, Miska, Bouazizi, Imed
• Primary Examiner(s): HUYNH, CONG LAC T
• Application Number:
  US11/844,300
• Publication Number:
  US 20080052306A1
• Time in Patent Office: 1,986 Days
• Field of Search: 715/201, 715/202
• US Class Current: 715/202
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 7/52 Systems for transmission of a pulse code modulated video signal with one or more other pulse code modulated signals, e.g. an audio signal or a synchronizing signal assembling of a multiplex stream by combining a video stream with other content or additional data, remultiplexing of multiplex streams, insertion of stuffing bits into the multiplex stream, assembling of a packetised elementary stream at server side H04N21/236; disassembling of a multiplex stream, remultiplexing of multiplex streams, extraction or processing of Service Information, disassembling of packetised elementary stream at client side H04N21/434

Abstract

A system and method for signaling and indicating track relationship information in media files provides a mechanism for signaling the information of layered track groups and the information of multiple description coding (MDC) track groups, as well as a mechanism for signaling track relationship information in an efficient way. In local playback or unicast streaming applications, to select an independently decodable track for a certain media type, the information of alternate track groups is first found via the track relation box, and one track is selected from an alternate track group for the media type. If stream switching is desired, the switching track group information is found via the track relation box. In multicast applications with scalable or MDC streams, the tracks in a layered or MDC group are found via the track relation box and selected among all the layered or MDC groups.

Claims

1. A method of storing coded multimedia content into a container file, comprising:

including a plurality of tracks into the container file;

determining track relationship information, the track relationship information identifying multiple description coding (MDC) and group track relationships among the plurality of tracks and

signaling the track relationship information,

wherein the track relationship information includes;

the number of tracks included in each alternate track group; and

an identifier for each track in each alternate track group.

2. The method of claim 1, wherein the track relationship information is encoded in a track relation box.

3. The method of claim 2, wherein the track relation box includes an indication as to whether information relating to alternate track groups is present in the track relation box.

4. The method of claim 3, wherein, if information relating to alternate track groups is present in the track relation box, the track relation box includes information regarding:

the number of alternate track groups in the container file,

an identifier for each alternate track group,

the number of tracks included in each alternate track group, and

an identifier for each track in each alternate track group.

5. The method of claim 2, wherein the track relation box includes an indication as to whether information relating to switching track groups is present in the track relation box.

6. The method of claim 5, wherein, if information relating to switching track groups is present in the track relation box, the track relation box includes information regarding:

the number of switching track groups in the container file,

an identifier for each switching track group,

the number of tracks included in each switching track group, and

an identifiers for each track in each switching track group.

7. The method of claim 2, wherein the track relation box includes an indication as to whether information relating to layered track groups is present in the track relation box.

8. The method of claim 7, wherein, if information relating to layered track groups is present in the track relation box, the track relation box includes information regarding:

the number of layered track groups in the container file,

an identifier for each layered track group,

the number of tracks included in each layered track group,

an identifier for each track in each layered track group,

for each track, an indication of the number of other tracks upon which the respective track directly or indirectly depends, and

for each track, an identification of the other tracks upon which the respective track directly or indirectly depends.

9. The method of claim 2, wherein the track relation box includes an indication as to whether information relating to multiple description coding (MDC) track groups is present in the track relation box.

10. The method of claim 9, wherein, if information relating to MDC track groups is present in the track relation box, the track relation box includes information regarding:

the number of MDC track groups in the container file,

an identifier for each MDC track group,

the number of tracks included in each MDC track group, and

an identifier for each track in each MDC track group.

11. The method of claim 2, wherein the track relation box is contained within a movie box.

12. The method of claim 2, wherein the track relation box is contained within a movie header box.

13. The method of claim 2, wherein the track relation box is contained within a movie-level user data box container.

14. The method of claim 1, wherein the track relationship information includes information regarding different types of track groups, and wherein the information regarding different types of track groups is encoded in separate boxes.

15. The method of claim 1, wherein the track relationship information includes information regarding layered track groups, the information regarding layered track groups being encoded at the track level.

16. The method of claim 1, wherein the track relationship information includes information regarding multiple description coding (MDC) track groups, the information regarding MDC track groups being encoded at the track level.

17. A computer program product, embodied in a computer-readable medium, for storing coded multimedia content into a container file, comprising:

computer code for including a plurality of tracks into the container file; and

computer code for determining track relationship information, the track relationship information identifying multiple description coding (MDC) and group track relationships among the plurality of tracks; and

computer code for signaling the track relationship information,

wherein the track relationship information includes;

the number of tracks included in each alternate track group; and

an identifier for each track in each alternate track group.

18. An apparatus, comprising:

a processor; and

a memory unit communicatively connected to the processor and including;

computer code for including a plurality of tracks into the container file;

computer code for determining track relationship information, the track relationship information identifying multiple description coding (MDC) and group track relationships among the plurality of tracks; and

computer code for signaling the track relationship information,

wherein the track relationship information includes;

the number of tracks included in each alternate track group; and

an identifier for each track in each alternate track group.

19. The apparatus of claim 18, wherein the track relationship information is encoded in a track relation box.

20. The apparatus of claim 19, wherein the track relation box includes an indication as to whether information relating to alternate track groups is present in the track relation box.

21. The apparatus of claim 20, wherein, if information relating to alternate track groups is present in the track relation box, the track relation box includes information regarding:

the number of alternate track groups in the container file,

an identifier for each alternate track group,

the number of tracks included in each alternate track group, and

an identifier for each track in each alternate track group.

22. The apparatus of claim 19, wherein the track relation box includes an indication as to whether information relating to switching track groups is present in the track relation box.

23. The apparatus of claim 22, wherein, if information relating to switching track groups is present in the track relation box, the track relation box includes information regarding:

the number of switching track groups in the container file,

an identifier for each switching track group,

the number of tracks included in each switching track group, and

an identifiers for each track in each switching track group.

24. The apparatus of claim 19, wherein the track relation box includes an indication as to whether information relating to layered track groups is present in the track relation box.

25. The apparatus of claim 24, wherein, if information relating to layered track groups is present in the track relation box, the track relation box includes information regarding:

the number of layered track groups in the container file,

an identifier for each layered track group,

the number of tracks included in each layered track group,

an identifier for each track in each layered track group,

for each track, an indication of the number of other tracks upon which the respective track directly or indirectly depends, and

for each track, an identification of the other tracks upon which the respective track directly or indirectly depends.

26. The apparatus of claim 19, wherein the track relation box includes an indication as to whether information relating to multiple description coding (MDC) track groups is present in the track relation box.

27. The apparatus of claim 26, wherein, if information relating to MDC track groups is present in the track relation box, the track relation box includes information regarding:

the number of MDC track groups in the container file,

an identifier for each MDC track group,

the number of tracks included in each MDC track group, and

an identifier for each track in each MDC track group.

28. The apparatus of claim 19, wherein the track relation box is contained within a movie box.

29. The apparatus of claim 19, wherein the track relation box is contained within a movie header box.

30. The apparatus of claim 19, wherein the track relation box is contained within a movie-level user data box container.

31. The apparatus of claim 18, wherein the track relationship information includes information regarding different types of track groups, and wherein the information regarding different types of track groups is encoded in separate boxes.

32. The apparatus of claim 18, wherein the track relationship information includes information regarding layered track groups, the information regarding layered track groups being encoded at the track level.

33. The apparatus of claim 18, wherein the track relationship information includes information regarding multiple description coding (MDC) track groups, the information regarding MDC track groups being encoded at the track level.

34. A method of storing coded multimedia content into a container file, comprising:

including a plurality of tracks into the container file;

determining track relationship information, the track relationship information identifying relationships among the plurality of tracks; and

signaling the track relationship information at a presentation or movie level,

wherein the track relationship information includes;

the number of tracks included in each alternate track group; and

an identifier for each track in each alternate track group.

35. A computer program product, embodied in a computer-readable medium, for storing coded multimedia content into a container file, comprising:

computer code for including a plurality of tracks into the container file; and

computer code for determining track relationship information, the track relationship information identifying relationships among the plurality of tracks; and

computer code for signaling the track relationship information at a presentation or movie level,

wherein the track relationship information includes;

the number of tracks included in each alternate track group; and

an identifier for each track in each alternate track group.

36. An apparatus, comprising:

a processor; and

a memory unit communicatively connected to the processor and including;

computer code for including a plurality of tracks into the container file; and

computer code for determining track relationship information, the track relationship information identifying relationships among the plurality of tracks; and

computer code for signaling the track relationship information at a presentation or movie level,

wherein the track relationship information includes;

the number of tracks included in each alternate track group; and

an identifier for each track in each alternate track group.

37. A method of parsing coded multimedia content from a container file, comprising:

parsing signaled track relationship information, the track relationship information identifying multiple description coding (MDC) and group track relationships among a plurality of tracks; and

parsing the plurality of tracks from the container file in accordance with the parsed track relationship information

wherein the track relationship information includes;

the number of tracks included in each alternate track group; and

an identifier for each track in each alternate track group.

38. The method of claim 37, wherein the track relationship information is encoded in a track relation box.

39. The method of claim 38, wherein the track relation box includes an indication as to whether information relating to alternate track groups is present in the track relation box.

40. The method of claim 39, wherein, if information relating to alternate track groups is present in the track relation box, the track relation box includes information regarding:

the number of alternate track groups in the container file,

an identifier for each alternate track group,

the number of tracks included in each alternate track group, and

an identifier for each track in each alternate track group.

41. The method of claim 38, wherein the track relation box includes an indication as to whether information relating to switching track groups is present in the track relation box.

42. The method of claim 41, wherein, if information relating to switching track groups is present in the track relation box, the track relation box includes information regarding:

the number of switching track groups in the container file,

an identifier for each switching track group,

the number of tracks included in each switching track group, and

an identifiers for each track in each switching track group.

43. The method of claim 38, wherein the track relation box includes an indication as to whether information relating to layered track groups is present in the track relation box.

44. The method of claim 43, wherein, if information relating to layered track groups is present in the track relation box, the track relation box includes information regarding:

the number of layered track groups in the container file,

an identifier for each layered track group,

the number of tracks included in each layered track group,

an identifier for each track in each layered track group,

for each track, an indication of the number of other tracks upon which the respective track directly or indirectly depends, and

for each track, an identification of the other tracks upon which the respective track directly or indirectly depends.

45. The method of claim 38, wherein the track relation box includes an indication as to whether information relating to multiple description coding (MDC) track groups is present in the track relation box.

46. The method of claim 45, wherein, if information relating to MDC track groups is present in the track relation box, the track relation box includes information regarding:

the number of MDC track groups in the container file,

an identifier for each MDC track group,

the number of tracks included in each MDC track group, and

an identifier for each track in each MDC track group.

47. The method of claim 38, wherein the track relation box is contained within a movie box.

48. The method of claim 38, wherein the track relation box is contained within a movie header box.

49. The method of claim 38, wherein the track relation box is contained within a movie-level user data box container.

50. The method of claim 37, wherein the track relationship information includes information regarding different types of track groups, and wherein the information regarding different types of track groups is encoded in separate boxes.

51. The method of claim 37, wherein the track relationship information includes information regarding layered track groups, the information regarding layered track groups being encoded at the track level.

52. The method of claim 37, wherein the track relationship information includes information regarding multiple description coding (MDC) track groups, the information regarding MDC track groups being encoded at the track level.

53. A computer program product, embodied in a computer-readable medium, for parsing coded multimedia content from a container file, comprising:

computer code for parsing signaled track relationship information, the track relationship information identifying multiple description coding (MDC) and group track relationships among a plurality of tracks; and

computer code for parsing the plurality of tracks from the container file in accordance with the parsed track relationship information,

wherein the track relationship information includes;

the number of tracks included in each alternate track group; and

an identifier for each track in each alternate track group.

54. An apparatus, comprising:

a processor; and

a memory unit communicatively connected to the processor and including;

computer code for parsing signaled track relationship information, the track relationship information identifying multiple description coding (MDC) and group track relationships among a plurality of tracks; and

computer code for parsing the plurality of tracks from the container file in accordance with the parsed track relationship information,

wherein the track relationship information includes;

the number of tracks included in each alternate track group; and

an identifier for each track in each alternate track group.

55. The apparatus of claim 54, wherein the track relationship information is encoded in a track relation box.

56. The apparatus of claim 55, wherein the track relation box includes an indication as to whether information relating to alternate track groups is present in the track relation box.

57. The apparatus of claim 56, wherein, if information relating to alternate track groups is present in the track relation box, the track relation box includes information regarding:

the number of alternate track groups in the container file,

an identifier for each alternate track group,

the number of tracks included in each alternate track group, and

an identifier for each track in each alternate track group.

58. The apparatus of claim 55, wherein the track relation box includes an indication as to whether information relating to switching track groups is present in the track relation box.

59. The apparatus of claim 58, wherein, if information relating to switching track groups is present in the track relation box, the track relation box includes information regarding:

the number of switching track groups in the container file,

an identifier for each switching track group,

the number of tracks included in each switching track group, and

an identifiers for each track in each switching track group.

60. The apparatus of claim 55, wherein the track relation box includes an indication as to whether information relating to layered track groups is present in the track relation box.

61. The apparatus of claim 60, wherein, if information relating to layered track groups is present in the track relation box, the track relation box includes information regarding:

the number of layered track groups in the container file,

an identifier for each layered track group,

the number of tracks included in each layered track group,

an identifier for each track in each layered track group,

for each track, an indication of the number of other tracks upon which the respective track directly or indirectly depends, and

for each track, an identification of the other tracks upon which the respective track directly or indirectly depends.

62. The apparatus of claim 55, wherein the track relation box includes an indication as to whether information relating to multiple description coding (MDC) track groups is present in the track relation box.

63. The apparatus of claim 62, wherein, if information relating to MDC track groups is present in the track relation box, the track relation box includes information regarding:

the number of MDC track groups in the container file,

an identifier for each MDC track group,

the number of tracks included in each MDC track group, and

an identifier for each track in each MDC track group.

64. The apparatus of claim 55, wherein the track relation box is contained within a movie box.

65. The apparatus of claim 55, wherein the track relation box is contained within a movie header box.

66. The apparatus of claim 55, wherein the track relation box is contained within a movie-level user data box container.

67. The apparatus of claim 54, wherein the track relationship information includes information regarding different types of track groups, and wherein the information regarding different types of track groups is encoded in separate boxes.

68. The apparatus of claim 54, wherein the track relationship information includes information regarding layered track groups, the information regarding layered track groups being encoded at the track level.

69. The apparatus of claim 54, wherein the track relationship information includes information regarding multiple description coding (MDC) track groups, the information regarding MDC track groups being encoded at the track level.

70. A method of parsing coded multimedia content from a container file, comprising:

parsing signaled track relationship information at a presentation or movie level, the track relationship information identifying relationships among a plurality of tracks; and

parsing the plurality of tracks from the container file in accordance with the parsed track relationship information

wherein the track relationship information includes;

the number of tracks included in each alternate track group; and

an identifier for each track in each alternate track group.

71. A computer program product, embodied in a computer-readable medium, for parsing coded multimedia content from a container file, comprising:

computer code for parsing signaled track relationship information at a presentation or movie level, the track relationship information identifying relationships among a plurality of tracks; and

computer code for parsing the plurality of tracks from the container file in accordance with the parsed track relationship information,

wherein the track relationship information includes;

the number of tracks included in each alternate track group; and

an identifier for each track in each alternate track group.

72. An apparatus, comprising:

a processor; and

a memory unit communicatively connected to the processor and including;

computer code for parsing signaled track relationship information at a presentation or movie level, the track relationship information identifying relationships among a plurality of tracks; and

computer code for parsing the plurality of tracks from the container file in accordance with the parsed track relationship information,

wherein the track relationship information includes;

the number of tracks included in each alternate track group; and

an identifier for each track in each alternate track group.

73. A computer-readable medium having embodied therein a container file, the container file comprising:

a plurality of tracks, and

signaled track relationship information, the track relationship information identifying multiple description coding (MDC) and group track relationships among the plurality of tracks,

wherein the track relationship information includes;

the number of tracks included in each alternate track group; and

an identifier for each track in each alternate track group.

74. A computer-readable medium having embodied therein a container file, the container file comprising:

a plurality of tracks, and

signaled track relationship information at a presentation or movie level, the track relationship information identifying relationships among the plurality of tracks,

wherein the track relationship information includes;

the number of tracks included in each alternate track group; and

an identifier for each track in each alternate track group.