Network streaming of coded video data

• US 9,357,275 B2
• Filed: 07/29/2012
• Issued: 05/31/2016
• Est. Priority Date: 09/06/2011
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Nagaraj, Thadi M., Gholmieh, Ralph A.
• Primary Examiner(s): Nguyen, Tammy
• Application Number:
  US13/561,075
• Publication Number:
  US 20130060956A1
• Time in Patent Office: 1,402 Days
• Field of Search: 709/231, 709/203, 709/219, 370/360
• US Class Current: 1/1
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: H04L 65/61 for supporting one-way streaming services, e.g. Internet radio
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04N 21/4384 involving operations to reduce the access time, e.g. fast-tuning for reducing channel switching latency
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/64322 IP
• CPC Class Codes: H04N 21/845 Structuring of content, e.g. decomposing content into time segments
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/85406 involving a specific file format, e.g. MP4 format

Abstract

In one example, a device configured to receive a first sub-segment of a segment of multimedia data, the first sub-segment comprising a first set of one or more data units and a first header including data indicative of locations of the data units within the first sub-segment, wherein at least one of the data units refers to a data unit of a second sub-segment of the segment. The device is also configured to, after receiving the first sub-segment, receive the second sub-segment, the second sub-segment comprising a second set of one or more data units and a second header including data indicative of locations of the data units within the second sub-segment. The device is also configured to process at least a portion of the segment after receiving the first sub-segment and the second sub-segment.

Claims

1. A method of receiving multimedia data, the method comprising:

receiving a first sub-segment of a segment of multimedia data, the first sub-segment sent before the segment was fully formed by a content preparation device, the first sub-segment comprising a first set of one or more data units and a first header including data indicative of locations of the data units within the first sub-segment, wherein at least one of the data units refers to a data unit of a second sub-segment of the segment;

after receiving the first sub-segment, receiving the second sub-segment, the second sub-segment sent before the segment was fully formed by the content preparation device, the second sub-segment comprising a second set of one or more data units and a second header including data indicative of locations of the data units within the second sub-segment; and

processing at least a portion of the segment after receiving the first sub-segment and the second sub-segment.

2. The method of claim 1, further comprising receiving a header for the segment, wherein the header includes information applicable to both the first sub-segment and the second sub-segment.

3. The method of claim 2, wherein receiving the header for the segment comprises receiving the header for the segment before receiving the first sub-segment, the method further comprising receiving, after receiving the first sub-segment and before receiving the second sub-segment, a flag value indicating that the header for the segment has not changed.

4. The method of claim 2, wherein the header for the segment comprises information indicative of at least one of an encoding format for audio data of the segment, an encoding format for video data of the segment, a bitrate for the segment, a quality level for the segment, a resolution of the video data of the segment, or a frame rate of the video data of the segment.

5. The method of claim 1, wherein processing the segment comprises decoding the first set of data units and the second set of data units.

6. The method of claim 5, wherein decoding the first set of data units comprises video decoding including at least one of spatially or temporally predicting at least a portion of at least one of the data units of the first set of data units relative to at least one of the data units of the second set of data units.

7. The method of claim 1, wherein receiving the first sub-segment comprises receiving the first sub-segment in accordance with a broadcast network protocol, and wherein receiving the second sub-segment comprises receiving the second sub-segment in accordance with the broadcast network protocol.

8. An apparatus for receiving multimedia data comprising one or more processors configured to:

receive a first sub-segment of a segment of multimedia data, the first sub-segment sent before the segment was fully formed by a content preparation device, the first sub-segment comprising a first set of one or more data units and a first header including data indicative of locations of the data units within the first sub-segment, wherein at least one of the data units refers to a data unit of a second sub-segment of the segment;

after receiving the first sub-segment, receive the second sub-segment, the second sub-segment sent before the segment was fully formed by the content preparation device, the second sub-segment comprising a second set of one or more data units and a second header including data indicative of locations of the data units within the second sub-segment; and

process at least a portion of the segment after receiving the first sub-segment and the second sub-segment.

9. The apparatus of claim 8, wherein in the one or more processors are further configured to receive a header for the segment, wherein the header includes information applicable to both the first sub-segment and the second sub-segment.

10. The apparatus of claim 9, wherein receiving the header for the segment comprises receiving the header for the segment before receiving the first sub-segment, wherein the one or more processors are further configured to receive, after receiving the first sub-segment and before receiving the second sub-segment, a flag value indicating that the header for the segment has not changed.

11. The apparatus of claim 9, wherein the header for the segment comprises information indicative of at least one of an encoding format for audio data of the segment, an encoding format for video data of the segment, a bitrate for the segment, a quality level for the segment, a resolution of the video data of the segment, or a frame rate of the video data of the segment.

12. The apparatus of claim 8, wherein processing the segment comprises decoding the first set of data units and the second set of data units.

13. The apparatus of claim 12, wherein decoding the first set of data units comprises video decoding including at least one of spatially or temporally predicting at least a portion of at least one of the data units of the first set of data units relative to at least one of the data units of the second set of data units.

14. The apparatus of claim 8, wherein receiving the first sub-segment comprises receiving the first sub-segment in accordance with a broadcast network protocol, and wherein receiving the second sub-segment comprises receiving the second sub-segment in accordance with the broadcast network protocol.

15. An apparatus for receiving multimedia data comprising:

means for receiving a first sub-segment of a segment of multimedia data, the first sub-segment sent before the segment was fully formed by a content preparation device, the first sub-segment comprising a first set of one or more data units and a first header including data indicative of locations of the data units within the first sub-segment, wherein at least one of the data units refers to a data unit of a second sub-segment of the segment;

means for receiving, after receiving the first sub-segment, the second sub-segment, the second sub-segment sent before the segment was fully formed by the content preparation device, the second sub-segment comprising a second set of one or more data units and a second header including data indicative of locations of the data units within the second sub-segment; and

means for processing at least a portion of the segment after receiving the first sub-segment and the second sub-segment.

16. The apparatus of claim 15, further comprising means for receiving a header for the segment, wherein the header includes information applicable to both the first sub-segment and the second sub-segment.

17. The apparatus of claim 16, wherein means for receiving the header for the segment comprises means for receiving the header for the segment before receiving the first sub-segment, the apparatus further comprising means for receiving, after receiving the first sub-segment and before receiving the second sub-segment, a flag value indicating that the header for the segment has not changed.

18. The apparatus of claim 16, wherein the header for the segment comprises information indicative of at least one of an encoding format for audio data of the segment, an encoding format for video data of the segment, a bitrate for the segment, a quality level for the segment, a resolution of the video data of the segment, or a frame rate of the video data of the segment.

19. The apparatus of claim 15, wherein means for processing the segment comprises means for decoding the first set of data units and the second set of data units.

20. The apparatus of claim 19, wherein means for decoding the first set of data units comprises means for video decoding including at least one of spatially or temporally predicting at least a portion of at least one of the data units of the first set of data units relative to at least one of the data units of the second set of data units.

21. The apparatus of claim 15, wherein means for receiving the first sub-segment comprises means for receiving the first sub-segment in accordance with a broadcast network protocol, and wherein means for receiving the second sub-segment comprises means for receiving the second sub-segment in accordance with the broadcast network protocol.

22. A computer program product comprising a non-transitory computer-readable medium having stored thereon instructions that, when executed, cause one or more processors to:

receive a first sub-segment of a segment of multimedia data, the first sub-segment sent before the segment was fully formed by a content preparation device, the first sub-segment comprising a first set of one or more data units and a first header including data indicative of locations of the data units within the first sub-segment, wherein at least one of the data units refers to a data unit of a second sub-segment of the segment;

after receiving the first sub-segment, receive the second sub-segment, the second sub-segment sent before the segment was fully formed by the content preparation device, the second sub-segment comprising a second set of one or more data units and a second header including data indicative of locations of the data units within the second sub-segment; and

process at least a portion of the segment after receiving the first sub-segment and the second sub-segment.

23. The computer program product of claim 22, further comprising instructions that, when executed, cause the one or more processors to receive a header for the segment, wherein the header includes information applicable to both the first sub-segment and the second sub-segment.

24. The computer program product of claim 23, wherein receiving the header for the segment comprises receiving the header for the segment before receiving the first sub-segment, the method further comprising receiving, after receiving the first sub-segment and before receiving the second sub-segment, a flag value indicating that the header for the segment has not changed.

25. The computer program product of claim 23, wherein the header for the segment comprises information indicative of at least one of an encoding format for audio data of the segment, an encoding format for video data of the segment, a bitrate for the segment, a quality level for the segment, a resolution of the video data of the segment, or a frame rate of the video data of the segment.

26. The computer program product of claim 22, wherein processing the segment comprises decoding the first set of data units and the second set of data units.

27. The computer program product of claim 26, wherein decoding the first set of data units comprises video decoding including at least one of spatially or temporally predicting at least a portion of at least one of the data units of the first set of data units relative to at least one of the data units of the second set of data units.

28. The computer program product of claim 22, wherein receiving the first sub-segment comprises receiving the first sub-segment in accordance with a broadcast network protocol, and wherein receiving the second sub-segment comprises receiving the second sub-segment in accordance with the broadcast network protocol.

29. A method of sending multimedia data, the method comprising:

sending a first sub-segment of a segment of multimedia data, the first sub-segment comprising a first set of one or more data units and a first header including data indicative of locations of the data units within the first sub-segment, wherein at least one of the data units refers to a data unit of a second sub-segment of the segment; and

after sending the first sub-segment, sending the second sub-segment, the second sub-segment comprising a second set of one or more data units and a second header including data indicative of locations of the data units within the second sub-segment,

wherein each sub-segment is sent before the segment has been fully formed.

30. The method of claim 29, further comprising encoding the at least one of the data units relative to the data unit of the second sub-segment, wherein sending the first sub-segment comprises sending the first sub-segment before finishing encoding of each data unit of the second sub-segment.

31. The method of claim 29, further comprising sending a header for the segment, wherein the header includes information applicable to both the first sub-segment and the second sub-segment.

32. The method of claim 31, wherein sending the header for the segment comprises sending the header for the segment before sending the first sub-segment, the method further comprising sending, after sending the first sub-segment and before sending the second sub-segment, a flag value indicating that the header for the segment has not changed.

33. The method of claim 31, further comprising generating the header for the segment to include information indicative of at least one of an encoding format for audio data of the segment, an encoding format for video data of the segment, a bitrate for the segment, a quality level for the segment, a resolution of the video data of the segment, or a frame rate of the video data of the segment.

34. An apparatus for sending multimedia data comprising one or more processors configured to:

send a first sub-segment of a segment of multimedia data, the first sub-segment comprising a first set of one or more data units and a first header including data indicative of locations of the data units within the first sub-segment, wherein at least one of the data units refers to a data unit of a second sub-segment of the segment; and

after sending the first sub-segment, send the second sub-segment, the second sub-segment comprising a second set of one or more data units and a second header including data indicative of locations of the data units within the second sub-segment,

wherein each sub-segment is sent before the segment has been fully formed.

35. The apparatus of claim 34, wherein the one or more processors are further configured to encode the at least one of the data units relative to the data unit of the second sub-segment, wherein sending the first sub-segment comprises sending the first sub-segment before finishing encoding of each data unit of the second sub-segment.

36. The apparatus of claim 34, wherein the one or more processors are further configured to send a header for the segment, wherein the header includes information applicable to both the first sub-segment and the second sub-segment.

37. The apparatus of claim 36, wherein sending the header for the segment comprises sending the header for the segment before sending the first sub-segment, wherein the one or more processors are further configured to send, after sending the first sub-segment and before sending the second sub-segment, a flag value indicating that the header for the segment has not changed.

38. The apparatus of claim 36, wherein the one or more processors are further configured to generate the header for the segment to include information indicative of at least one of an encoding format for audio data of the segment, an encoding format for video data of the segment, a bitrate for the segment, a quality level for the segment, a resolution of the video data of the segment, or a frame rate of the video data of the segment.

39. An apparatus for sending multimedia data, the apparatus comprising:

means for sending a first sub-segment of a segment of multimedia data, the first sub-segment comprising a first set of one or more data units and a first header including data indicative of locations of the data units within the first sub-segment, wherein at least one of the data units refers to a data unit of a second sub-segment of the segment; and

means for sending, after sending the first sub-segment, the second sub-segment, the second sub-segment comprising a second set of one or more data units and a second header including data indicative of locations of the data units within the second sub-segment,

wherein each sub-segment is sent before the segment has been fully formed.

40. The apparatus of claim 39, further comprising means for encoding the at least one of the data units relative to the data unit of the second sub-segment, wherein means for sending the first sub-segment comprises means for sending the first sub-segment before finishing encoding of each data unit of the second sub-segment.

41. The apparatus of claim 39, further comprising means for sending a header for the segment, wherein the header includes information applicable to both the first sub-segment and the second sub-segment.

42. The apparatus of claim 41, wherein means for sending the header for the segment comprises means for sending the header for the segment before sending the first sub-segment, further comprising means for sending, after sending the first sub-segment and before sending the second sub-segment, a flag value indicating that the header for the segment has not changed.

43. The apparatus of claim 41, further comprising means for generating the header for the segment to include information indicative of at least one of an encoding format for audio data of the segment, an encoding format for video data of the segment, a bitrate for the segment, a quality level for the segment, a resolution of the video data of the segment, or a frame rate of the video data of the segment.

44. A computer program product comprising a non-transitory computer-readable medium having stored thereon instructions that, when executed, cause one or more processors to:

send a first sub-segment of a segment of multimedia data, the first sub-segment comprising a first set of one or more data units and a first header including data indicative of locations of the data units within the first sub-segment, wherein at least one of the data units refers to a data unit of a second sub-segment of the segment; and

after sending the first sub-segment, send the second sub-segment, the second sub-segment comprising a second set of one or more data units and a second header including data indicative of locations of the data units within the second sub-segment,

wherein each sub-segment is sent before the segment has been fully formed.

45. The computer program product of claim 44, further comprising instructions that, when executed, cause the one or more processors to encode the at least one of the data units relative to the data unit of the second sub-segment, and to send the first sub-segment before finishing encoding of each data unit of the second sub-segment.

46. The computer program product of claim 44, further comprising instructions that, when executed, cause the one or more processors to send a header for the segment, wherein the header includes information applicable to both the first sub-segment and the second sub-segment.

47. The computer program product of claim 46, wherein sending the header for the segment comprises sending the header for the segment before sending the first sub-segment, further comprising further comprising instructions that, when executed, cause the one or more processors to send, after sending the first sub-segment and before sending the second sub-segment, a flag value indicating that the header for the segment has not changed.

48. The computer program product of claim 46, further comprising instructions that, when executed, cause the one or more processors to generate the header for the segment to include information indicative of at least one of an encoding format for audio data of the segment, an encoding format for video data of the segment, a bitrate for the segment, a quality level for the segment, a resolution of the video data of the segment, or a frame rate of the video data of the segment.