Multi-bit-rate streaming delivery

• US 8,205,004 B1
• Filed: 06/26/2009
• Issued: 06/19/2012
• Est. Priority Date: 06/26/2009
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Kaufman, Matthew, Barnert, Andrew
• Primary Examiner(s): Nguyen, Dustin
• Application Number:
  US12/493,121
• Time in Patent Office: 1,089 Days
• Field of Search: 709/231, 709/233, 709/232, 715/716, 375/240
• US Class Current: 709/231
• CPC Class Codes: H04L 65/70 Media network packetisation

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, relating to single-file multi-bit-rate streaming delivery are described. Media data can be encoded into a single file (or very small number of files), which can then be placed on an unmodified Hypertext Transfer Protocol (HTTP) server. Further, the techniques disclosed here can use HTTP for distribution of the encoded media file and may support multi-bit-rate playback at a client without requiring a modification or plug-in to the server software. Furthermore, these techniques use properties of HTTP and Transmission Control Protocol (TCP) to minimize playback startup time.

Claims

1. A method comprising:

receiving, from a media streaming provider via a communication channel in response to a first request, a first data item regarding a media document that includes multiple data segments, the received first data item comprising;

a first media data segment of the media document from among the multiple data segments, the first media data segment comprising a first media portion, and

a first portion of an index for the media document, the first index portion comprising index information relating to a first set of media data segments, the first set of media data segments comprising

media data segments from among the multiple data segments of the media document that comprise, respectively, media portions succeeding the first media portion, each of the media portions succeeding the first media portion being encoded at each of multiple bit-rates, and

media data segments of the media document that correspond, respectively, to predetermined media locations of the media document, each of the media data segments that correspond to the predetermined media locations including an associated media portion encoded at a lowest bit-rate from the multiple bit-rates;

while the received first data item is being output for playing on an output device, selecting a second media data segment from the first set of media data segments of the media document based on;

the information in the first index portion, and

a supportable streaming bit-rate via the communication channel;

requesting, in a second request different from the first request, the selected second media data segment of the media document from the media streaming provider; and

receiving, from the media streaming provider via a communication channel in response to the second request, a second data item regarding the media document, the received second data item comprising;

the selected second media data segment of the media document, the selected second media data segment comprising a second media portion, and

a second portion of the index for the media document that is different from the first index portion, the second index portion comprising index information relating to a second set of media data segments, the second set of media data segments comprising

media data segments from among the multiple data segments of the media document that comprise, respectively, media portions succeeding the second media portion, each of the media portions succeeding the second media portion being encoded at each of the multiple bit-rates, and

media data segments of the media document that correspond, respectively, to the predetermined media locations of the media document, each of the media data segments that correspond to the predetermined media locations including the associated media portion encoded at the lowest bit-rate from the multiple bit-rates.

2. The method of claim 1, wherein requesting the selected second media data segment of the media document via the communication channel comprises:

specifying a locator of the media document, a byte-offset to indicate a beginning of the selected second media data segment, and a byte-offset to indicate an ending of the selected second media data segment.

3. The method of claim 1, wherein the first media data segment comprises the first index portion, and the selected second media data segment comprises the second index portion.

4. The method of claim 1, wherein said selecting the second media data segment comprises:

if an encoding bit-rate of the first data item being output for playing on the output device is less than the supportable streaming bit-rate via the communication channel then, identifying the selected second media data segment from the media data segments that comprise, respectively, the media portions succeeding the first media portion, the identified second media data segment encoded at one of the multiple bit-rates

larger than or equal to the encoding bit-rate of the first data item being output for playing on the output device, and

smaller than the supportable streaming bit-rate via the communication channel; and

if the encoding bit-rate of the first data item being output for playing on the output device is larger than or equal to the supportable streaming bit-rate via the communication channel then, identifying the selected second media data segment from the media data segments that comprise, respectively, the media portions succeeding the first media portion, the identified second media data segment encoded at one of the multiple bit-rates smaller than the supportable streaming bit-rate via the communication channel.

5. The method of claim 4, wherein

the predetermined media locations

comprise byte-offsets spaced to divide the media into parts having equal duration, and

correspond to media portions encoded at a lowest bit-rate from multiple bit-rates, and

the selecting of the second media data segment comprises identifying the selected second media data segment from the media data segments that correspond, respectively, to the predetermined media locations of the media document.

6. The method of claim 5, wherein the identified second media data segment succeeds the received first media data segment.

7. The method of claim 5, wherein the identified second media data segment precedes the received first media data segment.

8. A non-transitory computer storage medium encoded with a computer program, the program comprising instructions that when executed by data processing apparatus cause the data processing apparatus to perform operations comprising:

receiving, from a media streaming provider via a communication channel in response to a first request, a first segment of a media document, the received first segment comprising;

a first media portion of the media document, and

a first portion of an index for the media document, the first index portion comprising index information relating to a first set of segments, the first set of segments comprising

segments of the media document that comprise, respectively, media portions succeeding the first media portion, each of the media portions succeeding the first media portion being encoded at each of multiple bit-rates, and

segments of the media document that correspond, respectively, to predetermined media locations of the media document, each of the segments that correspond to the predetermined media locations including an associated media portion encoded at a lowest bit-rate from the multiple bit-rates;

while the received first segment is being output for playing on an output device, selecting a second segment from the first set of segments of the media document based on;

the information in the first index portion, and

a supportable streaming bit-rate via the communication channel;

requesting, in a second request different from the first request, the selected second segment of the media document from the media streaming provider; and

receiving, from the media streaming provider via the communication channel in response to the second request, the selected second segment of the media document, the received selected second segment comprising;

a second media portion of the media document, and

a second portion of the index for the media document that is different from the first index portion, the second index portion comprising index information relating to a second set of segments, the second set of segments comprising

segments of the media document that comprise, respectively, media portions succeeding the second media portion, each of the media portions succeeding the second media portion being encoded at each of the multiple bit-rates, and

segments of the media document that correspond, respectively, to the predetermined media locations of the media document, each of the segments that correspond to the predetermined media locations including the associated media portion encoded at the lowest bit-rate from the multiple bit-rates.

9. The non-transitory computer storage medium of claim 8, wherein the request for the selected second segment of the media document via the communication channel includes operations comprising:

specifying a locator of the media document, a byte-offset to indicate a beginning of the selected second segment, and a byte-offset to indicate an ending of the selected second segment.

10. The non-transitory computer storage medium of claim 8, wherein said selecting the second segment comprises:

if an encoding bit-rate of the first segment being output for playing on the output device is less than the supportable streaming bit-rate via the communication channel then, identifying the selected second segment from among the segments of the media document that comprise, respectively, the media portions succeeding the first media portion, the identified second segment encoded at one of the multiple bit-rates

larger than or equal to the encoding bit-rate of the first segment being output for playing on the output device, and

smaller than the supportable streaming bit-rate via the communication channel; and

if the encoding bit-rate of the first segment being output for playing on the output device is larger than or equal to the supportable streaming bit-rate via the communication channel then, identifying the selected second segment from the segments of the media document that comprise, respectively, the media portions succeeding the first media portion, the identified second segment encoded at one of the multiple bit-rates smaller than the supportable streaming bit-rate via the communication channel.

11. The non-transitory computer storage medium of claim 10, wherein

the predetermined media locations

comprise byte-offsets spaced to divide the media into parts having equal duration, and

correspond to media portions encoded at a lowest bit-rate from multiple bit-rates, and

the selecting of the second segment comprises identifying the selected second segment from the segments of the media document that correspond, respectively, to the predetermined media locations of the media document.

12. The non-transitory computer storage medium of claim 11, wherein the identified second segment succeeds the received first segment of the media document.

13. The non-transitory computer storage medium of claim 11, wherein the identified second segment precedes the received first segment of the media document.

14. A system for streaming media to a remote media play point via a communication channel, the system comprising:

a storage device including a non-transitory computer storage medium, the storage device configured to store a media document comprising segments of the media document, wherein each one of the segments comprises;

a media portion of the media document associated with the one of the segments, wherein the media portion is encoded at a bit-rate selected from a first set of different bit-rates; and

a portion of an index for the media document that is different from index portions associated with other ones of the segments, the index portion comprising index information relating to

a first set of segments of the media document that comprise, respectively, media portions succeeding the media portion associated with the one of the segments, each succeeding media portion from the first set encoded at each of the bit-rates from the set of different bit-rates, and

a second set of segments of the media document that correspond, respectively, to predetermined media locations of the media document, each segment from the second set including an associated media portion encoded at a lowest bit-rate from the set of different bit-rates,

wherein the index information comprises byte-offsets corresponding to the segments from the first and second sets;

a processor communicatively coupled to the storage device, the processor configured to;

receive, from the remote media play point, different requests for segments of the media document, each one of the requests comprising a locator of the media document, a byte-offset to indicate a beginning of the requested segment, and a byte-offset to indicate an ending of the requested segment; and

provide the requested segments of the media document to the remote media play point, such that each of the requested segments is provided in response to an associated request, prior to receiving a subsequent request for another segment.

15. The system of claim 14, wherein the set of different bit-rates comprises a first bit-rate smaller than a ratio between (i) a fraction of a TCP-initial-burst payload and (ii) a network round-trip time, wherein

the media portion included in the provided segment is encoded at the first bit-rate, and

a combination of the fraction of the TCP-initial-burst payload and the first bit-rate is selected based on media content to enable uninterrupted playback between consecutive requests at the remote media play point.

16. The system of claim 14, wherein each media portion of the media document is encoded at each of the bit-rates from the set of different bit-rates in a quantity of segments of the media document corresponding to the set of different bit-rates.

17. The system of claim 16, wherein the quantity of segments of the media document that comprise the media portion encoded at each of the bit-rates from the set of different bit-rates, respectively, are interleaved in a file.

18. The system of claim 16, wherein the quantity of segments of the media document that comprise the media portion encoded at each of the bit-rates from the set of different bit-rates, respectively, are stored in files corresponding to a quantity of the set of different bit-rates, respectively.

19. The system of claim 14, wherein the predetermined media locations are associated with publisher switch points.

20. The system of claim 14, wherein:

the predetermined media locations comprise byte-offsets spaced to divide the media into parts having equal duration;

the byte-offsets corresponding to segments of the second set of segments included in an index portion associated with a first segment of the media document have the largest spacing; and

the spacing between the byte-offsets corresponding to the segments of the second set of segments is reduced incrementally in subsequent segments before reaching a smallest spacing equal to a duration of the media portion included in each segment.

21. The system of claim 14, wherein the predetermined media locations of the media document are selectively associated with preceding segments of the media document.

22. The system in claim 14, wherein the index portion associated with the one of the segments of the media document comprises (i) a predetermined byte-offset and (ii) a predetermined byte-range within the one of the segments of the media document.