Media content streaming using stream message fragments

• US 9,667,682 B2
• Filed: 05/22/2015
• Issued: 05/30/2017
• Est. Priority Date: 08/17/2009
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Swaminathan, Viswanathan, Mitra, Saayan
• Primary Examiner(s): Lazaro, David
• Application Number:
  US14/720,458
• Publication Number:
  US 20150256578A1
• Time in Patent Office: 739 Days
• CPC Class Codes: G06F 16/2282 Tablespace storage structures; Management thereof
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/64322 IP
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for media content streaming can include transacting access information associated with a media stream and transacting one or more fragments associated with the media stream to facilitate a delivery of media content associated with the media stream. Access information can include fragment sequencing information to facilitate individual retrieval of fragments associated with the media stream using a uniform resource identifier via a processing device configured to cache content. A fragment can include one or more stream messages. A stream message can include a message header and a corresponding media data sample. The message header can include a message stream identifier, a message type identifier, a timestamp, and a message length value.

Claims

1. A method comprising:

forming, by a client device, a request to access a media stream at the client device;

responsive to communicating the request to access the media stream, receiving, by the client device, media stream access information via a network, the access information comprising a fragment run table that includes fragment sequencing information to facilitate retrieval of fragments associated with the media stream;

transmitting, by the client device, a fragment request that includes a first fragment index to request a run of a plurality of the fragments associated with the media stream;

receiving, by the client device, the requested run of fragments associated with the media stream in response to transmitting the fragment request; and

consuming, by the client device, the received fragments.

2. A method as described in claim 1, wherein the fragment run table contains individual entries for each continuous run of fragments associated with the media stream, each entry including:

a value denoting a number of fragments associated with the continuous run;

a first fragment index indicating an index value associated with a first fragment of the continuous run; and

a fragment duration for each of the fragments in the continuous run.

3. A method as described in claim 1, wherein each fragment comprises at least one stream message, each stream message including a media data sample and a message header that includes a message stream identifier, a timestamp, and a message length value.

4. A method as described in claim 1, wherein the fragments are received, by the client device, using a Hypertext Transfer Protocol (HTTP).

5. A method as described in claim 1, further comprising receiving, by the client device, updated access information that reflects at least one additional fragment that was generated based on an incremental media data addition to the media stream.

6. A method as described in claim 1, further comprising obtaining, by the client device, a time index associated with the media stream responsive to communicating the request to access the media stream, the time index indicating a presentation time range for the media stream.

7. A method as described in claim 6, further comprising determining, by the client device, a fragment index to facilitate individual retrieval of a fragment from a run of fragments, wherein the fragment index indicates a timestamp for a corresponding fragment in the fragment run table for all presentation times in the time index.

8. A method comprising:

forming, by a client device, a request to access a media stream;

responsive to communicating the request to access the media stream, receiving, by the client device, media stream access information via a network, the access information comprising;

fragment sequencing information to facilitate individual retrieval of fragments associated with the media stream, said fragment sequencing information including a uniform resource identifier for each fragment, each uniform resource identifier indicating the location of a respective media cache node on which the fragment is stored; and

bootstrapping information for the media stream that identifies at least one alternative uniform resource identifier for fragments that are identical to the fragments associated with the media stream;

retrieving, by the client device, the fragments associated with the media stream using at least one of;

uniform resource identifiers included in the fragment sequencing information;

or

alternative uniform resource identifiers included in the bootstrapping information; and

consuming, by the client device, the retrieved fragments.

9. A method as described in claim 8, wherein each fragment comprises at least one stream message, each stream message including a media data sample and a message header that includes a message stream identifier, a timestamp, and a message length value.

10. A method as described in claim 8, wherein the fragments are retrieved, by the client device, using a Hypertext Transfer Protocol (HTTP).

11. A method as described in claim 8, wherein each of the fragments comprise at least one Real-Time Messaging Protocol (RTMP) message associated with audio data interleaved with at least one RTMP message associated with video data.

12. A method as described in claim 8, further comprising obtaining, by the client device, a time index associated with the media stream responsive to communicating the request to access the media stream, the time index indicating a presentation time range for the media stream.

13. A method as described in claim 12, further comprising determining, by the client device, a fragment index to facilitate individual retrieval of a fragment from a run of fragments, wherein the fragment index indicates a timestamp for a corresponding fragment in the fragment run table for all presentation times in the time index.

14. A system comprising:

at least one processor; and

at least one computer-readable storage medium having program instructions stored thereon that are executable by the at least one processor to perform operations comprising;

forming, by a device, a request to access a media stream at the device;

responsive to communicating the request to access the media stream, receiving, by the device, media stream access information, the access information comprising a fragment run table that includes fragment sequencing information to facilitate retrieval of fragments associated with the media stream;

transmitting, by the device, a fragment request that includes a first fragment index to request a run of a plurality of the fragments associated with the media stream;

receiving, by the device, the requested run of fragments associated with the media stream in response to transmitting the fragment request; and

consuming, by the device, the received fragments.

15. A system as described in claim 14, wherein the fragment run table contains individual entries for each continuous run of fragments associated with the media stream, each entry including:

a value denoting a number of fragments associated with the continuous run;

a first fragment index indicating an index value associated with a first fragment of the continuous run; and

a fragment duration for each of the fragments in the continuous run.

16. A system as described in claim 14, wherein each fragment comprises at least one stream message, each stream message including a media data sample and a message header that includes a message stream identifier, a timestamp, and a message length value.

17. A system as described in claim 14, wherein the fragments are received, by the device, using a Hypertext Transfer Protocol (HTTP).

18. A system as described in claim 14, the operations further comprising receiving, by the device, updated access information that reflects at least one additional fragment that was generated based on an incremental media data addition to the media stream.

19. A system as described in claim 14, the operations further comprising obtaining, by the device, a time index associated with the media stream responsive to communicating the request to access the media stream, the time index indicating a presentation time range for the media stream.

20. A system as described in claim 19, the operations further comprising determining, by the device, a fragment index to facilitate individual retrieval of a fragment from a run of fragments, wherein the fragment index indicates a timestamp for a corresponding fragment in the fragment run table for all presentation times in the time index.