Hypertext transfer protocol live streaming

• US 8,850,054 B2
• Filed: 01/17/2012
• Issued: 09/30/2014
• Est. Priority Date: 01/17/2012
• Status: Active Grant

• Current Assignee: Hulu LLC (The Walt Disney Company)
• Original Assignee: International Business Machines Corporation
• Inventors: Burckart, Erik J., Cuomo, Gennaro A., Joseph, Dinakaran, Moore, Victor S.
• Primary Examiner(s): VOSTAL, ONDREJ C
• Application Number:
  US13/352,154
• Publication Number:
  US 20130185452A1
• Time in Patent Office: 987 Days
• US Class Current: 709/231
• CPC Class Codes: G06F 15/16 Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs coordinating program control therefor G06F9/52; in regulating and control system G05B
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: H04N 21/2387 Stream processing in response to a playback request from an end-user, e.g. for trick-play
• CPC Class Codes: H04N 21/24 Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests monitoring of server performance or load G06F11/34; arrangements for observation, testing or troubleshooting for broadcast or for distribution combined with broadcast H04H20/12
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/2407 Monitoring of transmitted content, e.g. distribution time, number of downloads arrangements for monitoring programmes for broadcast or for distribution combined with broadcast H04H20/14
• CPC Class Codes: H04N 21/4825 using a list of items to be played back in a given order, e.g. playlists
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments

Abstract

Illustrative embodiments disclose receiving a command to play a selected audio visual media on a client device. The client device determines portions of audio visual media from elected audio visual media and a sequence identifying each portion of the portions in a particular order for playing the portions. The portions and the sequence are determined according to a policy for playing each portion on the client device. The client device retrieves the portions to play in sequence and plays at least a partially retrieved first portion of the portions of the selected audio visual media on the client device. The first portion is identified based on the particular order in the sequence.

Claims

1. A method for managing audio visual media, the method comprising:

receiving, by a processor unit of a client device, a command to play a selected audio visual media on the client device;

determining, by the processor unit, portions of audio visual media from the selected audio visual media using a predefined list of portions maintained on the client device and a sequence identifying each portion in a particular order for playing the portions in the predefined list of portions, wherein the portions and the sequence are determined according to a selected policy from a set of policies enabling the client device to request portions on-the-fly from a server, in response to adapting to changes detected by the client during a communication session for playing each portion on the client device, wherein a list generator module of the client device uses information from sources comprising metadata, the set of policies, preferences, rules, and metrics from a performance monitor and a communication environment monitor to generate the list of portions and a play sequence;

retrieving, by the processor unit, the portions to play in sequence determined wherein the processor unit, further storing a one or more portions in a set of memory buffers based on a digital rights management requirement allowing the one or more portions of the audio video media to be stored; and

playing, by the processor unit, at least a partially retrieved first portion of the portions of the selected audio visual media on the client device, wherein the first portion is identified based on the particular order in the sequence determined.

2. The method of claim 1, wherein retrieving, by the processor unit, the portions to play in the sequence determined comprises

retrieving the portions based on the selected policy from a set of policies;

and

wherein the selected policy includes rules for retrieving the portions using a stateless streaming protocol.

3. The method of claim 2, wherein the selected policy further includes a rule for determining a size of the portions and whether the portions can be retrieved concurrently, and wherein retrieving, by the processor unit, the portions to play in the sequence determined further comprises:

identifying a subsequent portion in the sequence after the first portion, that has not been retrieved, wherein the subsequent portion is identified according to the particular order for playing the portions;

transmitting a request to a server for the subsequent portion, wherein the request is made using a stateless streaming protocol;

receiving the subsequent portion in a response from the server and storing the subsequent portion in a buffer in a memory for use by the processor unit; and

wherein responsive to the selected policy allowing the portions to be retrieved concurrently, performing the identifying, transmitting, and receiving concurrently for two or more portions of the plurality of portions.

4. The method of claim 2, wherein the selected policy further includes a rule for determining a size for each portion of the portions based on a set of information retrieved from a performance monitor and wherein determining, by the processor unit, the portions of audio visual media from the selected audio visual media further comprises determining a length for each portion of the portions using the rule for determining the size of each portion of the portions and the set of information retrieved from the performance monitor.

5. The method of claim 4, wherein the set of information retrieved from the performance monitor includes at least one of a network signal strength, an encoding standard, a length of a portion of the portions, an available network bandwidth, a bandwidth usage limit, an amount of memory storage available, a location of the client device, and a direction of travel of the client device.

6. The method of claim 1, wherein the selected policy is based on a digital rights management requirement for a particular media file comprising at least one of limiting an amount of data that can be downloaded by the client device, limiting the amount of data that can be stored by the client device, limiting a number of times a portion can be played by the client device, and limiting which portions of the audio video media can be played by the client device.

7. The method of claim 1, wherein the particular order for playing the portions of the audio visual media is selected based on the command matching one of a set of commands including:

a fast reverse command, wherein the particular order includes a begin location for the first portion sequentially following a begin location for a second portion, and the first and second portion are non-contiguous;

a fast forward command, wherein the particular order includes the begin location for the first portion sequentially preceding the begin location for the second portion, and the first and second portion are non-contiguous; and

a reverse command, wherein the particular order includes the begin location for the first portion sequentially following the begin location for the second portion, and the first and second portion are contiguous.

8. The method of claim 1 further comprising:

generating, by the processor unit, a request for a portion of live streaming media, wherein a length of a final portion of the portions that is last in the particular order for playing the portions of the selected audio visual media is determined based on a begin location for the final portion and a predetermined indication of an end location for the final portion; and

receiving, by the processor unit, an identifier for an end of the live streaming media.

9. The method of claim 1, wherein the determining step further comprises:

generating, by the processor unit, the sequence identifying each portion of the portions in the particular order for playing the portions based on a set of received metadata about the audio video media, wherein identifying each portion includes identifying for each portion of the portions of the audio visual media a name for each portion based on the name of the audio visual media and a counter, a begin location for each portion, and an end location for each portion.

10. The method of claim 1, wherein the retrieving step further comprises:

transmitting, by the processor unit, a request to a server for the first portion of the portions of the audio visual media; and

receiving, by the processor unit, the first portion of the portions of the audio visual media in a response from the server and storing the first portion of the portions in a buffer in a memory for playing, by the processor unit, the first portion on the client device.

11. A computer program product for managing a media file, the computer program product comprising:

a non-transitory computer readable storage medium;

program code, stored on the non-transitory computer readable storage medium, for receiving a command to play a selected audio visual media on a client device;

program code, stored on the non-transitory computer readable storage medium, for determining portions of audio visual media from the selected audio visual media using a predefined list of portions maintained on the client device and a sequence identifying each portion of the portions in a particular order for playing the portions in the predefined list of portions, wherein the portions and the sequence are determined according to a selected policy from a set of policies enabling the client device to request portions on-the-fly from a server, in response to adapting to changes detected by the client during a communication session for playing each portion on the client device, wherein a list generator module of the client device uses information from sources comprising metadata, the set of policies, preferences, rules, and metrics from a performance monitor and a communication environment monitor to generate the list of portions and a play sequence;

program code, stored on the non-transitory computer readable storage medium, for retrieving the portions to play in the sequence determined, further storing a one or more portions in a set of memory buffers based on a digital rights management requirement allowing the one or more portions of the audio video media to be stored; and

program code, stored on the non-transitory computer readable storage medium, for playing at least a partially retrieved first portion of the portions of the selected audio visual media on the client device, wherein the first portion is identified based on the particular order in the sequence determined.

12. The computer program product of claim 11 further comprising:

wherein the program code for retrieving the portions to play in the sequence determined comprises program code for retrieving the portions based on the selected policy; and

wherein the selected policy includes rules using a stateless streaming; and

further comprising a rule for determining a size of the portions and whether the portions can be retrieved concurrently;

wherein program code for retrieving the portions to play in sequence further comprises;

program code, stored on the non-transitory computer readable storage medium, for identifying a subsequent portion in the sequence after the first portion that has not been retrieved, wherein the subsequent portion is identified according to the particular order for playing the portions;

program code, stored on the non-transitory computer readable storage medium, for transmitting a request to a server for the subsequent portion comprises a portion request requesting each portion of the portions is made using a stateless streaming protocol; and

program code, stored on the non-transitory computer readable storage medium, for receiving the subsequent portion in response from the server and storing the subsequent portion in a buffer in a memory for use;

wherein responsive to the selected policy allowing the portions to be retrieved concurrently, performing the identifying, transmitting, and receiving concurrently for two or more portions of the portions.

13. The computer program product of claim 12 further comprising program code, stored on the non-transitory computer readable storage medium, wherein the selected policy further includes a rule for determining a size for each portion of the portions based on a set of information retrieved from a performance monitor, and wherein determining the portions of audio visual media from the selected audio visual media further comprises determining a length for each portion of the portions using the rule for determining the size of each portion of the portions and the set of information retrieved from the performance monitor.

14. The computer program product of claim 11 further comprising:

program code, stored on the non-transitory computer readable storage medium, for generating a request for a portion of live streaming media, wherein a length of a final portion of the portions that is last in the particular order for playing the portions of the selected audio visual media is determined based on a begin location for the final portion and a predetermined indication of an end location for the final portion; and

program code, stored on the non-transitory computer readable storage medium, for receiving an identifier for an end of the live streaming media.

15. The computer program product of claim 11 further comprising:

program code, stored on the non-transitory computer readable storage medium, for generating the sequence identifying each portion of the portions in the particular order for playing the portions based on a set of received metadata about the audio video media, wherein identifying each portion includes identifying for each portion of the portions of the audio visual media a name for each portion based on the name of the audio visual media and a counter, a begin location for each portion, and an end location for each portion;

program code, stored on the non-transitory computer readable storage medium, for transmitting a request to a server for the first portion of the portions of the audio visual media; and

program code, stored on the non-transitory computer readable storage medium, for receiving the first portion of the portions of the audio visual media in a response from the server and storing the first portion of the portions in a buffer in a memory for playing the first portion on the client device.

16. A data processing system for streaming media files, the system comprising:

a bus system;

a storage device connected to the bus system, wherein the storage device includes program code;

a processor unit configured to execute the program code to receive a command to play a selected audio visual media on a client device;

determine portions of audio visual media from the selected audio visual media using a predefined list of portions maintained on the client device and a sequence identifying each portion of the portions in a particular order for playing the portions, in the predefined list of portions, wherein the portions and the sequence are determined according to a selected policy from a set of policies enabling the client device to request portions on-the-fly from a server, in response to adapting to changes detected by the client during a communication session for playing each portion on the client device, wherein a list generator module of the client device uses information from sources comprising metadata, the set of policies, preferences, rules, and metrics from a performance monitor and a communication environment monitor to generate the list of portions and a play sequence;

retrieve the portions to play in sequence determined, further storing a one or more portions in a set of memory buffers based on a digital rights management requirement allowing the one or more portions of the audio video media to be stored; and

play at least a partially retrieved first portion of the portions of the selected audio visual media on the client device, wherein the first portion is identified based on the particular order in the sequence determined.

17. The data processing system of claim 16, wherein in executing the program code to stream media files, the selected policy further includes a rule for determining a size for each portion of the portions based on a set of information retrieved from a performance monitor and wherein determining, by the processor unit, the portions of audio visual media from the selected audio visual media further comprises determining a length for each portion of the portions using the rule for determining the size of each portion of the portions and the set of information retrieved from the performance monitor.

18. The data processing system of claim 16, wherein in executing the program code to stream media files, the processor unit is further configured to play the particular order for playing the portions of the audio visual media based on the command matching one of a set of commands including:

a fast reverse command, wherein the particular order includes a begin location for the first portion sequentially following a begin location for a second portion, and the first and second portion are non-contiguous;

a fast forward command, wherein the particular order includes the begin location for the first portion sequentially preceding the begin location for the second portion, and the first and second portion are non-contiguous; and

a reverse command, wherein the particular order includes the begin location for the first portion sequentially following the begin location for the second portion, and the first and second portion are contiguous.

19. The data processing system of claim 16, wherein in executing the program code to stream media files, the processor unit is further configured to generate the sequence identifying each portion of the portions in the particular order for playing the portions based on a set of received metadata about the audio video media, wherein identifying each portion includes identifying for each portion of the portions of the audio visual media a name for each portion based on the name of the audio visual media and a counter, a begin location for each portion, and an end location for each portion;

transmit a request to a server for the first portion of the portions of the audio visual media; and

receive the first portion of the portions of the audio visual media in a response from the server and storing the first portion of the portions in a buffer in a memory for playing the first portion on the client device; and

further the processor unit is configured to generate the request for a portion of live streaming media, wherein a length of a final portion of the portions that is last in the particular order for playing the portions of the selected audio visual media is determined based on the begin location for the final portion and a predetermined indication of the end location for the final portion; and

receive an identifier for an end of the live streaming media.