Playlists for real-time or near real-time streaming

• US 9,832,245 B2
• Filed: 09/08/2014
• Issued: 11/28/2017
• Est. Priority Date: 06/03/2011
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Biderman, David, May, Jr., William, Pantos, Roger, Batson, James David, Bushell, John Samuel
• Primary Examiner(s): Naji, Younes
• Application Number:
  US14/480,490
• Publication Number:
  US 20140379873A1
• Time in Patent Office: 1,177 Days
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8543 using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML] information retrieval of semistructured data, the underlying structure being taken into account, e.g. mark-up language structure data G06F16/80
• CPC Class Codes: H04N 5/783 Adaptations for reproducing at a rate different from the recording rate

Abstract

Methods, systems and machine readable storage medium for allowing playback of streaming media at playback rates of other than 1× are described. In one embodiment, a method can determine different sets of I-frames that are available before a display deadline, where each set can have a different cadence, and one of the sets can be selected for download and display to achieve playback at other than 1×. Byte range requests from a client device can be used to retrieve each of the I-frames. Other methods, system and media are also described.

Claims

1. A machine readable non-transitory storage medium storing executable instructions which, when executed, cause a data processing system to perform a method comprising:

receiving, by a client device, a first playlist that includes a URL for a second playlist and a URL for a third playlist,

wherein the second playlist includes a plurality of URLs, each URL in the second playlist referencing a portion of a file containing a first frame data that includes only an I-frame corresponding to a 1×

speed, and each portion of the file having a same bit-rate, and

wherein the third playlist includes a plurality of URLs and associated tags to display a video at the 1×

speed, each of the plurality of URLs in the third playlist referencing a portion of the file containing a second frame data to be played back in a sequence to display the video at the 1×

speed;

determining, by the client device, a playback speed which is other than the 1×

speed;

transmitting the URL within the first playlist for retrieving the second playlist having the plurality of URLs that reference I-frames corresponding to the 1×

speed, in response to determining the playback speed;

receiving the second playlist;

transmitting requests for the I-frames using the plurality of URLs in the second playlist;

presenting, at the determined playback speed which is other than the 1×

speed, the I-frames that are received in response to the requests for the I-frames; and

wherein the plurality of URLs in the second playlist are associated with parameters specifying a range of data for each I-frame in the file containing the I-frames.

2. The medium as in claim 1 wherein the tags associated with the plurality of URLs in the third playlist include parameters specifying a range of data in the file containing the video.

3. The medium as in claim 1 wherein the first playlist includes a plurality of URLs, for a corresponding plurality of 1×

playlists, to display the video at the 1×

speed at either different resolutions or different qualities and the first playlist includes a plurality of URLs, for a corresponding plurality of I-frame only playlists, at either different resolutions or different qualities.

4. The medium as in claim 3 wherein the second playlist has tags, associated with or adjacent to the plurality of URLs in the second playlist, which specify portions of the file containing only I-frames.

5. The medium as in claim 3 wherein each of the plurality of URLs in the second playlist has a movie time metadata associated with each URL in the second playlist.

6. The medium as in claim 5 wherein the range of data for each I-frame is specified by a byte range and wherein each byte range includes audio data which is not used when playback is at the determined playback speed.

7. A data processing system comprising a processing system having at least one hardware processor, the processing system coupled to a memory programmed with executable instructions that, when executed by the processing system perform operations comprising:

receiving, by a client device, a first playlist that includes a URL for a second playlist and a URL for a third playlist,

wherein the second playlist includes a plurality of URLs, each URL in the second playlist referencing a portion of a file containing a first frame data that includes only an I-frame, and each portion of the file having a same bit-rate, and

wherein the third playlist includes a plurality of URLs and associated tags to display a video at a 1×

speed, each of the plurality of URLs in the third playlist referencing a portion of the file containing a second frame data to be played back in a sequence to display the video at the 1×

speed;

determining, by the client device, a playback speed which is other than the 1×

speed;

transmitting the URL within the first playlist for retrieving the second playlist having the plurality of URLs that reference I-frames corresponding to the 1×

speed, in response to determining the playback speed;

receiving the second playlist;

transmitting requests for the I-frames using the plurality of URLs in the second playlist;

presenting, at the determined playback speed which is other than the 1×

speed, the I-frames that are received in response to the requests for the I-frames; and

wherein the plurality of URLs in the second playlist are associated with parameters specifying a range of data for each I-frame in the file containing the I-frames.

8. The data processing system as in claim 7 wherein the tags associated with the plurality of URLs in the third playlist include parameters specifying a range of data in the file containing the video.

9. The data processing system as in claim 7 wherein the first playlist includes a plurality of URLs, for a corresponding plurality of 1×

playlists, to display the video at the 1×

speed at either different resolutions or different qualities and the first playlist includes a plurality of URLs, for a corresponding plurality of I-frame only playlists, at either different resolutions or different qualities.

10. The data processing system as in claim 9 wherein the second playlist has tags, associated with or adjacent to the plurality of URLs in the second playlist, which specify portions of the file containing only I-frames.

11. The data processing system as in claim 9 wherein each of the plurality of URLs in the second playlist has a movie time metadata associated with each URL in the second playlist and wherein the range of data for each I-frame is specified by a byte range and wherein each byte range includes audio data which is not used when playback is at the determined playback speed.

12. A machine implemented method comprising:

receiving, by a client device, a first playlist that includes a URL for a second playlist and a URL for a third playlist,

wherein the second playlist includes a plurality of URLs, each URL in the second playlist referencing a portion of a file containing a first frame data that includes only an I-frame, and each portion of the file having a same bit-rate, and

wherein the third playlist includes a plurality of URLs and associated tags to display a video at a 1×

speed, each of the plurality of URLs in the third playlist referencing a portion of the file containing a second frame data to be played back in a sequence to display the video at the 1×

speed;

determining, by the client device, a playback speed which is other than the 1×

speed;

transmitting the URL within the first playlist for retrieving the second playlist having the plurality of URLs that reference I-frames corresponding to the 1×

speed, in response to determining the playback speed;

receiving the second playlist;

transmitting requests for the I-frames using the plurality of URLs in the second playlist;

presenting, at the determined playback speed which is other than the 1×

speed, the I-frames that are received in response to the requests for the I-frames; and

wherein the plurality of URLs in the second playlist are associated with parameters specifying a range of data for each I-frame in the file containing the I-frames.

13. The method as in claim 12 wherein the tags associated with the plurality of URLs in the third playlist include parameters specifying a range of data in the file containing the video.

14. The method as in claim 12 wherein the first playlist includes a plurality of URLs, for a corresponding plurality of 1×

playlists, to display the video at the 1×

speed at either different resolutions or different qualities and the first playlist includes a plurality of URLs, for a corresponding plurality of I-frame only playlists, at either different resolutions or different qualities.

15. The method as in claim 14 wherein the second playlist has tags, associated with or adjacent to the plurality of URLs in the second playlist, which specify portions of the file containing only I-frames.

16. The method as in claim 14 wherein each of the plurality of URLs in the second playlist has a movie time metadata associated with each URL in the second playlist.

17. The method as in claim 16 wherein the range of data for each I-frame is specified by a byte range and wherein each byte range includes audio data which is not used when playback is at the determined playback speed.