Just-in-time (JIT) encoding for streaming media content

• US 9,609,340 B2
• Filed: 12/28/2012
• Issued: 03/28/2017
• Est. Priority Date: 12/28/2011
• Status: Active Grant

• Current Assignee: Verizon Patent and Licensing Incorporated (Verizon Communications Inc.)
• Original Assignee: Verizon Patent and Licensing Incorporated (Verizon Communications Inc.)
• Inventors: Brueck, David F., Owen, C. Ryan, Bye, Tyler, Edwards, Nathan James, Brueck, Ken
• Primary Examiner(s): Atala, Jamie
• Assistant Examiner(s): Lima, Fabio
• Application Number:
  US13/729,342
• Publication Number:
  US 20140247887A1
• Time in Patent Office: 1,551 Days
• Field of Search: 375/240.26
• US Class Current: 1/1
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/2408 Monitoring of the upstream path of the transmission network, e.g. client requests monitoring data switching networks utilization H04L43/0876; scheduling or organising the servicing of application requests H04L67/60

Abstract

A method and system for just-in-time (JIT) encoding of media content is described. The JIT encoder allows a server to create one or more slices of requested portions of the media content according to one of the available quality profiles when requested without previously creating and storing different copies of the media content at the different quality profiles.

Claims

1. A method comprising:

during a first time period;

receiving source data having media content at a just-in-time (JIT) encoder executing on a computing system, the media content containing compressed video and compressed audio;

inspecting the media content to locate key frames and audio boundaries without decoding the media content;

creating, responsive to the inspecting and without decoding the media content, an index indicating the key frames and audio boundaries of the media content, wherein the creating the index comprises creating a metadata descriptor file of the media content, wherein the metadata descriptor file specifies a plurality of different quality profiles and locations of where the media content encoded according to the plurality of different quality profiles will be stored during a second time period; and

storing the index for subsequent just-in-time encoding of the media content;

during the second time period, which comes after the first time period;

receiving, at the computing system from a second computing system, a request for a specified time range of the media content at a first quality level of a plurality of specified quality levels, wherein the first quality level corresponds to a specified quality profile of the plurality of different quality profiles;

inspecting, by the JIT encoder, the metadata descriptor file to identify a location associated with the specified quality profile;

finding, by the JIT encoder, a latest key frame before a first frame of the media content at the specified time range in the index;

decoding, by the JIT encoder, the media content from the latest key frame through a last frame of the media content of the specified time range, to generate decoded media content;

re-encoding, by the JIT encoder, the decoded media content according to the first quality level, to generate re-encoded media content;

creating, by the JIT encoder, one or more slices of the re-encoded media content for the specified time range; and

storing, by the JIT encoder, the one or more slices at the location specified in the metadata descriptor file for the specified quality profile.

2. The method of claim 1, wherein the finding, decoding, re-encoding, creating are performed at a rate to deliver and present a requested portion of the media content to a user at an originally anticipated playback speed without interruption of playback of the media content.

3. The method of claim 1, wherein the metadata descriptor file is a M3U file.

4. The method of claim 3, wherein the metadata descriptor file comprises a unique content identifier (UCID) and a duration of the media content.

5. The method of claim 1, wherein each of the plurality of quality profiles specify at least one of image size, video bit rate, audio bit rate, audio sample rate, number of audio tracks, frame rate, or staging size.

6. The method of claim 1, wherein each line of the metadata descriptor file includes at least one of an absolute pathname, a local pathname relative to the location, or a Uniform Resource Locator of the location where the media content encoded according to one quality profile is to be stored.

7. The method of claim 1, further comprising sending a response with the one or more slices to the second computing system.

8. The method of claim 1, wherein the one or more slices comprise one or more first slices, the method further comprising, during the second period:

predictively re-encoding the decoded media content according to at least a second quality level of the plurality of specified quality levels, to generate second re-encoded media content;

creating one or more second slices of the second re-encoded media content for the specified time range; and

storing the one or more second slices at a second location specified in the metadata descriptor file for a second quality profile corresponding to the second quality level.

9. The method of claim 8, wherein the one or more first slices and second slices are stored in transport stream files, and wherein the metadata descriptor file specifies addresses of the transport stream files.

10. A non-transitory computer readable storage medium comprising instructions that, when executed by a server computing system, cause the server computing system to:

during a first time period;

receive source data having media content at a just-in-time (JIT) encoder executing on the server computing system, the media content containing compressed video and compressed audio;

inspect the media content to locate key frames and audio boundaries without decoding the media content;

create, responsive to inspecting the media content and without decoding the media content, an index indicating the key frames and audio boundaries of the media content, wherein to create the index comprises to create a metadata descriptor file of the media content, wherein the metadata descriptor file specifies a plurality of different quality profiles and locations of where the media content encoded according to the plurality of different quality profiles will be stored during a second time period; and

store the index for subsequent just-in-time encoding of the media content;

during the second time period, which comes after the first time period;

receive, at the server computing system, a request for a specified time range of the media content at a first quality level of a plurality of specified quality levels, wherein the first quality level corresponds to a specified quality profile of the plurality of different quality profiles;

inspect, by the JIT encoder, the metadata descriptor file to identify a location associated with the specified quality profile;

find, by the JIT encoder, a latest key frame before a first frame of the media content at the specified time range in the index;

decode, by the JIT encoder, the media content from the latest key frame through a last frame of the media content of the specified time range, to generate decoded media content;

re-encode, by the JIT encoder, the decoded media content according to the first quality level, to generate re-encoded media content;

create, by the JIT encoder, one or more slices of the re-encoded media content for the specified time range; and

storing, by the JIT encoder, the one or more slices at the location specified in the metadata descriptor file for the specified quality profile.

11. The non-transitory computer readable storage medium of claim 10, wherein to find, to decode, to re-encode, and to create are performed at a rate to deliver and present a requested portion of the media content to a user at an originally anticipated playback speed without interruption of playback of the media content.

12. The non-transitory computer readable storage medium of claim 10, wherein each line of the descriptor file includes at least one of an absolute pathname, a local pathname relative to the location, or a Uniform Resource Locator of the location where the media content encoded according to one quality profile is to be stored.

13. The non-transitory computer readable storage medium of claim 10, wherein the instructions that, when executed by a server computing system, further cause the server computing system to send a response with the one or more slices to the second computing system.

14. The non-transitory computer readable storage medium of claim 10, wherein the one or more slices comprise one or more first slices, and wherein the instructions that, when executed by a server computing system, further cause the server computing system to, during the second period:

predictively re-encode the decoded media content according to at least a second quality level of the plurality of specified quality levels, to generate second re-encoded media content;

create one or more second slices of the second re-encoded media content for the specified time range; and

store the one or more second slices at a second location specified in the metadata descriptor file for a second quality profile corresponding to the second quality level.

15. The non-transitory computer readable storage medium of claim 14, wherein the one or more first slices and second slices are stored in transport stream files, and wherein the metadata descriptor file specifies addresses of the transport stream files.

16. A first computing system, comprising:

a data storage device; and

a processing device, coupled to the data storage device, to execute a just-in-time (JIT) encoder, wherein the JIT encoder is to;

during a first time period;

receive source data having media content containing compressed video and compressed audio;

inspect the media content to locate key frames and audio boundaries without decoding the media content;

create, responsive to inspecting the media content and without decoding the media content, an index indicating the key frames and audio boundaries of the media content, wherein to create the index comprises to create a metadata descriptor file of the media content, wherein the metadata descriptor file specifies a plurality of different quality profiles and locations of where the media content encoded according to the plurality of different quality profiles will be stored during a second time period; and

store the index for subsequent just-in-time encoding of the media content;

during the second time period, which comes after the first time period;

receive, from a second computing system, a request for a specified time range of the media content at a first quality level of a plurality of specified quality levels, wherein the first quality level corresponds to a specified quality profile of the plurality of different quality profiles;

inspect the metadata descriptor file to identify a location associated with the specified quality profile;

find a latest key frame before a first frame of the media content at the specified time range in the index;

decode the media content from the latest key frame through a last frame of the media content of the specified time range, to generate decoded media content;

re-encode the decoded media content according to the first quality level, to generate re-encoded media content;

create one or more slices of the re-encoded media content for the specified time range; and

storing, by the JIT encoder, the one or more slices at the location specified in the metadata descriptor file for the specified quality profile.

17. The first computing system of claim 16, wherein the processing device is further to execute a web server to receive requests, from clients, for specially requested portions of the media content at the specified quality levels, and to send responses to the requests with the one or more slices.

18. The first computing system of claim 16, wherein the media content is stored in a media content file comprising a container having metadata, audio samples and video samples of the media content, wherein the processing device is further to execute:

a web server to receive requests from clients for specially requested portions of the media content at the specified quality levels, and to send responses with the one or more slices to the clients;

a container reader to read the metadata from the container to inspect the media content to locate the key frames and audio boundaries without decoding the audio samples and the video samples, wherein the JIT encoder creates the index of the media content using time stamps of the key frames;

an audio decoder to decode the audio samples of the requested portions to obtain raw audio of the requested portions and to store the raw audio in an audio frame buffer;

a video decoder to decode the video samples of the requested portions to obtain raw video of the requested portions and to store the raw video in a video frame buffer;

an audio encoder to re-encode the raw audio according to an audio bit rate identified in the specified quality profile, to generate re-encoded audio;

a video encoder to re-encode the raw video according to a video bit rate identified in the specified quality profile, to generate re-encoded video; and

a slice creator to create the one or more slices with the re-encoded audio and the re-encoded video.

19. The first computing system of claim 16, wherein each line of the descriptor file includes at least one of an absolute pathname, a local pathname relative to the location, or a Uniform Resource Locator of the location where the media content encoded according to one quality profile is to be stored.

20. The first computing system of claim 16, wherein the JIT encoder is further to, during the second period:

predictively re-encode the decoded media content according to at least a second quality level of the plurality of specified quality levels, to generate second re-encoded media content;

create one or more second slices of the second re-encoded media content for the specified time range; and

store the one or more second slices at a second location specified in the metadata descriptor file for a second quality profile corresponding to the second quality level.