Apparatus and methods for thumbnail generation

• US 10,375,452 B2
• Filed: 04/14/2015
• Issued: 08/06/2019
• Est. Priority Date: 04/14/2015
• Status: Active Grant

• Current Assignee: Time Warner Cable Enterprises LLC (Charter Communications Incorporated)
• Original Assignee: Time Warner Cable Enterprises LLC (Charter Communications Incorporated)
• Inventors: Hardin, Glen, Manchester, Eric
• Primary Examiner(s): Shibru, Helen
• Application Number:
  US14/686,584
• Publication Number:
  US 20160307596A1
• Time in Patent Office: 1,575 Days
• Field of Search: 386241, 386343
• CPC Class Codes: G11B 27/005 Reproducing at a different information rate from the information rate of recording for television signals H04N5/783
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04N 21/440218 by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 conversion of standards in analogue television systems H04N7/01
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739

Abstract

Apparatus and methods for thumbnail generation. In one embodiment, a thumbnail stream is generated where one or more bits are assigned to key frames and minimizes the number of bits assigned to delta frames. Each key frame may be used to extract a still image for use in thumbnails during trick mode operation (e.g., fast forward, rewind, pause, or random seek operation). When the encoded video file is given to a Just in Time Packager (JITP), the JITP extracts the image files (via the key frames). Information regarding how to reference these files is stored in generated manifest file and may be reformatted by the JITP to fit the needs of the current product. In a variant, the JITP reformats the image files extracted from the encoded video for operation on a number of devices.

Claims

1. A packager apparatus comprising:

a first interface configured for data communication with a content delivery network;

a storage apparatus; and

a processor apparatus configured to execute at least one computer program, said at least one computer program stored on said storage apparatus and comprising a plurality of instructions which are configured to, when executed by said processor apparatus, cause said packager apparatus to;

receive a thumbnail digital data stream previously generated from a video digital data stream, said video digital data stream comprising a first plurality of digitally rendered key frames each separated by transitional video data, said thumbnail digital data stream comprising a second plurality of digitally rendered key frames each separated by one or more null frames, each of said one or more null frames comprising non-content data;

receive, from a user device via said content delivery network, data indicative of a user request for digital content, said digital content associated with said thumbnail digital data stream;

based at least in part on said receipt of said data indicative of said user request for said digital content, extract a plurality of digitally rendered thumbnail images from at least a portion of said second plurality of digitally rendered key frames in said thumbnail digital data stream, said plurality of digitally rendered thumbnail images configured for use during trick mode operation of said user device; and

based at least in part on said extraction of said plurality of digitally rendered thumbnail images, generate a manifest file comprising a digital data structure configured for storage of a first plurality of addresses, each of said first plurality of addresses corresponding to a location of one or more of said plurality of digitally rendered thumbnail images.

2. The packager apparatus of claim 1, wherein said plurality of instructions are further configured to, when executed by said processor apparatus, cause said packager apparatus to:

receive an encoded video digital data stream; and

segment said encoded video digital data stream into a plurality of segmented portions for delivery to said user device via said content delivery network.

3. The packager apparatus of claim 2, wherein said digital data structure of said manifest file is further configured for storage of a second plurality of addresses, each of said second plurality of addresses corresponding to a location of one or more of said plurality of segmented portions of said encoded video digital data stream.

4. The packager apparatus of claim 1, wherein said extraction of said plurality of digitally rendered thumbnail images comprises automatic skip of said each of said one or more null frames in said thumbnail digital data stream.

5. The packager apparatus of claim 1, wherein said data indicative of said user request for digital content at least in part comprises data indicative of a user request for trick mode operation of said user device during content playback.

6. The packager apparatus of claim 1, wherein said generation of said manifest file is based at least in part on data indicative of a device type of said user device.

7. The packager apparatus of claim 1, wherein said plurality of instructions are further configured to, when executed by said processor apparatus, cause said packager apparatus to remove said plurality of digitally rendered thumbnail images from said user device.

8. The packager apparatus of claim 1, wherein said plurality of instructions are further configured to, when executed by said processor apparatus, cause said packager apparatus to resize at least a portion of said plurality of digitally rendered thumbnail images based at least in part on data indicative of a device type of said user device.

9. The packager apparatus of claim 1, wherein:

said first interface is further configured for data communication with an encoder apparatus, and

said receipt of said thumbnail digital data stream previously generated from said video digital data stream comprises receipt of said thumbnail digital data stream from said encoder apparatus.

10. A method of operating a network packager apparatus for generation of a plurality of digitally rendered thumbnail images, said network packager apparatus in data communication with a content delivery network, said method comprising:

receiving a thumbnail digital data stream previously generated from a video digital data stream, said video digital data stream comprising a first plurality of digitally rendered key frames each separated by transitional video data, said thumbnail digital data stream comprising a second plurality of digitally rendered key frames each separated by one or more null frames, each of said one or more null frames comprising metadata relative to said transitional video data;

receiving, via said content delivery network, data indicative of a user request for trick mode operation of a user device during playback of digital content;

based at least in part on said receiving of said data indicative of said user request, extracting a plurality of digitally rendered thumbnail images from at least a portion of said second plurality of digitally rendered key frames in said thumbnail digital data stream, said plurality of digitally rendered thumbnail images configured for use during said trick mode operation of said user device; and

based at least in part on said extracting of said plurality of digitally rendered thumbnail images, storing a first plurality of addresses in a manifest file comprising a digital data structure, each of said first plurality of addresses corresponding to a location of one or more of said plurality of digitally rendered thumbnail images.

11. The method of claim 10, further comprising:

receiving an encoded video digital data stream;

segmenting said encoded video digital data stream into a plurality of segmented portions for delivery to said user device via said content delivery network; and

based at least in part on said segmenting of said encoded video digital data stream, storing a second plurality of addresses in said manifest file, each of said second plurality of addresses corresponding to a data storage location of one or more of said plurality of segmented portions of said encoded video digital data stream.

12. The method of claim 11, further comprising:

obtaining data indicative of a device type of said user device; and

based at least in part on said data indicative of said device type, formatting said plurality of segmented portions of said encoded video digital data stream to be compatible with said device type.

13. The method of claim 10, further comprising:

obtaining data indicative of a device type of said user device; and

based at least in part on said data indicative of said device type, formatting said plurality of digitally rendered thumbnail images to be compatible with said device type.

14. The method of claim 10, further comprising:

obtaining data indicative of a device type of said user device; and

based at least in part on said data indicative of said device type, resizing said plurality of digitally rendered thumbnail images to be compatible with said device type.

15. The method of claim 10, wherein said extracting of said plurality of digitally rendered thumbnail images from said at least a portion of said second plurality of digitally rendered key frames in said thumbnail digital data stream at least in part comprises automatic skipping of said each of said one or more null frames.

16. The method of claim 10, further comprising, at or after expiration of a user session, removing said plurality of digitally rendered thumbnail images from said user device.

17. A packager apparatus comprising:

a first data interface configured for data communication with a content delivery network;

data storage apparatus; and

data processor apparatus configured to execute at least one computer program thereon, said at least one computer program stored on said data storage apparatus and comprising a plurality of instructions which are configured to, when executed by said data processor apparatus, cause said packager apparatus to;

receive, via said content delivery network, data indicative of a user request for digital content generated by a computerized user device;

based at least in part on said receipt of said data indicative of said user request for said digital content;

access a thumbnail digital data stream previously generated from a video digital data stream, said digital content associated with said thumbnail digital data stream, said video digital data stream comprising a first plurality of digital key frames each separated by transitional video data, said thumbnail digital data stream comprising a second plurality of digital key frames each separated by one or more null frames, each of said one or more null frames comprising metadata relative to said transitional video data;

extract a plurality of digitally rendered thumbnail images from at least a portion of said second plurality of digital key frames in said thumbnail digital data stream, said plurality of digitally rendered thumbnail images configured for use during trick mode operation of said computerized user device; and

based at least in part on said extraction of said plurality of digitally rendered thumbnail images, generate a manifest file comprising a digital data structure configured for storage of a first plurality of addresses, each of said first plurality of addresses corresponding to a data storage location of one or more of said plurality of digitally rendered thumbnail images; and

wherein said generation of said manifest file is based at least in part on data indicative of a device type of said computerized user device.

18. The packager apparatus of claim 17, wherein said plurality of instructions are further configured to, when executed by said data processor apparatus, cause said packager apparatus to resize at least a portion of said plurality of digitally rendered thumbnail images based at least in part on said data indicative of said device type of said computerized user device.

19. The packager apparatus of claim 17, wherein said extraction of said plurality of digitally rendered thumbnail images at least in part comprises automatic skip of said each of said one or more null frames in said thumbnail digital data stream.

20. The packager apparatus of claim 17, wherein said plurality of instructions are further configured to, when executed by said data processor apparatus, cause said packager apparatus to:

receive an encoded video digital data stream; and

segment said encoded video digital data stream into a plurality of portions for delivery to said computerized user device via said content delivery network.

21. The packager apparatus of claim 20, wherein said digital data structure of said manifest file is further configured for storage of a second plurality of addresses, each of said second plurality of addresses corresponding to a data storage location of one or more of said plurality of segmented portions of said encoded video digital data stream.

22. The packager apparatus of claim 17, wherein said plurality of instructions are further configured to, when executed by said data processor apparatus, cause said packager apparatus to, based at least on said data indicative of said device type, format said plurality of digitally rendered thumbnail images to be compatible with said device type.