Multimedia distribution system

• US 8,472,792 B2
• Filed: 10/24/2005
• Issued: 06/25/2013
• Est. Priority Date: 12/08/2003
• Status: Active Grant

• Current Assignee: Sonic IP Incorporated (Endeavor Group Holdings Inc.)
• Original Assignee: DivX, LLC (f/k/a DivX CF Holdings LLC) (FIG LLC (d/b/a Fortress Investment Group LLC))
• Inventors: Butt, Abou Ul Aala Ahsan, Bramwell, Steve R., Fudge, Brian T.
• Primary Examiner(s): Tran, Thai
• Assistant Examiner(s): HASAN, SYED Y
• Application Number:
  US11/258,496
• Publication Number:
  US 20060129909A1
• Time in Patent Office: 2,801 Days
• Field of Search: 386/111, 386/124, 386/E5.004, 386/E5.052, 386/E5.067, 386/E9.013, 386/E9.017, 386/E9.036, 386/E9.05, 386/75, 386/96, 386/68, 386/69, 386/70, 386/E5.001, 386/E5.042, 348/409.1, 348/415.1, 348/E5.004, 348/E5.007, 348/E7.056, 348/E7.071, 348/515, 348/E5.006, 348/E5.099, 348/E5.108, 348/E7.063, 348/699, 348/700, 348/E5.067, 375/240.25, 375/E7.027, 375/E7.126, 375/E7.13, 375/E7.138, 375/E7.14, 375/E7.148, 375/E7.211, 375/E7.25, 375/E7.003, 375/E7.004, 375/E7.006, 375/E7.007, 375/E7.024, 375/E7.025, 375/E7.267, 375/240.1, 375/240.12, 375/E7.183, 375/E7.192, 375/E7.261, 375/E7.016, 375/E7.269, 700/94, 707/E17.009, 707/E17.028, 707/10, 707/999.102, 707/999.104, 709/203, 709/217, 709/218, 709/228, 709/231, 715/203, 715/233, 725/90, 725/93, 382/232, 703/24
• US Class Current: 386/345
• CPC Class Codes: G11B 20/10 Digital recording or reproducing
• CPC Class Codes: G11B 27/3027 used signal is digitally coded
• CPC Class Codes: G11B 27/322 used signal is digitally coded
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/126 Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
• CPC Class Codes: H04N 19/149 by estimating the code amount by means of a model, e.g. mathematical model or statistical model
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/154 Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion use of rate-distortion criteria H04N19/147
• CPC Class Codes: H04N 19/159 Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/18 the unit being a set of transform coefficients
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/192 the adaptation method, adaptation tool or adaptation type being iterative or recursive
• CPC Class Codes: H04N 19/196 being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters processing of motion vectors H04N19/513
• CPC Class Codes: H04N 19/198 including smoothing of a sequence of encoding parameters, e.g. by averaging, by choice of the maximum, minimum or median value
• CPC Class Codes: H04N 19/48 using compressed domain processing techniques other than decoding, e.g. modification of transform coefficients, variable length coding [VLC] data or run-length data motion estimation in a transform domain H04N19/547; processing of decoded motion vectors H04N19/513
• CPC Class Codes: H04N 19/577 Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/625 using discrete cosine transform [DCT]
• CPC Class Codes: H04N 19/80 : Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation H04N19/635, H04N19/86 take precedence
• CPC Class Codes: H04N 19/85 : using pre-processing or post-processing specially adapted for video compression
• CPC Class Codes: H04N 21/42646 : for reading from or writing on a non-volatile solid state storage medium, e.g. DVD, CD-ROM
• CPC Class Codes: H04N 21/8106 : involving special audio data, e.g. different tracks for different languages
• CPC Class Codes: H04N 21/8133 : specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/84 : Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8455 : involving pointers to the content, e.g. pointers to the I-frames of the video stream
• CPC Class Codes: H04N 21/8456 : by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/85406 : involving a specific file format, e.g. MP4 format
• CPC Class Codes: H04N 21/8543 : using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML] information retrieval of semistructured data, the underlying structure being taken into account, e.g. mark-up language structure data G06F16/80
• CPC Class Codes: H04N 21/8586 : by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02
• CPC Class Codes: H04N 7/17318 : Direct or substantially direct transmission and handling of requests

Abstract

A multimedia file and methods of generating, distributing and using the multimedia file are described. Multimedia files in accordance with embodiments of the present invention can contain multiple video tracks, multiple audio tracks, multiple subtitle tracks, a complete index that can be used to locate each data chunk in each of these tracks and an abridged index that can enable the location of a subset of the data chunks in each track, data that can be used to generate a menu interface to access the contents of the file and ‘meta data’ concerning the contents of the file. Multimedia files in accordance with several embodiments of the present invention also include references to video tracks, audio tracks, subtitle tracks and ‘meta data’ external to the file. One embodiment of a multimedia file in accordance with the present invention includes a series of encoded video frames, a first index that includes information indicative of the location within the file and characteristics of each encoded video frame and a separate second index that includes information indicative of the location within the file of a subset of the encoded video frames.

Claims

1. A decoder for decoding a multimedia file comprising at least one video track and at least one audio track, the decoder comprising:

a processor; and

memory having a multimedia file including;

a series of encoded video frames;

a first index that includes information indicative of the location within the file and characteristics of each encoded video frame; and

a separate second index that includes information indicative of the location within the file of a subset of the encoded video frames, the separate second index located prior to the series of encoded video frames and the first index, the first and second indexes enabling trick play functionality.

2. The decoder of claim 1, wherein:

the second index includes at least one tag that references an encoded video frame in the subset of encoded video frames;

each tag comprises;

the location within the file of the referenced encoded video frame;

the frame number of the encoded video frame in the sequence of encoded video frames.

3. The decoder of claim 2, wherein the multimedia file further comprises:

at least one audio track;

wherein each tag further comprises a reference to a portion of at least one of the audio tracks;

wherein the portion of the track that is referenced accompanies the encoded video frame referenced by the tag.

4. The decoder of claim 2, wherein:

each tag further comprises a reference to information located within the first index; and

the information referenced in the first index is indicative of the location within the file and characteristics of the encoded video frame referenced by the tag.

5. The decoder of claim 1 wherein the second index includes a plurality of tags, each tag references encoded video frames that are evenly spaced throughout the encoded video frames.

6. The decoder of claim 1 wherein the second index includes a plurality of tags, each tag references encoded video frames that are spaced at least ten seconds apart.

7. The decoder of claim 1 wherein the second index includes a plurality of tags, each tag includes chunk offset information, index offset information, video frame identifiers and audio track identifiers.

8. The decoder of claim 1 wherein trick play functionality comprises at least one of fast forward, rewind and scene skipping.

9. An encoder for encoding a multimedia file comprising at least one video track and at least one audio track, the encoder comprising:

a processor;

a memory including a file containing at least one sequence of encoded video frames and a full index that includes information indicative of the location within the file and characteristics of each encoded video frame;

wherein the processor is configured to generate an abridged index that references a subset of the encoded video frames in the sequence of encoded video frames and to encode a multimedia file including the abridged index, the at least one sequence of encoded video frames, and a full index so that the abridged index is located within the multimedia file prior to the series of encoded video frames, the first and second indexes enabling trick play functionality.

10. The encoder of claim 9, wherein:

the processor is configured to generate a complete index that references all of the encoded video frames in the sequence of encoded video frames; and

each reference to an encoded video frame in the abridged index includes a reference to the reference to that frame in the complete index.

11. The encoder of claim 9, wherein each reference to an encoded video frame in the abridged index includes the sequence number of the encoded video frame.

12. The encoder of claim 11, wherein the processor is configured to include in each reference to an encoded video frame a reference to a location within at least one sound track.

13. The encoder of claim 9 wherein the processor is configured to insert key frames when one of the processor detects a scene change and a threshold interval of video frames is exceeded without the processor detecting a scene change.

14. The encoder of claim 9 wherein trick play functionality comprises at least one of fast forward, rewind and scene skipping.

15. A decoder for decoding multimedia comprising at least one video track and at least one audio track, the decoder comprising:

a processor configured to decode multimedia;

wherein the multimedia includes;

a sequence of encoded video frames;

a complete index referencing each encoded video frame in the sequence of encoded video frames;

an abridged index referencing a subset of the encoded video frames in the sequence of encoded video frames;

wherein the processor is configured to locate a particular encoded video frame within the multimedia using the abridged index and to playback the sequence of encoded video frame starting from the located encoded video frame, the first and second indexes enabling trick play functionality.

16. The decoder of claim 15, wherein the processor is configured to locate reference information in the complete index using the abridged index.

17. The decoder of claim 15, wherein:

the multimedia file includes at least one audio track accompanying the sequence of encoded video frames; and

each reference to an encoded video frame in the abridged index includes a reference to a portion of at least one of the video tracks.

18. The decoder of claim 15 wherein the processor is configured to identify a desired encoded video frame;

determine the encoded video frame that is closest to the desired video frame in the abridged index; and

display an encoded video frame.

19. The decoder of claim 18, wherein:

each reference in the abridged index to an encoded video frame also includes a reference to the portion of the complete index that refers to that encoded video frame; and

wherein the processor configured to display an encoded video frame, further comprises;

the processor uses the reference to the encoded video frame in the abridged index that is closest to the desired encoded video frame to locate that encoded frame within the complete index;

the processor searches in the complete index for the desired encoded video frame; and

the processor displays the desired encoded video frame.

20. The device of claim 19, wherein the closest frame is the closest preceding frame in the sequence to the desired frame.

21. The device of claim 18, wherein the processor configured to an encoded video frame further comprises the processor displaying the encoded video frame that is determined to be closest to the desired video frame.

22. The decoder of claim 15 wherein the processor is configured to locate and playback the sequence of encoded video frame without receiving the complete index.

23. The decoder of claim 15 wherein trick play functionality comprises at least one of fast forward, rewind and scene skipping.