Data structure of multimedia file format, encrypting method and device thereof, and decrypting method and device thereof

• US 9,729,828 B2
• Filed: 07/15/2013
• Issued: 08/08/2017
• Est. Priority Date: 03/29/2002
• Status: Expired due to Term

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Sato, Jun, Terauchi, Toru
• Primary Examiner(s): Armouche, Hadi
• Assistant Examiner(s): WRIGHT, BRYAN F
• Application Number:
  US13/941,937
• Publication Number:
  US 20130301831A1
• Time in Patent Office: 1,485 Days
• Field of Search: 380236
• CPC Class Codes: H04L 63/0428 wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04N 2005/91364 the video signal being scrambled
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/4325 by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/440281 by altering the temporal resolution, e.g. by frame skipping television signal recording using magnetic recording on tape for reproducing at a rate different from the recording rate H04N5/783
• CPC Class Codes: H04N 21/4405 involving video stream decryption
• CPC Class Codes: H04N 5/783 Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 5/913 for scrambling ; for copy protection
• CPC Class Codes: H04N 7/167 Systems rendering the television signal unintelligible and subsequently intelligible

Abstract

In a data structure of a multimedia file format, a movie box and a media data box are provided. In each box, a non-encrypted size field, a non-encrypted type field and box data field are provided. In box data of the movie box, information data regarding multimedia data is stored. The multimedia data is encrypted and stored in box data of the media data box. The information data is obtained by referring to the container in the movie box. This information data is held as encryption and encoding information data. By referring to the information data, a data unit of the encrypted multimedia data in the media data box is obtained, and the unit data is decrypted.

Claims

1. A method of reproducing a multimedia file including attribution information and a sequential array of chunks, each of the chunks being equivalent to one or more encoded audio frames and/or encoded video frames, the encoded audio frames and the encoded video frames being encrypted for a chunk, the method comprising:

decrypting the multimedia file, which comprises;

obtaining chunk offset information from the attribution information in the multimedia file, wherein the chunk offset information indicates respective start positions of the chunks from a head of the file;

referring to one of the start position of the chunks;

extracting one of the chunks from the multimedia file based on the one of the start positions of the chunks; and

decrypting, for the chunk, the encrypted audio frames and/or encrypted video frames in the extracted chunk into the encrypted audio frames and/or the encoded video frames after extracting the one of the chunks based on the one of the start positions of the chunks, and successively outputting the encoded audio frames and the encoded video frames;

decoding an audio stream extracted from the encoded audio frames into an audio signal and a video stream extracted from the encoded video frames into a video signal; and

outputting the audio signal and the video signal.

2. The method according to claim 1, wherein the multimedia file includes a first box and a second box, the attribution information is contained in the first box and the chunks are contained in the second box.

3. The method according to claim 1, further comprising storing the encoded audio frames and the encoded video frames in a memory to decode the audio stream and the video stream.

8. The method according to claim 1, wherein the multimedia file has a file format in accordance with a predetermined standard, and has a hierarchical structure which includes a plurality of boxes in a top-level, and the plurality of boxes are arranged in a array which is arbitrarily defined in the predetermined standard.

4. A method of reproducing a multimedia file including attribution information and a sequential array of chunks, each of the chunks being a concatenation of one or a plurality of samples, one of the samples being equivalent to at least an encoded audio frame or an encoded video frame, the encoded audio frame and the encoded video frame being encrypted for a sample, the method comprising:

decrypting the multimedia file, which comprises;

obtaining chunk offset information and sample information from the attribution information in the multimedia file, wherein the chunk offset information indicates respective start positions of the chunks from a head of the file, and the sample information indicates a number of samples and respective sample sizes of the samples in each of the chunks;

referring to one of the start position of the chunks and the sample information;

calculating sample offset information from the chunks offset information and the sample information, wherein the sample offset information indicates respective start positions of the samples;

extracting one of the samples from the multimedia file based on the one of the start positions of the chunks and the sample offset information; and

decrypting, for the sample, the encrypted video frame in the extracted sample into the encoded audio frame and/or the encoded video frame after extracting the one of the samples based on the one of the start positions of the chunks and the sample offset information, and successively outputting the encoded audio frames and the encoded video frames; and

decoding an audio stream extracted from the encoded audio frames into an audio signal and a video stream extracted from the encoded video frame into a video signal; and

outputting the audio signal and the video signal.

5. The method according to claim 4, wherein the multimedia file includes a first box and a second box, the attribution information is contained in the first box and the samples are contained in the second box.

6. The method according to claim 5, wherein the multimedia file includes a first box and a second box, the attribution information is contained in the first box and the chunks are contained in the second box.

7. The method according to claim 5, further comprising storing the encoded audio frames and the encoded video frames frame in a memory.

9. The method according to claim 4, wherein the multimedia file has a file format in accordance with a predetermined standard, and has a hierarchical structure which includes a plurality of boxes in a top-level, and the plurality of boxes are arranged in a array which is arbitrarily defined in the predetermined standard.

20. The method according to claim 4, wherein the sample comprises an unencrypted residual data which is not aligned to bytes boundaries.

10. A video reproduction system for reproducing a multimedia file including attribution information and a sequential array of chunks, each of the chunks being equivalent to one or more encoded audio frames and/or encoded video frames, the encoded audio frames and the encoded video frames being encrypted for a chunk, the system comprising:

a memory;

a decryptor processor connected to the memory and configured to;

obtain chunk offset information from the attribution information in the multimedia file, wherein the chunk offset information indicates respective start positions of the chunks from a head of the file;

refer to one of the start position of the chunks;

extract one of the chunks from the multimedia file based on the one of the start positions of the chunks; and

decrypt, for the chunk, the encrypted audio frames and/or the encrypted video frames in the extracted chunk into the encoded audio frames and/or the encoded video frames after extracting the one of the chunks based on the one of the start positions of the chunks, and successively outputting the encoded audio frames and the encoded video frames;

one or more decoder processors configured to decode an audio stream extracted from the encoded audio frames into an audio signal and a video stream extracted from the encoded video frames into a video signal;

and an output interface configured to output the audio signal and the video signal.

11. The video reproduction system according to claim 10, wherein the multimedia file includes a first box and a second box, the attribution information is contained in the first box and the chunks are contained in the second box.

12. The video reproduction system according to claim 10, wherein the memory stores the multimedia file to decrypt the multimedia file.

13. The video reproduction system according to claim 10, wherein the memory stores the encoded audio frames and the encoded video frames decode the audio stream and the video stream.

18. The video reproduction system according to claim 10, wherein the multimedia file has a file format in accordance with a predetermined standard, and has a hierarchical structure which includes a plurality of boxes in a top-level, and the plurality of boxes are arranged in a array which is arbitrarily defined in the predetermined standard.

14. A video reproduction system for reproducing a multimedia file including attribution information and a sequential array of chunks, each of the chunks being a concatenation of one or a plurality of samples, one of the samples being equivalent to at least an encoded audio frame or an encoded video frame, the encoded audio frame and the encoded video frame being encrypted for a sample, the system comprising:

a memory;

a decryptor processor connected to the memory and configured to obtain chunk offset information and sample information from the attribution information in the multimedia file, wherein the chunk offset information indicates respective start positions of the chunks from a head of the file, and the sample information indicates a number of samples and respective sample sizes of the samples in each of the chunks

refer to one of the start position of the chunks and the sample information;

calculate sample offset information from the chunk offset information and the sample information, wherein the sample offset information indicates respective start positions of the samples;

extract one of the samples from the multimedia file based on the one of the start positions of the chunks and the sample offset information; and

decrypt, for the sample, the encrypted audio frame and/or the encrypted video frame in the extracted sample into the encoded audio frame and/or the encoded video frame after extracting the one of the samples based on the one of the start positions of the chunks and the sample offset information, and successively outputting the encoded audio frames and the encoded video frames;

one or more decoder processors configured to decode an audio stream extracted from the encoded audio frames into an audio signal and a video stream extracted from the encoded video frame into a video signal;

and an output interface configured to output the audio signal and the video signal.

15. The video reproduction system according to claim 14, wherein the multimedia file includes a first box and a second box, the attribution information is contained in the first box and the samples are contained in the second box.

16. The video reproduction system according to claim 14, wherein the multimedia file includes a first box and a second box, the attribution information is contained in the first box and the chunks are contained in the second box.

17. The video reproduction system according to claim 14, wherein the memory stores the encoded audio frames and the encoded video frame to decode the audio stream and the video stream.

19. The video reproduction system according to claim 14, wherein the multimedia file has a file format in accordance with a predetermined standard, and has a hierarchical structure which includes a plurality of boxes in a top-level, and the plurality of boxes are arranged in an array which is arbitrarily defined in the predetermined standard.

21. The video reproduction system according to claim 14, wherein the sample comprises an unencrypted residual data which is not aligned to bytes boundaries.

22. A method of reproducing a multimedia file including attribution information and a sequential array of chunks, each of the chunks being a concatenation of one or a plurality of samples, one of the samples being equivalent to at least an encoded audio frame or an encoded video frame, the encoded audio frame and the encoded video frame being encrypted for a sample, the method comprising:

decrypting the multimedia file for the sample during at least one of fast-forward reproduction, rewind reproduction, random access reproduction, and resume reproduction, which comprises;

obtaining chunk offset information and sample information from the attribution information in the multimedia file, wherein the chunk offset information indicates respective start positions of the chunks from a head of the file, and the sample information indicates a number of samples and respective sample sizes of the samples in each of the chunks;

referring to one of the start position of the chunks and the sample information,

calculating sample offset information from the chunk offset information and the sample information, wherein the sample offset information indicates respective start positions of the samples;

extracting one of the samples from the multimedia file based on the one of the start positions of the chunks and the sample offset information; and

decrypting, for the sample, the encrypted audio frame and/or the encrypted video frame in the extracted sample into the encoded audio frame and/or the encoded video frame after extracting the one of the samples;

decoding an audio stream extracted from the encoded audio frames into an audio signal and a video stream extracted from the encoded video frame into a video signal; and

outputting the audio signal and the video signal.

23. The method according to claim 22, wherein the multimedia file has a file format in accordance with a predetermined standard, and has a hierarchical structure which includes a plurality of boxes in a top-level, and the plurality of boxes are arranged in an array which is arbitrarily defined in the predetermined standard.

24. The method according to claim 23, wherein the sample comprises unencrypted residual data which is not aligned to bytes boundaries.

25. A video reproduction system of reproducing a multimedia file including attribution information and a sequential array of chunks, each of the chunks being a concatenation of one or a plurality of samples, one of the samples being equivalent to at least an encoded audio frame or an encoded video frame, the encoded audio frame and the encoded video frame being encrypted for a sample, the system comprising:

a memory;

a decryptor processor connected to the memory and configured to decrypt the multimedia file for the sample during at least one of a fast-forward reproduction, a rewind reproduction, a random access reproduction, and a resume reproduction, wherein the decryptor processor is configured to;

obtain chunk offset information and sample information from the attribution information in the multimedia file, wherein the chunk offset information indicates respective start positions of the chunks from a head of the file, and the sample information indicates a number of samples and respective sample sizes of the samples in each of the chunks;

refer to one of the start position of the chunks and the sample information;

calculate sample offset information from the chunk offset information and the sample information, wherein the sample offset information indicates respective start positions of the samples;

extract one of the samples from the multimedia file based on the one of the start positions of the chunks and the sample offset information; and

decrypt, for the sample, the encrypted audio frame and/or the encrypted video frame in the extracted sample into the encoded audio frame and/or the encoded video frame after extracting the one of the samples;

one or more hardware processors configured to decode an audio stream extracted from the encoded audio frames into an audio signal and a video stream extracted from the encoded video frame into a video signal; and

an output configured to output the audio signal and the video signal.

26. The video reproduction system according to claim 25, wherein the multimedia file has a file format in accordance with a predetermined standard, and has a hierarchical structure which includes a plurality of boxes in a top-level, and the plurality of boxes are arranged in an array which is arbitrarily defined in the predetermined standard.

27. The video reproduction system according to claim 26, wherein the sample comprises unencrypted residual data which is not aligned to bytes boundaries.