Fast and smart video trimming at frame accuracy on generic platform

• US 9,911,460 B2
• Filed: 05/22/2014
• Issued: 03/06/2018
• Est. Priority Date: 03/24/2014
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Dandu, Srinivas, Wu, Yongjun, Arunachalam, Shankaranand
• Primary Examiner(s): Vo, Tung
• Application Number:
  US14/285,613
• Publication Number:
  US 20150269967A1
• Time in Patent Office: 1,384 Days
• Field of Search: 37524026
• CPC Class Codes: G11B 27/00 Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/196 being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters processing of motion vectors H04N19/513
• CPC Class Codes: H04N 19/48 using compressed domain processing techniques other than decoding, e.g. modification of transform coefficients, variable length coding [VLC] data or run-length data motion estimation in a transform domain H04N19/547; processing of decoded motion vectors H04N19/513
• CPC Class Codes: H04N 9/87 Regeneration of colour television signals H04N9/80 takes precedence

Abstract

In a computing device that implements an encoder, a method comprises receiving an encoded video sequence with a file container, receiving input to execute a trimming operation to create a frame accurate target segment of one or more desired pictures from the encoded video sequence and trimming to frame accuracy. Trimming to frame accuracy is accomplished by changing the parameter identifications of leading and trailing portions, if supported, or changing the parameters, and using the changed parameters or parameter identifications in re-encoding the leading and trailing portions, while an untouched middle portion between the leading and trailing portions is re-muxed without re-encoding.

Claims

1. In a computing device that implements an encoder, a method comprising:

receiving an encoded video sequence with a file container;

receiving a video trimming operation input to trim arbitrary desired pictures from the encoded video sequence to create a frame accurate target segment, wherein the frame accurate target segment begins with a P or B picture and is not limited to beginning with a clear start picture;

wherein if the encoder supports use of changed parameter identifications, trimming to frame accuracy comprises creating new parameter identifications for each of a leading portion and a trailing portion, inserting the new parameter identifications in the leading portion and the trailing portion, re-encoding the leading portion and the trailing portion using the new parameter identifications, wherein the new parameter identifications are different from a parameter identification for an unchanged middle portion between the leading and trailing portions, and re-muxing the unchanged middle portion, without re-encoding, with the re-encoded leading and trailing portions, and wherein the method performs smart video editing so that only the arbitrary desired pictures are retained from the video sequence.

2. The computing device of claim 1, wherein trimming to frame accuracy comprises creating new parameter identifications for each of the leading portion and the trailing portion, inserting the new parameter identifications in the leading portion and the trailing portion, re-encoding the leading portion and the trailing portion using the new parameter identifications, wherein the new parameter identifications are different from a parameter identification for the unchanged middle portion.

3. The computing device of claim 1, wherein trimming to frame accuracy comprises creating a new sample description container in a multimedia container for the target segment.

4. The computing device of claim 1, wherein trimming to frame accuracy comprises creating a new sample description container in a multimedia container for the target segment, and wherein the new sample description container comprises (1) original parameter sets from an original sample description container, (2) new parameter sets different from the original parameter sets and having parameter identifications matching the original parameter sets, (3) the original parameter sets of (1) and the new parameter sets of (2) in combination, or (4) dummy parameter sets different from the original parameter sets and having parameter identifications matching the original parameter sets.

5. The computing device of claim 1, further comprising adjusting the timestamps of the pictures in the target segment to ensure playback in proper sequence and creating a new multimedia container to describe the re-encoded leading portion, the re-muxed middle portion and the re-encoded trailing portion.

7. The computing device of claim 5, wherein the new parameter set is inserted in and saved together with sample data after any parameter set present in sample data from the sample description container.

10. The computing device of claim 5, wherein trimming to frame accuracy comprises creating a new sample description container and storing values in the sample description container sufficient to ensure compliance with MPEG-4 file format specification.

6. In a computing device that implements an encoder, a method comprising:

receiving an encoded video sequence with a file container;

receiving input to execute a trimming operation to create a frame accurate target segment of one or more desired pictures from the encoded video sequence;

determining that an encoder to be used for re-encoding the leading portion and the trailing portion cannot support parameter identifications for a leading portion and a trailing portion that are different from a parameter identification for an unchanged middle portion between the leading portion and the trailing portion;

inserting a new parameter set with the same parameter identification for the leading portion and for the trailing portion together with respective clear start picture sample data;

trimming to frame accuracy by changing the parameters of the leading and trailing portions to have the new parameter set and the same parameter identification, using the changed parameters in re-encoding the leading and trailing portions and re-muxing the unchanged middle portion, without re-encoding, with the re-encoded leading and trailing portions.

8. The computing device of claim 6, wherein trimming to frame accuracy comprises inserting a new clear start picture into the target sequence at a starting point of the target sequence.

9. The computing device of claim 6, further comprising determining a type of an encoder suited for re-encoding and specifying a hardware or software encoder.

11. In a computing device that implements an encoder, a method comprising:

receiving an encoded video sequence with a file container;

receiving input to execute a trimming operation to create a frame accurate target segment of one or more desired pictures from the encoded video sequence;

trimming to frame accuracy by changing the parameters or the parameter identifications of leading and trailing portions, using the changed parameters or changed parameter identifications in re-encoding the leading and trailing portions, and re-muxing an unchanged middle portion between the leading and trailing portions, without re-encoding, with the re-encoded leading and trailing portions;

determining whether the encoder supports use of changed parameter identifications for the pictures in the leading portion and in the trailing portion that are different from original parameter identifications,

wherein if the encoder supports use of changed parameter identifications, trimming to frame accuracy comprises creating new parameter identifications for each of the leading portion and the trailing portion, inserting the new parameter identifications in the leading portion and the trailing portion, re-encoding the leading portion and the trailing portion using the new parameter identifications, wherein the new parameter identifications are different from a parameter identification for the unchanged middle portion, and

wherein if the encoder does not support use of changed parameter identifications, trimming to frame accuracy comprises creating a second set of parameters different from an original set of parameters for the unchanged middle portion and inserting the second set of parameters into the leading portion and into the trailing portion, wherein the original set of parameters and the second set of parameters have the same parameter identifications.

12. In a computing device that implements an encoder, a method comprising:

receiving an encoded video sequence with a file container;

receiving input to execute a trimming operation to create a frame accurate target segment of one or more desired pictures from the encoded video sequence; and

trimming to frame accuracy by changing the parameters or the parameter identifications of leading and trailing portions, using the changed parameters or changed parameter identifications in re-encoding the leading and trailing portions, and re-muxing an unchanged middle portion between the leading and trailing portions, without re-encoding, with the re-encoded leading and trailing portions,

wherein if the encoder does not support use of changed parameter identifications, then further comprising determining whether the leading portion and trailing portion contain an access unit delimiter, and if an access unit delimiter is present, then inserting the second set of parameters to follow the access unit delimiter.