Generation of MPEG slow motion playout

• US 20030053540A1
• Filed: 09/11/2001
• Published: 03/20/2003
• Est. Priority Date: 09/11/2001
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Gardere, Daniel, Noury, Michel, Wang, Jie, Faibish, Sorin, Keller, Sebastien
• Granted Patent: US 6,980,594 B2
• Time in Patent Office: Days
• US Class Current: 375/240.12
• CPC Class Codes: G11B 2220/20 Disc-shaped record carriers
• CPC Class Codes: G11B 2220/90 Tape-like record carriers
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/032 on tapes G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: H04N 19/114 Adapting the group of pictures [GOP] structure, e.g. number of B-frames between two anchor frames H04N19/107 takes precedence
• CPC Class Codes: H04N 19/177 the unit being a group of pictures [GOP]
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 19/577 Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 5/262 Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
• CPC Class Codes: H04N 5/783 Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 9/8042 involving data reduction

Abstract

MPEG coded video data includes groups of pictures (GOPs). Each group of pictures includes one or more I-frames and a plurality of B- or P-frames. To produce an MPEG slow-forward coded video stream, the coding type of each frame in the MPEG coded video data is identified, and freeze frames are inserted as a predefined function of the identified coding type and as a predefined function of a desired slow down factor. In a preferred implementation, for a slow-down factor of n, for each original I- or P-frame, (n−1) backward-predicted freeze frames are inserted, and for each original B-frame, (n−1) copies of the original B-frames are added, and a selected amount of padding is added to each copy of each original B-frame in order to obtain a normal play bit rate and avoid video buffer overflow or underflow.

Claims

1. A method of slowing an MPEG coded video stream, the MPEG coded video stream including groups of pictures (GOPs), each group of pictures including one or more I-frames and a plurality of B- or P-frames, said method comprising:

a) identifying coding type of each frame in the MPEG-coded video stream; and

b) inserting freeze frames as a predefined function of the identified coding type and as a predefined function of a desired slow down factor.

2. The method as claimed in claim 1, wherein the freeze frames include copies of original coded frames, and frames that are predicted frames, and the method further includes inserting into the MPEG coded video stream a selected amount of padding to obtain a normal play bit rate.

3. The method as claimed in claim 2, which includes selecting the amount of padding so that a video buffer verifier (VBV) has a level at an end of decoding said each freeze frame substantially equal to a level at an end of decoding a frame immediately preceding said each freeze frame.

4. The method as claimed in claim 2, wherein the predicted freeze frames are backward-predicted freeze frames, and the method includes placing the backward-predicted freeze frames in decode order after other B-frames immediately following an original I-frame or P-frame, and the backward-predicted freeze frames are placed in decode order just after all other B-frames that will immediately follow said original I-frame or P-frame.

5. The method as claimed in claim 1, which includes inserting, for each frame in the MPEG-coded video stream, an integer number of freeze frames into the MPEG-coded video stream, the integer number being a function of the slow-down factor.

6. A method of producing an MPEG slow-forward coded video stream from MPEG coded video data, the MPEG coded video data including groups of pictures (GOPs), the groups of pictures including I-frames, P-frames, and B-frames, said method comprising:

for each frame in the MPEG coded video data, identifying coding type of said each frame, and

for said each frame identified as an I-frame or P-frame, adding at least one predicted freeze frame to said each frame identified as an I-frame or P-frame to produce frames included in the MPEG slow-forward coded video stream, the predicted freeze frame being dependent on said each frame identified as an I-frame or P-frame; and

for said each frame identified as a B-frame, adding at least one copy of said each frame identified as a B-frame to said each frame identified as a B-frame to produce frames included in the MPEG slow-forward coded video stream.

7. The method as claimed in claim 6, which includes inserting padding into the copy of said each frame identified as a B-frame to obtain a normal play bit rate.

8. The method as claimed in claim 6, which includes inserting a selected amount of padding into the copy of said each frame identified as a B-frame, the amount of padding being selected so that a video buffer verifier (VBV) has a level at an end of decoding of the copy that is substantially equal to a level at an end of decoding of a frame immediately preceding the copy.

9. The method as claimed in claim 6, wherein the predicted freeze frame is a backward-predicted freeze frame, and the method includes placing the backward-predicted freeze frame in decode order after other B-frames immediately following said each frame identified as an I-frame or P-frame, and the backward-predicted freeze frame is placed just after all other B-frames that will immediately follow said each frame identified as an I-frame or P-frame.

10. The method as claimed in claim 6, wherein the method is responsive to a variable slow down factor of n, and the method includes, for said each frame identified as an I-frame or P-frame, adding (n−

1) predicted freeze frames to said each frame identified as an I-frame or P-frame to produce n frames included in the MPEG slow-forward coded video stream, and for said each frame that is identified as a B-frame, adding (n−

1) copies of said each frame identified as a B-frame to said each frame identified as a B-frame to produce n frames included in the MPEG slow-forward coded video stream.

11. An apparatus for producing an MPEG slow-forward coded video stream from MPEG coded video data, the MPEG coded video data including groups of pictures (GOPs), each group of pictures including one or more I-frames and a plurality of B- or P-frames, said apparatus comprising:

storage for containing the MPEG coded video data; and

a processor coupled to the storage for receiving a stream of the MPEG coded video data from the storage, the processor being programmed for identifying coding type of each frame in the stream of MPEG-coded video data from the storage, and inserting freeze frames as a predefined function of the identified coding type and as a predefined function of a desired slow down factor.

12. The apparatus as claimed in claim 11, wherein the freeze frames include copies of original coded frames, and frames that are predicted frames, and the processor is programmed for inserting into the stream of MPEG coded video data a selected amount of padding to obtain a normal play bit rate.

13. The apparatus as claimed in claim 12, wherein the processor is programmed for selecting the amount of padding so that a video buffer verifier (VBV) has a level at an end of decoding said each freeze frame substantially equal to a level at an end of decoding a frame immediately preceding said each freeze frame.

14. The apparatus as claimed in claim 12, wherein the predicted freeze frames are backward-predicted freeze frames, and the processor is programmed for placing the backward-predicted freeze frames in decode order after other B-frames immediately following an original I-frame or P-frame, and the backward-predicted freeze frames are placed in decode order just after all other B-frames that will immediately follow said original I-frame or P-frame.

15. The apparatus as claimed in claim 11, wherein the processor is programmed for inserting, for each frame in the MPEG-coded video stream, an integer number of freeze frames into the stream of MPEG-coded video data, the integer number being a function of the slow-down factor.

16. An apparatus for producing an MPEG slow-forward coded video stream from MPEG coded video data, the MPEG coded video data including groups of pictures (GOPs), the groups of pictures including I-frames, P-frames, and B-frames, said apparatus comprising:

storage for containing the MPEG coded video data; and

a processor coupled to the storage for receiving a stream of the MPEG coded video data from the storage, the processor being programmed for identifying coding type of each frame in the stream of the MPEG coded video data from the storage, and

for said each frame identified as an I-frame or P-frame, adding at least one predicted freeze frame to said each frame identified as an I-frame or P-frame to produce frames included in the MPEG slow-forward coded video stream, the predicted freeze frame being dependent on said each frame identified as an I-frame or P-frame; and

for said each frame identified as a B-frame, adding at least one copy of said each frame identified as a B-frame to said each frame identified as a B-frame to produce frames included in the MPEG slow-forward coded video stream.

17. The apparatus as claimed in claim 16, wherein the processor is programmed for inserting padding into the copy of said each frame identified as a B-frame to obtain a normal play bit rate.

18. The apparatus as claimed in claim 16, wherein the processor is programmed for inserting a selected amount of padding into the copy of said each frame identified as a B-frame, the amount of padding being selected so that a video buffer verifier (VBV) has a level at an end of decoding of the copy that is substantially equal to a level at an end of decoding of a frame immediately preceding the copy.

19. The apparatus as claimed in claim 16, wherein the predicted freeze frame is a backward-predicted freeze frame, and the processor is programmed for placing the backward-predicted freeze frame in decode order after other B-frames immediately following said each frame identified as an I-frame or P-frame, and the backward-predicted freeze frame is placed just after all other B-frames that will immediately follow said each frame identified as an I-frame or P-frame.

20. The apparatus as claimed in claim 16, wherein the processor is responsive to a variable slow down factor of n, and the processor is programmed for adding, for said each frame identified as an I-frame or P-frame, (n−

1) predicted freeze frames to said each frame identified as an I-frame or P-frame to produce n frames included in the MPEG slow-forward coded video stream, and for said each frame that is identified as a B-frame, adding (n−

1) copies of said each frame identified as a B-frame to said each frame identified as a B-frame to produce n frames included in the MPEG slow-forward coded video stream.