Trick mode elementary stream and receiver system

• US 8,213,779 B2
• Filed: 11/15/2004
• Issued: 07/03/2012
• Est. Priority Date: 09/07/2003
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Crinon, Regis J.
• Primary Examiner(s): ATALA, JAMIE JO
• Application Number:
  US10/989,827
• Publication Number:
  US 20050135783A1
• Time in Patent Office: 2,787 Days
• Field of Search: 386/68, 386/80
• US Class Current: 386/344
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 21/8455 involving pointers to the content, e.g. pointers to the I-frames of the video stream

Abstract

A video receiver system comprises a video elementary stream decoder that decodes an elementary stream and one or more trick mode processing modules that modify the elementary stream to enable a trick mode effect. The trick mode processing module(s) produce a trick mode elementary stream for input to the video elementary stream decoder module. For example, the one or more trick mode processing modules can replace plural non-key frames of the elementary stream with one or more P-type skipped frames for a fast forward effect, where the trick mode elementary stream comprises one or more entry point key frames and the one or more P-type skipped frames. The video receiver system can selectively route the elementary stream to either the video elementary stream decoder module or the one or more trick mode processing modules.

Claims

1. A video receiver system implemented in a computing environment, the video receiver system comprising:

a switch operable to engage or disengage trick mode processing of an input video elementary stream, the input video elementary stream including initial buffer fullness values in entry point headers, the initial buffer fullness values defining levels of fullness of a decoder buffer when the decoder buffer stores encoded video information for the input video elementary stream;

a video elementary stream decoder module operable to decode the input video elementary stream or a decoder-compliant trick mode elementary stream; and

one or more trick mode processing modules operable to modify the input video elementary stream to enable a trick mode effect, wherein the one or more trick mode processing modules are operable to produce the decoder-compliant trick mode elementary stream for input to the video elementary stream decoder module, and wherein the one or more trick mode processing modules include a buffer adjustment module operable to adjust, at the video receiver system, the initial buffer fullness values in the entry point headers of the input video elementary stream to produce adjusted buffer fullness values in entry point headers signaled as part of the trick mode elementary stream, the adjusted buffer fullness values defining levels of fullness of the decoder buffer when the decoder buffer stores encoded video information for the trick mode elementary stream, the adjusted buffer fullness values having been adjusted to regulate timing of decoding of the trick mode elementary stream instead of the input video elementary stream.

2. The video receiver system of claim 1 wherein the one or more trick mode processing modules are operable to replace plural non-key frames of the input video elementary stream with one or more P-type skipped frames for a fast forward effect by, for each of the one or more P-type skipped frames, signaling a picture type of skipped for the frame at picture layer in the trick mode elementary stream but signaling no further image data for the frame after the picture type of skipped in the trick mode elementary stream, and wherein the trick mode elementary stream comprises one or more entry point key frames and the one or more P-type skipped frames.

3. The video receiver system of claim 2 wherein each of the replaced plural non-key frames of the input video elementary stream is selected from a group consisting of:

progressive B-frame, progressive P-frame, interlaced B-frame, interlaced P-frame, B/B-frame, P/P-frame, BI/B-frame, B/BI-frame, or BI/BI-frame.

4. The video receiver system of claim 1 wherein the switch is operable to selectively route the input video elementary stream to either the video elementary stream decoder module or the one or more trick mode processing modules, and wherein the trick mode elementary stream is routed back to the video elementary stream decoder module after the one or more trick mode processing modules.

5. The video receiver system of claim 1 wherein the one or more trick mode processing modules further comprise an entry point detector.

6. The video receiver system of claim 5 wherein the one or more trick mode processing modules further comprise a bitstream filter.

7. The video receiver system of claim 5 wherein the one or more trick mode processing modules further comprise a frame-dropping module and a P-type skipped frame insertion module.

8. The video receiver system of claim 1 wherein the buffer adjustment module is operable to adjust the initial buffer fullness values in the entry point headers in the input video elementary stream by calculating a different one of the buffer fullness values for each of plural entry points, respectively, so as to regulate the timing of the decoding of the trick mode elementary stream.

30. The video receiver system of claim 1 wherein the one or more trick mode processing modules are further operable to, upon a switch from decoding of the input video elementary stream to decoding of the trick mode elementary stream:

add an end-of-sequence code to the input video elementary stream;

create a sequence start code and sequence header to start the trick mode elementary stream; and

route the trick mode elementary stream to the video elementary stream decoder.

9. In a computing device that implements a video receiver system, the computing device including a processor and memory, a method comprising:

receiving, at the computing device that implements the video receiver system, an input video elementary stream for processing by one or more of a video elementary stream decoder and one or more trick mode processing modules of the video receiver system, the input video elementary stream including initial buffer fullness values in entry point headers, the initial buffer fullness values defining levels of fullness of a decoder buffer when the decoder buffer stores encoded video information for the input video elementary stream;

receiving, at the computing device that implements the video receiver system, trick mode session information; and

with the computing device that implements the video receiver system, based at least in part on the received trick mode session information, processing the input video elementary stream in the one or more trick mode processing modules to enable a trick mode effect, wherein from the input video elementary stream the one or more trick mode processing modules produce a trick mode elementary stream for input to the video elementary stream decoder, and wherein the processing includes adjusting, at the computing device that implements the video receiver system, the initial buffer fullness values in the entry point headers of the input video elementary stream to produce adjusted buffer fullness values to signal in entry point headers in the trick mode elementary stream, the adjusted buffer fullness values defining levels of fullness of the decoder buffer when the decoder buffer stores encoded video information for the trick mode elementary stream, the adjusted buffer fullness values having been adjusted to regulate timing of decoding of the trick mode elementary stream instead of the input video elementary stream.

10. The method of claim 9 wherein the processing the input video elementary stream in the one or more trick mode processing modules includes replacing plural non-key frames of the input video elementary stream with one or more P-type skipped frames for a fast forward effect by, for each of the one or more P-type skipped frames, signaling a picture type of skipped for the frame at picture layer in the trick mode elementary stream but signaling no further image data for the frame after the picture type of skipped in the trick mode elementary stream, and wherein the trick mode elementary stream comprises one or more entry point key frames and the one or more P-type skipped frames.

11. The method of claim 10 wherein each of the one or more entry point key frames is of a type selected from a group consisting of progressive I-frame, interlaced I-frame, I/I-frame, I/P-frame, and P/I-frame.

12. The method of claim 9 wherein the processing the input video elementary stream in the one or more trick mode processing modules includes dropping frames of the input video elementary stream for a fast forward effect.

13. The method of claim 9 further comprising, with the computing device that implements the video receiver system, routing the trick mode elementary stream to the video elementary stream decoder for decoding.

14. The method of claim 9 further comprising:

with the computing device that implements the video receiver system, switching from the trick mode elementary stream back to the input video elementary stream, whereby the video elementary stream decoder stops decoding the trick mode elementary stream and starts decoding the input video elementary stream.

15. The method of claim 9 wherein the trick mode effect is slow motion.

16. The method of claim 9 wherein the trick mode effect is fast reverse.

17. The method of claim 9 wherein the trick mode effect is slow reverse.

18. The method of claim 9 wherein the trick mode effect is freeze frame.

19. The method of claim 9 further comprising:

operating the video elementary stream decoder based at least in part upon the adjusted buffer fullness values signaled in the entry point headers in the trick mode elementary stream.

20. The method of claim 9 wherein the input video elementary stream is contained within a transport stream.

21. The method of claim 9 further comprising, with the video elementary stream decoder, decoding the trick mode elementary stream without reference to the trick mode effect and without decoder logic adapted for implementing the trick mode effect.

22. The method of claim 9 further comprising, with the computing device that implements the video receiver system, routing the trick mode elementary stream to the video elementary stream decoder in place of the input video elementary stream.

23. One or more storage media having stored thereon software for causing the computing device to perform the method of claim 9.

29. The method of claim 9 further comprising:

with the computing device that implements the video receiver system, switching from decoding of the input video elementary stream to decoding of the trick mode elementary stream, including;

adding an end-of-sequence code to the input video elementary stream;

creating a sequence start code and sequence header to start the trick mode elementary stream; and

routing the trick mode elementary stream to the video elementary stream decoder.

24. In a computing device that implements a video receiver system, the computing device including a processor and memory, a method comprising:

receiving, at the computing device that implements the video receiver system, a video elementary stream for processing by one or more of an entry point detector, a bitstream filter, a P-type skipped frame insertion module and a video elementary stream decoder of the video receiver system;

receiving, at the computing device that implements the video receiver system, trick mode session information for the video elementary stream;

with the computing device that implements the video receiver system, in the entry point detector, detecting at least one entry point having a corresponding entry point key frame in the video elementary stream;

with the computing device that implements the video receiver system, in the bitstream filter, removing at least one frame following the entry point key frame in the video elementary stream, the removing based at least in part on the received trick mode information;

with the computing device that implements the video receiver system, in the skipped frame insertion module, inserting at least one P-type skipped frame to form a trick mode elementary stream with a fast forward effect by, for each of the at least one P-type skipped frame, signaling a picture type of skipped for the frame at picture layer in the trick mode elementary stream but signaling no further image data for the frame after the picture type of skipped in the trick mode elementary stream, wherein the inserting is based at least in part on the received trick mode information; and

with the computing device that implements the video receiver system, in the video elementary stream decoder, decoding the trick mode elementary stream.

25. The method of claim 24 wherein the entry point key frame is of a type selected from a group consisting of progressive I-frame, interlaced I-frame, I/I-frame, I/P-frame, and P/I-frame.

26. One or more storage media having stored thereon software for causing the computing device to perform the method of claim 24.

27. The method of claim 24 wherein the video elementary stream includes initial buffer fullness values in entry point headers, the initial buffer fullness values defining levels of fullness of a decoder buffer when the decoder buffer stores encoded video information for the video elementary stream, the method further comprising, with the computing device that implements the video receiver system, before the decoding, producing adjusted buffer fullness values in entry point headers signaled as part of the trick mode elementary stream, the adjusted buffer fullness values defining levels of fullness of the decoder buffer when the decoder buffer stores encoded video information for the trick mode elementary stream, the adjusted buffer fullness values having been adjusted to regulate timing of decoding of the trick mode elementary stream.

28. The method of claim 27 further comprising operating the video elementary stream decoder based at least in part upon the adjusted buffer fullness values.