Random access point (RAP) formation using intra refreshing technique in video coding

• US 8,711,933 B2
• Filed: 08/09/2010
• Issued: 04/29/2014
• Est. Priority Date: 08/09/2010
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Lee, Hung-Ju
• Primary Examiner(s): Le, Thao
• Assistant Examiner(s): LE, LONG HUYNH
• Application Number:
  US12/853,214
• Publication Number:
  US 20120033730A1
• Time in Patent Office: 1,359 Days
• Field of Search: 375/240.12, 375/240.13, 375/240.26, 382/254, 386/4
• US Class Current: 375/240.12
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04N 19/103 Selection of coding mode or of prediction mode
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/593 involving spatial prediction techniques

Abstract

A random access point can be generated in a stream of coded digital pictures containing a plurality of predictive coded frames in which one or more subsections of each frame are intra coded. A patch frame can be formed from intra-coded subsections in identified consecutive predictive-coded frames. The patch frame can be used as a synthetic random access point.

Claims

1. A method for generating a random access point from a stream of coded digital pictures containing a plurality of predictive coded frames, the plurality of predictive coded frames having two or more predictive coded frames in which one or more subsections of each of the two or more predictive coded frames are intra coded, the method comprising:

a) identifying two or more consecutive predictive-coded frames in the stream that each contain one or more intra-coded subsections from different portions with a processor module; and

b) forming a patch frame by combining the intra-coded subsections from the different portions of the two or more consecutive predictive-coded frames identified in a) into the patch frame with the processor module.

2. The method of claim 1, further comprising c) presenting the patch frame on a display.

3. The method of claim 1 wherein the stream of coded pictures includes no intra-coded frames.

4. The method of claim 1 wherein the one or more subsections include one or more macroblocks.

5. The method of claim 1 wherein the one or more subsections include one or more rows of macroblocks.

6. The method of claim 1 wherein a) is performed by an encoder unit that encodes a sequence of digital pictures to form the stream of coded digital pictures.

7. The method of claim 6 wherein a) includes setting a bit in a header in the stream of coded digital pictures.

8. The method of claim 6, further comprising, after a) and before b), transmitting the stream of coded pictures over a network to a device that contains a decoder, wherein b) is performed by the decoder.

9. The method of claim 1, wherein a) and b) are performed by a decoder unit that decodes the stream of coded pictures to form a sequence of decoded pictures.

10. The method of claim 9 wherein a) includes reading a bit in a header in the stream of coded digital pictures and determining from a value of the bit whether two or more consecutive predictive-coded frames in the stream can be used to form the patch frame.

11. The method of claim 10, further comprising, utilizing the patch frame as a random access point for display of the sequence of decoded pictures.

12. The method of claim 11, wherein utilizing the patch frame includes implementing fast forward or fast reverse in the display of the sequence of decoded pictures.

13. The method of claim 10, further comprising, utilizing the patch frame as a random access point for error resiliency.

14. An apparatus for generating a random access point in a stream of coded digital pictures containing a plurality of predictive coded frames, the plurality of predictive coded frames having two or more predictive coded frames in which one or more subsections of each of the two or more predictive coded frames are intra coded, the apparatus comprising:

a processor;

a memory; and

computer coded instructions embodied in the memory and executable by the processor, wherein the computer coded instructions are configured to implement a method for encoding a digital picture upon execution by the processor, the method comprising;

a) identifying two or more consecutive predictive-coded frames in the stream that each contain one or more intra-coded subsections from different portions; and

b) forming a patch frame by combining the intra-coded subsections from the different portions of the two or more consecutive predictive-coded frames identified in a) into the patch frame.

15. The apparatus of claim 14, wherein the method further comprises:

c) presenting the patch frame on a display.

16. The apparatus of claim 14, wherein the stream of coded pictures includes no intra-coded frames.

17. The apparatus of claim 14, wherein the one or more subsections include one or more macroblocks.

18. The apparatus of claim 14, wherein the one or more subsections include one or more rows of macroblocks.

19. The apparatus of claim 14, wherein a) and b) are performed by an encoder unit that encodes the digital pictures to form the stream.

20. The apparatus of claim 19, wherein the method further comprises transmitting the stream of coded pictures over a network to a device that contains a decoder.

21. The apparatus of claim 14, wherein a) and b) are performed by a decoder unit that decodes the stream of pictures to form a sequence of decoded pictures.

22. The apparatus of claim 21, further comprising, utilizing the patch frame as a random access point for display of the sequence of decoded pictures.

23. The apparatus of claim 22, wherein utilizing the patch frame includes implementing fast forward or fast reverse in the display of the sequence of decoded pictures.

24. The apparatus of claim 21, further comprising, utilizing the patch frame as a random access point for error resiliency.

25. A non-transitory computer-readable medium having embodied therein coded instructions executable by a computer processor, the computer coded instructions being configured to implement a method for generating a random access point in a stream of coded digital pictures containing a plurality of predictive coded frames, the plurality of predictive coded frames having two or more predictive coded frames in which one or more subsections of each of the two or more predictive coded frames are intra coded, comprising, the method comprising:

a) identifying two or more consecutive predictive-coded frames in the stream that each contain one or more intra-coded subsections from different portions; and

b) forming a patch frame by combining the intra-coded subsections from the different portions of the two or more consecutive predictive-coded frames identified in a) into the patch frame.

26. A method for generating a random access point in a stream of coded digital pictures containing a plurality of predictive coded frames, the plurality of predictive coded frames having two or more predictive coded frames in which one or more subsections of each of the two or more predictive coded frames are intra coded, the method comprising:

a) predictive coding two or more consecutive frames into a stream of digital pictures, wherein each of the two or more different predictive-coded frames contains one or more intra-coded subsections from different portions; and

b) adding information to the stream, wherein the information identifies for a decoder which of the two or more consecutive predictive-coded frames have intra-coded subsections at different portions which can be combined to form a patch frame.