Complexity-scalable intra-frame prediction technique

• US 7,170,937 B2
• Filed: 05/01/2003
• Issued: 01/30/2007
• Est. Priority Date: 05/01/2002
• Status: Active Grant

• Current Assignee: Texas Instruments, Inc.
• Original Assignee: Texas Instruments, Inc.
• Inventors: Zhou, Minhua
• Primary Examiner(s): PHILIPPE, GIMS S
• Application Number:
  US10/427,818
• Publication Number:
  US 20030206594A1
• Time in Patent Office: 1,370 Days
• Field of Search: 375/240.01, 375/240.02, 375/240.12, 375/240.13, 375/240.14, 375/240.15, 382/236
• US Class Current: 375/240.01
• CPC Class Codes: H04N 19/105 Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• CPC Class Codes: H04N 19/13 Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
• CPC Class Codes: H04N 19/196 being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters processing of motion vectors H04N19/513
• CPC Class Codes: H04N 19/198 including smoothing of a sequence of encoding parameters, e.g. by averaging, by choice of the maximum, minimum or median value
• CPC Class Codes: H04N 19/463 by compressing encoding parameters before transmission
• CPC Class Codes: H04N 19/593 involving spatial prediction techniques

Abstract

This invention is a method of encoding intra frames when encoding a motion picture. A set of intra frame prediction modes includes a low-complexity subset. A probability table relates the prediction mode of adjacent sub-blocks to the prediction mode of the current sub-block. For each combination of adjacent sub-blocks, the probability table includes a list of prediction modes in order of expected occurrence. The probability table is adjusted so that each list for prediction modes within the low-complexity subset include initial prediction modes of the low-complexity subset. Individual sub-blocks of intra frames are predictively coded in a low-complexity encoding the using the low-complexity subset or in a high-complexity encoding using any prediction mode. This permits a low-complexity decoder responsive to only the low-complexity subset.

Claims

1. A method of motion picture encoding comprising the steps of:

defining a plurality of intra frame prediction modes, said plurality of intra frame prediction modes including a DC mode and a plurality of modes having respective differing prediction directions;

forming a subset having a predetermined number of said plurality of intra frame prediction modes including said DC mode and some but not all of said plurality of modes having respective differing prediction directions;

dividing a picture frame into a plurality of sub-blocks;

selecting one of a low-complexity encoding and a high-complexity encoding;

upon selection of said low-complexity encoding, determining an intra frame prediction mode for each sub-block from among said subset of intra frame prediction modes;

upon selection of said high-complexity encoding, determining an intra frame prediction mode for each sub-block from among said plurality of intra frame prediction modes;

transmitting compressed data including said determined intra frame prediction mode for each sub-block to a decoder.

2. The method of claim 1, wherein:

said steps of defining said plurality of intra frame prediction modes and forming said subset having a predetermined number of said plurality of intra frame prediction modes occur once upon definition of an encoding standard.

3. The method of claim 1, further comprising the steps of:

forming a probability table relating the intra frame prediction mode assigned to two adjacent sub-blocks to the intra frame prediction mode assigned to a current sub-block, for each combination of intra frame prediction mode assigned to each of said two adjacent sub-blocks, said probability table including a list of intra frame prediction modes arranged in order of probability of expected occurrence for the current block from the most probable to the least probable;

adjusting each list for each combination of said probability table wherein the intra frame prediction modes of both adjacent sub-blocks within are said subset of intra frame prediction modes to include said predetermined number of intra frame prediction modes within said subset of intra frame prediction modes and a further number of intra frame prediction modes outside said subset of intra frame prediction modes; and

wherein said step of transmitting compressed data including said determined intra frame prediction mode for each sub-block to a decoder includes transmitting a variable length code reference to an entry in said probability table for each sub-block indicating which prediction mode within said corresponding list is assigned to said sub-block.

4. The method of claim 3, wherein:

said steps of forming said probability table and adjusting each list for each combination of said probability table occur once upon definition of an encoding standard.

5. The method of claim 3, wherein:

said step of transmitting a variable length code reference to an entry in said probability table for each sub-block includes combining an indication of prediction modes for two sub-blocks into a single variable length code.

6. The method of claim 5, wherein:

said step of transmitting a variable length code reference to an entry in said probability table for each sub-block includes forming a universal variable length code table accessed by a combined probability value of the two combined pixels, said universal variable length code table including a subset of entries corresponding to said first predetermined number of probabilities of each list.

7. The method of claim 6, wherein

said step of forming a universal variable length code table occurs once upon definition of an encoding standard.

8. The method of claim 1, wherein:

said step of defining a plurality of intra frame prediction modes consists of defining modes 0 through 8 for 4 by 4 pixel sub-blocks as follows

mode 0 wherein if A, B, C, D, E, F, G and H are within the frame all pixels are predicted by (A+B+C+D+E+F+G+H)/8, if E, F, G and H are outside the frame all pixels are predicted by (A+B+C+D)/4, if A, B, C and D are outside the frame all pixels are predicted by (E+F+G+H)/, and if pixels A, B, C, D, E, F, G and H are outside the frame all pixels are predicted by 128,

mode 1 wherein if A, B, C and D are within the frame then pixel a is predicted by (A+B)/2, pixel e is predicted by B, pixel b, i is predicted by (B+C)/2, pixels f, m are predicted by C, pixels c, j are predicted by C+D)/2 and pixels d, g, h, j, k, l, n, o and p are predicted by D,

mode 2 wherein if pixels A, B, C and D are inside the frame then pixels a, e, i and m are predicted by pixel A, pixels b, f, j and n are predicted by pixel B, pixels c, g, k and l are predicted by pixel C and pixels g, h, l and p are predicted by pixel D,

mode 3 wherein if all pixels A, B, C, D, E, F, G, H and I are inside the frame then pixel m is predicted by (H+2G+F)/4, pixels i and n are predicted by (G+2F+E)/4, pixels e, j and o are predicted by (F+2E+I)/4, pixels a, f, k and p are predicted by (E+2I+A)/4, pixels b, g and l are predicted by (I+2A+B)/4, pixels c and h are predicted by (A+2B+C)/4 and pixel d is predicted by (B+2C+D)/4,

mode 4 wherein if pixels E, F, G and H are inside the frame, then pixels a, b, c and d are predicted by pixel E;

pixels e, f, g and h are predicted by pixel F;

pixels i, j, k and l are predicted by pixel G, and pixels m, n, o and p are predicted by pixel H,

mode 5 wherein if pixels E, F, G and H are inside the frame, then pixel a is predicted by (E+F)/2, pixel b is predicted by F, pixels c and e are predicted by (F+G)/2, pixels f and d are predicted by G, pixels i and g are predicted by (G+H)/2 and pixels h, j, k, l, m, n, o and p are predicted by H,

mode 6 wherein if pixels A, B, C, D, E, F, G, H and I are inside the frame, then pixels a and j are predicted by (I+A+1)/2, pixels b and k are predicted by (A+B+1)/2, c and l are predicted by (B+C+1)/2, pixel d is predicted by (C+D+1)/2, pixels e and n are predicted by (E+2I+A+2)/4, pixels f and o are predicted by (I+2A+B+2)/4, g and p are predicted by (A+2B+C+2)/4, h is predicted by (B+2C+D+2)/4, i is predicted by (I+2E+F+2)/4 and m is predicted by (E+2F+G+2)/4,

mode 7 wherein if pixels A, B, C, D, E, F, G, H and I are inside the frame, then pixel a is predicted by 2(A+B+G)+F+H+4)/8, pixels b and i are predicted by (B+C+1)/2, pixels c and j are predicted by (C+D+1)/2, pixels d and k are predicted by (D+E+1)/2, pixel 1 is predicted by (E+F+1)/2, pixel e is predicted by (2(B+H)+A+C+G+H+4)/8, pixels f and m are predicted by (B+2C+D+2)/4, pixels g and n are predicted by (C+2D+E+2)/4, pixels h and o are predicted by (D+2E+F+2)/4 and pixel p is predicted by (E+2F+G+2)/4,

mode 8 wherein if pixels A, B, C, D, E, F, G, H and I are inside the frame, then pixels a and g are predicted by (I+E+1)/2, pixels b and h are predicted by (E+2I+A+2)/4, pixel c is predicted by (I+2A+B+2)/4, pixel d is predicted by (A+2B+C +2)/4, pixels e and k are predicted by (E+F+1)/2, pixels f and 1 are predicted by (I+2E+F+2)/4, pixels i and o are predicted by (F+G+1)/2,

pixels j and p are predicted by (E+2F+G+2)/4, pixel m is predicted by (G+H+1)/2 and n is predicted by (F+2G+H+2)/4;

wherein pixels a through p are respective pixels of said 4 by 4 pixel sub-block, pixels A, B, C and D are pixels of another block disposed above respective columns of said 4 by 4 sub-block, pixels E, F, G and H are pixels of another block disposed to the left of respective columns of said 4 by 4 sub-block and pixel I is a pixel of another sub-block disposed above and left of said 4 by 4 sub-block.

9. The method of claim 8, wherein:

forming a probability table relating the intra frame prediction mode assigned to a first adjacent sub-block disposed above the sub-block and to a second adjacent sub-block disposed left of the sub-block to the intra frame prediction mode assigned to a current sub-block, for each combination of intra frame prediction mode assigned to each of said two adjacent sub-blocks, said probability table including a list of intra frame prediction modes arranged in order of probability of expected occurrence for the current block from the most probable to the least probable and adjusted wherein the intra frame prediction modes of both adjacent sub-blocks within are said subset of intra frame prediction modes to include said predetermined number of intra frame prediction modes within said subset of intra frame prediction modes and a further number of intra frame prediction modes outside said subset of intra frame prediction modes, said probability consisting of

B/A Outside 0 1 2 3 Outside 0-------- 021------ 102------ 201------ 012------ 0 045------ 041253687 104235687 230145678 304215687 1 045------ 014253678 102435678 201345678 032154687 2 045------ 024135678 120345678 210345678 302145687 3 045------ 304152867 310425687 231054687 304215687 4 405------ 403512867 401523867 245031687 430512867 5 504------ 504312867 015432687 204513687 530412687 6 504------ 016234758 261308457 216304578 360214857 7 504------ 015463278 102576438 215680347 025136478 8 504------ 840315627 038145627 234185607 384156207 B/A 4 5 6 7 8 Outside 012------ 012------ 012------ 012------ 012------ 0 043152867 045132687 602314587 014627538 048356217 1 041253867 014532678 261354087 160275438 024385167 2 042513687 012543687 261350487 261705348 230451867 3 403512867 304512867 360214587 015364278 380456217 4 405312867 405132867 456231807 401537268 480531267 5 450312867 504132687 560243187 415073286 584631207 6 401362578 145062387 623105487 015462738 034816257 7 064517328 501436278 320156478 102574683 051348726 8 480315627 048351627 304682157 041368257 843025617;

and

wherein said step of transmitting compressed data including said determined intra frame prediction mode for each sub-block to a decoder includes transmitting a variable length code reference to an entry in said probability table for each sub-block indicating which prediction mode within said corresponding list is assigned to said sub-block.

10. The method of claim 9, wherein:

said step of transmitting a variable length code reference to an entry in said probability table for each sub-block includes combining an indication of prediction modes for two sub-blocks into a single variable length code.

11. The method of claim 10, wherein:

said step of transmitting a variable length code reference to an entry in said probability table for each sub-block includes forming a universal variable length code table accessed by a combined probability value of the two combined pixels, said universal variable length code table consisting of

0 2 5 6 11 15 16 24 46 1 4 9 12 22 25 30 38 59 3 8 14 20 27 36 32 52 63 7 13 21 29 37 43 45 56 70 10 19 28 35 39 47 53 60 71 18 23 34 42 49 55 61 68 76 17 26 33 41 44 54 62 66 75 31 40 50 48 57 65 69 73 79 51 58 64 67 72 74 77 78 80.

12. The method of claim 1, wherein:

said step of selecting one of a low-complexity encoding and a high-complexity encoding occurs once upon manufacture of an encoder.

13. The method of claim 1, wherein:

said step of selecting one of a low-complexity encoding and a high-complexity encoding occurs for each encoding of a motion picture.