Pixel interpolation filters for video decompression processor

• US 5,638,128 A
• Filed: 11/08/1994
• Issued: 06/10/1997
• Est. Priority Date: 11/08/1994
• Status: Expired due to Term

• Current Assignee: ARRIS Enterprises LLC (CommScope Holding Company, Inc.)
• Original Assignee: General Instrument Corporation (CommScope Holding Company, Inc.)
• Inventors: Hoogenboom, Chris, Vuong, Bao
• Primary Examiner(s): Britton, Howard W.
• Application Number:
  US08/335,651
• Time in Patent Office: 945 Days
• Field of Search: 348/415, 348/416, 348/716, 348/718, 348/719, 348/720, 348/721, 364/723
• US Class Current: 375/240.15
• CPC Class Codes: H04N 19/423 characterised by memory arrangements H04N19/433 takes precedence
• CPC Class Codes: H04N 19/43 Hardware specially adapted for motion estimation or compensation
• CPC Class Codes: H04N 19/523 with sub-pixel accuracy
• CPC Class Codes: H04N 19/577 Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 5/145 Movement estimation for video coding H04N19/51

Abstract

A method and apparatus are disclosed for interpolating pixels to obtain subpels for use by a video decompression processor. A prediction area is defined from which subpels are necessary to decompress a portion of a video image. Instead of reading all of the pixels from the prediction area and then processing them together to perform the necessary interpolation, portions of the pixel data are read and simultaneously averaged using in-place computation in order to reduce hardware requirements. Rounding of subpixel results is achieved using the carry input of conventional adders to add a binary "1" to the averaged pixels, which are subsequently truncated to provide the interpolated subpels.

Claims

1. A method for interpolating pixel data provided in multi-pixel words arranged in rows of a video frame, comprising the steps of:

(a) selecting a first set of at least one of said words to be interpolated from a row of said video frame;

(b) interpolating the pixel data for each word in said set in an interpolation direction defined by said row;

(c) temporarily storing the interpolated pixel data for said first set of words in a memory;

(d) selecting a subsequent set of at least one of said words to be interpolated from a next successive row of said video frame, said subsequent set of words being located adjacent said first set of words such that each word of said subsequent set has a counterpart word in said first set;

(e) interpolating the pixel data for a word in said subsequent set in said interpolation direction;

(f) reading from said memory the interpolated pixel data for the word in said first set that is the counterpart of the interpolated word from said subsequent set; and

(g) averaging the interpolated pixel data read from said memory with its counterpart interpolated pixel data from said subsequent set while concurrently storing the latter in said memory in place of the former.

2. A method in accordance with claim 1 wherein steps (e), (f) and (g) are performed for successive words in said subsequent set until all of the words in said subsequent set have been interpolated, averaged, and stored in said memory to replace the interpolated data for said first set of words.

3. A method in accordance with claim 1 comprising the further step of truncating the averaged interpolated pixel data.

4. A method in accordance with claim 1 comprising the further steps of:

selecting successive sets of words to be interpolated from successive rows of said video frame, each successive set of words being located adjacent the set of words selected in the previous row such that each word of each successive set has a counterpart word in the immediately preceding set;

interpolating the pixel data for a word in a current successive set in said interpolation direction;

reading from said memory the interpolated pixel data for the word in the immediately preceding set that is the counterpart of the interpolated word from said current successive set;

averaging the interpolated pixel data read from said memory with its counterpart interpolated pixel data from said current successive set while concurrently storing the latter in said memory in place of the former; and

performing the preceding interpolating, reading and averaging steps for successive words in each successive set until all of the words in a desired area of said video frame have been interpolated, averaged, and cycled through said memory.

5. A method in accordance with claim 4 comprising the further steps of:

defining a prediction area of said video frame from which pixel data is to be interpolated;

determining if said prediction area encompasses pixel data from more than one page of a frame store in which said video frame is stored; and

in the event that said prediction area encompasses pixel data from more than one page of said frame store, selecting said first, subsequent and successive sets of words to be interpolated such that all of the pixel data in said prediction area from a first page of said frame store is interpolated before the pixel data from a subsequent page of said frame store is interpolated.

6. A method in accordance with claim 5 comprising the further steps of:

temporarily storing pixel data adjacent a page boundary of a previously interpolated page of said frame store in a separate memory to enable the interpolation of pixel data residing adjacent said page boundary in a current page of said frame store without crossing said page boundary.

7. A method in accordance with claim 6 wherein pixel data is interpolated for a prediction area of at least two anchor frames, comprising the further steps of:

temporarily storing the interpolated pixel data for one of said anchor frames in a bidirectional data store while interpolating the pixel data for the other of said anchor frames;

averaging the temporarily stored interpolated pixel data from said bidirectional data store with the interpolated pixel data for the other of said anchor frames as the latter is being interpolated; and

writing the averaged anchor frame interpolated pixel data into said bidirectional data store for subsequent use in decoding a bidirectional (B) picture.

8. A method in accordance with claim 7 wherein said averaged anchor frame interpolated pixel data is written into said bidirectional data store in place of the anchor frame interpolated data that was read therefrom.

9. A subpixel interpolation filter for a video motion estimation processor comprising:

means for generating a first set of N subpels by averaging adjacent pixels contained in a first vector of (N+1) pixels within a row of a prediction area;

means for temporarily storing said first set of subpels;

means for generating a second set of N subpels by averaging adjacent pixels contained in a second vector of (N+1) pixels from a subsequent row of said prediction area, said second vector in said subsequent row being the counterpart of said first vector in said first row; and

means for averaging each subpel from said stored first set of subpels with a counterpart subpel from said second set as the counterpart subpels in said second set are being generated, to obtain a third set of subpels representative of said pixel data interpolated in two dimensions.

10. A subpixel interpolation filter in accordance with claim 9 comprising means for storing each subpel from said second set in said storing means in place of its counterpart subpel from said first set at the same time the second set subpel is being averaged with its counterpart first set subpel by said averaging means.

11. A subpixel interpolation filter in accordance with claim 9 further comprising:

means for determining when said prediction area encompasses pixel data from more than one page of a frame store in which the pixels being interpolated are stored; and

means responsive to said determining means for successively selecting vectors of pixels to be interpolated from successive rows within said prediction area such that all of the pixel data in said prediction area from a first page of said frame store is interpolated before the pixel data from a subsequent page of said frame store is interpolated, thereby minimizing the number of page boundaries that are crossed when interpolating all of the pixels from said prediction area.

12. A subpixel interpolation filter in accordance with claim 11 further comprising:

means for temporarily storing pixel data adjacent a page boundary of a previously interpolated page of said frame store to enable pixel data residing adjacent said page boundary in a page of said frame store currently being interpolated to be interpolated without crossing said page boundary.

13. A subpixel interpolation filter in accordance with claim 9 for interpolating pixel data from a prediction area of an intra (I) picture and from a prediction area of a predicted (P) picture for subsequent use in reconstructing a bidirectional (B) frame, further comprising:

means for temporarily storing interpolated pixel data for one of said I or P pictures in a bidirectional data store and averaging it with the interpolated pixel data for the other of said I and P pictures while the latter is being interpolated; and

means for writing the averaged I and P interpolated pixel data into said bidirectional data store for subsequent use in decoding said B frame.

14. A subpixel interpolation filter in accordance with claim 13 wherein said averaged I and P interpolated pixel data is written into said bidirectional data store in place of the I or P interpolated data that was read therefrom.

15. A horizontal pixel interpolation filter for a video decompression processor comprising:

an input for receiving consecutive words each containing N pixels from a prediction area of a video prediction frame, said consecutive words being received during successive clock cycles;

means for delaying said consecutive words of pixel data by one clock cycle;

means for holding;

a first pixel from each consecutive word received at said input, and

the immediately preceding word from said delay means; and

means coupled to receive and average the adjacent pixels held in said holding means each clock cycle to provide successive sets of horizontally interpolated subpels for use by said video decompression processor.

16. A horizontal pixel interpolation filter in accordance with claim 15 wherein said video prediction frame is stored as a set of tiles in a random access memory (RAM), each tile containing pixel data and occupying one page of said RAM, said interpolation filter further comprising:

memory means for storing a subset of words from said prediction area adjacent a first side of a vertical page break; and

means for inputting a word from said memory means to said holding means instead of inputting the immediately preceding word from said delay means when pixels adjacent a second side of said vertical page break are being interpolated.

17. A vertical interpolation filter for vertically interpolating the horizontally interpolated subpels provided by the filter of claim 15, comprising:

an input for receiving said successive sets of horizontally interpolated subpels during successive clock cycles;

means for buffering the successive sets of the horizontally interpolated subpels for averaging with vertically adjacent counterpart sets of horizontally interpolated subpels in said prediction area; and

means for averaging the buffered sets of horizontally interpolated subpels with said counterpart sets to provide successive sets of horizontally and vertically interpolated subpels for use by said video decompression processor.

18. A bidirectional interpolation filter for use in combination with the horizontal and vertical interpolation filters of claim 17, said horizontal and vertical interpolation filters being used to interpolate pixel data from a prediction area of an intra (I) picture and from a prediction area of a predicted (P) picture, comprising:

means for temporarily storing interpolated pixel data for one of said I or P pictures in a bidirectional data store and averaging it with the interpolated pixel data for the other of said I and P pictures while the latter is being interpolated by said horizontal and vertical interpolation filters; and

means for writing the averaged I and P interpolated pixel data into said bidirectional data store for subsequent use in decoding a bidirectional (B) frame.

19. A horizontal pixel interpolation filter in accordance with claim 15 wherein:

said averaging means comprise a plurality of adders coupled to said holding means, each adder adding two adjacent pixels from said holding means to provide a sum;

each adder includes a carry input adapted to add a binary "1" to the sum; and

means are provided for truncating said sum by its least significant bit, resulting in a subpel that is rounded away from zero.

20. A horizontal pixel interpolation filter in accordance with claim 19 wherein said video prediction frame is stored as a set of tiles in a random access memory (RAM), each tile containing pixel data and occupying one page of said RAM, said interpolation filter further comprising:

memory means for storing a subset of words from said prediction area adjacent a first side of a vertical page break; and

means for inputting a word from said memory means to said holding means instead of inputting the immediately preceding word from said delay means when pixels adjacent a second side of said vertical page break are being interpolated.