Method and apparatus for scaling images having a plurality of scan lines of pixel data

• US 5,793,379 A
• Filed: 08/29/1997
• Issued: 08/11/1998
• Est. Priority Date: 04/03/1995
• Status: Expired due to Term

• Current Assignee: Corilli Capital Limited Liability Company (Intellectual Ventures LLC)
• Original Assignee: NVIDIA Corporation
• Inventors: Lapidous, Eugene
• Primary Examiner(s): Feild, Joseph H.
• Assistant Examiner(s): HONG, STEPHEN S
• Application Number:
  US08/921,425
• Time in Patent Office: 347 Days
• Field of Search: 345/433, 345/434, 345/435, 345/439, 345/443, 345/428, 345/138, 382/298, 382/299, 382/300, 348/441, 348/443, 348/445
• US Class Current: 345/606
• CPC Class Codes: G06T 3/4007 based on interpolation, e.g. bilinear interpolation image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403

Abstract

A method of processing a digital input image having a plurality of scan lines of pixel data into an interpolated digital output image by interpolating the pixel data in each scan line of the digital input image and replicating the pixel data in the slow scan direction to provide a plurality of scan lines interpolated in the fast scan direction, calculating slow scan direction interpolation coefficients for scan lines to be interpolated in the interpolated output image, storing the interpolated scan lines using the storage typically used for the display image, interpolating selected scan lines which have been stored using selected existing scan lines to produce scan lines interpolated in the slow scan direction of the interpolated output image, and writing scan lines interpolated in the slow scan direction in place of scan lines selected for interpolation in the output image.

Claims

1. A method of scaling images in a digital display system having a central processing unit, and a graphics control circuit including a frame buffer, comprising the steps of:

interpolating the pixels of each scan line of pixels to a selected scale using the central processing unit as the scan line is written,

replicating in the slow scan direction each interpolated scan line being sent to the frame buffer to a selected scale using circuitry of the graphics control circuit,

interpolating scan lines in the slow scan direction utilizing selected scan lines stored in the frame buffer as input scan lines, and

replacing existing scan lines which have been selected for interpolation with the interpolated scan lines.

2. A method of scaling images as claimed in claim 1 in which the step of interpolating scan lines uses a blending circuit to interpolate scan lines.

3. A method of scaling images as claimed in claim 1 in which the steps of interpolating scan lines and replacing scan lines continue for as long as time remains before a next frame is to be written to the frame buffer.

4. A method of scaling images as claimed in claim 3 in which the time remaining before a next frame is to be written to the frame buffer is computed using a timing circuit in the graphics control circuit.

5. A method of scaling images as claimed in claim 4 in which the steps of interpolating scan lines and replacing scan lines use blending circuitry of the graphics control circuit.

6. A method of scaling images in a digital display system having a central processing unit, and a graphics control circuit including a frame buffer, comprising the steps of:

interpolating the pixels of each scan line of pixels to a selected scale using the central processing unit as the scan line is written,

replicating each interpolated scan line being sent to the frame buffer to a selected scale using circuitry of the graphics control circuit,

selectively interpolating scan lines utilizing scan lines stored in the frame buffer as input scan lines,

the step beginning by interpolating scan lines containing pixel data which contributes least to replacing scan lines, and proceeding by interpolating scan lines in an increasing order of contribution to replacing scan lines,

the step of selectively interpolating scan lines uses a blending circuit to interpolate scan lines, and

replacing existing scan lines which have been selected for interpolation with the interpolated scan lines.

7. A method of processing a digital input image having a plurality of original scan lines of pixel data into an interpolated digital output image comprising the steps of:

interpolating the pixel data in each original scan line of the digital input image to provide from each original scan line a plurality of identical scan lines interpolated in a fast scan direction,

storing the interpolated scan lines,

calculating a value of weight of each existing stored scan line that may be replaced by a scan line interpolated in a slow scan direction, the weight representing a contribution of an existing scan line to be used in the weighted sum with other scan lines to compute a replacement for the existing scan line,

selecting groups of existing scan lines from storage to produce interpolated scan lines in the slow scan direction of the interpolated output image,

creating an interpolated scan line for each existing scan line in a selected group as a weighted sum of the existing scan line with another scan line, and

writing each interpolated scan line created in place of an existing scan line from each of the groups.

8. A method of processing a digital input image as claimed in claim 7 in which the step of selecting groups of existing scan lines from storage to produce interpolated scan lines is based on the weight of each existing scan line in the weighted sum of scan lines which are used to compute replacement of the existing scan line.

9. A method of processing a digital input image as claimed in claim 7 in which the steps of selecting groups of existing scan lines, creating an interpolated scan line, and writing each interpolated scan line created in place of an existing scan line are repeated until a predefined time limit is exceeded for image processing.

10. A method of processing a digital input image as claimed in claim 7 in which the steps of selecting groups of existing scan lines, creating an interpolated scan line, and writing each interpolated scan line created in place of an existing scan line are based on image quality and a degree of change from original values of the pixels of existing scan lines selected by the user.

11. A method of processing a digital input image as claimed in claim 7 in which the step of storing the interpolated scan lines is accomplished utilizing a frame buffer.

12. A method of processing a digital input image as claimed in claim 7 in which the step of creating an interpolated scan line is accomplished utilizing blending circuitry.

13. A method of processing a digital input image having a plurality of original scan lines of pixel data into an interpolated digital output image comprising the steps of:

interpolating the pixel data in each original scan line of the digital input image to provide from each original scan line a plurality of identical scan lines interpolated in a fast scan direction,

storing the interpolated scan lines,

calculating a value of weight of each existing stored scan line that may be replaced by a scan line interpolated in a slow scan direction, the weight representing a contribution of an existing scan line to be used in the weighted sum with other scan lines to compute a replacement for the existing scan line,

selecting groups of existing scan lines from storage to produce interpolated scan lines in the slow scan direction of the interpolated output image,

the step of selecting groups of existing scan lines from storage to produce interpolated scan lines being based on the weight of each existing scan line in the weighted sum of scan lines which are used to compute replacement of the existing scan line,

creating an interpolated scan line for each existing scan line in a selected group as a weighted sum of the existing scan line with another scan line, and

writing each interpolated scan line created in place of an existing scan line from each of the groups,

in which the steps of selecting groups of existing scan lines, creating an interpolated scan line, and writing each interpolated scan line created in place of an existing scan line are repeated in ascending order of weights of existing scan lines in a weighted sum used to compute replacements, starting with groups of scan lines having lowest weights.

14. A method of processing a digital input image as claimed in claim 13 in which the steps of selecting groups of existing scan lines, creating an interpolated scan line, and writing each interpolated scan line created in place of an existing scan line are repeated until only existing scan lines with weights equal or larger than a predefined value are left uninterpolated or a predefined time limit is exceeded for image processing, whichever event occurs first.

15. A method of processing a digital input image having a plurality of original scan lines of pixel data into an interpolated digital output image comprising the steps of:

interpolating the pixel data in each original scan line of the digital input image to provide from each original scan line a plurality of identical scan lines interpolated in a fast scan direction,

storing the interpolated scan lines,

calculating a value of weight of each existing stored scan line that may be replaced by a scan line interpolated in a slow scan direction, the weight representing a contribution of an existing scan line to be used in the weighted sum with other scan lines to compute a replacement for the existing scan line,

selecting groups of existing scan lines from storage to produce interpolated scan lines in the slow scan direction of the interpolated output image,

creating an interpolated scan line for each existing scan line in a selected group as a weighted sum of the existing scan line with another scan line, and

writing each interpolated scan line created in place of an existing scan line from each of the groups,

in which the steps of selecting groups of existing scan lines, creating an interpolated scan line, and writing each interpolated scan line created in place of an existing scan line proceed through a gradually decreasing range of scan lines providing the greatest change with respect to original values of pixels in existing scan lines so long as image processing time remains.

16. A method of processing a digital input image as claimed in claim 15 which comprises the further steps of:

obtaining a time at the end of processing each range of scan lines,

comparing time remaining for image processing with a predefined time, and

stopping processing if insufficient time remains to process scan lines in a next range.

17. Apparatus for scaling a digital input image in a digital display system comprising:

pixel data interpolation circuitry to provide a plurality of scan lines interpolated in a fast scan direction from each scan line of a digital input image,

replicating circuitry to copy the pixels of each interpolated scan line to provide additional scan lines in the slow scan direction,

means for calculating slow scan direction interpolation coefficients for scan lines to be interpolated in the interpolated output image,

a memory array for storing a digital image including the interpolated and replicated scan lines, and

circuitry to interpolate selected scan lines which have been stored in the memory array using selected existing scan lines to produce interpolated scan lines in the slow scan direction of the interpolated output image.

18. Apparatus for scaling a digital input image in a digital display system as claimed in claim 17 in which the circuitry to interpolate selected scan lines comprises blender circuitry.

19. Apparatus for scaling a digital input image in a digital display system as claimed in claim 17 in which the replicating circuitry to copy the pixels of each interpolated scan line to provide additional scan lines in the slow scan direction comprises replication circuitry associated with the memory array.

20. Apparatus for scaling a digital input image in a digital display system as claimed in claim 17 in which the replicating circuitry to copy the pixels of each interpolated scan line to provide additional scan lines in the slow scan direction comprises texture mapping circuitry associated with the memory array.

21. Apparatus for scaling a digital input image in a digital display system as claimed in claim 17 in which the memory array for storing a digital image is a frame buffer.