Generating and displaying spatially offset sub-frames

• US 7,109,981 B2
• Filed: 07/31/2003
• Issued: 09/19/2006
• Est. Priority Date: 07/31/2003
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Allen, William J., Tretter, Daniel R., Damera-Venkata, Niranjan, Aufranc, Richard E. Jr.
• Primary Examiner(s): Shalwala, Bipin
• Assistant Examiner(s): Kovalick, Vincent E.
• Application Number:
  US10/631,681
• Publication Number:
  US 20050024391A1
• Time in Patent Office: 1,146 Days
• Field of Search: 345/204, 345/598, 345/660, 345/667, 348/129, 348/222, 348/581, 348/584, 382/151
• US Class Current: 345/204
• CPC Class Codes: G06T 3/4053 based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G09G 2320/02 Improving the quality of display appearance
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 3/007 Use of pixel shift techniques, e.g. by mechanical shift of the physical pixels or by optical shift of the perceived pixels
• CPC Class Codes: G09G 3/20 for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters

Abstract

A method of displaying an image with a display device includes receiving image data for the image. A first sub-frame and a second sub-frame corresponding to the image data are generated. The first and the second sub-frames are generated based on minimization of an error between the image data and a simulated image. The method includes alternating between displaying the first sub-frame in a first position and displaying the second sub-frame in a second position spatially offset from the first position.

Claims

1. A method of displaying an image with a display device, the method comprising:

receiving image data for the image;

generating a first sub-frame and a second sub-frame corresponding to the image data, the first and the second sub-frames generated based on minimization of an error between the image data and a simulated image; and

alternating between displaying the first sub-frame in a first position and displaying the second sub-frame in a second position spatially offset from the first position wherein the simulated image is based on upsampling of the first and second sub-frames, thereby generating upsampled sub-frame data.

2. The method of claim 1, and further comprising:

generating a third sub-frame and a fourth sub-frame corresponding to the image data, the third and the fourth sub-frames generated based on minimization of the error between the image data and the simulated image; and

wherein alternating between displaying the first sub-frame and displaying the second sub-frame further includes alternating between displaying the first sub-frame in the first position, displaying the second sub-frame in the second position, displaying the third sub-frame in a third position spatially offset from the first position and the second position, and displaying the fourth sub-frame in a fourth position spatially offset from the first position, the second position, and the third position.

3. The method of claim 2, wherein the simulated image is based on convolution of the first, the second, the third, and the fourth sub-frames with an interpolating filter.

4. The method of claim 3, wherein the interpolating filter is a 2×

2 interpolating filter with four filter coefficients.

5. The method of claim 4, wherein each of the filter coefficients has a value of one.

6. The method of claim 1, wherein the upsampling is a factor of two upsampling.

7. The method of claim 1, wherein the upsampling is quincunx upsampling.

8. The method of claim 1, wherein the upsampled sub-frame data includes first and second upsampled sub-frames, and wherein the simulated image is based on shifting of pixels in the first upsampled sub-frame, thereby generating a first shifted sub-frame.

9. The method of claim 8, wherein the simulated image is based on convolutions of the first shifted sub-frame and the second upsampled sub-frame with an interpolating filter.

10. The method of claim 9, wherein the simulated image is based on a summation of results of the convolutions.

11. The method of claim 1, wherein the simulated image is based on a convolution of the upsampled sub-frame data with an interpolating filter.

12. The method of claim 1, and further comprising:

filtering the error between the image data and the simulated image based on characteristics of human vision.

13. The method of claim 1, wherein the error between the image data and the simulated image represents a global error that is minimized in the spatial domain.

14. The method of claim 1, wherein the error between the image data and the simulated image represents a global error that is minimized in the frequency domain.

15. The method of claim 1, wherein the error between the image data and the simulated image represents a local error that is minimized in the spatial domain.

16. The method of claim 15, wherein the local error is adaptively minimized via a plurality of iterations.

17. The method of claim 15, wherein the minimization is based on a least mean squares (LMS) technique.

18. The method of claim 15, wherein the minimization is based on a projection on a convex set (POCS) technique.

19. A system for displaying an image, the system comprising:

a buffer adapted to receive image data for the image;

an image processing unit configured to define first and second sub-frames corresponding to the image data based on minimization of a difference between the image data and a simulated image; and

a display device adapted to alternately display the first sub-frame in a first position and the second sub-frame in a second position spatially offset from the first position wherein the simulated image is based on upsampling of the first and the second sub-frames, thereby generating upsampled sub-frame data.

20. The system of claim 19, wherein the image processing unit is configured to generate a third sub-frame and a fourth sub-frame corresponding to the image data, the third and the fourth sub-frames generated based on minimization of the difference between the image data and the simulated image;

and

wherein the display device is configured to alternate between displaying the first sub-frame in the first position, displaying the second sub-frame in the second position, displaying the third sub-frame in a third position spatially offset from the first position and the second position, and displaying the fourth sub-frame in a fourth position spatially offset from the first position, the second position, and the third position.

21. The system of claim 20, wherein the simulated image is based on convolution of the first, the second, the third, and the fourth sub-frames with an interpolating filter.

22. The system of claim 20, wherein the upsampled sub-frame data includes first and second upsampled sub-frames, and wherein the simulated image is based on shifting of pixels in the first upsampled sub-frame, thereby generating a first shifted sub-frame, and convolutions of the first shifted sub-frame and the second upsampled sub-frame with an interpolating filter.

23. The system of claim 22, wherein the simulated image is based on a summation of results of the convolutions.

24. The system of claim 19, wherein the simulated image is based on a convolution of the upsampled sub-frame data with an interpolating filter.

25. The system of claim 19, wherein the difference between the image data and the simulated image represents a global error that is minimized in the spatial domain.

26. The system of claim 19, wherein the difference between the image data and the simulated image represents a global error that is minimized in the frequency domain.

27. The system of claim 19, wherein the difference between the image data and the simulated image represents a local error that is adaptively minimized in the spatial domain via at least one iteration.

28. A system for generating low resolution sub-frames for display at spatially offset positions to generate the appearance of a high resolution image, the system comprising:

means for receiving a first high resolution image;

means for storing a relationship between sub-frame values and high resolution image values, the relationship based on minimization of an error metric between the high resolution image values and a simulated high resolution image that is a function of the sub-frame values; and

means for generating a first plurality of low resolution sub-frames based on the first high resolution image and the stored relationship.

29. The system of claim 28, wherein the simulated image is based on convolution of the sub-frame values with an interpolating filter.

30. The system of claim 28, wherein the simulated image is based on upsampling of the sub-frame values, thereby generating upsampled sub-frame data.

31. The system of claim 30, wherein the upsampled sub-frame data includes first and second upsampled sub-frames, and wherein the simulated image is based on shifting of pixels in the first upsampled sub-frame, thereby generating a first shifted sub-frame, and convolutions of the first shifted sub-frame and the second upsampled sub-frame with an interpolating filter.

32. The system of claim 31, wherein the simulated image is based on a summation of results of the convolutions.

33. The system of claim 30, wherein the simulated image is based on a convolution of the upsampled sub-frame data with an interpolating filter.

34. The system of claim 28, wherein the error metric between the high resolution image values and the simulated image represents a global error that is minimized in the spatial domain.

35. The system of claim 28, wherein the error metric between the high resolution image values and the simulated image represents a global error that is minimized in the frequency domain.

36. The system of claim 28, wherein the error metric between the high resolution image values and the simulated image represents a local error that is adaptively minimized in the spatial domain via at least one iteration.

37. A computer-readable medium having computer-executable instructions for performing a method of generating low resolution sub-frames for display at spatially offset positions to generate the appearance of a high resolution image, comprising:

receiving a first high resolution image;

providing a relationship between sub-frame values and high resolution image values, the relationship based on minimization of a difference between the high resolution image values and a simulated high resolution image that is a function of the sub-frame values; and

generating a first plurality of low resolution sub-frames based on the first high resolution image and the relationship between sub-frame values and high resolution image values.