Image downscaling using peripheral vision area localization

• US 6,417,867 B1
• Filed: 05/27/1999
• Issued: 07/09/2002
• Est. Priority Date: 05/27/1999
• Status: Expired due to Term

• Current Assignee: Sharp Laboratories of America Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Laboratories of America Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Hallberg, Bryan Severt
• Primary Examiner(s): Nguyen, Chanh
• Assistant Examiner(s): Alphonse, Fritz
• Application Number:
  US09/321,519
• Time in Patent Office: 1,139 Days
• Field of Search: 345/113, 345/114, 345/127, 345/435, 345/173, 345/132, 345/433, 345/660, 345/667, 345/671, 345/606, 345/548, 345/670, 395/326, 358/537, 382/232, 707/530
• US Class Current: 345/660
• CPC Class Codes: G06T 3/053 Detail-in-context presentations fisheye or wide-angle transformations G06T3/047
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 2340/045 Zooming at least part of an image, i.e. enlarging it or shrinking it
• CPC Class Codes: G09G 5/391 Resolution modifying circuits, e.g. variable screen formats

Abstract

Methods and apparatus for representing a digital image on a display having a lower resolution than the image are disclosed. In one embodiment, a display driver maps an original bitmap onto display coordinates using two regions. The first region is a viewer'"'"'s current area of interest on the display (e.g., determined by active cursor or pointer position, or by an eye tracker). This region of the original bitmap is mapped onto the display at full resolution. The remainder of the bitmap is downsampled to fit the display, and displayed on the remainder of the display. The first region is registered to the second region, such that as the viewer focuses on a new area of the display, the first region “moves” to align with the underlying downsampled image. The invention thus provides an intuitive and easy-to-use interface for viewing images on a limited-resolution display.

Claims

1. A display system comprising:

a display device having a first resolution;

a video RAM memory having a size sufficient to store a bitmap larger than the first resolution;

a display driver having a display mode for displaying a bitmap, larger than the first resolution and stored in the video RAM memory, on the display device, the display mode comprising displaying a subsection of the stored bitmap on a subsection of the display device, and displaying a downsampled version of the stored bitmap on areas of the display device other than the subsection of the display device, the subsection substantially registered to the downsampled version at a point on the display device.

2. The display system of claim 1, wherein in the display mode the driver responds to indications from a viewer of a new area of interest on the display by shifting the location of the displayed subsection of the stored bitmap to correspond to the new area of interest.

3. The display system of claim 1, further comprising a processor for generating bitmap data for storage in the video RAM memory.

4. The display system of claim 1, further comprising an input port for receiving bitmap data from a remote system for storage in the video RAM memory.

5. The display system of claim 1, further comprising a pointing device, and a pointing device translator for translating pointing device coordinates between the coordinate system of the display device and the coordinate system of a bitmap stored in the video RAM memory.

6. A method of generating, from a digital image having a first row and column size, a displayable image having a second row and column size, wherein the second row size is smaller than the first row size, the method comprising:

storing the digital image in a video RAM;

receiving an indication, from a display device user, of a point on a display device where full resolution display of the digital image is requested;

calculating a point on the digital image that is substantially registered with the point on the display device;

calculating a subsection of the digital image, including the calculated point, to be displayed at full resolution on the display device;

outputting, to a subsection of the display device corresponding to the calculated subsection of the digital image, full resolution data from the portion of the video RAM corresponding to the calculated subsection of the digital image; and

for display on areas of the display device other than the corresponding subsection, outputting data from the video RAM according to a downsampling pattern that maps the first row and column size to the second row and column size.

7. The method of claim 6, wherein outputting data from the video RAM comprises, when a display row on the display device comprises some columns within the calculated subsection and some columns outside the calculated subsection, outputting data from a first row of the video RAM corresponding to the display row for display of full resolution data to a first buffer, and outputting data from a second row of the video RAM corresponding to the display row for display outside the calculated subsection to a second buffer, and forming data for the display row by mixing full resolution data from the first buffer with downsampled data from the second buffer.

8. The method of claim 7, further comprising determining the second row of the video RAM by referencing a look-up table keyed to the display row.

9. The method of claim 7, further comprising downsampling data from the second buffer by referencing a look-up table keyed to display column.

10. The method of claim 7, further comprising low-pass filtering data from the second row of the video RAM prior to placing that data in the second buffer.

11. The method of claim 6, wherein outputting data from the video RAM comprises:

calculating a subsection of the displayable image corresponding to the subsection of the digital image to be displayed at full resolution on the display device;

for each display row outside of the row range of the calculated subsection of the displayable image, retrieving a row of data from the video RAM according to a downsampling pattern that maps the rows outside that row range into the rows outside the calculated subsection of the displayable image;

for each display row inside that row range, retrieving a row of data from the video RAM corresponding to that row in the digital image; and

for each retrieved row, outputting columns of data within the column range of the calculated subsection of the displayable image at full horizontal resolution, and outputting columns of data outside that column range according to a downsampling pattern that maps the columns outside that column range into the columns outside the calculated subsection of the displayable image.

12. The method of claim 11, wherein outputting columns of data for each retrieved row comprises referencing a look-up table keyed to display column.

13. The method of claim 6, wherein the step of calculating a point on the digital image comprises applying a hysteresis function to the indicated point for the purpose of limiting response to minor deviations in the location of the indicated point.

14. The method of claim 6, further comprising the step of calculating, based on information of the user'"'"'s eye position relative to the display device, the dimensions of the subsection prior to its display.

15. The method of claim 14, wherein calculating the dimensions comprises approximating the extent of the user'"'"'s foveal view projected onto the display device.

16. The method of claim 6, wherein receiving an indication comprises receiving an indication of the user'"'"'s point of focus on the display device.

17. The method of claim 6, further comprising the steps of tracking the orientation of the user'"'"'s eye, and estimating the user'"'"'s point of focus from the tracking.

18. The method of claim 6, wherein receiving an indication comprises receiving the display coordinates of an active cursor or pointer on the display device.

19. The method of claim 6, further comprising responding dynamically to changes in the content of the video RAM and changes in the indication received from the user.

20. The method of claim 6, wherein receiving an indication comprises comparing the current digital image to past digital images, and selecting a point on the current digital image having significant temporal change from past images.

21. The method of claim 6, wherein the downsampling pattern uniformly samples the digital image.

22. The method of claim 6, wherein the downsampling pattern only vertically downsamples rows of the digital image lying outside the calculated subsection, and only horizontally downsamples columns of the digital image lying outside the calculated subsection.

23. A display driver comprising:

a video RAM for storing a digital image having a first row and column size; and

circuitry for outputting a displayable image having a second row and column size, wherein the second row size is smaller than the first row size, the circuitry comprising

at least one buffer for receiving data from a row of the video RAM, and

a mixer that retrieves data from the at least one buffer according to coordinates for a subsection of the digital image to be displayed at full resolution, the mixer selecting full resolution data from the at least one buffer for display when that data is part of the subsection, the mixer otherwise selecting downsampled data from the at least one buffer for display.

24. The display driver of claim 23, wherein the at least one buffer comprises first and second row buffers, the first buffer for receiving data from a row of the video RAM that is to be downsampled to produce a display row, the second buffer for receiving data from a row of the video RAM that contains data to be displayed at full resolution.

25. The display driver of claim 24, wherein the circuitry for outputting a digital image further comprises a column look-up table in communication with the mixer, the column look-up table containing a mapping between video RAM columns and displayable columns, the mixer using the column look-up table to downsample data from the first buffer.

26. The display driver of claim 23, wherein the circuitry for outputting a digital image further comprises:

a row counter to maintain a value for the display row; and

a row translator to translate a row value from the row counter into a corresponding video RAM row, the video RAM row indicating the location of data to be received by the at least one buffer.

27. The display driver of claim 26, wherein the circuitry for outputting a digital image further comprises a row look-up table in communication with the row translator, the row look-up table containing a mapping between video RAM columns and displayable columns, the row translator using the row look-up table to downsample rows from the video RAM.

28. The display driver of claim 23, embodied in a video adapter.

29. The display driver of claim 23, further comprising a video buffer for accepting the mixer output and supplying it to a display device.