System and method for exact rendering in a zooming user interface

• US 7,075,535 B2
• Filed: 03/01/2004
• Issued: 07/11/2006
• Est. Priority Date: 03/05/2003
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Sand Codex
• Inventors: Aguera y Arcas, Blaise
• Primary Examiner(s): Chauhan, Ulka
• Assistant Examiner(s): PAPPAS, PETER
• Application Number:
  US10/790,253
• Publication Number:
  US 20040233219A1
• Time in Patent Office: 862 Days
• Field of Search: 345/428
• US Class Current: 345/428
• CPC Class Codes: G06F 2203/04805 Virtual magnifying lens, i.e. window or frame movable on top of displayed information to enlarge it for better reading or selection
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06T 3/4007 based on interpolation, e.g. bilinear interpolation image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403
• CPC Class Codes: G06T 3/4084 in the transform domain, e.g. fast Fourier transform [FFT] domain scaling
• CPC Class Codes: G09G 5/393 Arrangements for updating the contents of the bit-mapped memory

Abstract

A method and apparatus is disclosed that facilitates realistic navigation of visual content by displaying an interpolated image during navigation and a more exact image when the navigation ceases. Methodologies are disclosed for rendering and displaying “tiles”, portions of the visual content at different levels of detail to minimize perceivable discontinuities.

Claims

1. A method of displaying visual content, said method comprising:

generating a plurality of different levels of detail (LODs) of the visual content;

displaying the visual content as an interpolation of said LODs while the visual content is navigated; and

displaying a final image including at least a portion not as an interpolation of said LODs when said navigation substantially ceases, wherein prior to said final image being displayed, an intermediate final image is generated by interpolation from said plurality of said LODs,

wherein each LOD is comprised of tiles and said final image or said intermediate final image is displayed by using tiles from several LODs displayed as composite tiles,

wherein the tiles of each LOD are made available for entry into a frame buffer in an order that depends at least in part upon the LOD in which the tile is, or whether the tile is viewable presently, or the degree of foveation of such tile, and

wherein viewable tiles are rendered first, and within said viewable tiles, tiles are rendered in order of increasing resolution, and within tiles of a similar resolution, tiles are rendered in foveated order, the method further comprising implementing irrational tiling.

2. The method of claim 1 wherein said intermediate final image gradually changes to said final image.

3. The method of claim 1 wherein said final image or said intermediate image is rendered on a tile-by-tile basis.

4. A method of displaying visual content comprising combining plural LODs representing visual content, and gradually altering a contribution attributable to at least one of said LODs so that said displayed visual content gradually changes toward a better displayed image in response to information to render said better displayed image becoming available,

wherein said assigning assigns plural weights to each of said tiles in at least one LOD, and

wherein said plural weights include opacities at each of plural corners of said tile, opacities at each of plural edges of said tile, and an opacity at a point within each of said tiles.

5. The method of claim 4 further comprising calculating a levelopacitygrid set of variables for plural locations in an LOD, said levelopacitygrid set of variables being calculated by utilizing at least some of said weights for all tiles in said LOD tangent to a vertex at which said levelopacitygrid is to be calculated.

6. The method of claim 5 further comprising spatially filtering said levelopacitygrid set of variables for at least one LOD.

7. A method of combining plural LODs to display visual content, the method comprising weighting each of the LODs with an associated contribution, and varying the contribution provided by each LOD over time and space,

wherein the weighting is an opacity level,

wherein the total opacity of the combined LODs is less than one hundred percent, and

wherein said varying over time results in exponential convergence toward a target value.

8. The method of claim 7 wherein for each LOD, an opacity level is calculated for each of a plurality of vertices.

9. The method of claim 8 wherein said varying over time and space is designed to diminish viewable discontinuities.

10. The method of claim 9 wherein values representing the weighting are low pass filtered.

11. A method of displaying visual content comprising combining plural LODs representing visual content, and gradually altering a contribution attributable to at least three of said LODs so that said displayed visual content gradually changes,

wherein said contribution is altered gradually by assigning at least one weight to plural tiles within plural LODs, and then altering said weights,

wherein said assigning assigns plural weights to each of said tiles in at least one LOD, and

wherein said plural weights include opacities at each of plural corners of said tile, opacities at each of plural edges of said tile, and an opacity at a point within each of said tiles.

12. The method of claim 11 further comprising calculating a levelopacitygrid set of variables for plural locations in an LOD, said levelopacitygrid set of variables being calculated by utilizing at least some of said weights for all tiles in said LOD tangent to a vertex at which said levelopacitygrid is to be calculated.

13. The method of claim 12 further comprising spatially filtering said levelopacitygrid set of variables for at least one LOD.