System and method for exact rendering in a zooming user interface

• US 7,554,543 B2
• Filed: 05/22/2006
• Issued: 06/30/2009
• Est. Priority Date: 03/05/2003
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Aguera Y Arcas, Blaise
• Primary Examiner(s): PAPPAS, PETER
• Application Number:
  US11/438,467
• Publication Number:
  US 20060267982A1
• Time in Patent Office: 1,135 Days
• Field of Search: None
• US Class Current: 345/428
• CPC Class Codes: G06F 2203/04805 Virtual magnifying lens, i.e. window or frame movable on top of displayed information to enlarge it for better reading or selection
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06T 3/4007 based on interpolation, e.g. bilinear interpolation image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403
• CPC Class Codes: G06T 3/4084 in the transform domain, e.g. fast Fourier transform [FFT] domain scaling
• CPC Class Codes: G09G 5/393 Arrangements for updating the contents of the bit-mapped memory

Abstract

A method and apparatus is disclosed that facilitates realistic navigation of visual content by displaying an interpolated image during navigation and a more exact image when the navigation ceases. Methodologies are disclosed for rendering and displaying “tiles”, portions of the visual content at different levels of detail to minimize perceivable discontinuities.

Claims

1. A method of displaying visual content, said method comprising:

generating a plurality of different levels of detail (LODs) of the visual content;

displaying on a display device the visual content as an interpolation of said LODs while the visual content is navigated;

displaying on said display device the visual content as an intermediate final image when navigation ceases, wherein the intermediate final image is generated by interpolation from the plurality of the LODs; and

displaying on said display device a transition from the intermediate final image to a final image at an exact resolution while navigation has ceased, wherein the exact resolution is not equal to the resolution of any previously generated LODs of the visual content and wherein the final image is not an interpolation of said LODs.

2. The method of claim 1 wherein said navigation comprises one or more of the following:

two or three dimensional translation, rotation, image filtering, local stretching, dynamic spatial distortion, magnification or minification.

3. The method of claim 1 wherein said intermediate final image gradually changes to said final image.

4. The method of claim 3 wherein said final image or said intermediate image is rendered on a tile-by-tile basis.

5. The method of claim 1 wherein each LOD is comprised of tiles and said final image or said intermediate final image is displayed by using tiles from several LODs displayed as composite tiles.

6. The method of claim 5 wherein the tiles of each LOD are made available for entry into a frame buffer in an order that depends at least in part upon the LOD in which the tile is, or whether the tile is viewable presently, or the degree of foveation of such tile.

7. The method of claim 6 wherein viewable tiles are rendered first, and within said viewable tiles, tiles are rendered in order of increasing resolution, and within tiles of a similar resolution, tiles are rendered in foveated order.

8. The method of claim 5 wherein said visual content comprises vector and nonvector data.

9. The method of claim 8 wherein said plurality of LODs are generated at a remote terminal, and said intermediate and final images are generated at a locally viewable terminal.

10. A method of representing visual content comprising:

displaying on a display device the visual content as an interpolation of at least two or more LODs while the visual content is navigated;

displaying on the display device the visual content as an intermediate final image when navigation of the visual content ceases, wherein the intermediate final image is generated by combining at least a first LOD with a second LOD, each of said LODs being comprised of a plurality of tiles that form a grid of the visual content, the tiles being arranged so that edges of said tiles in said first LOD do not align with the edges of the tiles in said second LOD except, at most, in one position on the x-axis and at one position of the y-axis of the visual content; and

displaying on said display device a transition from the intermediate final image to a final image at an exact resolution while navigation has ceased, wherein the exact resolution is not equal to the resolution of any previously generated LODs of the visual content and wherein the final image is not an interpolation of said LODs.

11. The method of claim 10 applied to three or more such LODs having increasing resolution, wherein when the LODs are arranged in order of increasing resolution, no two consecutive LODs differ in resolution by a rational multiple.

12. A method of combining plural LODs to display visual content while the visual content is navigated, the method comprising:

displaying on a display device the visual content as an intermediate final image when navigation of the visual content ceases, wherein the intermediate final image is generated by weighting each of the LODs with an associated contribution, and varying the contribution provided by each LOD over time and points of the visual content; and

displaying on said display device a transition from the intermediate final image to a final image at an exact resolution while navigation has ceased, wherein the exact resolution is not equal to the resolution of any previously generated LODs of the visual content and wherein the final image is not an interpolation of said LODs.

13. The method of claim 12 wherein the weighting is an opacity level.

14. The method of claim 13 wherein the total opacity of the combined LODs is less than one hundred percent.

15. A method comprising displaying an intermediate final image and then displaying a final image of a visual content, the method comprising:

displaying on a display device the visual content as an interpolation of at least two or more LODs while the visual content is navigated;

displaying on a display device the visual content as the intermediate final image when navigation of the visual content ceases, wherein the final image and intermediate final image being comprised of tiles rendered in foveated order; and

displaying on said display device a transition from the intermediate final image to a final image at an exact resolution while navigation has ceased, wherein the exact resolution is not equal to the resolution of any previously generated LODs of the visual content and wherein the final image is not an interpolation of said LODs.

16. The method of claim 15 wherein lower resolution tiles are displayed prior to higher resolution tiles.

17. The method of claim 16 wherein said transition is gradual.

18. A method of displaying visual content, the method comprising:

displaying on a display device the visual content as an interpolation of a plural of LODs while the visual content is navigated;

displaying on a display device the visual content as the intermediate final image when navigation of the visual content ceases, wherein displaying the intermediate final image includes combining the plural LODs representing visual content, and gradually altering a contribution attributable to at least three of said LODs so that said displayed visual content gradually changes, wherein said contribution is altered gradually by assigning at least one weight simultaneously to plural tiles within plural LODs, and then altering said weights, and wherein said assigning assigns plural weights to each of said tiles in at least one LOD, and wherein the plural tiles of each of the LODs form a grid of the visual content; and

displaying on said display device a transition from the intermediate final image to a final image at an exact resolution while navigation has ceased, wherein the exact resolution is not equal to the resolution of any previously generated LODs of the visual content and wherein the final image is not an interpolation of said LODs.