PREDICTIVE TILING

• US 20120254780A1
• Filed: 03/28/2011
• Published: 10/04/2012
• Est. Priority Date: 03/28/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Mouton, Laurent, Waggoner, Nicholas R., Brun, Nicolas J., Nelte, Michael A., Shaath, Hilal
• Granted Patent: US 9,383,917 B2
• Time in Patent Office: Days
• US Class Current: 715/765
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

This document describes techniques and apparatuses for predictive tiling. These techniques predict tiles of content to pre-render so that an application will be ready to render content quickly in response to a user manipulation. By so doing, these techniques enable fast manipulation of content without unduly impacting drawing resources.

Claims

1. A computer-implemented method comprising:

receiving information concerning a current user manipulation made to an application interface;

predicting, based on the information and a responsiveness of an application responsible for rendering content in the application interface, one or more tiles of content to be pre-rendered; and

indicating, to the application, the one or more tiles of content effective to enable the application to pre-render the tiles of content in preparation for responding to the current user manipulation.

2. A computer-implemented method as described in claim 1, further comprising repeating the method one or more times until completion of said current user manipulation.

3. A computer-implemented method as described in claim 2, wherein a prior repetition of the method resulted in pre-rendering of one or more prior, pre-rendered tiles, the one or more prior, pre-rendered tiles stored in memory, and further comprising deleting from the memory the one or more prior, pre-rendered tiles responsive to the one or more prior, pre-rendered tiles no longer including currently rendered content within the application interface or a threshold that includes the currently rendered content.

4. A computer-implemented method as described in claim 1, further comprising, prior to predicting the one or more tiles of content to be pre-rendered, determining a size of the tiles of content based on a total content size and a viewport size.

5. A computer-implemented method as described in claim 1, further comprising determining a size of a threshold based on a total content size and a viewport size, and wherein the one or more tiles of content include at least a portion of content within the threshold.

6. A computer-implemented method as described in claim 1, wherein the information includes a convergence/pinch rate or divergence/spread rate of the current user manipulation.

7. A computer-implemented method as described in claim 1, wherein the information includes a velocity or inertia of the current user manipulation.

8. A computer-implemented method as described in claim 7, wherein predicting the one or more tiles of content includes determining a location in a total content based on the velocity or inertia, the one or more tiles of content including the location or adjacent to the tile of content that includes the location.

9. A computer-implemented method as described in claim 8, wherein the location is an intermediate location intermediate to a final location at which the current user manipulation completes.

10. A computer-implemented method as described in claim 1, wherein the current user manipulation is a gesture to pan, zoom, translate, transform, rotate, or affine transform the content.

11. A computer-implemented method as described in claim 1, wherein the responsiveness of the application includes a time to pre-render content and predicting an amount of the one or more tiles of content to be pre-rendered is predicted proportional to the time to pre-render content.

12. A computer-implemented method as described in claim 11, further comprising determining the time to pre-render content based on a timing of calls received from the application.

13. A computer-implemented method as described in claim 1, further comprising, prior to receiving information concerning the current user manipulation, indicating, to the application, initial content tiles for pre-rendering, the initial content tiles including at least a portion of a threshold having a current viewport in the application interface.

14. A computer-implemented method comprising:

receiving, at an application responsible for rendering content for an application interface, an indication of one or more tiles of content to be pre-rendered in preparation for responding to a current user manipulation made to the application interface, the one or more tiles predicted to be useful for responding to the current user manipulation based on information about the current user manipulation and a responsiveness of the application;

pre-rendering the one or more tiles; and

rendering, in response to the current user manipulation, at least a portion of the pre-rendered content of the one or more tiles in a viewport of the application interface.

15. A computer-implemented method as described in claim 14, further comprising, prior to receiving the indication, providing the information to a predictor from which the indication of the one or more tiles of content to be pre-rendered is received, the information having a velocity or inertia of the current user manipulation.

16. A computer-implemented method as described in claim 14, wherein the application is a webpage and rendering content in the viewport includes retrieving content from a remote content provider prior to pre-rendering the one or more tiles.

17. A computer-implemented method as described in claim 14, wherein the information includes a velocity or inertia of the user manipulation and the responsiveness of the application is based at least in part on a time to pre-render content by the application.

18. A computer-implemented method as described in claim 14, further comprising, prior to receiving the indication of one or more tiles of content to be pre-rendered, providing a size of the viewport and a size of total content to a predictor and receiving an indication of initial tiles for pre-rendering, the initial tiles including content adjacent to content currently presented in the viewport.

19. A computer-implemented method as described in claim 14, further comprising:

receiving an indication of previously pre-rendered tiles to delete from memory, the previously pre-rendered tiles not including content currently rendered in the viewport; and

responsive to receiving the indication, deleting the previously pre-rendered tiles from the memory.

20. A computer-implemented method comprising:

receiving, from an application associated with an application interface, a size of a viewport in the application interface through which a portion of total content can be displayed and a size of the total content;

determining, based on the viewport size and the size of the total content, a tile size and a threshold, the threshold including the viewport;

determining one or more initial content tiles that include at least a portion of the threshold;

indicating, to the application, the one or more initial content tiles effective to enable the application to pre-render the one or more initial content tiles to prepare for an initial portion of a user manipulation;

receiving information concerning the user manipulation made to the application interface;

predicting, based on the information, the threshold, and a responsiveness of the application, one or more tiles of content to be pre-rendered, the one or more tiles of content not including the initial content tiles but including at least a portion of a predicted threshold location; and

indicating, to the application, the one or more tiles of content effective to enable the application to pre-render content of the one or more tiles of content in preparation for responding to a non-initial portion of the user manipulation.