Virtual surface compaction

• US 9,959,668 B2
• Filed: 11/02/2015
• Issued: 05/01/2018
• Est. Priority Date: 05/31/2012
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Fink, Reiner, Blanco, Leonardo E., Ergan, Cenk, Priestley, Joshua Warren, Moncayo, Silvana Patricia, Pelton, Blake D.
• Primary Examiner(s): NGUYEN, ANH TUAN V
• Application Number:
  US14/930,456
• Publication Number:
  US 20160189424A1
• Time in Patent Office: 911 Days
• Field of Search: None
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 17/10 Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
• CPC Class Codes: G06T 17/20 Finite element generation, e.g. wire-frame surface description, tesselation
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 2340/045 Zooming at least part of an image, i.e. enlarging it or shrinking it
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2360/121 using a cache memory
• CPC Class Codes: G09G 2360/122 Tiling
• CPC Class Codes: G09G 2360/127 Updating a frame memory using a transfer of data from a source area to a destination area
• CPC Class Codes: G09G 5/346 for systems having a bit-mapped display memory
• CPC Class Codes: G09G 5/393 Arrangements for updating the contents of the bit-mapped memory
• CPC Class Codes: G09G 5/399 using two or more bit-mapped memories, the operations of which are switched in time, e.g. ping-pong buffers

Abstract

Virtual surface update and composition techniques are described. These techniques include support of initialization and batching of updates, use of updates and lookaside lists, use of gutters, blending and BLT operations, surface optimization techniques such as push down as well as enumeration and clumping, mesh usage, and occlusion management techniques.

Claims

1. A method implemented by a computing device, the method comprising:

writing one or more visuals as composition elements including bitmaps and associated compositional metadata by the computing device to a plurality of virtual composition surfaces, each virtual composition surface comprising one or more logical composition surfaces representative of individual surfaces as seen by an application running on the computing device;

tracking a plurality of valid regions by the computing device within the virtual composition surfaces comprising one or more current visuals;

determining that a valid region of the plurality of valid regions of a first virtual composition surface of the plurality of virtual composition surfaces by the computing device is includable within a second virtual composition surface of the plurality of virtual composition surfaces; and

responsive to the determination, integrating the valid region by the computing device into the second virtual composition surface, wherein the integration of the valid region into the second virtual composition surface comprises copying the valid region into a memory allocation corresponding to the second virtual composition surface.

2. A method as described in claim 1, wherein the current visuals comprise visuals that are to be displayed.

3. A method as described in claim 2, further comprising tracking non-valid regions by the computing device, the non-valid regions comprising visuals that are not to be displayed.

4. A method as described in claim 1, further comprising removing an indication that the valid region is valid by the computing device after integrating the valid region into the second virtual composition surface.

5. A method as described in claim 4, further comprising releasing a memory allocation by the computing device associated with the first virtual composition surface responsive to a determination by the computing device that the first virtual composition surface no longer contains any valid regions.

6. A method as described in claim 1, wherein the second virtual composition surface also contains a plurality of valid regions.

7. A method as described in claim 1, further comprising rendering the second virtual composition surface responsive to the integration of the valid region from the first virtual composition surface.

8. A system comprising:

one or more processors; and

one or more computer readable storage media comprising instructions, that, responsive to execution by the one or more processors, causes a visual composition system to perform operations comprising;

writing one or more visuals as composition elements including bitmaps and associated compositional metadata to a plurality of virtual composition surfaces, each virtual composition surface comprising one or more logical composition surfaces representative of individual surfaces as seen by an application;

tracking a plurality of valid regions within the virtual composition surfaces comprising one or more current visuals;

determining that a first said valid region of a first said virtual composition surface is combinable with a second said valid region of a second said virtual composition surface; and

responsive to the determination, creating a new virtual composition surface for inclusion of the first and second valid regions, and copying the first and second valid regions to the new virtual composition surface, wherein the copying of the first and second valid regions into the new virtual composition surface comprises copying the first and second valid regions into a memory allocation corresponding to the new virtual composition surface.

9. A system as described in claim 8, wherein the operations further comprise removing an indication that the first and second valid regions are valid after the first and second valid regions are copied to the new virtual composition surface.

10. A system as described in claim 9, wherein the operations further comprise releasing a memory allocation associated with the first or second virtual composition surface responsive to a determination that the first or second virtual composition surface no longer contains any valid regions.

11. A system as described in claim 8, further comprising rendering the new virtual composition surface with the first and second valid regions responsive to the first and second valid regions being copied into the new virtual composition surface.

12. One or more computer-readable storage media devices comprising instructions stored thereon, that, responsive to execution by one or more processors of a computing device, causes the computing device to implement a composition system to perform operations comprising:

writing one or more visuals as composition elements including bitmaps and associated compositional metadata to a plurality of virtual composition surfaces, each virtual composition surface comprising one or more logical composition surfaces representative of individual surfaces as seen by an application running on the computing device;

tracking a plurality of valid regions within the virtual composition surfaces comprising one or more current visuals;

determining that a valid region of the plurality of valid regions of a first virtual composition surface of the plurality of virtual composition surfaces is includable within a second virtual composition surface of the plurality of virtual composition surfaces; and

responsive to the determination, integrating the valid region into the second virtual composition surface, wherein the integration of the valid region into the second virtual composition surface comprises copying the valid region into a memory allocation corresponding to the second virtual composition surface.

13. One or more computer-readable storage media devices as described in claim 12, wherein the current visuals comprise visuals that are to be displayed.

14. One or more computer-readable storage media devices as described in claim 13, further comprising tracking non-valid regions by the computing device, the non-valid regions comprising visuals that are not to be displayed.

15. One or more computer-readable storage media devices as described in claim 12, further comprising removing an indication that the valid region is valid by the computing device after integrating the valid region into the second virtual composition surface.

16. One or more computer-readable storage media devices as described in claim 15, further comprising releasing a memory allocation by the computing device associated with the first virtual composition surface responsive to a determination by the computing device that the first virtual composition surface no longer contains any valid regions.