Application-directed memory de-duplication

• US 9,436,614 B2
• Filed: 05/02/2013
• Issued: 09/06/2016
• Est. Priority Date: 05/02/2013
• Status: Active Grant

• Current Assignee: Globalfoundries US Incorporated (GlobalFoundries, Inc.)
• Original Assignee: GlobalFoundries, Inc.
• Inventors: Dawson, Michael H., Iyengar, Arun K., Johnson, Graeme
• Primary Examiner(s): Peugh, Brian
• Assistant Examiner(s): Bone, Dustin
• Application Number:
  US13/875,702
• Publication Number:
  US 20140331016A1
• Time in Patent Office: 1,223 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 12/08 in hierarchically structured memory systems, e.g. virtual memory systems
• CPC Class Codes: G06F 12/10 Address translation
• CPC Class Codes: G06F 2009/45583 Memory management, e.g. access or allocation
• CPC Class Codes: G06F 2212/1016 Performance improvement
• CPC Class Codes: G06F 2212/1044 Space efficiency improvement
• CPC Class Codes: G06F 2212/152 Virtualized environment, e.g. logically partitioned system
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects

Abstract

In a computing system including an application executing on top of a virtualization control layer, wherein the virtualization control layer maps portions of a virtual memory to portions of a physical memory, a method for managing memory including: identifying, by the application, a range of virtual memory whose probability of being replicated in the virtual memory exceeds a given threshold; obtaining, by the application, at least one memory address corresponding to the range of virtual memory; and passing, from the application to the virtualization control layer, an identifier for the range of virtual memory and the memory address corresponding to the range of virtual memory, wherein the identifier is useable by the virtualization control layer to identify similar ranges within the virtual memory.

Claims

1. In a computing system comprised of an application executing on top of a virtualization control layer, wherein the virtualization control layer maps portions of a virtual memory to portions of a physical memory, a method for managing memory comprising the steps of:

identifying, by the application, a range of the virtual memory whose probability of being replicated in the virtual memory exceeds a given threshold;

obtaining, by the application, at least one memory address corresponding to the range of virtual memory;

passing, from the application to the virtualization control layer, an identifier for the range of virtual memory and the memory address corresponding to the range of virtual memory, wherein the identifier is useable by the virtualization control layer to identify similar ranges within the virtual memory; and

providing an application programming interface configured to allow the identifier and the range of virtual memory to be passed down from the application to a guest operating system, and from the guest operating system to the virtualization control layer at runtime;

wherein the application executes on the guest operating system, and the guest operating system executes on the virtualization control layer; and

wherein the method further comprises the step of using at the virtualization control layer, based at least in part upon the identifier, delta encoding to reduce redundant information in the physical memory.

2. The method of claim 1, wherein the application also obtains a size corresponding to the range of virtual memory and passes the size to the virtualization control layer along with the identifier and the memory address corresponding to the range of virtual memory.

3. The method of claim 2, further comprising the step of searching, by the virtualization control layer, in a first mapping structure for a match with the identifier passed by the application.

4. The method of claim 3, further comprising the step of creating, at the virtualization control layer, a new entry in the first mapping structure when no match is found for the identifier passed by the application.

5. The method of claim 4, further comprising the step of validating, at the virtualization control layer, that the range of virtual memory has the same content as a matched entry in the first mapping structure.

6. The method of claim 5, further comprising the step of configuring a second mapping structure such that the same portion of the physical memory is used to back the portion of the virtual memory corresponding to the range as is used to back portions of the virtual memory corresponding to the matched entry in the first mapping structure.

7. The method of claim 1, wherein the range of virtual memory represents at least one virtual memory page.

8. The method of claim 1, wherein the range of virtual memory is used to store at least one file read into memory.

9. The method of claim 1, wherein the range of virtual memory is used to store at least one read only program artifact.

10. The method of claim 1, wherein the virtualization control layer comprises a hypervisor.

11. The method of claim 1, wherein the virtualization control layer comprises an operating system.

12. The method of claim 1, wherein the identifier is useable by the virtualization control layer to limit comparison of memory pages to each other to particular memory pages.

13. The method of claim 1, wherein the identifier is useable by the virtualization control layer to determine that the similar ranges within the virtual memory are likely to occur.

14. The method of claim 1, further comprising the step of using at the virtualization control layer, based at least in part upon the identifier and the memory address corresponding to the range of virtual memory, delta encoding to reduce redundant information in the physical memory.

15. The method of claim 1, wherein the delta encoding operates using an offset that represents a difference from a base memory page.

16. The method of claim 15, wherein redundant information is reduced by de-duplicating a plurality of base memory pages.

17. The method of claim 1, wherein the identifier passed by the application is selected by the application such that the identifier is the same as an identifier from another process in the guest operating system.

18. The method of claim 1, further comprising the step of changing a page size of a portion of the physical memory that backs the identified range of virtual memory.

19. The method of claim 18, wherein the page size of the portion of the physical memory that backs the identified range of virtual memory is reduced.

20. In a computing system comprised of an application executing on top of a virtualization control layer, wherein the virtualization control layer maps portions of a virtual memory to portions of a physical memory, a method for managing memory comprising the steps of:

receiving, at the virtualization control layer from the application, an identifier for a range of virtual memory whose probability of being replicated in the virtual memory exceeds a given threshold and at least one memory address corresponding to the range of virtual memory;

using, by the virtualization control layer, the identifier to identify similar ranges within the virtual memory; and

providing an application programming interface configured to allow the identifier and the range of virtual memory to be passed down from the application to a guest operating system, and from the guest operating system to the virtualization control layer at runtime;

wherein the application executes on the guest operating system, and the guest operating system executes on the virtualization control layer; and

wherein the method further comprises the step of using at the virtualization control layer, based at least in part upon the identifier, delta encoding to reduce redundant information in the physical memory.