Systems, methods and apparatus for cache transfers

• US 10,339,056 B2
• Filed: 11/28/2012
• Issued: 07/02/2019
• Est. Priority Date: 07/03/2012
• Status: Active Grant

• Current Assignee: SanDisk Technologies LLC (Western Digital Corporation)
• Original Assignee: SanDisk Technologies LLC (Western Digital Corporation)
• Inventors: Joshi, Vikram, Luan, Yang, Brown, Michael F., Mehta, Bhavesh
• Primary Examiner(s): Chang, Jungwon
• Application Number:
  US13/687,979
• Publication Number:
  US 20140013059A1
• Time in Patent Office: 2,407 Days
• Field of Search: 709214, 709226, 711118, 711 6, 711122, 711130, 718 1
• CPC Class Codes: G06F 12/08 in hierarchically structured memory systems, e.g. virtual memory systems
• CPC Class Codes: G06F 12/0815 Cache consistency protocols
• CPC Class Codes: G06F 12/084 with a shared cache
• CPC Class Codes: G06F 12/0842 for multiprocessing or multitasking
• CPC Class Codes: G06F 12/0866 for peripheral storage systems, e.g. disk cache
• CPC Class Codes: G06F 12/0868 Data transfer between cache memory and other subsystems, e.g. storage devices or host systems
• CPC Class Codes: G06F 16/188 Virtual file systems
• CPC Class Codes: G06F 2009/45583 Memory management, e.g. access or allocation
• CPC Class Codes: G06F 2212/1016 Performance improvement
• CPC Class Codes: G06F 2212/152 Virtualized environment, e.g. logically partitioned system
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455

Abstract

A virtual machine cache provides for maintaining a working set of the cache during a transfer between virtual machine hosts. In response to a virtual machine transfer, the previous host of the virtual machine is configured to retain cache data of the virtual machine, which may include both cache metadata and data that has been admitted into the cache. The cache data may be transferred to the destination host via a network (or other communication mechanism). The destination host populates a virtual machine cache with the transferred cache data to thereby reconstruct the working state of the cache.

Claims

1. An apparatus, comprising:

a first cache storage device coupled to a first computing device, the first computing device comprising a processor and a memory; and

a virtual machine cache configured for operation on the first computing device, the virtual machine cache further configured to;

transfer a cache tag of a virtual machine to the first computing device from a second computing device, wherein the cache tag is stored outside of a memory space of the virtual machine;

determine that the transferred cache tag corresponds to cache data of the virtual machine retained at the second computing device and unavailable in the first cache storage device, the retained cache data comprising data cached at the second computing device during operation of the virtual machine at the second computing device; and

transfer the cache data of the virtual machine referred to by the transferred cache tag from the second computing device into the first cache storage device.

2. The apparatus of claim 1, wherein the virtual machine cache is further configured to determine that the transferred cache tag corresponds to cache data of the virtual machine retained at the second computing device in response to the virtual machine migrating to the first computing device from the second computing device.

3. The apparatus of claim 1, wherein the virtual machine cache is further configured to allocate cache capacity to the virtual machine in the cache storage of the first computing device.

4. The apparatus of claim 1, wherein the virtual machine cache is further configured to admit the cache data transferred from the second computing device into the first cache storage device.

5. The apparatus of claim 1, wherein the virtual machine cache is further configured to request the cache data corresponding to the transferred cache tag from the second computing device, the request comprising an identifier of the virtual machine.

6. The apparatus of claim 1, wherein:

the transferred cache tag comprises a logical identifier; and

the virtual machine cache is further configured to determine that the transferred cache tag corresponds to cache data of the virtual machine retained at the second computing device in response to a cache miss for the logical identifier in the first cache storage device.

7. The apparatus of claim 1, wherein the virtual machine cache is further configured to request the cache tag from the second computing device.

8. The apparatus of claim 1, wherein:

the transferred cache tag is included in a memory image of the virtual machine; and

the memory image is transferred to the first computing device during migration of the virtual machine from the second computing device to the first computing device.

9. The apparatus of claim 1, wherein the second computing device is configured to send cache data corresponding to the virtual machine retained at the second computing device in response to determining that the virtual machine is being transferred to the first computing device.

10. A method, comprising:

determining that cache tags of a virtual machine relocating to a first computing system are retained at a second computing system, wherein the cache tags are stored outside of a memory space of the virtual machine;

transferring the cache tags of the virtual machine to the first computing system from the second computing system;

using the transferred cache tags to identify cache data of the virtual machine stored at the second computing system, the identified cache data unavailable in a cache storage device of the first computing system, the identified cache data stored at the second computing system during operation of the virtual machine at the second computing system;

accessing a first portion of the identified cache data of the virtual machine stored at the second computing system at the first computing system by use of the transferred cache tags; and

transferring the cache data of the virtual machine referred to by the transferred cache tags from the second computing system into local cache storage of the first computing system.

11. The method of claim 10, further comprising:

requesting the first portion of the identified cache data from the second computing system by use of the transferred cache tags.

12. The method of claim 10, further comprising:

maintaining cache metadata at the first computing system, the cache metadata associating virtual machine identifiers with cache addresses of cache data admitted into the local cache storage of the first computing system;

wherein the cache metadata associates an identifier of the virtual machine with the first portion of the identified cache data admitted into the local cache storage.

13. The method of claim 10, further comprising:

admitting a second portion of the identified cache data of the virtual machine into the cache storage device of the first host computing system in response to one or more of;

receiving the second portion of the identified cache data of the virtual machine from the second computing system; and

accessing the second portion of the identified cache data of the virtual machine from one or more of a primary storage system and a backing storage system.

14. The method of claim 10, wherein the transferred cache tags correspond to a previous cache capacity of the virtual machine, the method further comprising:

provisioning cache capacity to the virtual machine at the first computing system, the provisioning further comprising one or more of;

retaining the transferred cache tags of the virtual machine in response to the provisioned cache capacity corresponding to the previous cache capacity of the virtual machine;

removing one or more of the transferred cache tags in response to the provisioned cache capacity being less than the previous cache capacity of the virtual machine; and

adding one or more additional cache tags to the transferred cache tags in response to the provisioned cache capacity being greater than the previous cache capacity of the virtual machine.

15. The method of claim 10, wherein transferring the cache tags of the virtual machine to the first computing system comprises one or more of:

requesting the cache tags from the second computing system in response to the virtual machine being relocated to operate on the first computing system; and

receiving the cache tags from the second computing system during relocation of the virtual machine to the first computing system.

16. An apparatus, comprising:

a cache management system for operation on a first host computing device comprising a processor and memory, wherein the cache management system is implemented outside of a memory space of one or more virtual machines, the cache management system comprising;

means for determining that cache entries pertaining to a virtual machine in the one or more virtual machines configured for operation on the first host computing device are being retained at a second host computing device;

means for transferring the cache entries pertaining to the virtual machine to the first host computing device from the second host computing device, the transferred cache entries comprising a cache entry corresponding to a particular input/output (I/O) address;

means for using the cache entries to determine that the particular I/O address is associated with cache data of the virtual machine stored at the second host computing device; and

means for transferring the cache data associated with the particular I/O address from the second host computing device into the local cache storage of the first host computing device; and

an input/output (I/O) driver comprising;

means for directing an I/O request pertaining to a particular identifier of the virtual machine to the second host computing device in response to the transferring of the cache entries and the cache data.

17. The apparatus of claim 16, wherein the cache management system further comprises means for sending a request for the cache data associated with the particular I/O address to the second host computing device, the request comprising the particular identifier of the virtual machine.

18. The apparatus of claim 16, wherein the cache management system further comprises means for admitting the cache data associated with the particular I/O address stored at the second host computing device into the local cache storage of the first host computing device by one or more of:

means for requesting the cache data associated with the particular I/O address from the second host computing device in response to an I/O request of the virtual machine at the first host computing device;

means for requesting the cache data associated with the particular I/O address from the second host computing device in response to transferring the cache entries pertaining to the virtual machine from the second host computing device;

means for prefetching the cache data associated with the particular I/O address from the second host computing device in response to determining that the virtual machine was previously deployed on the second host computing device; and

means for receiving the cache data associated with the particular I/O address pushed from the second host computing device.

19. The apparatus of claim 16, further comprising means for allocating an amount of cache storage capacity to the virtual machine in the local cache storage of the first host computing device.

20. The apparatus of claim 19, wherein:

the transferred cache tags correspond to a previous amount of cache storage capacity allocated to the virtual machine; and

the cache management system further comprises means for configuring a number of cache entries available for caching data of the virtual machine within the local cache storage of the first host computing device based on the amount of cache storage capacity allocated to the virtual machine at the first host computing device by one or more of;

means for configuring the number of cache entries available for caching data of the virtual machine within the local cache storage to be substantially equivalent to a number of the transferred cache entries in response to the amount of cache storage capacity being substantially equivalent to the previous amount of cache storage capacity;

means for reducing the number of cache entries available for caching data of the virtual machine within the local cache storage as compared to the number of the transferred cache entries in response to the amount of cache storage capacity being less than the previous amount of cache storage capacity; and

means for increasing the number of cache entries available for caching data of the virtual machine within the local cache storage as compared to the number of the transferred cache entries in response to the amount of cache storage capacity being greater than the previous amount of cache storage capacity.

21. The apparatus of claim 16, wherein the cache management system further comprises means for determining that the cache entries pertaining to the virtual machine are being retained at the second host computing device in response to determining that the virtual machine was relocated from the second host computing device.

22. The apparatus of claim 16, wherein the second cache manager further comprises means for accessing the portion of the cache data of the particular virtual machine retained at the first host computing device in response to a request of the particular virtual machine operating on the second host computing device.

23. A system, comprising:

a first host computing device, comprising;

a first cache manager configured to;

cache data of a particular virtual machine in cache storage of the first host computing device in association with respective cache tags allocated to the particular virtual machine, wherein the respective cache tags are stored outside of a memory space of the particular virtual machine; and

retain the cache data of the particular virtual machine within the cache storage of the first host computing device in response to the particular virtual machine being migrated from the first host computing device; and

a second host computing device, comprising;

a cache provisioner configured to allocate cache storage capacity within a cache storage device of the second host computing device to the particular virtual machine in response to the particular virtual machine being migrated to operate on the second host computing device; and

a second cache manager configured to;

receive the cache tags of the particular virtual machine from the first host computing device;

use the received cache tags to determine that the cache data of the particular virtual machine is being retained at the first host computing device;

access a portion of the cache data of the particular virtual machine retained at the first host computing device by use of the received cache tags; and

populate the cache storage capacity allocated to the particular virtual machine at the second host computing device by transferring the portion of the cache data of the particular virtual machine accessed from the first host computing device to the cache storage capacity of the second host computing device.

24. The system of claim 23, wherein the first cache manager is further configured to remove the portion of the cache data of the particular virtual machine from the cache storage of the first host computing device in response to transferring the portion of the cache data of the particular virtual machine to the second host computing device.

25. The system of claim 23, wherein the first cache manager is further configured to provide the portion of the cache data of the particular virtual machine to the second host computing device in response to one or more of:

a request from the second host computing device; and

an indication that the particular virtual machine is migrating to the second host computing device.

26. The system of claim 23, wherein the second cache manager is further configured to request the portion of the cache data of the particular virtual machine retained at the first host computing device by use of the received cache tags and an identifier of the particular virtual machine.

27. The system of claim 23, wherein the cache tags of the particular virtual machine are transferred to the second host computing device during migration of the particular virtual machine from the first host computing device to the second host computing device.

28. The system of claim 23, wherein the second cache manager is further configured to request the cache tags of the particular virtual machine from the first host computing device.

29. The system of claim 23, wherein the second cache manager is further configured to notify the first host computing device that identified cache data of the particular virtual machine no longer needs to be retained at the first host computing device in response to one or more of:

overwriting the identified cache data at the second host computing device;

modifying the identified cache data at the second host computing device;

deleting the identified cache data at the second host computing device; and

acquiring the identified cache data from one or more of a primary storage device and a backing storage device.

30. The system of claim 23, wherein the first cache manager is further configured to push the portion of the cache data of the particular virtual machine to the second host computing device in response to determining that the particular virtual machine is being migrated to the second host computing device.

31. The system of claim 30, wherein the cache provisioner is further configured to modify the received cache tags of the particular virtual machine in accordance with the cache storage capacity allocated to the particular virtual machine at the second host computing device, wherein modifying the received cache tags comprises one of:

removing one or more of the received cache tags; and

adding one or more cache tags to the received cache tags.