Centralized management of virtual machines

• US 8,983,988 B2
• Filed: 03/05/2013
• Issued: 03/17/2015
• Est. Priority Date: 08/11/2008
• Status: Active Grant

• Current Assignee: Vmware LLC (Broadcom, Inc.)
• Original Assignee: VMware, Inc. (Broadcom, Inc.)
• Inventors: Raghuram, Sirishkumar, Le, Bich Cau, Suryanarayana, Gopala, Joshi, Kiran
• Primary Examiner(s): CHEEMA, AZAM M
• Application Number:
  US13/785,794
• Publication Number:
  US 20130185723A1
• Time in Patent Office: 742 Days
• US Class Current: 707/758
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 2009/45579 I/O management, e.g. providing access to device drivers or storage
• CPC Class Codes: G06F 9/455 Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching

Abstract

A method enables a central management service to operate on individual files within virtual disks associated with different virtual machines (VMs) running in one or more host computers that are each networked to a remote storage system. An IO request from a VM is received at a virtualization software layer on a host computer, wherein the IO request relates to a file stored in a virtual disk associated with the VM, and the file is individually stored in the remote storage system in accordance with a file system. The central management service is notified of the received IO request and uses the file system to access the file in the remote storage system to perform a management task on the file, and the IO request is then performed on the file by the virtualization software layer upon a notification of a successful completion of the management task.

Claims

1. A method for enabling a central management service to operate on individual files associated with different virtual machines running in one or more host computers that are each networked to a remote storage system, the method comprising:

receiving, at a virtualization software layer on a host computer, an input/output (IO) request from a first virtual machine running on the host computer, wherein (i) the IO request relates to a first file stored in a first virtual disk associated with the first virtual machine, the first virtual disk locally attached to the host computer, and (ii) a second file corresponding to the first file is individually stored in the remote storage system in accordance with a file system that governs how data is stored in the remote storage system;

notifying the central management service of the received IO request, wherein the central management service (i) determines a second pathname used by the file system to access the second file in the remote storage system, the second pathname being resolved from a first pathname associated with the IO request and used by the first virtual machine to identify the first file within the first virtual disk, (ii) uses the file system to access the second file in the remote storage system using the second pathname, and (iii) performs a management task on the second file that was accessed by the management service; and

performing, by the virtualization software layer, the IO request on the second file in the remote storage system using the second pathname upon a notification of a successful completion of the management task by the central management service.

2. The method of claim 1, further comprising:

resolving the first pathname associated with the IO request and used by the first virtual machine to identify the first file within the first virtual disk to the second pathname used by the file system to access the second file in the remote storage system; and

transmitting the second pathname to the central management service to enable the central management service to use the file system to access the second file in the remote storage system.

3. The method of claim 1, wherein (i) the management task comprises one of anti-virus scanning on the second file, backup of the second file, patching of the second file and versioning of the second file, and (ii) the central management service implements a framework that enables third parties to provide management tasks to the central management service to perform on the second file.

4. The method of claim 1, wherein the IO request comprises one of a file open operation, a file close operation, a file create operation, a file delete operation and a file rename operation.

5. The method of claim 1, wherein the file system comprises a host computer portion residing in the virtual software layer of the host computer and a remote portion that (i) maintains a namespace database to resolve pathnames used by virtual machines to identify files within virtual disks to pathnames used to access the files within the remote storage system, and (ii) provides resolved pathnames to the host computer portion to enable the host computer portion to access files in the remote storage system.

6. The method of claim 1, wherein a result of the management task that was performed on the first file is applicable to other IO requests from the second virtual machine such that the management task is avoided when the second virtual machine sends an IO request for the third file.

7. The method of claim 1, further comprising receiving, by the virtualization software layer, the second pathname upon the successful completion of the management task by the central management service.

9. The method of claim 1, wherein the central management service runs within a third virtual machine.

8. A method for enabling a central management service to operate on individual files associated with different virtual machines running in one or more host computers that are each networked to a remote storage system, the method comprising:

receiving, at a virtualization software layer on a host computer, an input/output (IO) request from a first virtual machine running on the host computer, wherein (i) the IO request relates to a first file stored in a first virtual disk associated with the first virtual machine, the first virtual disk locally attached to the host computer, and (ii) a second file corresponding to the first file is individually stored in the remote storage system in accordance with a file system that governs how data is stored in the remote storage system;

notifying the central management service of the received IO request, wherein the central management service uses the file system to access the second file in the remote storage system and performs a management task on the second file that was accessed by the management service;

performing, by the virtualization software layer, the IO request on the second file in the remote storage system upon a notification of a successful completion of the management task by the central management service;

comparing files that are stored in the remote storage system and associated with different virtual disks in order to determine whether any of the files have identical content;

removing any duplicates of the files that are identified as having identical content; and

updating a namespace database maintained by the file system to remap pathnames used by virtual machines to access any removed duplicate file to a pathname used by the file system to identify a remaining file having the identical content.

10. The method of claim 8, further comprising:

resolving a first pathname associated with the 10 request and used by the first virtual machine to identify the first file within the first virtual disk to a second pathname used by the file system to access the second file in the remote storage system; and

transmitting the second pathname to the central management service to enable the central management service to use the file system to access the second file in the remote storage system.

11. The method of claim 8, wherein (i) the management task comprises one of anti-virus scanning on the second file, backup of the second file, patching of the second file and versioning of the second file, and (ii) the central management service implements a framework that enables third parties to provide management tasks to the central management service to perform on the second file.

12. The method of claim 8, wherein the IO request comprises one of a file open operation, a file close operation, a file create operation, a file delete operation and a file rename operation.

13. The method of claim 8, wherein the file system comprises a host computer portion residing in the virtual software layer of the host computer and a remote portion that (i) maintains a namespace database to resolve pathnames used by virtual machines to identify files within virtual disks to pathnames used to access the files within the remote storage system, and (ii) provides resolved pathnames to the host computer portion to enable the host computer portion to access files in the remote storage system.

14. The method of claim 8, further comprising:

comparing files that are stored in the remote storage system and associated with different virtual disks in order to determine whether any of the files have identical content;

removing any duplicates of the files that are identified as having identical content; and

updating a namespace database maintained by the file system to remap pathnames used by virtual machines to access any removed duplicate file to a pathname used by the file system to identify a remaining file having the identical content.

15. The method of claim 8, wherein the central management service runs within a third virtual machine.

16. A non-transitory computer-readable storage medium including instructions that, when executed on a computer processor of a host computer, causes the computer processor to enable a central management service to operate on individual files associated with different virtual machines running in one or more host computers that are each networked to a remote storage system, by performing the steps of:

receiving, at a virtualization software layer on the host computer, an input/output (IO) request from a first virtual machine running on the host computer, wherein (i) the IO request relates to a first file stored in a first virtual disk associated with the first virtual machine, the first virtual disk locally attached to the host computer, and (ii) a second file corresponding to the first file is individually stored in the remote storage system in accordance with a file system that governs how data is stored in the remote storage system;

forwarding the received IO request to a central server system that notifies the central management service of the received IO request and the second pathname, wherein the central management service (i) determines a second pathname used by the file system to access the second file in the remote storage system, the second pathname being resolved from a first pathname associated with the IO request and used by the first virtual machine to identify the first file within the first virtual disk, (ii) uses the file system to access the second file in the remote storage system using the second pathname, and (iii) performs a management task on the second file that was accessed by the management service; and

performing, by the virtualization software layer, the IO request on the second file in the remote storage system using the second pathname upon a notification of a successful completion of the management task by the central management service.

17. The non-transitory computer-readable storage medium of claim 16, wherein the central server system is configured to perform the steps of:

resolving the first pathname associated with the IO request and used by the first virtual machine to identify the file within the first virtual disk to the second pathname used by the file system to access the second file in the remote storage system; and

transmitting the second pathname to the central management service to enable the central management service to use the file system to access the second file in the remote storage system.

18. The non-transitory computer-readable storage medium of claim 16, wherein (i) the management task comprises one of anti-virus scanning on the second file, backup of the second file, patching of the file and versioning of the second file, and (ii) the central management service implements a framework that enables third parties to provide management tasks to the central management service to perform on the second file.

19. The non-transitory computer-readable storage medium of claim 16, wherein the IO request comprises one of a file open operation, a file close operation, a file create operation, a file delete operation and a file rename operation.

20. The non-transitory computer-readable storage medium of claim 16, wherein the file system comprises a host computer portion residing in the virtual software layer of the host computer and a remote portion that (i) maintains a namespace database to resolve pathnames used by virtual machines to identify files within virtual disks to pathnames used to access the files within the remote storage system, and (ii) provides resolved pathnames to the host computer portion to enable the host computer portion to access files in the remote storage system.

21. The non-transitory computer-readable storage medium of claim 16, the central server system is configured to perform the steps of:

comparing files that are stored in the remote storage system and associated with different virtual disks in order to determine whether any of the files have identical content;

removing any duplicates of the files that are identified as having identical content; and

updating a namespace database maintained by the file system to remap pathnames used by virtual machines to access any removed duplicate file to a pathname used by the file system to identify a remaining file having the identical content.

22. The non-transitory computer-readable storage medium of claim 16, wherein the central management service runs within a virtual machine.

23. A host computer configured to enable a central management service to operate on individual files associated with different virtual machines running in one or more host computers that are each networked to a remote storage system, the host computer comprising a processor configured to perform the steps of:

receiving, at a virtualization software layer on the host computer, an input/output (IO) request from a first virtual machine running on the host computer, wherein (i) the IO request relates to a first file stored in a first virtual disk associated with the first virtual machine, the first virtual disk locally attached to the host computer, and (ii) a second file corresponding to the first file is individually stored in the remote storage system in accordance with a file system that governs how data is stored in the remote storage system;

forwarding the received IO request to a central server system that notifies the central management service of the received IO request and the second pathname, wherein the central management service (i) determines a second pathname used by the file system to access the second file in the remote storage system, the second pathname being resolved from a first pathname associated with the IO request and used by the first virtual machine to identify the first file within the first virtual disk, (ii) uses the file system to access the second file in the remote storage system using the second pathname, and (iii) performs a management task on the second file that was accessed by the management service; and

performing, by the virtualization software layer, the IO request on the second file in the remote storage system using the second pathname upon a notification of a successful completion of the management task by the central management service.

24. The host computer of claim 23, wherein the central server system is configured to perform the steps of:

resolving the first pathname associated with the IO request and used by the first virtual machine to identify the first file within the first virtual disk to the second pathname used by the file system to access the second file in the remote storage system; and

transmitting the second pathname to the central management service to enable the central management service to use the file system to access the second file in the remote storage system.

25. The host computer of claim 23, wherein (i) the management task comprises one of anti-virus scanning on the second file, backup of the file, patching of the second file and versioning of the second file, and (ii) the central management service implements a framework that enables third parties to provide management tasks to the central management service to perform on the second file.

26. The host computer of claim 23, wherein the IO request comprises one of a file open operation, a file close operation, a file create operation, a file delete operation and a file rename operation.

27. The host computer of claim 23, wherein the file system comprises a host computer portion residing in the virtual software layer of the host computer and a remote portion residing in the central server system that (i) maintains a namespace database to resolve pathnames used by virtual machines to identify files within virtual disks to pathnames used to access the files within the remote storage system, and (ii) provides resolved pathnames to the host computer portion to enable the host computer portion to access files in the remote storage system.

28. The host computer of claim 23, wherein the central server system is further configured to perform the steps of:

comparing files that are stored in the remote storage system and associated with different virtual disks in order to determine whether any of the files have identical content;

removing any duplicates of the files that are identified as having identical content; and

updating a namespace database maintained by the file system to remap pathnames used by virtual machines to access any removed duplicate file to a pathname used by the file system to identify a remaining file having the identical content.