Performing online in-place upgrade of cluster file system

• US 8,577,853 B2
• Filed: 08/17/2011
• Issued: 11/05/2013
• Est. Priority Date: 08/17/2011
• Status: Active Grant

• Current Assignee: Vmware LLC (Broadcom, Inc.)
• Original Assignee: VMware, Inc. (Broadcom, Inc.)
• Inventors: Vilayannur, Murali, Rawat, Mayank, Vaghani, Satyam B., Li, Jinyuan
• Primary Examiner(s): PYO, MONICA M
• Application Number:
  US13/212,002
• Publication Number:
  US 20130046740A1
• Time in Patent Office: 811 Days
• Field of Search: 707/695, 707802-803, 717/127, 717/174
• US Class Current: 707/695
• CPC Class Codes: G06F 16/119 Details of migration of file systems migration mechanisms in storage systems G06F3/0647
• CPC Class Codes: G06F 16/176 Support for shared access to files; File sharing support

Abstract

A shared file system for a group of host computer systems is upgraded in-place in a manner that the shared file system can remain online and accessible to the host computer systems. Each host computer system first loads a new file system driver that is backward compatible with a driver that is currently used by them to interact with the file system. Second, one of the host computer systems acquires locks to file system management data structures of the file system, upgrades the file system management data structures, and upon completion thereof, notifies the other host computer system that the upgrade to the file system management data structures is complete.

Claims

1. A method of upgrading a version of a shared file system to an upgraded shared filed system without taking the shared file system offline, wherein the shared file system is supported by at least one storage array and accessed by a plurality of host computer systems, each host computer system including a file system driver for accessing data on the at least one storage array stored in accordance with the shared file system, said method comprising:

transmitting a request to each host computer system to upgrade its respective file system driver to a new file system driver that corresponds to the upgraded shared file system;

upon receiving a notification from each of the host computer systems that the host computer system has upgraded its respective file system driver to the new file system driver, transmitting a request to a selected host computer system to upgrade file system management data structures stored in the shared file system for correspondence with the upgraded shared file system; and

transmitting a request to each host computer system to upgrade file descriptors for each file for which the host computer system currently holds a file lock for correspondence with the upgraded shared file system, wherein each file descriptor that corresponds to a file for which no host computer system currently holds a file lock is upgraded by the new file system driver of a host computer system that subsequently obtains a file lock in order to access the file that corresponds to the file descriptor.

2. The method of claim 1, wherein the upgrade of the file system management data structures by the selected host computer system is performed by the new file system driver in the selected host computer system.

3. The method of claim 1, wherein the upgrade of the file descriptors for each file for which a host computer system currently holds a file lock is performed by the new file system driver in the host computer system.

4. The method of claim 1, wherein the upgrade of the file descriptors for each file for which a lock is not held is performed by the new file system driver in the selected host computer system.

5. The method of claim 1, wherein the file system management data structures include a bitmap of storage blocks that indicates which storage blocks are used or unused.

6. The method of claim 5, wherein the upgrade of the file system management data structures by the selected host computer system comprises extending the bitmap of storage blocks to accommodate a larger address space supported by the upgraded shared file system.

7. The method of claim 1, further comprising transmitting a request to each of the host computer systems to invalidate any versions of the file system management data structures locally cached by the host computer system.

8. The method of claim 1, wherein the selected host computer system obtains locks for the file system management data structures in order to perform the upgrade to the file system management data structures.

9. The method of claim 1, wherein the shared file system is a virtual machine file system and each of the host computer systems has at least one virtual machine running therein.

10. The method of claim 1, wherein the upgraded shared file system is backwards compatible with the shared file system.

11. A method of upgrading a version of a shared file system to an upgraded shared file system without taking the shared file system offline, wherein the shared file system is supported by at least one storage array and accessed by a plurality of host computer systems, each host computer system including an upgraded file system driver compatible with the upgraded shared file system and the at least one storage array storing upgraded file system management data structures compatible with the upgraded shared file system, said method performed in each of the host computer systems and comprising:

for each file for which the host computer system currently holds a file lock, upgrading the file descriptors for the file for which the host computer system currently holds the file lock for correspondence with the upgraded shared file system; and

for each file for which no host computer system currently holds a file lock, in response to a request to access the file;

obtaining access to a file descriptor corresponding to the file and stored in the shared file system;

comparing a version identifier in the file descriptor with a version identifier of the upgraded file system driver of the host computer system;

upgrading the file descriptor for correspondence with the upgraded shared file system if the comparison step determines a difference between the version identifier in the file descriptor and the version identifier of the upgraded file system driver; and

enabling access to the file in accordance with the request.

12. The method of claim 11, further comprising obtaining an exclusive lock for the file, prior to the upgrading step, if the comparison step determines a difference between the version identifier in the file descriptor and the version identifier of the upgraded file system driver.

13. The method of claim 11, further comprising obtaining a shared lock for the file and upgrading the shared lock be an exclusive lock, prior to the upgrading step, if the comparison step determines a difference between the version identifier in the file descriptor and the version identifier of the upgraded file system driver.

14. The method of claim 11, wherein the request originates from an application running on the host computer system during normal operations.

15. The method of claim 11, wherein the shared file system is a virtual machine file system and each of the host computer systems has at least one virtual machine running therein.

16. The method of claim 15, wherein the file represents a virtual disk corresponding to one of the virtual machines in one of the host computer systems.

17. The method of claim 11, wherein upgrading the file descriptor comprises converting address formats of data blocks referenced in the file descriptor to a larger bit address space.

18. A non-transitory computer readable storage medium comprising instructions that are to be executed in a host that is part of a computer system configured with a shared file system, wherein the shared file system is supported by at least one storage array and accessed by a plurality of host computer systems, each host computer system including an upgraded file system driver compatible with the upgraded shared file system and the at least one storage array storing upgraded file system management data structures compatible with the upgraded shared file system, wherein the instructions, when executed in the said host, cause said host to carry out the steps of:

for each file for which the host computer system currently holds a file lock, upgrading the file descriptors for the file for which the host computer system currently holds the file lock for correspondence with the upgraded shared file system; and

for each file for which no host computer system currently holds a file lock, in response to

a request to access the file;

obtaining access to a file descriptor corresponding to the file and stored in the shared file system;

comparing a version identifier in the file descriptor with a version identifier of the upgraded file system driver of the host computer system;

upgrading the file descriptor for correspondence with the upgraded shared file system if the comparison step determines a difference between the version identifier in the file descriptor and the version identifier of the upgraded file system driver; and

enabling access to the file in accordance with the request.

19. The non-transitory computer readable storage medium of claim 18, further comprising obtaining an exclusive lock for the file, prior to the upgrading step, if the comparison step determines a difference between the version identifier in the file descriptor and the version identifier of the upgraded file system driver.

20. The non-transitory computer readable storage medium of claim 18, further comprising obtaining a shared lock for the file and upgrading the shared lock be an exclusive lock, prior to the upgrading step, if the comparison step determines a difference between the version identifier in the file descriptor and the version identifier of the upgraded file system driver.

21. The non-transitory computer readable storage medium of claim 18, wherein the request originates from an application running on the host computer system during normal operations.

22. The non-transitory computer readable storage medium of claim 18, wherein the shared file system is a virtual machine file system and each of the host computer systems has at least one virtual machine running therein.

23. The non-transitory computer readable storage medium of claim 22, wherein the file represents a virtual disk corresponding to one of the virtual machines in one of the host computer systems.