Converting storage objects between formats in a copy-free transition

• US 10,684,985 B2
• Filed: 02/16/2016
• Issued: 06/16/2020
• Est. Priority Date: 02/16/2016
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Vully, Vani, Thoppil, Anil, Leong, James, Revsin, Vitaly, Zheng, Qinghua, Simharajan, Srishylam
• Primary Examiner(s): Al-Hashemi, Sana A
• Application Number:
  US15/045,193
• Publication Number:
  US 20170235802A1
• Time in Patent Office: 1,582 Days
• Field of Search: 707607, 707609, 707649, 707687, 707705, 707769, 707790, 707813, 707821
• CPC Class Codes: G06F 16/119 Details of migration of file systems migration mechanisms in storage systems G06F3/0647

Abstract

A copy-free transition tool converts storage objects from a source format associated with a source storage system to a destination format associated with a destination storage system. The transition tool exports configuration information associated with the source storage system to the destination storage system and brings the storage objects offline. Once the transition tool determines that the storage devices containing the storage objects are physically connected to the destination storage system, the tool can convert file systems from the source format to the destination format while leaving data and file layout unchanged. The tool can also modify metadata associated with each of the storage objects to conform to the destination format and store the modified metadata with the destination storage system.

Claims

1. A method comprising:

taking a volume, comprised within an aggregate of volumes, within a first storage system offline, wherein the volume organizes files and directories according to an original organization and structure of a first file system having a first operating system (OS) format supported by the first storage; and

transitioning, using a transition tool, from utilizing the first storage system to utilizing a second storage system for hosting the volume, wherein a reversion snapshot of the volume is created as a protected version of the volume to preserve integrity of the original organization and structure of the first file system for use in transitioning back to utilizing the first storage system, wherein the transitioning comprises;

in response to the aggregate having less than a threshold amount of available storage space during a pre-commit phase of the transitioning, dynamically bringing the aggregate and the volumes of the aggregate offline;

converting the original organization and structure of how the files and directories were structured by the first file system in the first OS format to a second file system with a second organization and structure for the files and directories compatible with a second OS format supported by the second storage system, wherein the converting retains data of the volume in an unmodified state and renames the aggregate to match a configuration of the second storage system, and wherein configuration information associated with the first storage system is exported to the second storage system; and

modifying metadata associated with the volume to conform to the second OS format for storage within the second storage system.

2. The method of claim 1, comprising:

in response to bringing the aggregate online, retaining the volumes of the aggregate offline.

3. The method of claim 1, comprising:

in response to a failure to dynamically offline the aggregate, rebooting a node associated with at least one of the first storage system or the second storage system and retaining the aggregate in an offline state.

4. The method of claim 1, comprising:

estimating a cutover time to transition the volume from being hosted by the first storage system to being hosted by the second storage system based upon a time to perform export and import operations of the transition.

5. The method of claim 4, comprising:

estimating the cutover time based upon a first timespan to offline storage devices, comprising the aggregate, from the first storage system and a second timespan to online the storage devices to the second storage system.

6. The method of claim 1, wherein the file system stores user data according to a file layout within the volume and the converting retains the user data and the file layout in the unmodified state.

7. The method of claim 1, comprising:

aborting the transition based upon the aggregate being a first threshold percentage full and an amount of snapshot storage spilling into user data space exceeding a second threshold percentage.

8. A system comprising:

a memory comprising machine executable code having stored thereon instructions for performing a method; and

a processor coupled to the memory, the processor configured to execute the machine executable code to cause the processor to perform operations comprising;

taking, comprised within an aggregate of volumes, a volume within a first storage system offline, wherein the volume organizes files and directories according to an original organization and structure of a first file system having a-first operating system (OS) format supported by the first storage; and

transitioning, using a transition tool, from utilizing the first storage system to utilizing a second storage system for hosting the volume, wherein a reversion snapshot of the volume is created as a protected version of the volume to preserve integrity of the original organization and structure of the first file system for use in transitioning back to utilizing the first storage system, wherein the transitioning comprises;

estimating a cutover time to transition the volume from being hosted by the first storage system to being hosted by the second storage system based upon a time to perform export and import operations of the transition, wherein the cutover time is provided through the transition tool;

converting the original organization and structure of how the files and directories were structured by the first file system in the first OS format to a second file system with a second organization and structure for the files and directories compatible with a second OS format supported by the second storage system, wherein the converting retains data of the volume in an unmodified state and renames the aggregate to match a configuration of the second storage system, and wherein configuration information associated with the first storage system is exported to the second storage system; and

modifying metadata associated with the volume to conform to the second OS format.

9. The system of claim 8, wherein the volume is comprised within a first tier of storage objects.

10. The system of claim 9, wherein volumes of the first tier of storage objects are stored within aggregates of a second tier of storage objects.

11. The system of claim 10, wherein metadata associated with each volume in the first tier of storage objects is modified before metadata of aggregates of the second tier of storage objects.

12. The system of claim 8, wherein a storage device comprising the volume is physically connected to the first storage system when the configuration information is exported.

13. The system of claim 8, wherein the file system stores user data according to a file layout within the volume and the converting retains the user data and the file layout in the unmodified state.

14. The system of claim 8, comprising bringing the volume online once the metadata, modified to conform to the second OS format, is stored with the second storage system.

15. A non-transitory computer-readable medium that stores instructions, executable by one or more processors, to cause the one or more processors to perform operations that comprise:

taking a volume, comprised within an aggregate of volumes, within a first storage system offline, wherein the volume organizes files and directories according to an original organization and structure of a first file system having a-first operating system (OS) format supported by the first storage;

transitioning, using a transition tool, from utilizing the first storage system to utilizing a second storage system for hosting the volume, wherein a reversion snapshot of the volume is created as a protected version of the volume to preserve integrity of the original organization and structure of the first file system for use in transitioning back to utilizing the first storage system; and

aborting the transition based upon the aggregate being a first threshold percentage full and an amount of snapshot storage spilling into user data space exceeding a second threshold percentage.

16. The non-transitory computer-readable medium of claim 15, wherein the volume is comprised within a first tier of storage objects.

17. The non-transitory computer-readable medium of claim 16, wherein volumes of the first tier of storage objects are stored within aggregates of a second tier of storage objects.

18. The non-transitory computer-readable medium of claim 17, wherein metadata associated with each volume in the first tier of storage objects is modified before metadata of aggregates of the second tier of storage objects.

19. The non-transitory computer-readable medium of claim 15, wherein configuration information associated with the first storage system is exported to the second storage system.

20. The non-transitory computer-readable medium of claim 15, wherein the file system stores user data according to a file layout within the volume.