Extension of write anywhere file system layout

• US 8,990,539 B2
• Filed: 11/12/2013
• Issued: 03/24/2015
• Est. Priority Date: 04/30/2004
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Edwards, John K., Lewis, Blake H., English, Robert M., Hamilton, Eric, Corbett, Peter F.
• Primary Examiner(s): BATAILLE, PIERRE MICHE
• Application Number:
  US14/077,812
• Publication Number:
  US 20140082281A1
• Time in Patent Office: 497 Days
• Field of Search: 711/114, 711/170, 711/202, 711/203, 711/E12.058, 711/E12.084
• US Class Current: 711/202
• CPC Class Codes: G06F 16/188 Virtual file systems
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

A file system layout apportions an underlying physical volume into one or more virtual volumes (vvols) of a storage system. The underlying physical volume is an aggregate comprising one or more groups of disks, such as RAID groups, of the storage system. The aggregate has its own physical volume block number (pvbn) space and maintains metadata, such as block allocation structures, within that pvbn space. Each vvol has its own virtual volume block number (vvbn) space and maintains metadata, such as block allocation structures, within that vvbn space. Notably, the block allocation structures of a vvol are sized to the vvol, and not to the underlying aggregate, to thereby allow operations that manage data served by the storage system (e.g., snapshot operations) to efficiently work over the vvols. The file system layout extends the file system layout of a conventional write anywhere file layout system implementation, yet maintains performance properties of the conventional implementation.

Claims

1. A data storage system, comprising:

a processor configured to execute a storage operating system, the storage operating system, when executed, configured to implement a physical volume including a plurality of data storage devices, wherein the physical volume has a physical address space;

one or more logical volumes overlaid onto the physical volume, wherein each logical volume has a separate logical volume address space, wherein the logical volume address space includes an independent set of numbers that is translated to disk block numbers (dbns) on a storage device of the plurality of storage devices and wherein each block within the logical volume is identified with a logical volume address associated with the logical volume address space; and

a logical volume data container of the logical volume, the logical volume data container stored in the physical volume and having physical blocks associated with the logical volume.

2. The data storage system of claim 1 wherein at least one data object is stored in the logical volume.

3. The data storage system of claim 2 wherein the data object is selected from a group consisting of a lun, a directory, a qtree, and a file.

4. The data storage system of claim 1 wherein at least one of the plurality of storage devices includes an electronic random access memory.

5. The data storage system of claim 1 wherein at least one of the plurality of storage devices includes a micro-electro mechanical device.

6. The data storage system of claim 1 wherein the plurality of data storage devices is organized into one or more RAID groups.

7. The data storage system of claim 1 wherein a pointer to a first block within the logical volume includes a physical address of the first block within the physical address space, and wherein the logical volume address, associated with the first block, is configured to store the logical volume.

8. The data storage system of claim 1 wherein the storage operating system is further configured to provide a first mapping data structure that provides a mapping between a physical address in the physical address space and a logical address in the logical address space of the logical volume and is further configured to provide a second mapping structure that provides a mapping between the logical address in the logical address space of the logical volume and the physical address of the physical address space of the physical volume.

9. The data storage system of claim 1 wherein the storage operating system is further configured to execute a file system.

10. The data storage system of claim 9 wherein the file system is configured to generate a snapshot of the logical volume.

11. A method for operating a data storage system having a processor, comprising:

organizing a physical volume including a plurality of storage blocks on a plurality of data storage devices, the plurality of storage blocks forming a physical address space;

storing a plurality of data containers within the physical volume, each data container embodying a logical volume overlaid onto the physical volume, wherein the logical volume has a logical address space;

storing a set of mapping data structures to provide mappings between a physical address in the physical address space and a logical address in the logical address space of the logical volume and between the logical address in the logical address space of the logical volume and the physical address of the physical address space of the physical volume; and

storing a data container having a buffer tree on a file system, wherein the buffer tree utilizes the physical address as a block pointer.

12. The method of claim 11 further comprising implementing the file system on the logical volume.

13. The method of claim 12 wherein the data container comprises a file.

14. The method of claim 11 further comprising configuring the plurality of data storage devices into one or more RAID groups.

15. The method of claim 11 further comprising generating a snapshot of the logical volume.

16. The method of claim 11 further comprising:

implementing the file system on the logical volume; and

utilizing, by the buffer tree, the logical address as the block pointer.

17. The method of claim 11 further comprising increasing a size of the logical volume, wherein free blocks within the physical volume are utilized to increase the size of the logical volume.

18. The method of claim 11 further comprising generating a snapshot of the file system implemented on the logical volume.

19. A computer readable storage medium containing executable program instructions for execution by a processor comprising:

program instructions that organize a physical volume including a plurality of storage blocks on a plurality of data storage devices, the plurality of storage blocks forming a physical address space;

program instructions that store a plurality of data containers within the physical volume, each data container embodying a logical volume overlaid onto the physical volume, wherein the logical volume has a logical address space;

program instructions that store a set of mapping data structures to provide mappings between a physical address in the physical address space and a logical address in the logical address space of the logical volume and between the logical address in the logical address space of the logical volume and the physical address of the physical address space of the physical volume; and

program instructions that store a data container having a buffer tree on a file system, wherein the buffer tree utilizes the physical address as a block pointer.