Extent-based storage architecture

• US 8,539,008 B2
• Filed: 04/29/2011
• Issued: 09/17/2013
• Est. Priority Date: 04/29/2011
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Faith, Rickard E., Periyagaram, Subramaniam, Yadav, Sandeep, Prakash, Ashish, Lewis, Blake, Kimmel, Jeff, Daniel, Steve
• Primary Examiner(s): Casanova, Jorge A
• Application Number:
  US13/098,310
• Publication Number:
  US 20120278382A1
• Time in Patent Office: 872 Days
• Field of Search: 707/812, 707/822
• US Class Current: 707/822
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/183 Provision of network file services by network file servers, e.g. by using NFS, CIFS network file access protocols H04L67/1097
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/0644 Management of space entities, e.g. partitions, extents, pools
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

An extent-based storage architecture is implemented by a storage server receiving a read request for an extent from a client, wherein the extent includes a group of contiguous blocks and the read request includes a file block number. The storage server retrieves an extent identifier from a first sorted data structure, wherein the storage server uses the received file block number to traverse the first sorted data structure to the extent identifier. The storage server retrieves a reference to the extent from a second sorted data structure, wherein the storage server uses the retrieved extent identifier to traverse the second sorted data structure to the reference, and wherein the second sorted data structure is global across a plurality of volumes. The storage server retrieves the extent from a storage device using the reference and returns the extent to the client.

Claims

1. A computerized method comprising:

receiving, by a storage server from a client, a read request for an extent, wherein the extent includes a group of contiguous blocks of data and the read request includes a file block number (FBN) and wherein the storage server utilizes an FBN offset granularity that is less than a predetermined block size;

retrieving, by the storage server, a first extent identifier from a first sorted data structure, wherein the storage server uses the received FBN to traverse the first sorted data structure to the first extent identifier; and

retrieving, by the storage server, a first reference to the first extent from a second sorted data structure, wherein the storage server uses the retrieved first extent identifier to traverse the second sorted data structure to the first reference, and wherein the second sorted data structure is global across a plurality of volumes;

retrieving, by the storage server from a storage device, the extent using the first reference; and

returning, by the storage server, the extent to the client.

2. The computerized method of claim 1, wherein the first reference identifies a physical block number (PVBN).

3. The computerized method of claim 2, wherein each PVBN is referenced directly by no more than one extent identifier.

4. The computerized method of claim 1, wherein the first reference identifies a second extent identifier and the second extent identifier includes a second reference that identifies a PVBN.

5. The computerized method of claim 1, wherein the storage server uses the retrieved first extent identifier to traverse the second sorted data structure to multiple references including the first reference, wherein the storage server uses the multiple references to retrieve the extent.

6. The computerized method of claim 1, wherein extents vary in length.

7. A storage server comprising:

a memory;

a processor coupled to the memory through a bus, wherein the processor executes instructions that cause the processor to

receive a read request from a client for an extent, wherein the extent includes a group of contiguous blocks of data and the read request includes a file block number (FBN) and wherein the storage server utilizes an FBN offset granularity that is less than a predetermined block size;

retrieve a extent identifier from a first sorted data structure, wherein the storage server uses the received FBN to traverse the first data structure to the first extent identifier;

retrieve a first reference to the extent from a second sorted data structure, wherein the storage server uses the retrieved first extent identifier to traverse the second data structure to the first reference, and wherein the second sorted data structure is global across a plurality of volumes;

retrieve the extent from a storage device using the first reference; and

return the extent to the client.

8. The storage server of claim 7, wherein the first reference identifies a physical block number (PVBN).

9. The storage server of claim 8, wherein each PVBN is referenced directly by no more than one extent identifier.

10. The storage server of claim 7, wherein the first reference identifies a second extent identifier and the second extent identifier includes a second reference that identifies a PVBN.

11. The storage server of claim 7, wherein the storage server uses the retrieved first extent identifier to traverse the second sorted data structure to multiple references including the first reference, wherein the storage server uses the multiple references to retrieve the extent.

12. The storage server of claim 7, wherein extents vary in length.

13. A computerized method comprising:

receiving, by a storage server from a client, a write request for a first extent including a group of contiguous blocks of data and a file block number (FBN), wherein the storage server utilizes an FBN offset granularity that is less than a predetermined block size;

writing, by the storage sever, a first entry in a first sorted data structure, the first entry including a first extent identifier and a first reference to the first extent in the storage device, wherein the first extent identifier is used to determine a location the first entry in the first sorted data structure; and

writing, by the storage sever, a second entry in a second sorted data structure, the second entry including the FBN and the first extent identifier, wherein the FBN is used to determine a location the second entry in the second sorted data structure, and wherein the second sorted data structure is global across a plurality of volumes.

14. The computerized method of claim 13, wherein the first reference identifies a physical volume block number (PVBN).

15. The computerized method of claim 13, wherein the first reference identifies a second extent identifier and the second extent identifier includes a second reference that identifies a PVBN.

16. The computerized method of claim 13, wherein the write request is a request to overwrite a portion of a second extent, wherein the writing of the second entry includes overwriting a second extent identifier with the first extent identifier, and wherein the first entry further includes the second extent identifier for the second extent, an offset within the second extent indicating a start of blocks within the second extent to be overwritten, and a number of blocks from the offset to be overwritten.

17. The computerized method of claim 16, wherein the request to overwrite a portion of the second extent includes a second offset within the second extent indicating a start of blocks within the second extent that are not being overwritten and a number of blocks from the offset that are not being overwritten.

18. A storage server comprising:

a memory;

a processor coupled to the memory through a bus, wherein the processor executes instructions that cause the processor to

receive a write request for a first extent including a group of contiguous blocks of data and a file block number (FBN) from a client, wherein the storage server utilizes an FBN offset granularity that is less than a predetermined block size,

write a first entry in a first sorted data structure, the first entry including a first extent identifier and a first reference to the first extent in the storage device, wherein the first extent identifier is used to determine a location the first entry in the first sorted data structure, and

write a second entry in a second sorted data structure, the second entry including the FBN and the first extent identifier, wherein the FBN is used to determine a location the second entry in the second sorted data structure, and wherein the second sorted data structure is global across a plurality of volumes.

19. The storage server of claim 18, wherein the first reference identifies a physical volume block number (PVBN).

20. The storage server of claim 18, wherein the first reference identifies a second extent identifier and the second extent identifier includes a second reference that identifies a PVBN.

21. The storage server of claim 18, wherein the write request is a request to overwrite a portion of a second extent, wherein the writing of the second entry includes overwriting a second extent identifier with the first extent identifier, and wherein the first entry further includes the second extent identifier for the second extent, an offset within the second extent indicating a start of blocks within the second extent to be overwritten, and a number of blocks from the offset to be overwritten.

22. The storage server of claim 21, wherein the request to overwrite a portion of the second extent includes a second offset within the second extent indicating a start of blocks within the second extent that are not being overwritten and a number of blocks from the offset that are not being overwritten.