Network storage system

• US 7,428,540 B1
• Filed: 10/23/2000
• Issued: 09/23/2008
• Est. Priority Date: 03/03/2000
• Status: Expired due to Fees

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Coates, Joshua L., Bozeman, Patrick E., Gautier, Taylor, Patterson, David A., Gonzalez, Michael, Russell, Georgina L., Jones, F. Alan
• Primary Examiner(s): Hwang; Joon H
• Application Number:
  US09/695,499
• Time in Patent Office: 2,892 Days
• Field of Search: 707100-1041, 707200-206, 707 1- 10, 709200-203, 709217-219, 711/118, 711/133, 711/147, 711161-162
• US Class Current: 1/1
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/188 Virtual file systems
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: Y10S 707/99934 Query formulation, input preparation, or translation

Abstract

A network storage system includes a virtual file system (“VFS”), to manage the files of the network storage system, and a storage center that stores the files. The VFS and the storage center are separated, such that a client accesses the VFS to conduct file system operations and the client accesses the storage center to upload/download files. The client accesses the network storage system through one or more storage ports. The storage center includes a plurality of distributed object storage managers (DOSMs) and a storage cluster that includes a plurality of intelligent storage nodes. The network storage system includes additional storage centers at geographically disparate locations. The network storage system uses a multi-cast protocol to maintain file information at the DOSMs regarding files stored in the intelligent storage nodes, including files stored in disparate storage centers.

Claims

1. A network storage system comprising:

a storage port for accessing at a client, a virtual file system and a plurality of storage centers, the storage port, mounted at the client, translates a client local file system request to a network storage file system request including a file identifier identifying a file in a single file system;

a virtual file system (“

VFS”

) storing file system information for the single file system, wherein the client of the network storage system accesses the VFS via the storage port over a network to manage a plurality of files of the single file system, and wherein the client receives a generated storage resource locator (“

SRL”

) from the VFS in response to the network storage file system request to access the file in the single file system;

the plurality of storage centers, located in geographically disparate locations from each other, the client and the VFS, and coupled to the client through a wide area, public access network, each of the storage centers storing a plurality of files for the single file system, wherein the client of the network storage system transmits the received SRL directly to one of the storage centers over the wide area, public access network, and downloads the file over the wide area, public access network, and wherein the SRL includes a public access network address for a storage center to access one of the storage centers over the wide area, public access network and a unique identifier associated with contents of the file to uniquely identify the file stored at the one of the storage centers; and

at least one additional storage port for accessing the virtual file system and the storage centers in an event of a failover condition of the storage port.

2. The network storage system of claim 1, further comprising a dynamic failover mechanism for servicing access requests from a disparate storage center in an event that a failure occurs in another one of the storage centers.

3. The network storage system of claim 1, wherein each storage center comprises:

a plurality of distributed object storage managers (“

DOSMs”

) for receiving requests to access the storage center; and

a storage cluster, comprising a plurality of intelligent storage nodes, for storing files of the network storage system for serving access requests from the DOSMs, each intelligent storage node including a processor core and a plurality of storage devices.

4. The network storage system of claim 3, further comprising a multi-cast protocol for maintaining file information at the DOSMs regarding files stored in an intelligent storage node.

5. The network storage system of claim 3, wherein the DOSMs further comprise a data cache for caching at least a subset of files stored in an intelligent storage node.

6. The network storage system of claim 5, further comprising a load balancing fabric for selecting a DOSM for an access request based on demand to access the storage center, and for caching data for files in high demand in the data cache of the DOSMs.

8. The network storage system of claim 1, wherein the file identifier includes a digital fingerprint derived from contents of the file.

9. The network storage system of claim 1, wherein the SRL is received from the VFS over a control path and the file is downloaded from the storage center over a data path.

7. The network storage system of clam 1, further comprising a content delivery network coupled to the network storage system.

10. A method for retrieving files in a network storage system, the method comprising:

storing file system information in a virtual file system (“

VFS”

) for a single file system;

accessing, at a client, the virtual file system and a plurality of storage centers using a storage port, the storage port, mounted at the client, translates a client local file system request to a network storage file system request including a file identifier identifying a file in the single file system;

providing at least one additional storage port for accessing the virtual file system and the storage centers in an event of a failover condition of the storage port;

receiving the network storage file system request from the client at the VFS to access the file in the network storage system;

generating at the VFS, in response to the network storage file system request from the client, a storage resource locator (“

SRL”

);

storing a plurality of files for the single file system in the plurality of storage centers, the storage centers located in geographically disparate locations from each other, the client and the VFS;

coupling the storage centers to the client through a wide area, public access network;

transmitting, from the client directly to one of the storage centers, over a wide area, public access network, the SRL received from the VFS, wherein the SRL comprises a public access network address for a storage center to access the one of the storage centers over the wide area, public access network and comprises a unique file identifier associated with contents of the file to uniquely identify the file stored at the one of the storage centers; and

downloading, over the wide area, public access network, the file identified by the SRL from the storage center identified to the client.

11. The method of claim 10, wherein downloading the file from the storage center comprises;

receiving a request for access to the storage center;

selecting one of a plurality of distributed object storage managers (DOSMs) to service the request; and

accessing an intelligent storage node from the DOSM selected to service the request, each intelligent storage node including a processor core and a plurality of storage devices.

12. The method of claim 11, further comprising:

issuing commands from a multi-cast protocol to maintain file information at the DOSMs requesting files stored in an intelligent storage node.

13. The method of claim 11, further comprising:

caching at least a subset of files stored in intelligent storage nodes at the DOSMs.

14. The method of claim 11, further comprising:

selecting a DOSM for a download request based on demand to access the storage center; and

caching data for files in high demand in the DOSMs.

15. The method of claim 10, further comprising:

servicing access requests from a disparate storage center in an event that a failure occurs in the storage center.

16. The method of claim 10, further comprising:

accessing the storage center from a content delivery network.

17. The method of claim 10, wherein the file identifier includes a digital fingerprint derived from contents of the file.

18. A network storage system comprising:

a storage port for accessing at a client, a virtual file system and a storage center, the storage port, mounted at the client, translates a client local file system request to a network storage file system request including a file identifier identifying a file in a single file system;

a virtual file system (“

VFS”

) storing file system information for the single file system, wherein the client of the network storage system accesses the VFS via the storage port over a network to manage a plurality of files of the single file system, and wherein the client receives a generated storage resource locator (“

SRL”

) from the VFS in response to the network storage file system request to access the file in the single file system;

the storage center, located in geographically disparate locations from the client and the VFS, and coupled to the client through a wide area, public access network, the storage center storing a plurality of files for the single file system, wherein the client of the network storage system transmits the received SRL directly to the storage center over the wide area, public access network, and downloads the file over the wide area, public access network, and wherein the SRL includes a public access network address for the storage center to access the storage center over the wide area, public access network and a unique identifier associated with contents of the file to uniquely identify the file stored at the storage center; and

at least one additional storage port for accessing the virtual file system and the storage center in an event of a failover condition of the storage port.

19. The network storage system of claim 18, wherein the file identifier includes a digital fingerprint derived from contents of the file.