File array storage architecture having file system distributed across a data processing platform

• US 6,301,605 B1
• Filed: 09/29/2000
• Issued: 10/09/2001
• Est. Priority Date: 11/04/1997
• Status: Expired due to Term

• Current Assignee: PMC-Sierra Incorporated (Microchip Technology Incorporated)
• Original Assignee: Adaptec Incorporated (Steel Partners Holdings LP)
• Inventors: Franklin, Chris, Noya, Eric S., Luke, Stanley, Wong, Jeffrey T., Panner, Bryan K., Arnott, Randy Marc, Juzsczak, Chester, Hoskins, Timothy Lee, Silverman, Herbert W., Napolitano, Richard, Shaughnessy, Paul Richard, McLeod, Alexander C.
• Primary Examiner(s): Beausoleil, Robert
• Assistant Examiner(s): PHAN, RAYMOND NGAN
• Application Number:
  US09/677,034
• Time in Patent Office: 375 Days
• Field of Search: 710/129, 710/5, 710/8, 710/10, 710/11, 710/16, 710/17, 710/18, 709/102, 709/104, 709/105, 709/201, 709/202-203, 714/6, 714/7, 711/112-113, 711/118, 711/130, 711/147, 711/156
• US Class Current: 709/201
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: G06F 3/0611 in relation to response time
• CPC Class Codes: G06F 3/0643 Management of files
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

A file array storage architecture comprises a file system that is distributed across a data processing platform consisting of a host computer coupled to an adapter over a high-speed, low latency interface and an input/output subsystem that is located entirely on the adapter. The distributed nature of the architecture enables implementation of the file system in accordance with a modified client-server computing model; that is, the architecture includes a client file system executing on the host computer and a server file system executing on the adapter.

Claims

1. A method for configuring storage devices from a console of a data processing system having a distributed storage architecture executing on a host computer coupled to an adapter, the method comprising the steps of:

entering parameters through a graphical user interface of the console, the parameters specifying a size of a file system and an organization of the storage devices;

translating the parameters into operations instructing an input/output (I/O) subsystem to transform the storage devices from a present organization to the specified organization;

transforming each file stored on the present organization of storage devices to a file stored on the specified organization of storage devices during execution of the distributed storage architecture system; and

receiving a transaction request at the file system; and

if the transaction request is a read request, directing the read request to the present organization of the storage devices.

2. The method of claim 1 further comprising the step of, if the transaction request is a write request, determining if the write request is directed to a file being transformed.

3. The method of claim 2 further comprising the steps of:

if the write request is directed to a file being transformed, directing the write request to the present and specified organizations of the storage devices; and

if the write request is directed to a file that has yet to be transformed, directing the write request to the specified organization of the storage devices.

4. A method for configuring storage devices from a console of a data processing system having a distributed storage architecture executing on a host computer coupled to an adapter, the method comprising the steps of:

entering parameters through a graphical user interface of the console, the parameters specifying a size of a file system and an organization of the storage devices;

translating the parameters into operations instructing an input/output (I/O) subsystem to transform the storage devices from a present organization to the specified organization;

transforming each file stored on the present organization of storage devices to a file stored on the specified organization of storage devices during execution of the distributed storage architecture system; and

wherein the organization of the storage devices includes one of a mirror set, a stripe set and a redundant array of independent disks.

5. The method of claim 4 further comprising the step of, if the write request is directed to a file being transformed:

logging an extent of the transformation of each file stored on the present organization of storage devices to a file stored on the specified organization of storage devices using a bit map data structure; and

storing the bit map structure in a cache memory of the data processing system.

6. The method of claim 5 wherein the cache memory is a non-volatile random access memory.

7. The method of claim 5 further comprising the step of, if the write request is directed to a file that has yet to be transformed:

marking a bit map data structure with a high-water mark to indicate an extent to which the present organization of storage devices has been morphed; and

storing the bit map structure in a cache memory of the data processing system.

8. The method of claim 7 wherein the cache memory is a non-volatile random access memory.

9. A distributed storage architecture executing on a host computer coupled to an adapter and having a console, comprising:

a graphical user interface associated with the console for entering parameters, the parameters specifying a size of a file system and an organization of the storage devices coupled to channels of the adapter;

a translator that translates the parameters into operations instructing an input/output (I/O) subsystem executing on the adapter to transform the storage devices from a present organization to the specified organization;

means for transforming each file stored on the present organization of storage devices to a file stored on the specified organization of storage devices during execution of II the distributed storage architecture system; and

a server file system that services an I/O request by instructing the I/O subsystem to interact with the storage devices to one of retrieve and store data specified by the I/O request.

10. The system of claim 9 wherein the server file system further comprises a cache manager executed by a central processing unit (CPU) of the adapter, the cache manager cooperating with a file array driver associated with a client to implement various caching strategies using each of a host cache and an adapter cache.

11. The system of claim 10 wherein the adapter further comprises a non-volatile random access memory (NVRAM) coupled to the adapter CPU.

12. The system of claim 11 wherein the server file system further comprises a NVRAM manager executed by the adapter CPU, the NVRAM manager interacting with the cache manager to share the NVRAM as a cache for user data and metadata.

13. The system of claim 12 further comprising a first communications manager executing on the host computer and interfacing with a file system of the client to transport the I/O request over a low-latency bus to the adapter.

14. The system of claim 13 further comprising a second communications manager executing on the adapter and interfacing with the server file system to receive the I/O request from the low-latency bus.

15. A distributed storage architecture executing on a host computer coupled to an adapter and having a console, comprising:

a graphical user interface associated with the console for entering parameters, the parameters specifying a size of a file system and an organization of the storage devices coupled to channels of the adapter;

a translator that translates the parameters into operations instructing an input/output (I/O) subsystem executing on the adapter to transform the storage devices from a present organization to the specified organization;

means for transforming each file stored on the present organization of storage devices to a file stored on the specified organization of storage devices during execution of the distributed storage architecture system; and

wherein the storage devices comprise disks and wherein the I/O subsystem comprises a channel manager for implementing protocols over a channel of the adapter that enable communication between the disks and the adapter.

16. The system of claim 15 wherein the I/O subsystem further comprises a hardware abstraction layer that manipulates port interface circuitry coupling the adapter to the disks.

17. The system of claim 16 wherein the I/O subsystem further comprises a container manager that manages containers of the file system, the containers constituting logical units of storage for the file system and unit of organization of data on the disks, thereby enabling efficient mapping of file system addresses to disk addresses.

18. A computer-readable medium including program instructions executing on a computer for configuring storage devices from a console of a data processing system having a distributed storage architecture executing on a host computer coupled to an adapter, the program instructions performing the steps of:

receiving parameters through a graphical user interface of the console, the parameters specifying a size of a file system and an organization of the storage devices;

translating the parameters into operations instructing an input/output (I/O) subsystem to transform the storage devices from a present organization to the specified organization;

transforming each file stored on the present organization of storage devices to a file stored on the specified organization of storage devices during execution of the distributed storage architecture system; and

wherein the organization of the storage devices includes one of a mirror set, a stripe set and a redundant array of independent disks.

19. The computer-readable medium of claim 18 further comprising the step of, if the write request is directed to a file being transformed:

logging an extent of the transformation of each file stored on the present organization of storage devices to a file stored on the specified organization of storage devices using a bit map data structure; and

storing the bit map structure in a cache memory of the data processing system.

20. The computer-readable medium of claim 19 wherein the cache memory is a non-volatile random access memory.

21. The computer-readable medium of claim 19 further comprising the step of, if the write request is directed to a file that has yet to be transformed:

marking a bit map data structure with a high-water mark to indicate an extent to which the present organization of storage devices has been morphed; and

storing the bit map structure in a cache memory of the data processing system.

22. The computer readable medium of claim 21 wherein the cache memory is a non-volatile random access memory.

23. A computer-readable medium including program instructions executing on a computer for configuring storage devices from a console of a data processing system having a distributed storage architecture executing on a host computer coupled to an adapter, the program instructions performing the steps of:

receiving parameters through a graphical user interface of the console, the parameters specifying a size of a file system and an organization of the storage devices;

translating the parameters into operations instructing an input/output (I/O) subsystem to transform the storage devices from a present organization to the specified organization;

transforming each file stored on the present organization of storage devices to a file stored on the specified organization of storage devices during execution of the distributed storage architecture system; and

receiving a transaction request at the file system; and

if the transaction request is a read request, directing the read request to the present organization of the storage devices.

24. The computer-readable medium of claim 23 further comprising the step of, if the transaction request is a write request, determining if the write request is directed to a file being transformed.

25. The computer-readable medium of claim 24 further comprising the steps of:

if the write request is directed to a file being transformed, directing the write request to the present and specified organizations of the storage devices; and

if the write request is directed to a file that has yet to be transformed, directing the write request to the specified organization of the storage devices.