High performance storage array interconnection fabric using multiple independent paths

• US 20030221018A1
• Filed: 12/18/2000
• Published: 11/27/2003
• Est. Priority Date: 12/18/2000
• Status: Active Grant

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Inventors: Wu, Chia Y., Lee, Whay S., Chong, Fay Jr., Talagala, Nisha D., Rettberg, Randall
• Granted Patent: US 7,401,161 B2
• Time in Patent Office: Days
• US Class Current: 709/249
• CPC Class Codes: H04L 12/56 Packet switching systems
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A storage array interconnection fabric may be configured using multiple independent paths. A storage system including a plurality of communication paths is configured for connecting each node of a plurality of nodes forming an interconnection fabric. Each of the communications paths is an independent communications path. In addition, a first portion of the plurality of nodes is configured to communicate with a plurality of mass storage devices such as disk drives. A second portion of the plurality of nodes may be configured to communicate with a host.

Claims

1. A storage system comprising:

a plurality of nodes;

one or more mass storage devices connected to each one of a first portion of said plurality of nodes respectively; and

an interconnection fabric configured for connecting each one of said plurality of nodes to every other one of said plurality of nodes;

wherein the interconnection fabric comprises a plurality of point-to-point connections between said plurality of nodes, wherein said interconnection fabric is configured to provide a plurality of independent communication paths between each one of said plurality of nodes to every other one of said plurality of nodes.

2. The storage system as recited in claim 1, wherein each node is configured to communicate with each other node by routing messages bi-directionally.

3. The storage system as recited in claim 1, wherein said mass storage devices comprise disk drives.

4. The storage system as recited in claim 1, wherein said mass storage devices comprise random access memories configured as storage cache.

5. The storage system as recited in claim 1, wherein said mass storage devices comprise tape drives.

6. The storage system as recited in claim 1, wherein said mass storage devices comprise optical storage drives.

7. The storage system as recited in claim 1, wherein each node is configured to communicate with each other node by routing messages uni-directionally.

8. The storage system as recited in claim 1, wherein a second portion of said plurality of nodes is configured to communicate with one or more host computers.

9. A method of interconnecting a plurality of nodes in a storage system, said method comprising:

connecting each node to each other node using a plurality of point-to-point connections;

forming an interconnection fabric comprising the nodes and said point-to-point connections;

a source node sending a first message to a destination node over a first communication path in said interconnection fabric;

said source node sending a second message to said destination node over a second communication path in said interconnection fabric, wherein said second communication path is independent from said first communication path;

said destination node interfacing to a mass storage device to respond to said first and second communications.

10. The method as recited in claim 9 further comprising nodes on said first and second communication path routing messages bi-directionally.

11. The method as recited in claim 9, wherein said mass storage devices comprise disk drives.

12. The method as recited in claim 9, wherein said mass storage devices comprise tape drives.

13. The method as recited in claim 9, wherein said mass storage devices comprise optical storage drives.

14. The method as recited in claim 9, wherein said storage devices comprise random access memories configured as cache memories for caching data stored in one or more mass storage devices.

15. The method as recited in claim 9 further comprising said source node interfacing to a host.

16. The method as recited in claim 9 further comprising nodes on said first and second communication path routing messages uni-directionally.

17. A method for routing communications within a storage system comprising a plurality of nodes interconnected by an interconnection fabric, the method comprising:

sending a communication from a source node to a destination node using a first communication path comprising one or more point-to-point connections between said source node, any intervening nodes, and said destination node;

detecting a failure in said first communication path; and

resending said communication from said source node to said destination node using a second communication path which is independent from said first communication path, wherein said second communication path comprises one or more point-to-point connections between said source node, any intervening nodes, and said destination node.

18. The method as recited in claim 17, further comprising:

detecting a failure in said second communication path; and

resending said communication from said source node to said destination node using a third communication path which is independent from said first and said second communication paths, wherein said third communication path comprises one or more point-to-point connections between said source node, any intervening nodes, and said destination node.

19. The method as recited in claim 18, further comprising:

detecting a failure in said third communication path; and

resending said communication from said source node to said destination node using a fourth communication path which is independent from said first, said second and said third communication paths, wherein said fourth communication path comprises one or more point-to-point connections between said source node, any intervening nodes, and said destination node.

20. The method as recited in claim 17 further comprising said destination node interfacing to a plurality of mass storage devices.

21. The method as recited in claim 17 further comprising said source node interfacing to a plurality of mass storage devices.