High speed information processing and mass storage system and method, particularly for information and application servers

• US 7,263,476 B1
• Filed: 06/12/2000
• Issued: 08/28/2007
• Est. Priority Date: 06/12/2000
• Status: Expired due to Fees

• Current Assignee: QUAD Research
• Original Assignee: QUAD Research
• Inventors: Dellacona, Richard
• Primary Examiner(s): Rodriguez; Paul
• Assistant Examiner(s): Thangavelu; Kandasamy
• Application Number:
  US09/592,572
• Time in Patent Office: 2,633 Days
• Field of Search: 703/27, 703/13, 711/14, 711/114, 711/154, 711/207, 711/1, 711/112, 711/200, 712/11, 708/517, 708/320, 714/48, 714/64, 714/4, 714/5, 710/38, 710/315, 370/455, 370/258, 370/222, 600/508, 398/5, 361/684, 361/695, 340/507
• US Class Current: 703/13
• CPC Class Codes: G06F 11/2007 using redundant communication media
• CPC Class Codes: G06F 11/201 between storage system components
• CPC Class Codes: G06F 3/0613 in relation to throughput
• CPC Class Codes: G06F 3/0635 by changing the path, e.g. traffic rerouting, path reconfiguration
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

A high speed, microcomputer based, Fibre Channel compatible and fault tolerant information processing and mass storage system especially suited for information servers and application servers. A unique and extremely versatile system architecture, including a dual loop arbitrated, Fibre Channel capable, multiple-fault tolerant, hot-swappable mass storage disk array, permits combinations of servers and mass storage arrays which can be tailored for a wide variety of applications and which can be configured with emphasis on the system characteristics such as redundancy, speed, processing capability, storage capability, and the like, as desired. A unique backplane and/or midplane arrangement for connecting the system components allows for easy and, in most cases, on-line field upgrading and/or service and at the same time provides for the very effective cooling of components, particularly those such as disk drives which tend to produce a lot of heat.

Claims

1. A high speed mass storage system which is readily expandable to increase its storage capacity while the system is in operation comprising:

a first server including a first controller and at least one first computer connected in communication with said first controller, each said at least one first computer including at least one CPU;

a second server including a second controller and at least one second computer connected in communication with said second controller, each said at least one second computer including at least one CPU;

first and second mass storage modules each including;

(a) a plurality of plug-in storage devices for storing information;

(b) a storage device bypass circuit board associated with each storage device, each storage device being plugged into a connector on the storage device bypass circuit board, and each of said storage device bypass circuit boards of said first and second mass storage modules including first and second electronic switches, each of said first and second electronic switches including input and output electrical connections to said first and second controllers, respectively, each of said first and second electronic switches including input and output electrical connections to a corresponding one of said plug-in storage devices, and a fault signal output produced by said corresponding one of said plurality of storage devices being connected to each of said first and second electronic switches to control switching of said first and second electronic switches to alternatively route signals from and to said first and second controllers to and from said corresponding one of said plurality of storage devices, or to bypass said corresponding one of said plurality of storage devices;

(c) a module bypass circuit board including an optical input/output connector for outputting electrical signals from the module as light signals and for inputting light signals into the module as electrical signals, and wherein the optical input/output connectors of the module bypass circuit boards of the first and second mass storage modules are connected by a fiber optic transmission medium such that signals are communicated between the first and second mass storage modules in the form of light;

said first controller providing a communication path between the first server and each said storage device through its associated storage device bypass circuit board and through the module bypass circuit board, said second controller providing a communication path between the second server and each said storage device through its associated storage device bypass circuit board and the module bypass circuit board; and

at least one of said servers being operative to establish direct communication between the first and second controllers, and said first and second controllers being operative to maintain direct communication between the first and second controllers independent of said at least one first computer of said first server and said at least one second computer of said second server.

2. The high speed mass storage system of claim 1 wherein each storage device bypass circuit board completes the connection of the at least one first computer or the at least one second computer with the other storage device bypass circuits and their associated storage devices whether or not the storage device is present.

3. The high speed mass storage system of claim 1 wherein each said module bypass circuit board outputs electrical signals from the corresponding mass storage module via the optical input/output connector when light signals are received by said optical input/output connector.

4. The high speed mass storage system of claim 1 wherein the module bypass circuit board of the first mass storage module outputs electrical signals from the first mass storage module to the second mass storage module via the optical input/output connector when light signals are received from the second mass storage module by said optical input/output connector.

5. The high speed mass storage system of claim 1 wherein each said mass storage module includes a storage device bypass board connector for each of the storage device bypass circuit boards with an opening between each connector to permit the flow of air between the connectors and alongside the bypass circuit boards and storage devices for cooling purposes.

6. The high speed mass storage system of claim 1 wherein the storage devices are disk drives and the storage device bypass circuit boards are disk drive bypass circuit boards each having a connector to receive a disk drive.

7. The high speed mass storage system of claim 6 wherein each said mass storage module includes a disk drive bypass circuit board connector for each of the drive bypass circuit boards with an opening between each connector to permit the flow of air between the connectors, and wherein each drive bypass circuit board is a relatively flat circuit board with a connector on opposite edges, wherein one of the connectors is the connector which receives the disk drive and the other connector connects to said drive bypass circuit board connector, said connectors, bypass circuit boards and drives being arranged such that when they are connected there is a path for air flow from outside the module alongside each bypass circuit board and its associated disk drive for cooling purposes without any backplane obstruction.

8. The high speed mass storage system of claim 7 wherein each said mass storage module is housed in an enclosure and at least one fan is mounted to force air from outside said enclosure through the spaces between said bypass boards and drives.

9. The high speed mass storage system of claim 1 wherein the controller operates with a Fibre Channel protocol.

10. The high speed mass storage system of claim 1 wherein the controller is an arbitrated dual channel Fibre Channel controller.

11. The high speed mass storage system of claim 9 wherein each storage device is a disk drive and wherein each storage device bypass circuit board comprises a disk drive bypass circuit board including a circuit which completes the connection of the at least one first computer or the at least one second computer with the other drive bypass circuits and their associated disk drives whether or not the disk drive is present.

12. The high speed mass storage system of claim 11 wherein the module bypass circuit board outputs electrical signals from each said mass storage module via the optical input/output connector when light signals are received by said optical input/output connector.

13. The high speed mass storage system of claim 11 wherein each said mass storage module includes a disk drive bypass circuit board connector for each of the disk drive bypass circuit boards with an opening between each connector to permit the flow of air between the connectors, and wherein each disk drive bypass circuit board is a relatively flat circuit board with a connector on opposite edges, wherein one of the connectors is the connector which receives the disk drive and the other connector connects to said disk drive bypass circuit board connector, said connectors, bypass circuit boards and drives being arranged such that when they are connected there is a path for air flow from outside each said mass storage module alongside each bypass circuit board and its associated disk drive for cooling purposes without any backplane obstruction.

14. The high speed mass storage system of claim 13 wherein each said mass storage module is housed in an enclosure and at least one fan is mounted to force air from outside said enclosure through the spaces between said bypass boards and drives.

15. The high speed mass storage system of claim 10 wherein the storage devices are disk drives and the storage device bypass circuit boards are disk drive bypass circuit boards, and wherein the at least one module includes a disk drive bypass board connector for each of the disk drive bypass circuit boards with an opening between each connector to permit the flow of air between the connectors and alongside the bypass circuit boards and disk drives for cooling purposes.

16. The high speed mass storage system of claim 1 wherein each of said module bypass circuit boards of said first and second mass storage modules include first and second electronic switches, each of said first and second electronic switches including input and output electrical connections to said first and second controllers, each of said first and second electronic switches including input and output electrical connections to said optical input/output connector, and a signal detect output produced by said optical input/output connector being connected to each of said first and second electronic switches to control switching of said first and second electronic switches to alternatively route signals from and to said first and second controllers to and from a corresponding one of said first and second mass storage modules, or to bypass said corresponding one of said first and second mass storage modules.

17. A high speed mass storage system adapted to be readily expandable to increase its capacity while the system is in operation comprising:

a first server including a first controller and at least one first computer connected in communication with said first controller, each said at least one first computer including at least one CPU;

a second server including a second controller and at least one second computer connected in communication with said second controller, each said at least one second computer including at least one CPU;

first and second mass storage modules each including;

(a) a plurality of plug-in disk drives for storing information;

(b) a disk drive bypass circuit board associated with each disk drive and including a disk drive connector at one edge thereof and a bypass board connector at another edge thereof, each disk drive being plugged into said disk drive connector on the disk drive bypass circuit board, each of said disk drive bypass circuit boards of said first and second mass storage modules including first and second electronic switches, each of said first and second electronic switches including input and output electrical connections to said first and second controllers, respectively, each of said first and second electronic switches including input and output electrical connections to a corresponding one of said plug-in disk drives, and a fault signal output produced by said corresponding one of said plurality of disk drives being connected to each of said first and second electronic switches to control switching of said first and second electronic switches to alternatively route signals from and to said first and second controllers to and from said corresponding one of said plurality of disk drives, or to bypass said corresponding one of said plurality of disk drives;

(c) a module bypass circuit board including an optical input/output connector for outputting electrical signals from the module as light signals and for inputting light signals into the module as electrical signals, and wherein the optical input/output connectors of the module bypass circuit boards of the first and second mass storage modules are connected by a fiber optic transmission medium such that signals are communicated between the modules in the form of light, each of said module bypass circuit boards of said first and second mass storage modules including first and second electronic switches, each of said first and second electronic switches including input and output electrical connections to said first and second controllers, respectively, each of said first and second electronic switches including input and output electrical connections to said optical input/output connector, and a signal detect output produced by said optical input/output connector being connected to each of said first and second electronic switches to control switching of said first and second electronic switches to alternatively route signals from and to said first and second controllers to and from a corresponding one of said first and second mass storage modules, or to bypass said corresponding one of said first and second mass storage modules;

said first controller connecting the at least one first computer of the first controller with each said disk drive through its associated drive bypass circuit board and through the module bypass circuit board such that a loop is formed between the output and input of the first controller with each disk drive bypass circuit board and the module bypass circuit board in said loop and completing said loop whether or not a disk drive is plugged into the disk drive connector; and

said second controller connecting the at least one second computer of the second controller with each said disk drive through its associated drive bypass circuit board and through the module bypass circuit board; and

at least one of said first and second servers being operative to establish direct communication between the first and second controllers, and said first and second controllers being operative to maintain direct communication between the first and second controllers independent of said at least one first computer of said first server and said at least one second computer of said second server.

18. The high speed mass storage system of claim 17, wherein said module bypass circuit board of said first mass storage module completes said loop through the second module.

19. The high speed mass storage system of claim 17 wherein the module bypass circuit board outputs electrical signals from each said mass storage module via the optical input/output connector when light signals are received by said optical input/output connector.

20. The high speed mass storage system of claim 17 wherein the module bypass circuit board of each said mass storage module outputs electrical signals from the first mass storage module to the second mass storage module via the optical input/output connector when light signals are received from the second mass storage module by said optical input/output connector.

21. The high speed mass storage system of claim 17 wherein each said mass storage module includes a drive bypass board connector for each of the drive bypass circuit boards with an opening between each connector to permit the flow of air between the connectors and alongside the bypass circuit boards and disk drives for cooling purposes.

22. The high speed mass storage system of claim 17 wherein each said mass storage module includes a drive bypass circuit board connector for each of the drive bypass circuit boards, and wherein each drive bypass circuit board is a relatively flat circuit board with a connector on opposite edges, wherein one of the connectors is the connector which receives the disk drive and the other connector connects to said drive bypass circuit board connector, said connectors, bypass circuit boards and drives being arranged such that when they are connected there is a path for air flow from outside each said mass storage module alongside each bypass circuit board and its associated disk drive for cooling purposes without any backplane obstruction.

23. The high speed mass storage system of claim 22 wherein each said mass storage module is housed in an enclosure and at least one fan is mounted to force air from outside said enclosure through the spaces between said bypass boards and drives.

24. The high speed mass storage system of claim 23 wherein each drive bypass circuit board connector is mounted in the same plane in spaced relationship with each other.

25. The high speed mass storage system of claim 17 wherein the controller operates with a Fibre Channel protocol.

26. The high speed mass storage system of claim 17 wherein the controller is an arbitrated dual channel Fibre Channel system.

27. The high speed mass storage system of claim 26 wherein each drive bypass circuit board completes the connection of the at least one first computer or the at least one second computer with the other drive bypass circuits and their associated disk drives whether or not the disk drive is present.

28. The high speed mass storage system of claim 26 wherein the module bypass circuit board outputs electrical signals from each said mass storage module via the optical input/output connector when light signals are received by said optical input/output connector.

29. The high speed mass storage system of claim 26 wherein each said mass storage module includes a drive bypass board connector for each of the drive bypass circuit boards with an opening between each connector to permit the flow of air between the connectors and alongside the bypass circuit boards and disk drives for cooling purposes.

30. The high speed mass storage system of claim 26 wherein each said mass storage module includes a drive bypass circuit board connector for each of the drive bypass circuit boards with an opening between each connector to permit the flow of air between the connectors, and wherein each drive bypass circuit board is a relatively flat circuit board with a connector on opposite edges, wherein one of the connectors is the connector which receives the disk drive and the other connector connects to said drive bypass circuit board connector, said connectors, bypass circuit boards and drives being arranged such that when they are connected there is a path for air flow from outside each said mass storage module alongside each bypass circuit board and its associated disk drive for cooling purposes without any backplane obstruction.

31. The high speed mass storage system of claim 30 wherein each said mass storage module is housed in an enclosure and at least one fan is mounted to force, air from outside said enclosure through the spaces between said bypass boards and drives.