Redundant SAS storage virtualization subsystem and system using the same and method therefor

• US 10,191,669 B2
• Filed: 10/04/2016
• Issued: 01/29/2019
• Est. Priority Date: 12/21/2004
• Status: Active Grant

• Current Assignee: Infortrend Technology Incorporated (Infortrend Corporation)
• Original Assignee: Infortrend Technology Incorporated (Infortrend Corporation)
• Inventors: Pang, Ching-Te, Schnapp, Michael Gordon, Sue, Shiann-Wen, Lee, Cheng-Yu
• Primary Examiner(s): Unelus, Ernest
• Application Number:
  US15/284,551
• Publication Number:
  US 20170024151A1
• Time in Patent Office: 847 Days
• CPC Class Codes: G06F 11/2041 with more than one idle spare processing component
• CPC Class Codes: G06F 11/2089 Redundant storage control functionality
• CPC Class Codes: G06F 11/2092 Techniques of failing over between control units
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 3/0617 in relation to availability
• CPC Class Codes: G06F 3/0635 by changing the path, e.g. traffic rerouting, path reconfiguration
• CPC Class Codes: G06F 3/0664 at device level, e.g. emulation of a storage device or system
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

A redundant external storage virtualization computer system. The redundant storage virtualization computer system includes a host entity for issuing an IO request, a redundant external SAS storage virtualization controller pair coupled to the host entity for performing an IO operation in response to the IO request issued by the host entity, and a plurality of physical storage devices for providing storage to the computer system. Each of the physical storage devices is coupled to the redundant storage virtualization controller pair through a SAS interconnect. The redundant storage virtualization controller pair includes a first and a second SAS storage virtualization controller both coupled to the host entity. In the redundant SAS storage virtualization controller pair, when the second storage virtualization controller is not on line, the first storage virtualization controller will take over the functionality originally performed by the second storage virtualization controller.

Claims

1. A redundant storage virtualization subsystem (SVS) for providing data storage space, comprising:

a redundant external storage virtualization controller (SVC) pair which are for performing IO operations in response to IO requests from a host entity, and comprise a first external SVC and a second external SVC both for coupling to the host entity; and

a group of physical storage devices (PSDs) for providing data storage space to the host entity, in which at least one member of said group of PSDs is coupled to the said redundant external SVC pair through a serial signal interconnect for transmission with serial attached small computer system interface-(SAS) protocol, in which each of the PSDs is a hard disk drive (HDD) or a solid state drive (SSD);

wherein in the redundant external SVC pair, each of the external SVCs further comprises;

a central processing circuitry for performing the IO operations in response to the IO requests;

at least one IO device interconnect controller coupled to said central processing circuitry;

at least one host-side IO device interconnect port provided in one of said at least one IO device interconnect controller for coupling to said host entity; and

at least one SAS device-side IO device interconnect port provided in one of said at least one IO device interconnect controller coupled to said PSDs through said serial-signal interconnect;

wherein when one SVC in said redundant external SVC pair is not on line or goes off line after being on line, the alternate SVC in said redundant external SVC pair will automatically take over the functionality originally performed by said one SVC in the redundant external SVC pair;

wherein an inter-controller communication channel (ICC) is provided between the two SVCs in said redundant external SVC pair for communicating state synchronization information;

wherein said inter-controller communication channel is to exchange parameters and data relating to operation of the redundant storage virtualization subsystem;

wherein said first external SVC and said second external SVC are configured to define at least one virtualized logical media unit (LMU) consisting of sections of said group of PSDs, and are configured to provide a mapping that maps combination of the sections of said group of PSDs to the at least one virtualized LMU visible to the host entity, and the at least one virtualized LMU is contiguously addressable by the host entity to which the at least one virtualized LMU is made available;

wherein the IO requests are parsed to determine what operation is to be performed and on which sections of the virtualized LMU the operation is to be performed;

wherein when the operation comprises internally-emulated, asynchronous device sub-operations, then the SVC executes the associated sub-operations including transferring any associated data to/from the host entity, and wherein when there is a failed operation, the SVC responds to the host entity with a status report indicating that the operation failed;

wherein when one of the SVC pair detects a malfunction of the other SVC, the one SVC monitors a state of the SVS to determine whether to send a signal to the malfunctioning SVC; and

wherein said redundant external SVC pair are alive and perform an IO request rerouting function such that when one of said redundant external SVC pair, both of which are alive, receives one of the I/O requests accessing the at least one virtualized LMU, then the I/O request is dispatched through the one SVC or the other SVC to access the at least one virtualized LMU.

2. The redundant SVS of claim 1, further comprising providing an access ownership transferring mechanism for said SVC and the alternate SVC in the said redundant external SVC pair to cooperatively transfer access ownership back and forth therebetween;

and wherein the SVC is configured to perform the access ownership transferring mechanism such that when the storage virtualization controller receives the I/O requests accessing the at least one LMU and has no access ownership of the at least one LMU, the SVC is configured to get the access ownership from the alternate SVC which has the access ownership of the at least one LMU, and then the SVC is configured to process the IO requests to access the at least one LMU.

3. The redundant SVS of claim 1, further comprising an enclosure management services mechanism for managing and monitoring a device belonging to an enclosure of the SVS, and the device excludes said group of PSDs.

4. The redundant SVS of claim 1, wherein said group of PSDs are received in a plurality of enclosures.

5. The redundant SVS of claim 1, wherein when the operation comprises a synchronous device sub-operation, a device-side IO request is generated and issued to appropriate PSDs in response.

6. The redundant SVS of claim 1, wherein when a write IO request of the IO requests from the host entity is received by the SVC, a write IO request complete report is first issued to the host entity by the SVC before data of the write IO request is actually committed into the PSDs.

7. The redundant SVS of claim 1, wherein said redundant external SVC pair are alive and perform an IO request rerouting function such that when one of said redundant external SVC pair, both of which are alive, receives the I/O requests accessing the at least one virtualized LMU and is determined not to have an access ownership that allows to access the at least one virtualized LMU, the one SVC will pass the IO requests, via the inter-controller communication interconnect (ICC), to the other of said redundant external SVC pair, which is determined to have the access ownership that allows to access the at least one virtualized LMU, and the other SVC will process the IO requests to access the at least one virtualized LMU and send an I/O request execution completion status information to the receiving SVC.

8. The redundant SVS of claim 1, wherein for each of said PSDs, the redundant SVS further comprises an access control switch coupled between each of said PSDs and the redundant external SVC pair for selectively switching the connection of each of said PSDs to the redundant external SVC pair between the first external SVC and the second external SVC.

9. The redundant SVS of claim 8, wherein said access control switch coupled between one of said PSDs and the redundant external SVC pair selectively allows patching through of the serial signal of said one PSD to and from the first external SVC when in a first patching state of said access control switch and to and from the second external SVC when in a second patching state of said access control switch.

10. The redundant SVS of claim 1, wherein one of said host-side IO device interconnect port and one of said SAS device-side IO device interconnect port are provided in a same said IO device interconnect controller.

11. The redundant SVS of claim 1, wherein said at least one IO device interconnect controller comprises a plurality of IO device interconnect controllers;

wherein one of said host-side IO device interconnect port and one of said SAS device-side IO device interconnect port are provided in different said IO device interconnect controllers.

12. The redundant SVS of claim 1, wherein a logical media unit that is presented to said host entity through a first said host-side IO device interconnect port is also redundantly presented to said host entity through a second said host-side IO device interconnect port in order to make the host entity maintain access to the PSD even if one of the interconnects breaks, becomes blocked or malfunctions.

13. The redundant SVS of claim 12, wherein the first said host-side IO device interconnect port and the second said host-side IO device interconnect port are IO device interconnect ports of the same one SVC in the redundant external SVC pair.

14. The redundant SVS of claim 12, wherein the first said host-side IO device interconnect port is an IO device interconnect port of one SVC in the redundant external SVC pair and the second said host-side IO device interconnect port is an IO device interconnect port of the other SVC in the redundant external SVC pair.

15. The redundant SVS of claim 12, wherein the first said host-side IO device interconnect port and the second said host-side IO device interconnect port are coupled to the same host-side IO device interconnect.

16. The redundant SVS of claim 15, wherein the first said host-side IO device interconnect port and the second said host-side IO device interconnect port are coupled to the said same host-side IO device interconnect through a switch circuit.

17. The redundant SVS of claim 12, wherein the first said host-side IO device interconnect port and the second said host-side IO device interconnect port are each coupled to a different host-side IO device interconnect.

18. The redundant SVS of claim 1, wherein said host-side IO device interconnect port comprises one of the following types:

Fibre Channel supporting point-to-point connectivity in target mode, Fibre Channel supporting public loop connectivity in target mode, Fibre Channel supporting private loop connectivity in target mode, parallel SCSI (Small Computer System Interface) operating in target mode, ethernet supporting the iSCSI (Internet Small Computer System Interface) protocol operating in target mode, SAS (Serial Attached Small Computer System Interface) operating in target mode, Serial ATA (Serial Advanced Technology Attachment) operating in target mode, IEEE 1394A/IEEE 1394B, and, USB/USB (Universal Serial Bus) 2.0.

19. The redundant SVS of claim 1, wherein said inter-controller communication channel is an existing IO device interconnect, whereby inter-controller communication exchange is multiplexed with IO requests and associated data.

20. The redundant SVS of claim 1, wherein said inter-controller communication channel is a dedicated channel the primary function thereof is to exchange said state synchronization information.

21. The redundant SVS of claim 1, wherein said inter-controller communication channel comprises one of the following types Fibre Channel, Serial ATA (Serial Advanced Technology Attachment), Parallel SCSI (Serial Advanced Technology Attachment), Ethernet, SAS (Serial Attached SCSI), I2C (Inter-Integrated Circuit), and, PCI-Express (Peripheral Component Interconnect Express).

22. The redundant SVS of claim 1, wherein said group of PSDs include a first set of PSDs and a second set of PSDs, and said first set of PSDs and said second set of PSDs are not received in a same enclosure, and at least one member SVC of said redundant external SVC pair includes at least one expansion port for coupling to said second set of PSDs in a second enclosure through at least one external cable.

23. The redundant SVS of claim 22, wherein members of a set of at least one said expansion port are mutually coupled together and to said second set of PSDs through a switch circuit.

24. The redundant SVS of claim 22, wherein a set of at least two said expansion ports form a redundant expansion port set for mutually performing IO request rerouting function whereby IO requests normally delivered to said second set of PSDs through a first member port of said redundant expansion port set may be rerouted through a second member port of said redundant expansion port set.

25. The redundant SVS of claim 22, wherein a member of said second set of PSDs has a pair of redundant ports with a member port of said redundant port pair being coupled to a set of at least one said expansion port.

26. The redundant SVS of claim 25, wherein the IO request rerouting function is performed through said redundant ports of said member of said second set of PSDs whereby IO requests normally delivered to said second set of PSDs through a first member port of said redundant port pair may be rerouted to said second set of PSDs through a second member port of said redundant port pair.

27. The redundant SVS of claim 26, wherein a set of at least two said expansion ports form a redundant expansion port set for mutually performing IO request rerouting function whereby IO requests normally delivered to said second set of PSDs through a first member port of said redundant expansion port set may be rerouted through a second member port of said redundant expansion port set.

28. The redundant SVS of claim 25, wherein each member port in said PSD redundant port pair is coupled to a different set of at least one expansion port.

29. The redundant SVS of claim 25, wherein said member port of redundant PSD port pair and said set of at least one said expansion port are mutually coupled together through a switch circuit.

30. The redundant SVS of claim 29, wherein said set of at least one expansion port comprises a first and a second expansion port subset forming a pair of complementary subsets with at least one member expansion port per subset.

31. The redundant SVS of claim 30, wherein one of the interconnect signal line switching mechanisms implemented by said switch circuit is the coupling of said first subset of the said complementary subset pair to a first member port of said PSD redundant port pair and coupling of said second subset of the said complementary subset pair to a second member port of said PSD redundant port pair.

32. The redundant SVS of claim 31, wherein one of the interconnect signal line switching mechanisms implemented by said switch circuit is the coupling of both subsets of the said complementary subset pair to a first member port of said PSD redundant port pair.

33. The redundant SVS of claim 31, wherein one of the interconnect signal line switching mechanisms implemented by said switch circuit is the coupling of said first subset of the said complementary subset pair to a first member port of said PSD redundant port pair.

34. The redundant SVS of claim 25, wherein a member SVC of the redundant external SVC pair further comprises at least two said expansion ports forming a redundant expansion port set.

35. The redundant SVS of claim 34, wherein a first and a second member port in the said redundant expansion port set are each coupled to a different one of member ports in redundant PSD port pair of a member PSD of said second set of PSDs.

36. The redundant SVS of claim 34, wherein a first and a second member port in the said redundant expansion port set are both coupled to the same one of member ports in redundant PSD port pair of a member PSD of said second set of PSDs.

37. The redundant SVS of claim 25 comprising:

a first expansion port set comprising at least one said expansion port on the first external SVC in the redundant external SVC pair;

a second expansion port set comprising at least one said expansion port on the second external SVC in the redundant external SVC pair;

wherein said first expansion port set and said second expansion port set together form a redundant expansion port set pair.

38. The redundant SVS of claim 37, wherein said first expansion port set and said second expansion port set are each coupled to a different one of member ports in redundant PSD port pair of each PSD of said second set of PSDs.

39. The redundant SVS of claim 37, wherein said first expansion port set and said second expansion port set are both coupled to the same one of member ports in redundant PSD port pair of each PSD of said second set of PSDs.

40. The redundant SVS of claim 22, wherein at least one said expansion port is Fibre Channel, Serial ATA, Parallel SCSI, Ethernet, SAS, IEEE1394A/IEEE1394B, and, USB/USB2.0.

41. The redundant SVS of claim 1, wherein said group of PSDs comprise one of the following PSD types:

a SAS (Serial Attached SCSI) PSD, a SATA (Serial Advanced Technology Attachment) PSD, and a PATA (Parallel Advanced Technology Attachment) PSD.

42. The redundant SVS of claim 1, wherein each SVC in said redundant external SVC pair includes a state-defining circuit for forcing externally connected signal lines of alternate SVC in said redundant external SVC pair to a predetermined state.

43. The redundant SVS of claim 1, wherein each SVC of said redundant external SVC pair includes a self-killing circuit for forcing its own externally connected signal lines to a predetermined state.

44. An external storage virtualization controller (SVC) for using in a redundant external SVC pair of a redundant storage virtualization subsystem (SVS), said external storage virtualization controller comprising:

a central processing circuitry for performing IO operations in response to IO requests from a host entity;

at least one IO device interconnect controller coupled to said central processing circuitry;

at least one host-side IO device interconnect port provided in one of said at least one IO device interconnect controller for coupling to said host entity; and

at least one serial attached small computer system interface (SAS) device-side IO device interconnect port provided in one of said at least one IO device interconnect controller for performing serial signal transmission with SAS protocol with a group of PSDs, in which each of the PSDs is a hard disk drive (HDD) or a solid state drive (SSD);

wherein the said external SVC will automatically take over the functionality originally performed by the alternate external SVC in the said redundant external SVC pair when said alternate external SVC is not on line or goes off line after being on line;

wherein an inter-controller communication channel is provided between the two SVCs in said redundant external SVC pair for communicating state synchronization information;

wherein said inter-controller communication channel is to exchange parameters and data relating to operation of a redundant storage virtualization subsystem;

wherein said two SVCs are configured to define at least one virtualized logical media unit (LMU) consisting of sections of said group of PSDs, and are configured to provide a mapping that maps combination of the sections of said group of PSDs to the at least one virtualized LMU visible to the host entity, and the at least one virtualized LMU is contiguously addressable by the host entity to which the at least one virtualized LMU is made available; and

wherein the IO requests are parsed to determine what operation is to be performed and on which sections of the virtualized LMU the operation is to be performed;

wherein when the operation comprises internally-emulated, asynchronous device sub-operations, then the SVC executes the associated sub-operations including transferring any associated data to/from the host entity, and wherein when there is a failed operation, the SVC responds to the host entity with a status report indicating that the operation failed;

wherein when one of the SVC pair detects a malfunction of the other SVC, the one SVC monitors a state of the SVS to determine whether to send a signal to the malfunctioning SVC; and

wherein said redundant external SVC pair are alive and perform an IO request rerouting function such that when one of said redundant external SVC pair, both of which are alive, receives one of the I/O requests accessing the at least one virtualized LMU, then the I/O request is dispatched through the one SVC or the other SVC to access the at least one virtualized LMU.

45. The SVC of claim 44 further comprising a detection mechanism for detecting an off-line or failed state of said alternate SVC.

46. The SVC of claim 44, wherein said SVC includes a state-defining circuit for forcing externally connected signal lines of alternate SVC in said redundant external SVC pair to a predetermined state.

47. The SVC of claim 44, wherein said SVC includes a self-killing circuit for forcing its own externally connected signal lines to a predetermined state.

48. The SVC of claim 44, wherein an inter-controller communication port is provided for communicating state synchronization information between the said SVC and the alternate SVC in said redundant external SVC pair.

49. The SVC of claim 48, wherein said inter-controller communication port comprises one of the following types:

Fibre Channel, Serial ATA (Serial Advanced Technology Attachment), Parallel SCSI (Small Computer System Interface), Ethernet, SAS (Serial Attached Small Computer System Interface), I2C, and PCI-Express (Peripheral Component Interconnect Express).

50. A method for performing storage virtualization in a computer system having a first and a second external storage virtualization controller (SVC) configured into a redundant external SVC pair, where each of said first and second external SVC comprises:

a central processing circuitry for performing IO operations in response to IO requests from a host entity;

at least one IO device interconnect controller coupled to said central processing circuitry(CPC);

at least one host-side IO device interconnect port provided in one of said at least one IO device interconnect controller for coupling to said host entity; and

at least one serial attached small computer system interface (SAS) device-side IO device interconnect port provided in one of said at least one IO device interconnect controller for performing serial-signal transmission with SAS protocol with a group of PSDs, the method comprising;

in response to the IO requests from the host entity of the computer system, performing the IO operations, by said CPC of one SVC in said redundant external SVC pair, to access said group of PSDs of the computer system using serial signal transmission with SAS protocol, in which each of the PSDs is a hard disk drive (HDD) or a solid state drive (SSD);

when said one SVC in said redundant external SVC pair is not on line or goes off line after being on line, performing, by said CPC of the alternate SVC in said redundant external SVC pair, the said IO operations in response to said IO requests issued by said host entity to access said group of PSDs of the computer system;

wherein an inter-controller communication channel is provided between the two SVCs in said redundant external SVC pair for communicating state synchronization information;

wherein said inter-controller communication channel is to exchange parameters and data relating to operation of a redundant storage virtualization subsystem;

wherein said first and second external SVC are configured to define at least one virtualized logical media unit (LMU) consisting of sections of said group of PSDs, and are configured to provide a mapping that maps combination of the sections of said group of PSDs to the at least one virtualized LMU visible to the host entity, and the at least one virtualized LMU is contiguously addressable by the host entity to which the at least one virtualized LMU is made available; and

wherein the IO requests are parsed to determine what operation is to be performed and on which sections of the virtualized LMU the operation is to be performed;

wherein when the operation comprises internally-emulated, asynchronous device sub-operations, then the SVC executes the associated sub-operations including transferring any associated data to/from the host entity, and wherein when there is a failed operation, the SVC responds to the host entity with a status report indicating that the operation failed;

wherein when one of the SVC pair detects a malfunction of the other SVC, the one SVC monitors a state of the computer system to determine whether to send a signal to the malfunctioning SVC;

wherein said alternate SVC will automatically take over the functionality originally performed by said one of the SVCs when said one SVC is not on line or goes off line after being on line; and

wherein said redundant external SVC pair are alive and perform an IO request rerouting function such that when one of said redundant external SVC pair, both of which are alive, receives one of the I/O requests accessing the at least one virtualized LMU, then the I/O request is dispatched through the one SVC or the other SVC to access the at least one virtualized LMU.