Storage virtualization computer system and external controller therefor

• US 10,452,270 B2
• Filed: 09/14/2012
• Issued: 10/22/2019
• Est. Priority Date: 07/02/2003
• Status: Active Grant

• Current Assignee: Infortrend Technology Incorporated (Infortrend Corporation)
• Original Assignee: Infortrend Technology Incorporated (Infortrend Corporation)
• Inventors: Liu, Ling-Yi, Lee, Tse-Han, Schnapp, Michael Gordon, Wang, Yun-Huei, Pao, Chung-Hua
• Primary Examiner(s): Unelus, Ernest
• Application Number:
  US13/615,653
• Publication Number:
  US 20130013827A1
• Time in Patent Office: 2,594 Days
• Field of Search: 710 74, 714 54
• CPC Class Codes: G06F 11/2089 Redundant storage control functionality
• CPC Class Codes: G06F 3/0607 by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
• CPC Class Codes: G06F 3/0611 in relation to response time
• CPC Class Codes: G06F 3/0617 in relation to availability
• CPC Class Codes: G06F 3/0658 Controller construction arrangements
• CPC Class Codes: G06F 3/0664 at device level, e.g. emulation of a storage device or system
• CPC Class Codes: G06F 3/0683 Plurality of storage devices
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

A storage virtualization computer system. The storage virtualization computer system comprises a host entity for issuing an IO request, a storage virtualization controller coupled to the host entity for executing IO operations in response to the IO request, and a at least one physical storage device, each coupled to the storage virtualization controller through a point-to-point serial-signal interconnect, for providing storage to the storage virtualization computer system through the storage virtualization controller. As an example, the point-to-point serial-signal interconnect can be a Serial ATA IO device interconnect.

Claims

1. A storage virtualization computer system comprising:

a host entity for issuing host IO requests;

an external storage virtualization controller (SVC) comprising at least one I/O controller and being coupled to said host entity for executing IO operations in response to said host IO requests; and

a group of physical storage devices (PSDs), each coupled to the external storage virtualization controller through a point-to-point serial-signal interconnect, for providing storage to the storage virtualization computer system through the external storage virtualization controller;

wherein said external storage virtualization controller is configured to define at least one logical media unit (LMU) consisting of sections of said group of PSDs;

wherein the host IO requests are parsed to determine what operation is to be performed and on which section(s) of the LMU the operation is to be performed; and

wherein when the operation comprises internally-emulated, asynchronous device sub-operations, then the external SVC executes the associated sub-operations including transferring any associated data to/from the host entity and then, when there is a failed operation, the external SVC generates a status report and responds to the host entity with the status report indicating the failed operation;

wherein the asynchronous device sub-operations comprise device-side IO requests to be sent to the PSDs, and when one of the device-side IO requests does not complete successfully, the SVC engages a backup operation that allows successful completion of the sub-operations, where when one of the PSDs is inaccessible, the backup operation includes generating at least one other device-side IO request to at least one media section that is different from a media section to be accessed by the one device-side IO request which does not complete successfully; and

wherein when one of the host IO requests from the host entity is received by the SVC, an IO complete report that the one of the host I/O requests is successfully complete is first issued to the host entity by the SVC before the SVC completes the operation performed on the section(s) of the LMU associated with said one host IO request.

2. The storage virtualization computer system of claim 1, wherein the operation further comprises a synchronous device sub-operation.

3. The storage virtualization computer system of claim 1, wherein said point-to-point serial-signal interconnect is a Serial Advanced Technology Attachment (SATA) IO device-side interconnect.

4. The storage virtualization computer system of claim 1, wherein said group of the PSDs comprises hard disk drives (HDDs) or solid state drives (SSDs).

5. The storage virtualization computer system of claim 1, wherein said group of the PSDs comprises Serial Advanced Technology Attachment (SATA) PSDs.

6. The storage virtualization computer system of claim 1, wherein said group of the PSDs comprises Parallel Advanced Technology Attachment (PATA) PSDs and a serial-to-parallel converter is provided between a device-side IO device interconnect controller and said PATA PSDs.

7. The storage virtualization computer system of claim 1, further comprising a detachable canister attached to said storage virtualization controller for containing one of said group of the PSDs therein.

8. The storage virtualization computer system of claim 1, wherein one of said group of the PSDs is detached from said storage virtualization controller when said storage virtualization controller is on-line.

9. The storage virtualization computer system of claim 1, wherein a new PSD is attached to said storage virtualization controller when said storage virtualization controller is on-line.

10. The storage virtualization computer system of claim 1, wherein said group of PSDs include a first set of PSDs and a second set of PSDs, said first set of PSDs and said external storage virtualization controller are in the same enclosure, said first set of PSDs and said second set of PSDs are not received in a same enclosure, and said external storage virtualization controller further comprises at least one multiple-device device-side expansion port for coupling to said second set of said PSDs.

11. The storage virtualization computer system of claim 1, wherein said storage virtualization controller comprises:

a central processing circuitry for performing IO operations in response to said host IO requests of said host entity;

at least one IO device interconnect controller coupled to said central processing circuitry;

at least one host-side IO device interconnect port provided in a said at least one IO device interconnect controller for coupling to said host entity; and

at least one device-side IO device interconnect port provided in a said at least one IO device interconnect controller for coupling to a said at least one physical storage device.

12. The storage virtualization computer system of claim 11, wherein said at least one host-side IO device interconnect port and said at least one device-side IO device interconnect port are provided in a same IO device interconnect controller.

13. The storage virtualization computer system of claim 11, wherein said at least one host-side IO device interconnect port and said at least one device-side IO device interconnect port are provided in different IO device interconnect controllers.

14. The storage virtualization computer system of claim 11, wherein said at least one said host-side IO device interconnect port is Fibre Channel supporting point-to-point connectivity in target mode.

15. The storage virtualization computer system of claim 11, wherein said at least one said host-side IO device interconnect port is Fibre Channel supporting private loop connectivity in target mode.

16. The storage virtualization computer system of claim 11, wherein said at least one said host-side IO device interconnect port is Fibre Channel supporting public loop connectivity in target mode.

17. The storage virtualization computer system of claim 11, wherein said at least one said host-side IO device interconnect port is parallel Small Computer System Interface (SCSI) operating in target mode.

18. The storage virtualization computer system of claim 11, wherein said at least one said host-side IO device interconnect port is ethernet supporting the Internet Small Computer System Interface (iSCSI) protocol operating in target mode.

19. The storage virtualization computer system of claim 11, wherein said at least one said host-side IO device interconnect port is Serial-Attached Small Computer System Interface (SAS) operating in target mode.

20. The storage virtualization computer system of claim 11, wherein said at least one said host-side IO device interconnect port is Serial Advanced Technology Attachment (SATA) operating in target mode.

21. The storage virtualization computer system of claim 11, wherein said external SVC issues a device-side IO request to said IO device interconnect controller, and said IO device interconnect controller re-formats said device-side IO request and accompanying IO data into at least one data packet for transmission to said group of PSDs through said device-side IO device interconnect port.

22. The storage virtualization computer system of claim 11 further comprising an enclosure management services mechanism that is implemented using intelligent circuitry which includes a CPU and runs a software program for managing and monitoring devices belonging to the storage virtualization computer system.

23. The storage virtualization computer system of claim 1, wherein the external SVC is equipped with the means and intelligence to dynamically adjust the distribution of the device-side I/O requests among the various PSDs 420 and/or IO device interconnects to further optimize a collective PSD/Interconnect bandwidth.

24. The storage virtualization computer system of claim 1, wherein said external storage virtualization controller is configured to provide a mapping that allows at least one section of the at least one LMU to be accessible to the host entity.

25. A storage virtualization subsystem for providing storage to a host entity for issuing host IO requests, comprising:

an external storage virtualization controller (SVC) comprising at least one I/O controller and being coupled to said host entity for executing IO operations in response to said host IO requests; and

a group of physical storage devices (PSDs), each coupled to the external storage virtualization controller through a point-to-point serial-signal interconnect, for providing storage to the host entity through the external storage virtualization controller;

wherein said external storage virtualization controller is configured to define at least one logical media unit (LMU) consisting of sections of said group of PSDs;

wherein the host IO requests are parsed to determine what operation is to be performed and on which section(s) of the LMU the operation is to be performed;

wherein when the operation comprises internally-emulated, asynchronous device sub-operations, then the SVC executes the associated sub-operations including transferring any associated data to/from the host entity and then, when there is a failed operation, the SVC generates a status report and responds to the host entity with the status report indicating the failed operation;

wherein the asynchronous device sub-operations comprise device-side IO requests to be sent to the PSDs, and when one of the device-side IO requests does not complete successfully, the SVC engages backup operation that allows successful completion of the sub-operations, where when one of the PSDs is inaccessible, the backup operation includes generating at least one other device-side IO request to at least one media section that is different from a media section to be accessed by the one device-side IO request which does not complete successfully; and

wherein when one of the host IO requests from the host entity is received by the SVC, an IO complete report that the one of the host I/O requests is successfully complete is first issued to the host entity by the SVC before the SVC completes the operation performed on the section(s) of the LMU associated with said one host IO request.

26. The storage virtualization subsystem of claim 25, wherein the operation further comprises a synchronous device sub-operation.

27. The storage virtualization subsystem of claim 25, wherein said point-to-point serial-signal interconnect is a Serial Advanced Technology Attachment (SATA) IO device-side interconnect.

28. The storage virtualization subsystem of claim 25, wherein said group of the PSDs comprises hard disk drives (HDDs) or solid state drives (SSDs).

29. The storage virtualization subsystem of claim 25, wherein said group of the PSDs comprises Serial Advanced Technology Attachment (SATA) PSDs.

30. The storage virtualization subsystem of claim 25, wherein said group of the PSDs comprises Parallel Advanced Technology Attachment (PATA) PSDs and a serial-to-parallel converter is provided between said device-side IO device interconnect controller and said PATA PSDs.

31. The storage virtualization subsystem of claim 25 further comprising a detachable canister attached to said storage virtualization controller for containing one of said group of the PSDs therein.

32. The storage virtualization subsystem of claim 25, wherein one of said group of the PSDs is detached from said storage virtualization controller when said storage virtualization controller is on-line.

33. The storage virtualization subsystem of claim 25, wherein a new PSD is attached to said storage virtualization controller when said storage virtualization controller is on-line.

34. The storage virtualization subsystem of claim 25, wherein said group of PSDs include a first set of PSDs and a second set of PSDs, said first set of PSDs and said external storage virtualization controller are in the same enclosure, said first set of PSDs and said second set of PSDs are not received in a same enclosure, and said external storage virtualization controller further comprises at least one multiple-device device-side expansion port for coupling to said second set of said PSDs.

35. The storage virtualization subsystem of claim 25, wherein said storage virtualization controller comprises:

a central processing circuitry for performing IO operations in response to said host IO requests of said host entity;

at least one IO device interconnect controller coupled to said central processing circuitry;

at least one host-side IO device interconnect port provided in a said at least one IO device interconnect controller for coupling to said host entity; and

at least one device-side IO device interconnect port provided in a said at least one IO device interconnect controller for coupling to a said at least one physical storage device.

36. The storage virtualization subsystem of claim 35, wherein said at least one host-side IO device interconnect port and said at least one device-side IO device interconnect port are provided in a same IO device interconnect controller.

37. The storage virtualization subsystem of claim 35, wherein said at least one host-side IO device interconnect port and said at least one device-side IO device interconnect port are provided in different IO device interconnect controllers.

38. The storage virtualization subsystem of claim 35, wherein said at least one said host-side IO device interconnect port is Fibre Channel supporting point-to-point connectivity in target mode.

39. The storage virtualization subsystem of claim 35, wherein said at least one said host-side IO device interconnect port is Fibre Channel supporting private loop connectivity in target mode.

40. The storage virtualization subsystem of claim 35, wherein said at least one said host-side IO device interconnect port is Fibre Channel supporting public loop connectivity in target mode.

41. The storage virtualization subsystem of claim 35, wherein said at least one said host-side IO device interconnect port is parallel Small Computer System Interface (SCSI) operating in target mode.

42. The storage virtualization subsystem of claim 35, wherein said at least one said host-side IO device interconnect port is ethernet supporting the Internet Small Computer System Interface (iSCSI) protocol operating in target mode.

43. The storage virtualization subsystem of claim 35, wherein said at least one said host-side IO device interconnect port is Serial-Attached SCSI (SAS) operating in target mode.

44. The storage virtualization subsystem of claim 35, wherein said at least one said host-side IO device interconnect port is Serial Advanced Technology Attachment (SATA) operating in target mode.

45. The storage virtualization subsystem of claim 35, wherein said external SVC issues a device-side IO request to said IO device interconnect controller, and said IO device interconnect controller re-formats said device-side IO request and accompanying IO data into at least one data packet for transmission to said group of PSDs through said device-side IO device interconnect port.

46. The storage virtualization subsystem of claim 35 further comprising an enclosure management services mechanism that is implemented using intelligent circuitry which includes a CPU and runs a software program for managing and monitoring devices belonging to the storage virtualization subsystem.

47. The storage virtualization subsystem of claim 25, wherein the external SVC is equipped with the means and intelligence to dynamically adjust the distribution of the device-side I/O requests among the various PSDs 420 and/or IO device interconnects to further optimize a collective PSD/Interconnect bandwidth.

48. The storage virtualization subsystem of claim 25, wherein said external storage virtualization controller is configured to provide a mapping that allows at least one section of the at least one LMU to be accessible to the host entity.

49. An external storage virtualization controller (SVC) for executing IO operations in response to host IO requests from a host entity, comprising:

a central processing circuitry for performing IO operations in response to said host IO requests of said host entity;

at least one IO device interconnect controller coupled to said central processing circuitry;

at least one host-side IO device interconnect port provided in a said at least one IO device interconnect controller for coupling to said host entity; and

at least one device-side IO device interconnect port provided in a said at least one IO device interconnect controller for coupling to and performing point-to-point serial-signal transmission with a group of physical storage devices (PSDs);

wherein said external storage virtualization controller is configured to define at least one logical media unit (LMU) consisting of sections of said group of PSDs;

wherein the host IO requests are parsed to determine what operation is to be performed and on which section(s) of the LMU the operation is to be performed;

wherein when the operation comprises internally-emulated, asynchronous device sub-operations, then the SVC executes the associated sub-operations including transferring any associated data to/from the host entity and then, when there is a failed operation, the SVC generates a status report and responds to the host entity with the status report indicating the failed operation;

wherein the asynchronous device sub-operations comprise device-side IO requests to be sent to the PSDs, and when one of the device-side IO requests does not complete successfully, the SVC engages backup operation that allows successful completion of the sub-operations, where when one of the PSDs is inaccessible, the backup operation includes generating at least one other device-side IO request to at least one media section that is different from a media section to be accessed by the one device-side IO request which does not complete successfully; and

wherein when one of the host IO requests from the host entity is received by the SVC, an IO complete report that the one of the host I/O requests is successfully complete is first issued to the host entity by the SVC before the SVC completes the operation performed on the section(s) of the LMU associated with said one host IO request.

50. The external storage virtualization controller of claim 49, wherein the operation further comprises a synchronous device sub-operation.

51. The external storage virtualization controller of claim 49, wherein said point-to-point serial-signal interconnect is a Serial Advanced Technology Attachment (SATA) IO device-side interconnect.

52. The external storage virtualization controller of claim 49, wherein said group of the PSDs comprises hard disk drives (HDDs) or solid state drives (SSDs).

53. The external storage virtualization controller of claim 49, wherein said group of the PSDs comprises Serial Advanced Technology Attachment (SATA) PSDs.

54. The external storage virtualization controller of claim 49, wherein said group of the PSDs comprises Parallel Advanced Technology Attachment (PATA) PSDs and a serial-to-parallel converter is provided between said device-side IO device interconnect controller and said PATA PSDs.

55. The external storage virtualization controller of claim 49 further comprising a detachable canister attached to said storage virtualization controller for containing one of said group of the PSDs therein.

56. The external storage virtualization controller of claim 49, wherein one of said group of the PSDs is detached from said storage virtualization controller when said storage virtualization controller is on-line.

57. The external storage virtualization controller of claim 49, wherein a new PSD is attached to said storage virtualization controller when said storage virtualization controller is on-line.

58. The external storage virtualization controller of claim 49, wherein said group of PSDs include a first set of PSDs and a second set of PSDs, said first set of PSD and said external storage virtualization controller are in the same enclosure, said first set of PSDs and said second set of PSDs are not received in a same enclosure, and said external storage virtualization controller further comprises at least one multiple-device device-side expansion port for coupling to said second set of said PSDs.

59. The external storage virtualization controller of claim 49, wherein said at least one host-side IO device interconnect port and said at least one device-side IO device interconnect port are provided in a same IO device interconnect controller.

60. The external storage virtualization controller of claim 49, wherein said at least one host-side IO device interconnect port and said at least one device-side IO device interconnect port are provided in different IO device interconnect controllers.

61. The external storage virtualization controller of claim 49, wherein said at least one said host-side IO device interconnect port is Fibre Channel supporting point-to-point connectivity in target mode.

62. The external storage virtualization controller of claim 49, wherein said at least one said host-side IO device interconnect port is Fibre Channel supporting private loop connectivity in target mode.

63. The external storage virtualization controller of claim 49, wherein said at least one said host-side IO device interconnect port is Fibre Channel supporting public loop connectivity in target mode.

64. The external storage virtualization controller of claim 49, wherein said at least one said host-side IO device interconnect port is parallel SCSI operating in target mode.

65. The external storage virtualization controller of claim 49, wherein said at least one said host-side IO device interconnect port is ethernet supporting the iSCSI protocol operating in target mode.

66. The external storage virtualization controller of claim 49, wherein said at least one said host-side IO device interconnect port is Serial-Attached Small Computer System Interface (SAS) operating in target mode.

67. The external storage virtualization controller of claim 49, wherein said at least one said host-side IO device interconnect port is Serial Advanced Technology Attachment (SATA) operating in target mode.

68. The external storage virtualization controller of claim 49, wherein said external SVC issues a device-side IO request to said IO device interconnect controller, and said IO device interconnect controller re-formats said device-side IO request and accompanying IO data into at least one data packet for transmission to said group of PSDs through said device-side IO device interconnect port.

69. The external storage virtualization controller of claim 49 further comprising an enclosure management services mechanism that is implemented using intelligent circuitry which includes a CPU and runs a software program for managing and monitoring devices belonging to a storage virtualization subsystem.

70. The external storage virtualization controller of claim 49, wherein the external SVC is equipped with the means and intelligence to dynamically adjust the distribution of the device-side I/O requests among the various PSDs 420 and/or IO device interconnects to further optimize a collective PSD/Interconnect bandwidth.

71. The external storage virtualization controller of claim 49, wherein said external storage virtualization controller is configured to provide a mapping that allows at least one section of the at least one LMU to be accessible to the host entity.

72. A method for performing storage virtualization in a computer system with an external storage virtualization controller (SVC) of the computer system, comprising:

receiving host IO requests from a host entity of the computer system with the storage virtualization controller;

parsing the host IO requests with the storage virtualization controller to decide at least one IO operation to perform in response to said host IO requests; and

performing at least one IO operation with the storage virtualization controller to access a group of physical storage devices (PSDs) of the computer system in point-to-point serial-signal transmission;

wherein said external storage virtualization controller is configured to define at least one logical media unit (LMU) consisting of sections of said group of PSDs;

wherein the host IO requests are parsed to determine what operation is to be performed and on which section(s) of the LMU the operation is to be performed;

wherein when the operation comprises internally-emulated, asynchronous device sub-operations, then the SVC executes the associated sub-operations including transferring any associated data to/from the host entity and then, when there is a failed operation, the SVC generates a status report and responds to the host entity with the status report indicating the failed operation;

wherein the asynchronous device sub-operations comprise device-side IO requests to be sent to the PSDs, and when one of the device-side IO requests does not complete successfully, the SVC engages backup operation that allows successful completion of the sub-operations, where when one of the PSDs is inaccessible, the backup operation includes generating at least one other device-side IO request to at least one media section that is different from a media section to be accessed by the one media section which does not complete successfully; and

wherein when one of the host IO requests from the host entity is received by the SVC, an IO complete report that the one of I/O requests is successfully complete is first issued to the host entity by the SVC before the SVC completes the operation performed on the section(s) of the LMU associated with said one host IO request.

73. The method of claim 72, wherein the operation further comprises a synchronous device sub-operation.

74. The method of claim 72, wherein said point-to-point serial-signal interconnect is a Serial ATA IO device-side interconnect.

75. The method of claim 72, wherein said group of the PSDs comprises hard disk drives (HDDs) or solid state drives (SSDs).

76. The method of claim 72, wherein said group of the PSDs comprises Serial Advanced Technology Attachment (SATA) PSDs.

77. The method of claim 72, wherein said group of the PSDs comprises Parallel Advanced Technology Attachment (PATA) PSDs and a serial-to-parallel converter is provided between said device-side IO device interconnect controller and said PATA PSDs.

78. The method of claim 72 further comprising a detachable canister attached to said storage virtualization controller for containing one of said group of the PSDs therein.

79. The method of claim 72, wherein one of said group of the PSDs is detached from said storage virtualization controller when said storage virtualization controller is on-line.

80. The method of claim 72, wherein a new PSD is attached to said storage virtualization controller when said storage virtualization controller is on-line.

81. The method of claim 72, wherein said group of PSDs include a first set of PSDs and a second set of PSDs, said first set of PSDs and said external storage virtualization controller are in the same enclosure, said first set of PSDs and said second set of PSDs are not received in a same enclosure, and said external storage virtualization controller further comprises at least one multiple-device device-side expansion port for coupling to said second set of said PSDs.

82. The method of claim 72, wherein said storage virtualization controller comprises:

a central processing circuitry for performing IO operations in response to said host IO requests of said host entity;

at least one IO device interconnect controller coupled to said central processing circuitry;

at least one host-side IO device interconnect port provided in a said at least one IO device interconnect controller for coupling to said host entity; and

at least one device-side IO device interconnect port provided in a said at least one IO device interconnect controller for coupling to a said at least one physical storage device.

83. The method of claim 82, wherein said at least one host-side IO device interconnect port and said at least one device-side IO device interconnect port are provided in a same IO device interconnect controller.

84. The method of claim 82, wherein said at least one host-side IO device interconnect port and said at least one device-side IO device interconnect port are provided in different IO device interconnect controllers.

85. The method of claim 82, wherein said at least one said host-side IO device interconnect port is Fibre Channel supporting point-to-point connectivity in target mode.

86. The method of claim 82, wherein said at least one said host-side IO device interconnect port is Fibre Channel supporting private loop connectivity in target mode.

87. The method of claim 82, wherein said at least one said host-side IO device interconnect port is Fibre Channel supporting public loop connectivity in target mode.

88. The method of claim 82, wherein said at least one said host-side IO device interconnect port is Parallel Small Computer System Interface (SCSI) operating in target mode.

89. The method of claim 82, wherein said at least one said host-side IO device interconnect port is ethernet supporting the Internet Small Computer System Interface (iSCSI) protocol operating in target mode.

90. The method of claim 82, wherein said at least one said host-side IO device interconnect port is Serial-Attached Small Computer System Interface (SAS) operating in target mode.

91. The method of claim 82, wherein said at least one said host-side IO device interconnect port is Serial Advanced Technology Attachment (SATA) operating in target mode.

92. The method of claim 82, wherein said external SVC issues a device-side IO request to said IO device interconnect controller, and said IO device interconnect controller re-formats said device-side IO request and accompanying IO data into at least one data packet for transmission to said group of PSDs through said device-side IO device interconnect port.

93. The method of claim 82 further comprising an enclosure management services mechanism that is implemented using intelligent circuitry which includes a CPU and runs a software program for managing and monitoring devices belonging to the computer system.

94. The method of claim 72, wherein the external SVC is equipped with the means and intelligence to dynamically adjust the distribution of the device-side I/O requests among the various PSDs 420 and/or IO device interconnects to further optimize a collective PSD/Interconnect bandwidth.

95. The method of claim 72, wherein said external storage virtualization controller is configured to provide a mapping that allows at least one section of the at least one LMU to be accessible to the host entity.