JBOD subsystem and external emulation controller thereof

• US 9,594,510 B2
• Filed: 05/24/2004
• Issued: 03/14/2017
• Est. Priority Date: 07/02/2003
• Status: Active Grant

• Current Assignee: Infortrend Technology Incorporated (Infortrend Corporation)
• Original Assignee: Infortrend Technology Incorporated (Infortrend Corporation)
• Inventors: Liu, Ling-Yi, Lee, Tse-Han, Schnapp, Michael Gordon, Wang, Yun-Huei, Pao, Chung-Hua
• Primary Examiner(s): Unelus, Ernest
• Application Number:
  US10/709,718
• Publication Number:
  US 20050005063A1
• Time in Patent Office: 4,677 Days
• Field of Search: 711/162, 711/165, 711/114, 710/74
• US Class Current: 1/1
• CPC Class Codes: G06F 11/2089 Redundant storage control functionality
• CPC Class Codes: G06F 3/0607 by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
• CPC Class Codes: G06F 3/0611 in relation to response time
• CPC Class Codes: G06F 3/0617 in relation to availability
• CPC Class Codes: G06F 3/0658 Controller construction arrangements
• CPC Class Codes: G06F 3/0664 at device level, e.g. emulation of a storage device or system
• CPC Class Codes: G06F 3/0683 Plurality of storage devices
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

A JBOD subsystem for providing storage to a host entity. The JBOD subsystem contains at least one external JBOD emulation controller coupled to the host entity for emulating IO operations in response to the IO requests and a set of at least one physical storage device coupled to the JBOD emulation controller for providing storage to the host entity through the JBOD emulation controller. The JBOD emulation controller defines at least one logical media unit (LMU) consisting of sections of the set of physical storage device (PSD) and communicates with the PSD through a point-to-point serial-signal interconnect. As an example, the point-to-point serial-signal interconnect can be a Serial ATA IO device interconnect.

Claims

1. A computer system comprising:

a host entity for issuing IO requests;

an external JBOD (just a bunch of disks) emulation controller coupled to the host entity for emulating IO operations in response to the IO requests; and

a group of physical storage devices (PSDs) coupled to the JBOD emulation controller each through a point-to-point serial-signal interconnect for providing storage to the computer system through the JBOD emulation controller in which each of the PSDs is a hard disk drive (HDD) or a solid state drive (SSD), wherein

said JBOD emulation controller defines at least one logical media unit (LMU) comprising sections of said group of PSDs, and is configured to provide a mapping that maps combination of the sections of said group of PSDs to the at least one LMU visible to the host entity, and the at least one LMU is contiguously addressable by the host entity to which the at least one LMU is made available, and said JBOD emulation controller performs the following functions;

bringing the whole LMU on line such that the whole LMU is accessible by the host entity, while the JBOD emulation controller is on line, and while a requisite quorum of said PSDs becomes on-line, in which the requisite quorum refers to said group of PSDs of the whole LMU data of which is accessible correctly by the JBOD emulation controller while at least one PSD of said PSDs is inaccessible; and

taking the whole LMU off line such that the whole LMU is inaccessible by the host entity, while the JBOD emulation controller is on line, and while all the requisite quorum of said PSDs is not on line, in which on line PSDs of said PSDs are less than the requisite quorum of said PSDs;

wherein said external JBOD emulation controller comprises

a central processing circuitry for performing said IO operations in response to said IO requests of said host entity;

at least one IO device interconnect controller coupled to said central processing circuitry;

at least one host-side IO device interconnect port provided in one of said at least one IO device interconnect controller for coupling to said host entity; and

at least one device-side IO device interconnect port provided in one of said at least one IO device interconnect controller for coupling to one of said PSDs; and

wherein the IO requests are parsed to determine what operation is to be performed and on which sections of the LMU the operation is to be performed;

wherein when the operation comprises internally-emulated, asynchronous device sub-operations, then the JBOD emulation controller executes the associated sub-operations including transferring any associated data to/from the host entity; and

wherein when there is a failed operation, the JBOD emulation controller generates a status report and responds to the host entity with the status report indicating that the operation failed.

2. The computer system of claim 1 wherein the point-to-point serial-signal interconnect is a Serial ATA IO device interconnect.

3. The computer system of claim 1 wherein the point-to-point serial-signal interconnect is a Serial-Attached SCSI (SAS) IO device interconnect.

4. The computer system of one of claims 1 through 3, wherein said LMU are presented redundantly to the host entity on more than one host-side IO device interconnect port in order to make the host entity maintain access to the PSD even if one of the interconnects breaks, becomes blocked or malfunctions.

5. The computer system of one of claims 1 through 3, further comprises a second external JBOD emulation controller coupled to the host entity for emulating IO operations in response to the IO requests, wherein said external JBOD emulation controller and said second external JBOD emulation controller are configured into a redundant pair, and said LMU is allowed to be brought on line or taken off line while the JBOD emulation controller is on line.

6. The computer system of claim 5, wherein said LMU is redundantly presented to the host by both of said external JBOD emulation controllers.

7. The computer system of claim 1 wherein said external JBOD emulation controller is configured for accommodating said group of PSDs of different serial protocols.

8. The computer system of claim 7 wherein said group of PSDs are received in a plurality of enclosures.

9. The computer system of claim 1 wherein said external JBOD emulation controller issues a device-side IO request to said IO device interconnect controller, and said IO device interconnect controller re-formats said device-side IO request and accompanying IO data into at least one data packet for transmission to said group of PSDs through said device-side IO device interconnect port, wherein said data packet comprises a start segment at the beginning indicating the start of said data packet, an end segment at the end indicating the end of the data packet, a payload data segment containing actual IO information to transmit through the SAS device-side IO device interconnect port, and a check data segment containing check codes derived from said payload for checking the correctness of said payload data after transmission.

10. The computer system of claim 1, further comprising an enclosure management services mechanism that is implemented using an intelligent circuitry which includes a CPU and runs a software program for managing and monitoring devices belonging to the computer system.

11. The computer system of claim 1, wherein when the operation comprises a synchronous device sub-operation, a device-side IO request is generated and issued to appropriate PSDs in response.

12. The computer system of claim 1 further comprising a load balancing function over two paths between the host entity and JBOD emulation controller, so that when the two paths between the host entity and JBOD emulation controller function normally, the host entity will elect to issue IO requests over the two paths between the host entity and JBOD emulation controller so as to achieve the load balancing function.

13. A JBOD (just a bunch of disks) subsystem for providing storage to a host entity, comprising:

at least one external JBOD emulation controller for coupling to the host entity for emulating IO operations in response to IO requests issued from the host entity; and

a group of PSDs each coupled to the JBOD emulation controller through a point-to-point serial-signal interconnect for providing storage to the host entity through the JBOD emulation controller in which each of the PSDs is a hard disk drive (HDD) or a solid state drive (SSD), wherein

said JBOD emulation controller defines at least one logical media unit (LMU) comprising sections of said group of PSDs, and is configured to provide a mapping that maps combination of the sections of said group of PSDs to the at least one LMU visible to the host entity, and the at least one LMU is contiguously addressable by the host entity to which the at least one LMU is made available, and said JBOD emulation controller performs the following functions;

bringing said whole LMU on line such that the whole LMU is accessible by the host entity, while the JBOD emulation controller is on line, and while a requisite quorum of said PSDs becomes on-line, in which the requisite quorum refers to said group of PSDs of the whole LMU data of which is accessible correctly by the JBOD emulation controller while at least one PSD of said PSDs is inaccessible; and

taking said whole LMU off line such that the whole LMU is inaccessible by the host entity, while the JBOD emulation controller is on line, and while all the requisite quorum of said PSDs is not on line, in which on line PSDs of said PSDs are less than the requisite quorum of said PSDs;

wherein said external JBOD emulation controller comprises

a central processing circuitry for performing said IO operations in response to said IO requests of said host entity;

at least one IO device interconnect controller coupled to said central processing circuitry;

at least one host-side IO device interconnect port provided in one of said at least one IO device interconnect controller for coupling to said host entity; and

at least one device-side IO device interconnect port provided in one of said at least one IO device interconnect controller for coupling to one of said PSDs; and

wherein the IO requests are parsed to determine what operation is to be performed and on which sections of the LMU the operation is to be performed;

wherein when the operation comprises internally-emulated, asynchronous device sub-operations, then the JBOD emulation controller executes the associated sub-operations including transferring any associated data to/from the host entity; and

wherein when there is a failed operation, the JBOD emulation controller generates a status report and responds to the host entity with the status report indicating that the operation failed.

14. The JBOD subsystem of claim 13 wherein the point-to-point serial-signal interconnect is a Serial ATA IO device interconnect.

15. The JBOD subsystem of claim 13 wherein the point-to-point serial-signal interconnect is a Serial-Attached SCSI (SAS) IO device interconnect.

16. The JBOD subsystem of one of claims 13 through 15, further comprising auto-on-lining mechanism to automatically bring on line one of said LMU which was previously off-line once the requisite quorum of said PSDs becomes on-line.

17. The JBOD subsystem of one of claims 13 through 15, further comprising auto-off-lining mechanism to automatically take off line one of said LMU which was previously on-line once the requisite quorum of said PSDs becomes off-line.

18. The JBOD subsystem of one of claims 13 through 15, further comprising determining mechanism for automatically determining when one of said PSDs has been removed or when one has been inserted.

19. The JBOD subsystem of one of claims 13 through 15, further comprising scanning-in mechanism to automatically scan in PSDs on detection of insertion of the PSDs.

20. The JBOD subsystem of one of claims 13 through 15, further comprising informing mechanism for informing the host entity when the mapping of said LMUs to host-side interconnect LUNs has changed.

21. The JBOD subsystem of one of claims 13 through 15, further comprising unique ID determination mechanism to uniquely identify said PSDs independent of their location in which they are installed in the JBOD subsystem.

22. The JBOD subsystem of claim 21, wherein information used to uniquely identify each of said PSDs is stored on said PSDs.

23. The JBOD subsystem of one of claims 13 through 15, wherein LMU identification and configuration information is stored on the member PSDs that compose the LMU.

24. The JBOD subsystem of claim 23, wherein LMU identification information presented to the host entity is generated from said LMU identification information stored on the member PSDs that compose the LMU.

25. The JBOD subsystem of one of claims 13 through 15, wherein LMU identification information presented to the host entity is generated from information stored in a non-volatile memory in the JBOD emulation controller.

26. The JBOD subsystem of one of claims 13 through 15, wherein LMU identification information presented to the host entity is generated as follows:

from information stored in a non-volatile memory in the JBOD subsystem prior to being able to obtain LMU identification information off of the member PSDs and from LMU identification information stored on the member PSDs that compose the LMU after the member PSDs become accessible.

27. The JBOD subsystem of one of claims 13 through 15, wherein a first and a second of said at least one JBOD emulation controller are configured into a redundant pair, whereby when the first JBOD emulation controller goes off line or is taken off line, the second JBOD emulation controller will take over the functionality of the first JBOD emulation controller.

28. The JBOD subsystem of claim 27, wherein a host-side port of said first JBOD emulation controller and a host-side port of said second JBOD emulation controller are configured into a complementary port pair.

29. The JBOD subsystem of claim 28, wherein said complementary port pair are interconnected onto a same host-side IO device interconnect.

30. The JBOD subsystem of claim 29, wherein said complementary port pair are interconnected together with switch circuitry.

31. The JBOD subsystem of claim 28, wherein each port of said complementary port pair is interconnected onto a different host-side IO device interconnect.

32. The JBOD subsystem of claim 27, wherein one of said LMU is presented to the host entity through both said first and said second JBOD emulation controllers.

33. The JBOD subsystem of one of claims 13 through 15, further comprising ID generation mechanism to automatically generate the LMU identification information presented to the host entity when a need arises.

34. The JBOD subsystem of one of claims 13 through 15 wherein said LMU are presented redundantly to the host entity on more than one host-side IO device interconnect port in order to make the host entity maintain access to the PSD even if one of the interconnects breaks, becomes blocked or malfunctions.

35. The JBOD subsystem of one of claims 13 through 15, further comprising an enclosure management services (EMS) mechanism that is implemented using an intelligent circuitry which includes a CPU and runs a software program for managing and monitoring devices belonging to the JBOD subsystem.

36. The JBOD subsystem of claim 35, wherein said EMS mechanism is of a direct-connect EMS configuration.

37. The JBOD subsystem of claim 35, wherein said EMS mechanism is of a device-forward EMS configuration.

38. The JBOD subsystem of claim 35, wherein said EMS mechanism implements both direct-connect and device-forward EMS configurations.

39. The JBOD subsystem of claim 35, wherein said JBOD emulation controller is configured to support SES (SCSI Enclosure Services) enclosure management services protocol.

40. The JBOD subsystem of claim 35, wherein said JBOD emulation controller is configured to support SAF-TE (SCSI Accessed Fault-Tolerant Enclosure) enclosure management services protocol.

41. The JBOD subsystem of one of claims 13 through 15, wherein at least one said host-side IO device interconnect port is Fibre Channel supporting point-to-point connectivity in target mode.

42. The JBOD subsystem of one of claims 13 through 15, wherein at least one said host-side IO device interconnect port is Fibre Channel supporting public loop connectivity in target mode.

43. The JBOD subsystem of one of claims 13 through 15, wherein at least one said host-side IO device interconnect port is Fibre Channel supporting private loop connectivity in target mode.

44. The JBOD subsystem of one of claims 13 through 15, wherein at least one said host-side IO device interconnect port is parallel SCSI operating in target mode.

45. The JBOD subsystem of one of claims 13 through 15, wherein at least one said host-side IO device interconnect port is ethernet supporting the iSCSI protocol operating in target mode.

46. The JBOD subsystem of one of claims 13 through 15, wherein at least one said host-side IO device interconnect port is Serial-Attached SCSI (SAS) operating in target mode.

47. The JBOD subsystem of one of claims 13 through 15, wherein at least one said host-side IO device interconnect port is Serial ATA operating in target mode.

48. The JOBD subsystem of claim 13 wherein said JBOD emulation controller is configured for accommodating said group of PSDs of different serial protocols.

49. The JOBD subsystem of claim 48 wherein said group of PSDs are received in a plurality of enclosures.

50. The JOBD subsystem of claim 13 wherein said external JBOD emulation controller issues a device-side IO request to said IO device interconnect controller, and said IO device interconnect controller re-formats said device-side IO request and accompanying IO data into at least one data packet for transmission to said group of PSDs through said device-side IO device interconnect port, wherein said data packet comprises a start segment at the beginning indicating the start of said data packet, an end segment at the end indicating the end of the data packet, a payload data segment containing actual IO information to transmit through the SAS device-side IO device interconnect port, and a check data segment containing check codes derived from said payload for checking the correctness of said payload data after transmission.

51. The JBOD subsystem of claim 13, wherein when the operation comprises a synchronous device sub-operation, a device-side IO request is generated and issued to appropriate PSDs in response.

52. The JBOD subsystem of claim 13 further comprising a load balancing function over two paths between the host entity and JBOD emulation controller, so that when the two paths between the host entity and JBOD emulation controller function normally, the host entity will elect to issue IO requests over the two paths between the host entity and JBOD emulation controller so as to achieve the load balancing function.

53. A method for performing JBOD (just a bunch of disks) emulation in a computer system having at least one external JBOD emulation controller and a group of physical storage devices (PSDs) connected to the JBOD emulation controller, the method comprising:

defining at least one logical media unit (LMU) comprising sections of said group of PSDs by the JBOD emulation controller;

receiving and parsing IO requests from a host entity by the JBOD emulation controller to perform an IO operation to access the LMU by accessing said group of PSDs through at least one device-side IO device interconnect port in point-to-point serial signal transmission; and

performing the following functions;

bringing said whole LMU on line such that the whole LMU is accessible by the host entity, while the JBOD emulation controller is on line, and while a requisite quorum of said PSDs becomes on-line, in which the requisite quorum refers to said group of PSDs of the whole LMU data of which is accessible correctly by the JBOD emulation controller while at least one PSD of said PSDs is inaccessible; and

taking said whole LMU off line such that the whole LMU is inaccessible by the host entity, while the JBOD emulation controller is on line, and while all the requisite quorum of said PSDs is not on line, in which on line PSDs of said PSDs are less than the requisite quorum of said PSDs;

the JBOD emulation controller is configured to provide a mapping that maps combination of the sections of said group of PSDs to the at least one LMU visible to the host entity, and the at least one LMU is contiguously addressable by the host entity to which the at least one LMU is made available;

wherein said external JBOD emulation controller comprises

a central processing circuitry for performing said IO operation in response to said IO requests of said host entity;

at least one IO device interconnect controller coupled to said central processing circuitry;

at least one host-side IO device interconnect port provided in one of said at least one IO device interconnect controller for coupling to said host entity; and

at least one device-side IO device interconnect port provided in one of said at least one IO device interconnect controller for coupling to one of said PSDs in which each of the PSDs is a hard disk drive (HDD) or a solid state drive (SSD); and

wherein the IO requests are parsed to determine what operation is to be performed and on which sections of the LMU the operation is to be performed;

wherein when the operation comprises internally-emulated, asynchronous device sub-operations, then the JBOD emulation controller executes the associated sub-operations including transferring any associated data to/from the host entity; and

wherein when there is a failed operation, the JBOD emulation controller generates a status report and responds to the host entity with the status report indicating that the operation failed.

54. The method of claim 53 wherein the device-side IO device interconnect port is a Serial ATA IO device interconnect port.

55. The method of claim 53 wherein the device-side IO device interconnect port is a Serial-Attached SCSI (SAS) IO device interconnect port.

56. The method of one of claims 53 through 55 further comprising:

while the JBOD emulation controller is on line, bringing on line one of said at least one LMU which is not on line.

57. The method of one of claims 53 through 55 further comprising:

while the JBOD emulation controller is on line, taking off line one of said at least one LMU which is on line.

58. The method of claim 53, further comprising automatically bringing on line one of said LMU which was previously off-line on detection of insertion of one of said PSDs associated with said LMU.

59. The method of claim 53, further comprising automatically taking off line one of said LMU which was previously on-line on detection of off-lining of all PSDs associated with said LMU.

60. The method of claim 57, wherein said at least one host-side IO device interconnect port supports one of the following:

Fibre Channel supporting point-to-point connectivity in target mode, Fibre Channel supporting public loop connectivity in target mode, Fibre Channel supporting private loop connectivity in target mode, parallel SCSI operating in target mode, ethernet supporting the iSCSI protocol operating in target mode, Serial-Attached SCSI (SAS) operating in target mode, and Serial ATA operating in target mode.

61. The method of claim 53 wherein said JBOD emulation controller is configured for accommodating said group of PSDs of different serial protocols.

62. The method of claim 61 wherein said group of PSDs are received in a plurality of enclosures.

63. The method of claim 53 wherein said external JBOD emulation controller issues a device-side IO request to said IO device interconnect controller, and said IO device interconnect controller re-formats said device-side IO request and accompanying IO data into at least one data packet for transmission to said group of PSDs through said device-side IO device interconnect port, wherein said data packet comprises a start segment at the beginning indicating the start of said data packet, an end segment at the end indicating the end of the data packet, a payload data segment containing actual IO information to transmit through the SAS device-side IO device interconnect port, and a check data segment containing check codes derived from said payload for checking the correctness of said payload data after transmission.

64. The method of claim 53, further comprising an enclosure management services mechanism that is implemented using an intelligent circuitry which includes a CPU and runs a software program for managing and monitoring devices belonging to the computer system.

65. The method of claim 53, wherein when the operation comprises a synchronous device sub-operation, a device-side IO request is generated and issued to appropriate PSDs in response.

66. The method of claim 53 further comprising a load balancing function over two paths between the host entity and JBOD emulation controller, so that when the two paths between the host entity and JBOD emulation controller function normally, the host entity will elect to issue IO requests over the two paths between the host entity and JBOD emulation controller so as to achieve the load balancing function.

67. A non-transitory computer-readable storage medium having a computer program code stored therein that causes a computer system having an external JBOD (just a bunch of disks) emulation controller and a group of physical storage devices (PSDs) connected to the JBOD emulation controller to perform the steps of:

defining at least one logical medium unit comprising sections of said PSDs by the JBOD emulation controller; and

receiving and parsing IO requests from a host entity by the JBOD emulation controller to perform an IO operation to access the logical media unit (LMU) by accessing said group of PSDs through at least one device-side IO device interconnect in point-to-point serial signal transmission, wherein said JBOD emulation controller performs the following functions;

bringing the whole LMU on line such that the whole LMU is accessible by the host entity, while the JBOD emulation controller is on line, and while a requisite quorum of said PSDs becomes on-line, in which the requisite quorum refers to said group of PSDs of the whole LMU data of which is accessible correctly by the JBOD emulation controller while at least one PSD of said PSDs is inaccessible; and

taking the whole LMU off line such that the whole LMU is inaccessible by the host entity, while the JBOD emulation controller is on line, and while all the requisite quorum of said PSDs is not on line, in which on line PSDs of said PSDs are less than the requisite quorum of said PSDs, and the JBOD emulation controller is configured to provide a mapping that maps combination of the sections of said group of PSDs to the at least one LMU visible to the host entity, and the at least one LMU is contiguously addressable by the host entity to which the at least one LMU is made available;

wherein said external JBOD emulation controller comprises

a central processing circuitry for performing said IO operation in response to said IO requests of said host entity;

at least one IO device interconnect controller coupled to said central processing circuitry;

at least one host-side IO device interconnect port provided in one of said at least one IO device interconnect controller for coupling to said host entity; and

at least one device-side IO device interconnect port provided in one of said at least one IO device interconnect controller for coupling to one of said PSDs in which each of the PSDs is a hard disk drive (HDD) or a solid state drive (SSD); and

wherein the IO requests are parsed to determine what operation is to be performed and on which sections of the LMU the operation is to be performed;

wherein when the operation comprises internally-emulated, asynchronous device sub-operations, then the JBOD emulation controller executes the associated sub-operations including transferring any associated data to/from the host entity; and

wherein when there is a failed operation, the JBOD emulation controller generates a status report and responds to the host entity with the status report indicating that the operation failed.

68. The non-transitory computer-readable storage medium of claim 67 wherein the device-side IO device interconnect is a Serial ATA IO device interconnect.

69. The non-transitory computer-readable storage medium of claim 67 wherein the device-side IO device interconnect is a Serial-Attached SCSI (SAS) IO device interconnect.

70. The non-transitory computer-readable storage medium of claim 67 wherein said at least one external JBOD emulation controller is configured for accommodating said group of PSDs of different serial protocols.

71. The non-transitory computer-readable storage medium of claim 70 wherein said group of PSDs are received in a plurality of enclosures.

72. The non-transitory computer-readable storage medium of claim 67 wherein said external JBOD emulation controller issues a device-side IO request to said IO device interconnect controller, and said IO device interconnect controller re-formats said device-side IO request and accompanying IO data into at least one data packet for transmission to said group of PSDs through said device-side IO device interconnect port, wherein said data packet comprises a start segment at the beginning indicating the start of said data packet, an end segment at the end indicating the end of the data packet, a payload data segment containing actual IO information to transmit through the SAS device-side IO device interconnect port, and a check data segment containing check codes derived from said payload for checking the correctness of said payload data after transmission.

73. The non-transitory computer-readable storage medium of claim 67, further comprising an enclosure management services mechanism that is implemented using an intelligent circuitry which includes a CPU and runs a software program for managing and monitoring devices belonging to the computer subsystem.

74. The non-transitory computer-readable storage medium of claim 67, wherein when the operation comprises a synchronous device sub-operation, a device-side IO request is generated and issued to appropriate PSDs in response.

75. The non-transitory computer-readable storage medium of claim 67 further comprising a load balancing function over two paths between the host entity and JBOD emulation controller, so that when the two paths between the host entity and JBOD emulation controller function normally, the host entity will elect to issue IO requests over the two paths between the host entity and JBOD emulation controller so as to achieve the load balancing function.