STORAGE DEVICE

• US 20180011763A1
• Filed: 02/26/2015
• Published: 01/11/2018
• Est. Priority Date: 02/26/2015
• Status: Active Grant

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: TANAKA, Katsuya, MIZUNO, Makio
• Granted Patent: US 10,459,791 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 11/0727 in a storage system, e.g. in a DASD or network based storage system drivers for digital recording or reproducing units G06F3/06; circuits for error detection or correction within digital recording or reproducing units G11B20/18; for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: G06F 11/0757 by exceeding a time limit, i.e. time-out, e.g. watchdogs
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 13/10 Program control for peripheral devices G06F13/14 - G06F13/42 take precedence
• CPC Class Codes: G06F 16/172 Caching, prefetching or hoarding of files
• CPC Class Codes: G06F 16/1827 Management specifically adapted to NAS management of storage area networks [SAN] G06F3/067
• CPC Class Codes: G06F 3/0605 by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0635 by changing the path, e.g. traffic rerouting, path reconfiguration

Abstract

A storage device according to an embodiment of the present invention has a plurality of storage nodes, each of which has a plurality of logical ports having send and receive queues for a communication request and an identification number, and an internal network for connecting the plurality of storage nodes with one another. The storage nodes each have, as the logical ports, a data communication logical port used for data communication with other storage nodes and an error communication logical port used to notify the other storage nodes of a state of the data communication logical port. When detecting an occurrence of transition of the data communication logical port to an error state, the storage node uses the error communication logical port to notify the other storage nodes of the identification number and the state of the data communication logical port.

Claims

1. A storage device comprising:

a plurality of storage nodes, each of which has a plurality of logical ports having send and receive queues for a communication request and an identification number; and

an internal network interconnecting the plurality of storage nodes, wherein

a first storage node among the plurality of storage nodes has, as the logical ports, a first data communication logical port used for data communication with a second storage node and a first error communication logical port used in order to notify the second storage node of a state of the first data communication logical port,

the second storage node among the plurality of storage nodes has, as the logical ports, a second data communication logical port used for data communication with the first storage node in the logical port serving as a communication destination of the first data communication logical port and a second error communication logical port used in order to notify the first storage node of a state of the second data communication logical port, and

when detecting transition of the first data communication logical port to an error state,

the first storage node notifies the second storage node of an identification number and a state of the first data communication logical port using the first error communication logical port.

2. The storage device according to claim 1, wherein

information transfer using the first error communication logical port is carried out with priority higher than priority of information transfer using the first data communication logical port.

3. The storage device according to claim 1, wherein

when detecting transition of the first data communication logical port to the error state,

the first storage node discards the first data communication logical port,

creates a third data communication logical port used for data communication with the second storage node, and then

notifies the second storage node of an identification number of the third data communication logical port created above using the first error communication logical port.

4. The storage device according to claim 3, wherein

when receiving a notification including the identification number and the error state of the first data communication logical port,

the second storage node discards the second data communication logical port,

creates a fourth data communication logical port used for data communication with the first storage node, and then

notifies the first storage node of an identification number of the fourth data communication logical port created above using the second error communication logical port.

5. The storage device according to claim 4, wherein

the first storage node causes transition of a state of the third data communication logical port to a state which allows sending and receiving of a request, and then notifies the second storage node of the identification number and the state of the third data communication logical port, and

the second storage node causes transition of a state of the fourth data communication logical port to a state which allows sending and receiving of a request, and then notifies the first storage node of the identification number and the state of the fourth data communication logical port.

6. The storage device according to claim 4, wherein

information transfer using the second error communication logical port is carried out with priority higher than priority of information transfer using the second data communication logical port.

7. The storage device according to claim 1, wherein

the first storage node detects transition of the first data communication logical port to the error state by periodically acquiring the state of the first data communication logical port.

8. The storage device according to claim 1, wherein

when detecting transition of the first data communication logical port to the error state,

the first storage node causes transition of a state of the first data communication logical port to a reset state, and then causes transition of the state to a state which allows sending and receiving of a request, and then

after the transition of the state of the first data communication logical port to the state which allows sending and receiving of a request, notifies the second storage node of the identification number and the state of the first data communication logical port.

9. The storage device according to claim 1, wherein

the first data communication logical port is the logical port used also for data communication with the storage node other than the second storage node, and

the first storage node also notifies the storage node other than the second storage node of the state of the first data communication logical port.

10. The storage device according to claim 9, wherein

the first storage node has a control data communication logical port used for data communication with the second storage node in addition to the first data communication logical port, and

when detecting transition of the first data communication logical port to an error state,

the first storage node notifies the second storage node of the identification number and the state of the first data communication logical port using the control data communication logical port.

11. The storage device according to claim 1, wherein

the first storage node further has a fifth data communication logical port used for data communication with a third storage node which is one of the plurality of storage nodes, and

the first error communication logical port is used in order to notify the third storage node of a state of the fifth data communication logical port in addition to notifying the second storage node of the state of the first data communication logical port.

12. The storage device according to claim 1, wherein

the internal network is a network of an InfiniBand standard, and

the logical port is a Queue Pair.

13. The storage device according to claim 12, wherein

when notifying the identification number and the state of the first data communication logical port or the second data communication logical port, the storage node performs the notification by creating a request in which the identification number and the state are set to an Immediate Data of an RDMA Write with Immediate operation, and then posting the request to the Queue Pair.

14. A method for controlling a storage device having:

a plurality of storage nodes, each of which has a plurality of logical ports having send and receive queues for a communication request and an identification number; and

an internal network interconnecting the plurality of storage nodes, wherein

a first storage node among the plurality of storage nodes has, as the logical ports, a first data communication logical port used for data communication with a second storage node and a first error communication logical port used in order to notify the second storage node of a state of the first data communication logical port, and

the second storage node among the plurality of storage nodes has, as the logical ports, a second data communication logical port used for data communication with the first storage node in the logical port serving as a communication destination of the first data communication logical port and a second error communication logical port used in order to notify the first storage node of a state of the second data communication logical port, the method wherein

when detecting transition of the first data communication logical port to an error state,

the first storage node notifies the second storage node of an identification number and a state of the first data communication logical port using the first error communication logical port.

15. The method for controlling a storage device according to claim 14, wherein

when detecting transition of the first data communication logical port to the error state,

the first storage node discards the first data communication logical port,

creates a third data communication logical port used for data communication with the second storage node, and then

notifies the second storage node of an identification number of the third data communication logical port created above using the first error communication logical port.