Block caching between a host device client and storage array in a shared storage environment

• US 9,672,151 B1
• Filed: 12/17/2012
• Issued: 06/06/2017
• Est. Priority Date: 12/17/2012
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Pedone, Jr., James M., Ma, Gang, Faibish, Sorin, Tzelnic, Percy
• Primary Examiner(s): Bragdon, Reginald
• Assistant Examiner(s): Wang, Edward
• Application Number:
  US13/717,004
• Time in Patent Office: 1,632 Days
• Field of Search: 711141
• CPC Class Codes: G06F 12/0808 with cache invalidating means G06F12/0815 takes precedence
• CPC Class Codes: G06F 12/0815 Cache consistency protocols
• CPC Class Codes: G06F 12/084 with a shared cache
• CPC Class Codes: G06F 12/0871 Allocation or management of cache space
• CPC Class Codes: G06F 12/0888 using selective caching, e.g. bypass
• CPC Class Codes: G06F 12/12 Replacement control
• CPC Class Codes: G06F 2212/1016 Performance improvement
• CPC Class Codes: G06F 2212/283 Plural cache memories
• CPC Class Codes: G06F 2212/311 In host system
• CPC Class Codes: G06F 2212/314 In storage network, e.g. network attached cache
• CPC Class Codes: G06F 2212/6046 Using a specific cache allocation policy other than replacement policy
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0655 Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/0679 Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP]
• CPC Class Codes: G06F 3/0683 Plurality of storage devices
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

A storage system comprises a shared storage environment that includes a storage array having at least one storage volume shared between first and second host devices. The storage system further comprises a server associated with the storage array, at least first and second clients associated with the respective first and second host devices, and a first block cache arranged between the first client and the storage array. The server is configured to coordinate operations of the first and second clients relating to the storage volume shared between the first and second host devices in a manner that ensures coherency of data stored in the first block cache. The server may comprise a storage block mapping protocol (SBMP) server and the first and second clients may comprise respective SBMP clients. The block cache is illustratively implemented using a VFCache or other type of server flash cache.

Claims

1. An apparatus comprising:

a shared storage environment comprising a storage array having at least one storage volume shared between first and second host devices;

a server associated with the storage array and external to the first and second host devices;

at least first and second clients implemented on the respective first and second host devices;

a first block cache located between the first client and the storage array, wherein the first block cache is implemented externally to the storage array; and

at least one of an iSCSI driver and a Fibre Channel driver coupled between the first block cache and the storage array;

wherein the first client communicates with the storage array over at least first and second distinct paths, the first path connecting the first client to the storage array via the server and the second path connecting the first client to the storage array via the first block cache; and

wherein the server is configured to coordinate operations of the first and second clients relating to the storage volume shared between the first and second host devices in a manner that ensures coherency of data blocks stored in the first block cache.

2. The apparatus of claim 1 wherein the server comprises a storage block mapping protocol (SBMP) server and the first and second clients comprise respective SBMP clients.

3. The apparatus of claim 1 wherein the server is configured to coordinate operations of the first and second clients relating to the storage volume shared between the first and second host devices at least in part by being configured to grant locks on particular data blocks in the shared storage volume to only one of the first and second clients at a time responsive to lock requests from those clients.

4. The apparatus of claim 1 wherein the server is configured to coordinate operations of the first and second clients relating to the storage volume shared between the first and second host devices at least in part by being configured to receive from the first client a lock request for a first range of data blocks in the shared storage volume, to grant a lock on the first range of data blocks to the first client responsive to the lock request from the first client, to subsequently receive from the second client a lock request for a second range of data blocks comprising at least a portion of the first range of data blocks, to notify the first client that its lock on the first range of data blocks is revoked, and to grant a lock on the second range of data blocks to the second client responsive to the lock request from the second client.

5. The apparatus of claim 4 wherein the first client is configured to store the first range of data blocks in the fir block cache and to access those data blocks from the first block cache as long as its granted lock on the first range of data blocks remains valid.

6. The apparatus of claim 1 further comprising a second block cache located between the second client and the storage array, wherein the second block cache is implemented externally to the storage array.

7. The apparatus of claim 6 wherein the server is configured to coordinate operations of the first and second clients relating to the storage volume shared between the first and second host devices in a manner that ensures coherency of data stored in the first block cache and ensures coherency of data stored in the second block cache.

8. The apparatus of claim 1 wherein the first client and the first block cache are implemented on the first host device.

9. The apparatus of claim 1 wherein the server is implemented within an array controller of the storage array.

10. The apparatus of claim 1 wherein the first block cache comprises an internal cache of the first host device and further wherein an external cache is coupled between the second host device and the storage array.

11. The apparatus of claim 10 wherein the server is implemented with the external cache.

12. The apparatus of claim 1 wherein the first block cache comprises a server flash cache.

13. The apparatus of claim 1 wherein the fir block cache comprises a designated portion of an internal memory of the first host device.

14. A processing platform that incorporates the apparatus of claim 1.

15. A method comprising:

configuring a storage array of a shared storage environment to include at least one storage volume shared between first and second host devices having respective first and second clients implemented thereon; and

coordinating operations of the first and second clients relating to the storage volume shared between the first and second host devices in a manner that ensures coherency of data stored in a first block cache located between the first client and the storage array;

wherein the first block cache is implemented externally to the storage array;

wherein at least one of an iSCSI driver and a Fibre Channel driver is coupled between the first block cache and the storage array; and

wherein the first client communicates with the storage array over at least first and second distinct paths, the first path connecting the first client to the storage array via the server and the second path connecting the first client to the storage array via the first block cache.

16. The method of claim 15 wherein at least one of the configuring and coordinating is implemented in an array controller associated with the storage array.

17. The method of claim 15 wherein at least one of the configuring and coordinating is implemented in a server associated with the storage array, wherein the server is external to the first and second host devices.

18. The method of claim 17 wherein the server communicates with the first and second clients utilizing a storage block mapping protocol (SBMP).

19. The method of claim 15 wherein coordinating operations of the first and second clients relating to the storage volume shared between the first and second host devices comprises granting locks on particular data blocks in the shared storage volume to only one of the first and second clients at a time responsive to lock requests from those clients.

20. The method of claim 15 wherein coordinating operations of the first and second clients relating to the storage volume shared between the first and second host devices comprises:

receiving from the first client a lock request for a first range of data blocks in the shared storage volume;

granting a lock on the first range of data blocks to the first client responsive to the lock request from the first client;

subsequently receiving from the second client a lock request for a second range of data blocks comprising at least a portion of the first range of data blocks;

notifying the first client that its lock on the first range of data blocks is revoked; and

granting a lock on the second range of data blocks to the second client responsive to the lock request from the second client.

21. The method of claim 20 further comprising the first client storing the first range of data blocks in the first block cache and accessing those data blocks from the fir block cache as long as the corresponding lock granted to the first client remains valid.

22. A computer program product comprising a non-transitory processor-readable storage medium having encoded therein executable code of one or more software programs, wherein the one or more software programs when executed cause a processing platform to:

configure a storage array of a shared storage environment to include at least one storage volume shared between first and second host devices having respective first and second clients implemented thereon; and

coordinate operations of the first and second clients relating to the storage volume shared between the first and second host devices in a manner that ensures coherency of data stored in a first block cache located between the first client and the storage array;

wherein the first block cache is implemented externally to the storage array;

wherein at least one of an iSCSI driver and a Fibre Channel driver is coupled between the first block cache and the storage array; and

wherein the first client communicates with the storage array over at least first and second distinct paths, the first path connecting the first client to the storage array via the server and the second path connecting the first client to the storage array via the first block cache.