METHOD AND APPARATUS FOR MANAGING THIN PROVISIONING VOLUME BY USING FILE STORAGE SYSTEM

• US 20100306500A1
• Filed: 06/02/2009
• Published: 12/02/2010
• Est. Priority Date: 06/02/2009
• Status: Active Grant

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: MIMATSU, Yasuyuki
• Granted Patent: US 8,504,797 B2
• Time in Patent Office: Days
• US Class Current: 711/209
• CPC Class Codes: G06F 3/0605 by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0643 Management of files
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

In one embodiment, a method of operating block-based thin provisioning disk volumes in a system including a first storage system which is connected via a network to a second storage system comprises, in response to a volume creation request to create a thin provisioning disk volume in the first storage system, recording in the first storage system attribute information of the block-based thin provisioning disk volume; specifying a directory path for the block-based thin provisioning disk volume in a file system in the second storage system; and creating a directory for the block-based thin provisioning disk volume under the specified directory path.

Claims

1. A method of operating block-based thin provisioning disk volumes in a system including a first storage system which is connected via a network to a second storage system, the method comprising:

in response to a volume creation request to create a thin provisioning disk volume in the first storage system, recording in the first storage system attribute information of a block-based thin provisioning disk volume;

specifying a directory path for the block-based thin provisioning disk volume in a file system in the second storage system; and

creating a directory for the block-based thin provisioning disk volume under the specified directory path.

2. A method according to claim 1, wherein the attribute information of the block-based thin provisioning disk volume is stored in a disk volume table and comprises at least one of:

a volume ID of the block-based thin provisioning disk volume;

a file-based flag indicating that each disk block in the block-based thin provisioning disk volume is stored as a disk block file in the file system in the second storage system;

a volume size of said each disk block;

a file size representing a number of sectors in each disk block file stored in the second storage system;

a part of a file path for each disk block file stored therein;

or

a compression algorithm for compressing data in each disk block.

3. A method according to claim 1, wherein the disk block files are grouped into disk block groups and the file path further includes a disk block group number of the disk block group to which the disk block belongs, and wherein the attribute information of the block-based thin provisioning disk volume further comprises at least one of:

for each disk block group, a disk block group size which defines a number of disk block files in the disk block group;

or

for each disk block group, a base directory for the disk block group.

4. A method according to claim 1, wherein the second storage system is one of a plurality of storage service providers,

wherein the file path is a URL which includes a base URL of the second storage system, a storage ID of the first storage system, a volume ID of the block-based thin provisioning disk volume in the first storage system, a file name including or based on a disk block number of the disk block stored as the disk block file in the second storage system, and an extension representing a compression algorithm used to compress the disk block, and wherein the attribute information of the block-based thin provisioning disk volume further comprises a current provider indicating the storage service provider currently accessed.

5. A method according to claim 1, wherein the second storage system is one of a plurality of network-attached storage systems, wherein the file path includes a base directory for each file system in the network-attached storage systems.

6. A method according to claim 1, further comprising:

in response to a volume deletion request to delete a block-based thin provisioning disk volume in the first storage system, deleting all disk block files and the directory stored in the second storage system for the block-based thin provisioning disk volume specified in the volume deletion request, and deleting the attribute information of the block-based thin provisioning disk volume.

7. A method according to claim 1, further comprising:

receiving a request selected from the group consisting of a volume discovery request, a shutdown request, and a file system table management request;

if the request is a volume discovery request, reading a configuration file which contains ID of one or more storage systems specified in the volume discovery request or ID of the first storage system which receives the volume discovery request from each file system exported by the second storage system, selecting a configuration file from the read configuration files which has a newest timestamp and recording values of the selected configuration file to the file system table and the disk volume table, and renaming directories under each base directory from an ID specified in the configuration file to an ID of the first storage system;

if the request is a shutdown request, storing a configuration file which includes a file system table for recording file system information of the second storage system, the disk volume table, a storage system ID of the first storage system, and a current time in each file system which is recorded in the file system table, and unmounting all file systems and shutting down the first storage system; and

if the request is a file system table management request, sending current values in a file system table for recording file system information of the second storage system to a management server connected to the network, receiving new values from the management server and recording the new values in the file system table, and mounting file systems specified in the file system table.

8. A method according to claim 1, in response to a block read request to read data in the block-based thin provisioning disk volume in the first storage system, further comprising:

retrieving a start logical block address and size to be read from the read request;

identifying one or more disk block files of the block-based thin provisioning disk volume to be read;

reading each disk block file from the second storage system;

if the reading is successful, storing the disk block read into a buffer memory;

if the reading fails because the disk block file of the block-based thin provisioning disk volume to be read does not exist, storing zeros into a buffer memory; and

returning the data stored in the buffer memory to an application server.

9. A method according to claim 1, in response to a block write request to write data in the block-based thin provisioning disk volume in the first storage system, further comprising:

retrieving a start logical block address, size of data, and data to be written from the write request;

identifying one or more disk block files of the block-based thin provisioning disk volume to be written;

dividing the data into data blocks; and

writing each of the divided data blocks as the identified disk block file to the second storage system.

10. A system of operating block-based thin provisioning disk volumes, the system comprising:

a first storage system;

a second storage system; and

a network connecting the first storage system and the second storage system;

wherein, in response to a volume creation request to create a thin provisioning disk volume in the first storage system, the first storage system records attribute information of the block-based thin provisioning disk volume in the first storage system;

wherein the first storage system specifies a directory path for the block-based thin provisioning disk volume in a file system in the second storage system; and

wherein the first storage system creates a directory for the block-based thin provisioning disk volume under the specified directory path.

11. A system according to claim 10, wherein the attribute information of the block-based thin provisioning disk volume is stored in a disk volume table and comprises at least one of:

a volume ID of the block-based thin provisioning disk volume;

a file-based flag indicating that each disk block in the block-based thin provisioning disk volume is stored as a disk block file in the file system in the second storage system;

a volume size of said each disk block;

a file size representing a number of sectors in each disk block file stored in the second storage system;

a part of a file path for each disk block file stored therein;

or

a compression algorithm for compressing data in each disk block.

12. A system according to claim 10, wherein the first storage system:

in response to a volume deletion request to delete a block-based thin provisioning disk volume in the first storage system, deletes all disk block files and the directory stored in the second storage system for the block-based thin provisioning disk volume specified in the volume deletion request, and deleting the attribute information of the block-based thin provisioning disk volume.

13. A system according to claim 10, wherein the first storage system:

receives a request selected from the group consisting of a volume discovery request, a shutdown request, and a file system table management request;

if the request is a volume discovery request, reads a configuration file which contains ID of one or more storage systems specified in the volume discovery request or ID of the first storage system which receives the volume discovery request from each file system exported by the second storage system, selects a configuration file from the read configuration files which has a newest timestamp and recording values of the selected configuration file to the file system table and the disk volume table, and renames directories under each base directory from an ID specified in the configuration file to an ID of the first storage system;

if the request is a shutdown request, stores a configuration file which includes a file system table for recording file system information of the second storage system, the disk volume table, a storage system ID of the first storage system, and a current time in each file system which is recorded in the file system table, and unmounts all file systems and shuts down the first storage system; and

if the request is a file system table management request, sends current values in a file system table for recording file system information of the second storage system to a management server connected to the network, receives new values from the management server and recording the new values in the file system table, and mounts file systems specified in the file system table.

14. A system according to claim 10, wherein the first storage system:

retrieves a start logical block address and size to be read from the read request;

identifies one or more disk block files of the block-based thin provisioning disk volume to be read;

reads each disk block file from the second storage system;

if the reading is successful, stores the disk block read into a buffer memory;

if the reading fails because the disk block file of the block-based thin provisioning disk volume to be read does not exist, stores zeros into a buffer memory; and

returns the data stored in the buffer memory to an application server.

15. A system according to claim 10, wherein the first storage system, in response to a block write request to write data in the block-based thin provisioning disk volume in the first storage system:

retrieves a start logical block address, size of data, and data to be written from the write request;

identifies one or more disk block files of the block-based thin provisioning disk volume to be written;

divides the data into data blocks; and

writes each of the divided data blocks as the identified disk block file to the second storage system.

16. A computer-readable storage medium storing a plurality of instructions for controlling a data processor to operate block-based thin provisioning disk volumes in a system including a first storage system which is connected via a network to a second storage system, the plurality of instructions comprising:

instructions that cause the data processor, in response to a volume creation request to create a thin provisioning disk volume in the first storage system, to record in the first storage system attribute information of the block-based thin provisioning disk volume;

instructions that cause the data processor to specify a directory path for the block-based thin provisioning disk volume in a file system in the second storage system; and

instructions that cause the data processor to create a directory for the block-based thin provisioning disk volume under the specified directory path.

17. A computer-readable storage medium according to claim 16, wherein the plurality of instructions further comprise:

instructions that cause the data processor, in response to a volume deletion request to delete a block-based thin provisioning disk volume in the first storage system, to delete all disk block files and the directory stored in the second storage system for the block-based thin provisioning disk volume specified in the volume deletion request, and delete the attribute information of the block-based thin provisioning disk volume.

18. A computer-readable storage medium according to claim 16, wherein the plurality of instructions further comprise:

instructions that cause the data processor to receive a request selected from the group consisting of a volume discovery request, a shutdown request, and a file system table management request;

instructions that cause the data processor, if the request is a volume discovery request, to read a configuration file which contains ID of one or more storage systems specified in the volume discovery request or ID of the first storage system which receives the volume discovery request from each file system exported by the second storage system, select a configuration file from the read configuration files which has a newest timestamp and recording values of the selected configuration file to the file system table and the disk volume table, and rename directories under each base directory from an ID specified in the configuration file to an ID of the first storage system;

instructions that cause the data processor, if the request is a shutdown request, to store a configuration file which includes a file system table for recording file system information of the second storage system, the disk volume table, a storage system ID of the first storage system, and a current time in each file system which is recorded in the file system table, and unmount all file systems and shutting down the first storage system; and

instructions that cause the data processor, if the request is a file system table management request, to send current values in a file system table for recording file system information of the second storage system to a management server connected to the network, receive new values from the management server and recording the new values in the file system table, and mount file systems specified in the file system table.

19. A computer-readable storage medium according to claim 16, wherein the plurality of instructions further comprise, in response to a block read request to read data in the block-based thin provisioning disk volume in the first storage system:

instructions that cause the data processor to retrieve a start logical block address and size to be read from the read request;

instructions that cause the data processor to identify one or more disk block files of the block-based thin provisioning disk volume to be read;

instructions that cause the data processor to read each disk block file from the second storage system;

instructions that cause the data processor, if the reading is successful, to store the disk block read into a buffer memory;

instructions that cause the data processor, if the reading fails because the disk block file of the block-based thin provisioning disk volume to be read does not exist, to store zeros into a buffer memory; and

instructions that cause the data processor to return the data stored in the buffer memory to an application server.

20. A computer-readable storage medium according to claim 16, wherein the plurality of instructions further comprise, in response to a block write request to write data in the block-based thin provisioning disk volume in the first storage system:

instructions that cause the data processor to retrieve a start logical block address, size of data, and data to be written from the write request;

instructions that cause the data processor to identifying one or more disk block files of the block-based thin provisioning disk volume to be written;

instructions that cause the data processor to divide the data into data blocks; and

instructions that cause the data processor to write each of the divided data blocks as the identified disk block file to the second storage system.