File input/output control device and method for the same

• US 7,159,050 B2
• Filed: 06/28/2004
• Issued: 01/02/2007
• Est. Priority Date: 01/27/2004
• Status: Expired due to Fees

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Iwasaki, Masaaki, Miyata, Kenichi
• Primary Examiner(s): Huynh; Kim
• Assistant Examiner(s): Schneider; Joshua D.
• Application Number:
  US10/876,647
• Publication Number:
  US 20050165972A1
• Time in Patent Office: 918 Days
• Field of Search: 707/2, 707/9, 707/10, 707100-102, 707/104.1, 707200-206, 711/100, 711111-114, 711148-156, 711161-165, 711170-173, 713/150, 713/153, 713/200, 713/201, 710/1, 710/5, 710/6, 710/30, 710/31, 710/33, 710/34, 710/36, 710/38, 710/62, 710/72, 710/74
• US Class Current: 710/33
• CPC Class Codes: G06F 2211/1028 Distributed, i.e. distributed RAID systems with parity
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: Y10S 707/99952 Coherency, e.g. same view to multiple users
• CPC Class Codes: Y10S 707/99953 Recoverability

Abstract

In a technology for dividing a file into a plurality of fragments which are distributed to a plurality of storage devices, to maintain a high level of security and fault tolerance, while storing the file on fewer storage devices than in the past.

A file input/output control device 200, upon receiving a file from a client 100, constructs a plurality of fragments from a file with reference to a predetermined number of divisions and redundancy. A file input/output control device 200 allows a plurality of fragments to be stored on a single storage device, but distributes fragments to storage devices 300 in such a way as to avoid sending a single type of fragment to any one storage device, and to avoid sending all types of fragments to any one storage device. By so doing, file input/output control device 200 ensures security against cracking and system fault tolerance, while enabling files to be stored on fewer storage devices than in the past.

Claims

1. A file input/output control device for controlling input/output of a file to and from a plurality of storage devices, the file input/output control device comprising:

an information transmission unit that connects said storage devices;

a fragment unit for constructing a plurality of fragments from said file according to a predetermined number of divisions n (n is an integer ≧

2) such that the fragments are derived by dividing said file into n fragments having predetermined redundancy r (r is an integer ≧

2), said n fragments including fragments of different types; and

a fragment output unit for outputting the constructed fragments to m (m is an integer ≧

2) of said storage devices, in such a way as to store at least one group having a plurality of fragments of any type in one storage device, while not storing fragments of the same type on any one storage device, and while not storing fragments of all types on any one storage device,

wherein each fragment is assigned a unique fragment identifier which is different from the fragment identifiers of the other fragments, said unique fragment identifier uniquely identifies said fragment to which it is assigned relative to the other fragments based on a type of said fragment.

2. A file input/output control device according to claim 1, wherein said fragment output unit outputs said fragments to a number m (m is an integer) of storage devices fulfilling the relationship:

m>

nr/(n−

1).

3. A file input/output control device according to claim 1, the file input/output control device further comprising:

an identifier assigning unit for assigning to each said fragment a unique fragment identifier depending on the type of said fragment; and

a distribution memory unit for storing said fragment identifier, in association with the storage device which is the destination of the fragment corresponding to said fragment identifier.

4. A file input/output control device according to claim 3, wherein said fragment input unit, in the event of being unable to input one fragment, makes reference to said distribution memory unit to input said one fragment from another storage device having said one fragment stored therein.

5. A file input/output control device according to claim 4, wherein said fragment input unit, in the event of being unable to input one fragment, makes reference to said distribution memory unit to input said one fragment from another storage device having said one fragment stored therein.

6. A file input/output control device according to claim 1, the file input/output control device further comprising an encryption unit for performing encryption of said file prior to geeration of said fragments by said fragment unit.

7. A file input/output control device according to claim 1, the file input/output control device further comprising an encryption unit for performing encryption of said fragments.

8. A file input/output control device according to claim 1, wherein said file is given a file identifier, and the file input/output control device further comprise an encryption unit that uses said file identifier as key information to perform encryption of at least one of said file and said fragments.

9. A file input/output control device for controlling input/output of a file to and from a plurality of storage devices, the file input/output control device comprising:

an information transmission unit that connects said storage devices;

a fragment unit for constructing a plurality of fragments from said file according to a predetermined number of divisions n (n is an integer ≧

2) such that the fragments are derived by dividing said file into n fragments having a predetermined redundancy r (r is an integer ≧

2), said n fragments including fragments of different types;

a fragment output unit for outputting the constructed fragments to m (m is an integer ≧

2) of said storage devices, in such a way as to store at least one group having a plurality of fragments of any type in one storage device, while not storing fragments of the same type on any one storage device, and while not storing fragments of all types on any one storage device;

a fragment input unit for inputting fragments of all types from said storage devices; and

a file reconstruction unit for reconstructing said file from said fragments of all types,

wherein seid fragment input unit inputs said fragment from the storage device storing a fragment of the same type and having the shortest transmission time to said file input/output control device.

10. A method for a computer to control input/output of a file to and from a plurality of storage devices, said method comprising:

connecting said storage devices by a predetermined information transmission unit;

constructing a plurality of fragments from said file according to a predetermined number of divisions n (n is an integer ≧

2) such that the fragments are derived by dividing said file into n fragments having a predetermined redundancy r (r is an integer ≧

2), said n fragments including fragments of different types; and

outputting the constructed fragments to m (m is an integer ≧

2) of said storage devices, in such a way as to store at least one group having a plurality of fragments of any type in one storage device while not storing fragments of the same type on any one storage device, and while not storing fragments of all types on any one storage device,

wherein each fragment is assigned a unique fragment identifier which is different from the fragment identifiers of the other fragments, said unique fragment identifier uniquely identifies said fragments to which it is assigned relative to the other fragments based on a type of said fragment.

11. A program stored on a storage medium, for controlling input/output of a file to and from a plurality of storage devices connected by a predetermined information transmission system, said program when executed causes a computer to perform;

a first function of constructing a plurality of fragments from said file according to a predetermined number of divisions n (n is an integer ≧

2) such that the fragments are derived by dividing said file into n fragments having a predetermined redundancy r (r is an integer ≧

2), said n fragments including fragments of different types; and

a second function of outputting the constructed fragments to m (m is an integer ≧

2) of said storage devices, in such a way as to store at least one group having a plurality of fragments of any type in. one storage device, while not storing fragments of the same type on any one storage device, and while not storing fragments of all types on any one storage device,

wherein each fragment is assigned a unique fragment identifier which is different from the fragment identifiers of the other fragments, said unique fragment identifier uniquely identifies said fragments which it is assigned relative to the other fragments based on a type of said fragment.