STORAGE SYSTEM

• US 20130339320A1
• Filed: 11/30/2011
• Published: 12/19/2013
• Est. Priority Date: 01/28/2011
• Status: Active Grant

• Current Assignee: NEC Corporation
• Original Assignee: NEC Corporation
• Inventors: Noda, Kenji
• Granted Patent: US 9,858,287 B2
• Time in Patent Office: Days
• US Class Current: 707/692
• CPC Class Codes: G06F 11/1004 to protect a block of data words, e.g. CRC or checksum G06F11/1076 takes precedence; security arrangements for protecting computers or computer systems against unauthorized activity G06F21/00
• CPC Class Codes: G06F 11/1453 using de-duplication of the data
• CPC Class Codes: G06F 16/1748 De-duplication implemented within the file system, e.g. based on file segments de-duplication techniques in storage systems for the management of data blocks G06F3/0641
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0641 De-duplication techniques

Abstract

The storage system includes a data dividing means for dividing writing target data into a plurality of units of partial data, and generating units of new divided file data; an index file generation means for generating, for each of the units of partial data, an index entry, and generating index file data by adding test data for error detection; a data writing means for writing the divided file data and the index file data; and a recovery means for detecting an error in the index entries written in the storage device, based on the test data included in each of the index entries. The recovery means deletes an index entry in which an error is detected and all of the subsequent index entries in the index file data stored in the storage device, from the index file data.

Claims

1. A storage system comprising:

a data dividing unit that divides data, to be written into a given storage device, into a plurality of units of partial data, sorts the units of the partial data into a plurality of classifications according to a predetermined criterion, and for each of the classifications, generates new divided file data by linking the units of the partial data;

an index file generation unit that generates, for each of the units of the partial data, an index entry including location information in the data to be written before division of the units of the partial data and location information in the divided file data generated after the division of the units of the partial data, adds test data for error detection to the index entry, and generates index file data by linking a plurality of the index entries;

a data writing unit that writes the divided file data generated by the data dividing unit, and the index file data generated by the index file generation unit, into the storage device; and

a recovery unit that detects an error in the index entries written in the storage device, based on the test data included in each of the index entries, wherein

the recovery unit deletes an index entry in which an error is detected and all of subsequent index entries in the index file data stored in the storage device, from the index file data.

2. The storage system, according to claim 1, wherein

the recovery unit performs error detection processing on the index entries in the index file data stored in the storage device, in sequence from the end of the index file data.

3. The storage system, according to claim 2, wherein

the data writing unit stores, in the storage device, an index entry having been written in the storage device, among the index entries in the index file data, while adding specific information to the index entry, and

when the recovery unit performs the error detection processing on the index entries in sequence from the end of the index file data, if the specific information is added to any of the index entries, the recovery unit stops the error detection processing of the index entries.

4. The storage system, according to claim 1, wherein

the index file generation unit allows each of the index entries to include data size information representing a data size of a unit of the partial data corresponding to the index entry, and

the recovery unit modifies a file size of the divided file data based on information included in an index entry located at the end of the index file data having been recovered after deletion of the index entry in which an error was detected and all of the subsequent index entries.

5. The storage system, according to claim 4, wherein

the recovery unit extends or deletes the end of the divided file data such that the file size of the divided file data conforms to a file size, the file size being information included in the index entry located at the end of the recovered index file data, and being specified by location information in the divided file data in which the unit of the partial data corresponding to the index entry is included, and the data size information of the unit of the partial data.

6. A non-transitory computer-readable medium storing a program comprising instructions for causing an information processing device to realize:

a data dividing unit that divides data, to be written into a given storage device, into a plurality of units of partial data, sorts the units of the partial data into a plurality of classifications according to a predetermined criterion, and for each of the classifications, generates new divided file data by linking the units of the partial data;

an index file generation unit that generates, for each of the units of the partial data, an index entry including location information in the data to be written before division of the units of the partial data and location information in the divided file data generated after the division of the units of the partial data, adds test data for error detection to the index entry, and generates index file data by linking a plurality of the index entries;

a data writing unit that writes the divided file data generated by the data dividing unit, and the index file data generated by the index file generation unit, into the storage device; and

a recovery unit that detects an error in the index entries written in the storage device, based on the test data included in each of the index entries, wherein

the recovery unit deletes an index entry in which an error is detected and all of subsequent index entries in the index file data stored in the storage device, from the index file data.

7. The non-transitory computer-readable medium storing the program, according to claim 6, wherein

the recovery unit performs error detection processing on the index entries in the index file data stored in the storage device, in sequence from the end of the index file data.

8. An information processing method comprising, in an information processing device:

dividing data, to be written into a given storage device, into a plurality of units of partial data, sorting the units of the partial data into a plurality of classifications according to a predetermined criterion, and for each of the classifications, generating new divided file data by linking the units of the partial data;

generating, for each of the units of the partial data, an index entry including location information in the data to be written before division of the units of the partial data and location information in the divided file data generated after the division of the units of the partial data, adding test data for error detection to the index entry, and generating index file data by linking a plurality of the index entries;

writing the divided file data and the index file data into the storage device; and

detecting an error in the index entries written in the storage device, based on the test data included in each of the index entries, and deleting an index entry in which an error is detected and all of subsequent index entries in the index file data stored in the storage device, from the index file data.

9. The information processing method, according to claim 8, further comprising

performing error detection processing on the index entries in the index file data stored in the storage device, in sequence from the end of the index file data.