Topological data categorization and formatting for a mass storage system

• US 6,691,209 B1
• Filed: 05/26/2000
• Issued: 02/10/2004
• Est. Priority Date: 05/26/2000
• Status: Expired due to Term

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: OʼConnell, Mark Andrew
• Primary Examiner(s): Padmanabhan, Mano
• Assistant Examiner(s): Namazi, Mehdi
• Application Number:
  US09/579,427
• Time in Patent Office: 1,355 Days
• Field of Search: 707/102, 711/114, 700/200-206
• US Class Current: 711/114
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0632 by initialisation or re-initialisation of storage systems
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD
• CPC Class Codes: Y10S 707/99953 Recoverability

Abstract

A method and apparatus for storing data in a mass storage system implementing striped RAID technology by topological categorization and ordering of the data according to the topology of the storage areas. A mass storage system includes a mass storage space for storing data items of a plurality of data types. Each data item contains data of a corresponding data type and each data type is defined by the characteristics of the information represented by the data. The storage space is topologically organized as a plurality of basic units of storage space containing a predetermined number of data blocks of predetermined sizes. A data classifier categorizes each data item as a member of a data type and, for each data type, orders the data of the data items into one or more data block groups in a corresponding write buffer wherein each data block group corresponds to a basic unit of storage, and writes each data item into a corresponding data type area of the storage space. The data types include structured data types having defined data characteristics and a general data type having variable data characteristics and the general data type includes a full-basic unit data type wherein the data forms one or more data block groups conforming to the basic unit of storage space, and a partial-basic unit data type.

Claims

1. In a mass storage system including a mass storage space for storing data items of a plurality of data types, each data item containing data of a corresponding data type and each data type being defined by the characteristics of the information represented by the data, and wherein the storage space is topologically organized as a plurality of basic units of storage space wherein each basic unit of storage space contains storage space for a predetermined number of data blocks of predetermined sizes, a method for storing the data in the storage space, comprising the steps of:

categorizing each data item to be written into the storage space as a member of a data type, wherein each data type is determined according to a relationship between a size of a data item and a topology of a data storage space organization in the mass storage space, for each data type, ordering the data of the data items into one or more data block groups wherein each data block group corresponds to a basic unit of storage, and writing the data items of each data type into a corresponding data type area of the storage space.

2. The method of claim 1 for storing data in a storage space, wherein:

the data types include, structured data types having defined data characteristics, and at least one general data type having variable data characteristics.

3. The method of claim 1 for storing data in a storage space, wherein:

each basic unit of storage space is a stripe of a striped mass storage system and wherein each stripe contains storage space for a predetermined number of data blocks.

4. The method of claim 3 for storing data in a storage space, wherein:

the mass storage system is a RAID technology storage system and wherein each stripe further includes at least one data block for storing data recovery information.

5. The method of claim 1 for storing data in a storage space, wherein:

the mass storage space is structured into a plurality of data partitions wherein each data partition corresponds to a data type and is used to store data of the corresponding data type.

6. In a mass storage system including a mass storage space for storing data items of a plurality of data types, each data item containing data of a corresponding data type and each data type being define by the characteristics of the information represented by the data, and wherein the storage space is topologically organized as plurality of basic units of storage space wherein each basic unit of storage space contains storage space for a predetermined number of data blocks of predetermined sizes, a method for storing the data in the storage space comprising the steps of:

categorizing each data item to be written into the storage space as a member of a data type, for each data type ordering the data of the data items into one or more data block groups wherein each data block group corresponds to a basic unit of storage, and writing the data items of each data type into a corresponding data type area of the storage space, wherein the data types include structured data types having defined data characteristics, and at least one general data type having variable data characteristics, and the at least one general data type includes, a full-basic unit data type wherein the data of the data items form one or more data block groups wherein each data block group conforms to the basic unit of storage space, and a partial-basic unit data type wherein the data of the data items form one or more data block groups wherein each data block group differs from the basic unit of storage space.

7. In a mass storage system including a mass storage space for storing data items of a plurality of data types, each data item containing data of a corresponding data type and each data type being defined by the characteristics of the information represented by the data, and wherein the storage space is topologically organized as a plurality of basic units of storage space wherein each basic unit of storage space contains storage space for a predetermined number of data blocks of predetermined sizes, a topological data formatter for organizing the data items to be written into the storage space, comprising:

a write buffer for and corresponding to each data type, and a data classifier for, categorizing each data item to be written into the storage space as a member of a data type, wherein each data type is determined according to a relationship between a size of a data item and a topology of a data storage space organization in the mass storage space, storing each categorized data item to be written into the storage space in the corresponding write buffer so that the data of the data items is ordered into one or more data block groups wherein each data block group corresponds to a basic unit of storage, and reading the data items of each data type from the corresponding write buffer and writing the data items of each data type into a corresponding data type area of the storage space.

8. The topological data formatter of claim 7, wherein:

the data types include, structured data types having defined data characteristics, and at least one general data type having variable data characteristics.

9. The topological data formatter of claim 7, wherein:

each basic unit of storage space is a stripe of a striped mass storage system and wherein each stripe contains storage space for a predetermined number of data blocks.

10. The storage data manager of claim 9, wherein the mass storage system is a RAID technology storage system and wherein each stripe further includes at least one data block for storing data recovery information.

11. The topological data formatter of claim 7, wherein the mass storage space is structured into a plurality of data partitions wherein each data partition corresponds to a data type and is used to store data of the corresponding data type.

12. In a mass storage system including space for storing data items of a plurality of data types each data item containing data of a corresponding data type and each data type being defined by the characteristics of the information represented by the data and wherein the storage space is topologically organized a plurality of basic units of storage space wherein each basic unit of storage space contains storage space for a predetermined number of data blocks of predetermined sizes a topological data formatter for organizing the data items to be written into the storage space, comprising:

a write buffer for and corresponding to each data type, and a data classifier for categorizing each data item to be written into the storage space as a member of a data type, storing each categorized data item to be written into the storage space in the corresponding write buffer so that the data of the data items is ordered into one or more data block groups wherein each data block group corresponds to a basic unit of storage, and reading the a data items of each data type from the corresponding write buffer and writing the data items of each data type into a corresponding data type area of the storage space, wherein the data types include, structured data types having defined data characteristics, and at least one general data type having variable data characteristics, and wherein the at least one general data type includes, a full-basic unit data type wherein the data of the data items form one or more data block groups wherein each data block group conforms to the basic unit of storage space, and a partial-basic unit data type wherein the data of the data items form one or more data block groups wherein each data block group differs from the basic unit of storage space.