Apparatus, system and method incorporating virtualization for data storage

• US 20070143559A1
• Filed: 12/20/2005
• Published: 06/21/2007
• Est. Priority Date: 12/20/2005
• Status: Abandoned Application

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Yagawa, Yuichi
• Application Number:
  US11/311,489
• Publication Number:
  US 20070143559A1
• Time in Patent Office: Days
• US Class Current: 711/170
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: G06F 3/0605 by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0625 Power saving in storage systems
• CPC Class Codes: G06F 3/0634 by changing the state or mode of one or more devices
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

For long-term data preservation, a storage virtualization system contains a metadata extraction module, an indexing module, a search module, and a virtualization module. The system utilizes two types of virtual volumes: unmarked volumes and marked volumes. The metadata extraction module extracts metadata that describes the data stored in logical volumes located in external storage. The indexing module scans the data and creates an index, and the index and metadata are stored in a local storage. After metadata is extracted for all data in a volume, and all data in the volume are indexed, the virtual volume corresponding to that volume is marked and the volume is ready to be made inactive. The search module allows a user to search for desired data using the metadata and the index stored in the local storage instead having to access the external storage systems where the data is actually stored.

Claims

1. A system for storing data that incorporates a virtualization system, comprising:

a virtualization module for creating one or more virtual volumes mapping to one or more logical volumes storing data on an external storage system;

a metadata extraction module for extracting metadata from data in the one or more logical volumes as mapped by the one or more virtual volumes;

wherein the metadata enables searching of the data in the virtual volumes and determining a location of the data in said one or more logical volumes on the external storage system to which the virtual volumes are mapped.

2. The system of claim 1, further including:

an indexing module for indexing the data to create an index representing content of the data,

wherein the index as well as the metadata enables searching of the data in the virtual volumes and determining a location of the data in said one or more logical volumes on the external storage system to which the virtual volumes are mapped.

3. The system of claim 2, further including:

a graphic interface that simulates searching of said virtual volumes for desired data,

wherein, by searching said metadata and/or said index and using the results of the searching, a location of the desired data may be determined without searching said logical volumes to which the virtual volumes are mapped.

4. The system of claim 2, wherein:

when the virtualization system has completed metadata extraction and indexing of data in a logical volume mapped by a virtual volume, the virtual volume mapping thereto is marked as an indication that the logical volume may be made inactive.

5. The system of claim 4, wherein:

a logical volume that has been made inactive may be made active in response to an access request from the virtualization system, whereby a specified file or data may be accessed in said logical volume.

6. The system of claim 2, wherein:

the physical location of data is determined from the metadata as the metadata is extracted from the logical volumes.

7. The system of claim 2, further including:

a host in communication with the virtualization system, said host including a graphic user interface that enables a user to search the one or more virtual volumes in simulation of searching corresponding logical volumes by searching said metadata or said index, and

providing results based on the extracted metadata or index, the results including a physical location in the external storage system of data for which the user is searching.

8. The system of claim 2 further including:

a controller, said controller executing said virtualization module for creating the one or more virtual volumes mapping to the one or more logical volumes storing data on the external storage system; and

an information processing device separate from said controller for executing said metadata extraction module for extracting metadata from the data in the one or more logical volumes mapped by the one or more virtual volumes, and for executing said indexing module for indexing the data to create an index representing content of the data.

15. The virtualization system of claim 8, further including:

a host in communication with the virtualization system, said host including a graphic user interface that enables a user to search the virtual volumes as if searching corresponding logical volumes by searching said metadata and/or said index, and wherein the virtualization system provides results from the extracted metadata, said results including a physical location in the external storage system of data for which a user is searching.

9. A virtualization system for a storage system including a virtualization module for mapping, on a one-to-one basis, a plurality of virtual volumes to a plurality of logical volumes located in external storage devices in communication with the virtualization system, said virtualization system comprising:

a metadata extraction module for extracting metadata from data stored in the logical volumes and storing the metadata in a local storage;

an indexing module for creating an index representing data stored in the logical volumes,

whereby, when extraction of metadata from a particular logical volume has been completed and the data stored on the particular logical volume has been indexed, a particular virtual volume mapping to the particular logical volume is marked whereby a communication is sent to the external storage system to indicate that the particular logical volume may be made inactive.

10. The virtualization system of claim 9, wherein:

the particular virtual volume mapping to the particular logical volume is marked to indicate that the particular logical volume may be made inactive.

11. The virtualization system of claim 9, wherein:

the location of data in the particular logical volume may be determined by searching the index and accessing the stored metadata while said particular logical volume is inactive.

12. The virtualization system of claim 9, further including a graphic user interface that displays whether desired data is located in a logical volume whose status is active or inactive.

13. The virtualization system of claim 10, wherein;

when all virtual volumes mapping to all corresponding logical volumes in a storage system have been marked, the storage system is made inactive.

14. The virtualization system of claim 9, wherein

the physical location of data is determined during extraction of metadata for the data by accessing a table that maps the particular virtual volume to the corresponding particular logical volume.

16. The virtualization system of claim 9, wherein:

a controller is provided for said mapping, on a one-to-one basis, said plurality of virtual volumes to said plurality of logical volumes; and

an information processing device separate from the controller is provided for said extracting of metadata from data stored in the logical volumes and said creating of an index of data stored in the logical volumes.

17. A method for storing data, comprising:

providing a virtualization system including a virtualization module that creates virtual volumes that map to logical volumes in one or more external storage systems;

extracting metadata from data in the logical volumes mapped by corresponding virtual volumes;

adding, to an index, index information representing the data from which the metadata is extracted; and

upon completing of extracting the metadata and adding of index information from all data in a particular logical volume mapped by a particular virtual volume, sending a communication to the external storage device containing the particular logical volume indicating that the particular logical volume can be made inactive.

18. The method of claim 17, further including the step of:

making the external storage system inactive, when all logical volumes contained in that storage system have been indicated to be made inactive.

19. The method of claim 17, further including the step of:

providing a graphic user interface that simulates searching of a virtual volume by searching the index and returning results from the extracted metadata, said results including the physical location of desired data in the results returned from searching.

20. The method of claim 17, further including the step of:

marking the particular virtual volume upon completing of extracting the metadata and adding of index information from all data in the particular logical volume mapped by the particular virtual volume, said marking indicating that the particular logical volume mapped by the particular virtual can be made inactive.

21. The method of claim 17, further including the step of:

providing a controller and an appliance, wherein

said controller carries out said step of creating virtual volumes that map to logical volumes, and

said appliance carries out said steps of extracting metadata from data in the logical volumes mapped by corresponding virtual volumes and adding, to an index, index information representing the data from which the metadata is extracted.

22. A system for storing data, comprising:

a storage controller;

an information processing device separate from said controller and in communication therewith; and

one or more storages in communication with said controller and having one or more logical volumes, wherein

the controller creates virtual volumes that map to logical volumes in the one or more storages;

the information processing device extracts metadata from data in the one or more logical volumes mapped by corresponding virtual volumes, and adds, to an index, index information represent the data from which the metadata is extracted; and

the metadata and/or the index enables searching of the virtual volumes to determine the location of data in the one or more logical volumes.