Storage system for content distribution

• US 20030236850A1
• Filed: 03/21/2002
• Published: 12/25/2003
• Est. Priority Date: 03/21/2002
• Status: Active Grant

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Kodama, Shoji
• Granted Patent: US 7,115,919 B2
• Time in Patent Office: Days
• US Class Current: 709/214
• CPC Class Codes: G06F 16/184 implemented as replicated file system
• CPC Class Codes: Y10S 707/99953 Recoverability
• CPC Class Codes: Y10S 707/99957 Garbage collection

Abstract

A processing system comprises a primary storage system and a plurality of secondary storage systems. The primary storage system is managed by a contents manager that keeps a file system used to make file level I/O accesses to a controller that translates the file access to block I/O to access the magnetic media for the data. The secondary storage systems are available to and accessed by application servers, also using file level I/O. The content manager may change a file or data on the primary storage system and, if so, will also change the file system accordingly. The file system is then made available to the application servers, after the controller transfers changed files to the secondary storage systems using block level I/O.

Claims

1. A data processing system comprising:

a master storage system, including storage media and a first disk controller for storing and accessing original data on the storage media;

a plurality of secondary storage systems each for storing copies of the original data, each of the secondary storage systems including a second disk controller;

the first and second disk controllers operating to receive I/O requests for access to the original data and original data copy, respectively, and storing the data using block level I/O;

a manager processor coupled to the master storage system having a file system process to respond to file level I/O requests from application programs for accessing the original data, the manager processor maintaining data structures identifying the locations of file data corresponding to the original data stored at the master storage system;

at least two server processors coupled to ones of plurality of secondary storage systems, each of the server processors having copies of at least portions of the data structures for locating file data on the secondary storage systems;

whereby the manager processor operates to write changes to file data to make corresponding changes to the original data changes the data structure to identify the changed data, and to notify the server processors that original data structures have been changed; and

whereby copies of the changed original data and data structure are sent by the master storage system to the secondary storage systems.

2. A data storage and distribution system, including a manager processor, a local data storage facility for storing a data image and a plurality of remote data facilities each for storing replications of the data image, and including

a file system executing on the manager processor operating to receive file level access requests to the local and remote data storage facilities;

block level I/O access to the data image and replicated data images

means for transferring changes to the data image to the plurality of remote storage facilities using block level I/O for making corresponding changes to the replicated data images.

3. The data storage and distribution system of claim 2, each of the plurality of remote storage facilities having couple thereto at least one server processor for accessing data contained in the replicated data image.

4. The data storage and distribution system of claim 2, wherein the local storage facility included storage media for storing the data image and a controller operating to access the storage media.

5. The data storage and distribution system of claim 4, wherein each of the remote storage facilities include storage media for storing the data image and a controller operating to access the associated storage media.

6. The data storage and distribution system of claim 5, wherein the controller operates to receive and translate file level I/O requests to block level I/O requests to change the data image.

7. The data storage and distribution system of claim 6, wherein the controller operates to perform a remote copy operation for each file level I/O request that changes the data image to copy the changes to the plurality of remote storage facilities.

8. The data storage and distribution system of claim 7, including at least one data structure maintained by the content manager identifying locations of data in the data image.

9. The data storage and distribution system of claim 8, wherein the content manager operates to change the data structure to identify locations of changes to the data manager.

10. The data storage and distribution system of claim 9, including at least one server processor coupled to each of the remote storage facilities and to the content manager, the content manager operating to forward the changed data structure to the server processors when the data image is changed.

11. A data processing system comprising:

a first data center including a master storage for storing original data, the first data center maintaining a first data structure identifying locations of file data in the original data;

a second data center including second storage for storing a copy of a least a portion of the original data, the second data center having a second data structure identifying locations of the portions of the original data;

the first data center operating to write to or change the original data, changing also the first data structure to reflect such writing or change of the original data; and

the master storage communicating to the second storage the written or changed data and the changed first data structure; and

the first data center notifying the second data center of the changed data and data structures.

12. The data processing system of claim 11, wherein the communicated data structure portion is in file level I/O format.

13. The data processing system of claim 12, wherein the written or changed data communicated to the second storage is in block level I/O format.

14. The data processing system of claim 13, wherein the master storage and the second storage are magnetic media.

15. The data processing system of claim 13, wherein the master storage and the second storage are disk storage.