System, method, and program for accessing secondary storage in a network system

• US 6,502,106 B1
• Filed: 03/25/1999
• Issued: 12/31/2002
• Est. Priority Date: 03/25/1999
• Status: Expired due to Term

• Current Assignee: LinkedIn Corporation (Microsoft Corporation)
• Original Assignee: International Business Machines Corporation
• Inventors: Makansi, Tarek, Gampper, James Michael, Wolfe, Daniel Charles
• Primary Examiner(s): Vu, Kim
• Assistant Examiner(s): Nguyen, Tam V
• Application Number:
  US09/276,413
• Time in Patent Office: 1,377 Days
• Field of Search: 707/107, 707/200, 707/3, 707/8, 707/204, 707/205, 707/206, 707/518, 707/104.1, 707/201, 707/203, 707/10, 707/219, 709/219, 709/202, 709/203, 709/207
• US Class Current: 709/202
• CPC Class Codes: G06F 16/9574 of access to content, e.g. by caching
• CPC Class Codes: Y10S 707/959 Network
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing

Abstract

Disclose is a system, method, and program for accessing files maintained in a server that is capable of being accessed over a network. A request is received for a file maintained in the server. A determination is then made as to whether a copy of the requested file is stored in a storage system. The system then determines a delay time associated with retrieving the copy of the requested file from the storage system after determining that the storage system includes the copy of the requested file. A determination is then made as to whether the delay time exceeds a maximum delay time. The system retrieves the requested file from the storage system to return to the request after determining that the delay time does not exceed the maximum delay time. Alternatively, the system retrieves the requested file from the server over the network to return to the request after determining that the delay time exceeds the maximum delay time.

Claims

1. A method for processing file requests for files maintained in a server that are capable of being accessed from the server over a network, comprising:

receiving a request for a file maintained in the server;

determining whether a copy of the requested file is stored in a storage system;

determining a delay time associated with retrieving the copy of the requested file from the storage system after determining that the storage system includes the copy of the requested file;

determining whether the delay time exceeds a maximum delay time;

determining a network response time to retrieve the requested file from the server over the network;

retrieving the requested file from the storage system to return to the request after determining that the delay time does not exceed the maximum delay time;

retrieving the requested file from the storage system when the delay time is greater than the maximum delay time if the network response time is greater than the maximum delay time; and

retrieving the requested file from the server over the network to return to the request after determining that the delay time exceeds the maximum delay time.

2. The method of claim 1, wherein the maximum delay time is a value related to the data transfer capabilities of the storage system.

3. The method of claim 1, wherein determining the delay time comprises estimating a time to process all file requests queued against the storage system.

4. The method of claim 3, wherein estimating the time to process all file requests queued against the storage system comprises:

determining the delay time for each queued file request by adding (1) a set-up time estimating time needed to ready the storage system for data transfer operations and (2) a data transfer time to transfer the data of the requested file from the secondary storage; and

summing the delay time for each queued file request to estimate the time to process all file requests queued against the storage system.

5. The method of claim 4, wherein the data transfer time for a file request queued against the storage system is determined by:

providing a data transfer rate of the storage system; and

dividing the file size of the file request queued against the storage system by the data transfer rate.

6. The method of claim 1, wherein the storage system comprises a primary storage device and a secondary storage device, wherein retrieving the requested file from the storage system comprises retrieving the requested file from one of the primary and secondary storage devices.

7. The method of claim 6, wherein determining whether the requested file is in the storage system comprises determining whether the requested file is stored in one of the primary and secondary storage devices, further comprising retrieving the requested file from the primary storage device after determining that the requested file is stored in the primary storage device, wherein determining whether the delay time exceeds the maximum delay time occurs after determining that the requested file is stored in the secondary storage device, and wherein retrieving the requested file from the storage device after determining that the delay time does not exceed the maximum delay time comprises retrieving the requested file from the secondary storage device.

26. The method of claim 6, wherein the secondary storage device has more storage space than the primary storage device, further comprising:

storing files retrieved from the server over the network in the primary storage device; and

migrating files from the primary storage device to the secondary storage that are removed from the primary storage device to make room for more recent files retrieved from the server.

27. The method of claim 26, further comprising:

retrieving the requested file from the primary storage device if the requested file is in the primary storage device, wherein retrieving the requested file from the storage system if the determined delay time does not exceed the maximum delay time comprises retrieving the requested file from the secondary storage device.

8. A system for processing file requests, wherein a copy of the requested file is maintained in both a server capable of being accessed from over a network and a storage system;

comprising;

a computer system in communication with the storage system;

program logic executed by the computer system, comprising

(i) means for receiving a request for a file maintained in the server;

(ii) means for determining whether a copy of the requested file is stored in the storage system;

(iii) means for determining a delay time associated with retrieving the copy of the requested file from the storage system after determining that the storage system includes the copy of the requested file;

(iv) means for determining whether the delay time exceeds a maximum delay time;

(v) means for determining a network response time to retrieve the requested file from the server over the network;

(vi) means for retrieving the requested file from the storage system to return to the request after determining that the delay time does not exceed the maximum delay time;

(vii) means for retrieving the requested file from the storage system when the delay time is greater than the maximum delay time if the network response time is greater than the maximum delay time; and

(viii) means for retrieving the requested file from the server over the network to return to the request after determining that the delay time exceeds the maximum delay time.

9. The system of claim 8, wherein the maximum delay time is a value related to the data transfer capabilities of the storage system.

10. The system of claim 8, wherein the means for determining the delay time comprises estimating a time to process all file requests queued against the storage system.

11. The system of claim 10, wherein the means for estimating the time to process all file requests queued against the storage system comprises:

means for determining the delay time for each queued file request by adding (1) a set-up time estimating time needed to ready the storage system for data transfer operations and (2) a data transfer time to transfer the data of the requested file from the secondary storage; and

means for summing the delay time for each queued file request to estimate the time to process all file requests queued against the storage system.

12. The system method of claim 11, wherein the means for determining the data transfer time for a file request queued against the storage system comprises:

means for providing a data transfer rate of the storage system; and

means for dividing the file size of the file request queued against the storage system by the data transfer rate.

13. A system for processing file requests, wherein a copy of the requested file is maintained in a server capable of being accessed over a network, comprising:

a computer system;

a storage system accessible to the computer system;

program logic executed by the computer system, comprising

(i) means for receiving a request for a file maintained in the server;

(ii) means for determining whether a copy of the requested file is stored in the storage system;

(iii) means for determining a delay time associated with retrieving the copy of the requested file from the storage system after determining that the storage system includes the copy of the requested file;

(iv) means for determining whether the delay time exceeds a maximum delay time;

(v) means for determining a network response time to retrieve the requested file from the server over the network;

(vi) means for retrieving the requested file from the storage system to return to the request after determining that the delay time does not exceed the maximum delay time;

(vii) means for retrieving the requested file from the storage system when the delay time is greater than the maximum delay time if the network response time is greater than the maximum delay time; and

(viii) means for retrieving the requested file from the server over the network to return to the request after determining that the delay time exceeds the maximum delay time.

14. The system of claim 13, wherein the storage system comprises a primary storage device and a secondary storage device, wherein the means for retrieving the requested file from the storage system comprises retrieving the requested file from one of the primary and secondary storage devices.

15. The system of claim 14, wherein the means for determining whether the requested file is in the storage system comprises determining whether the requested file is stored in one of the primary and secondary storage devices, wherein the program logic further comprises means for retrieving the requested file from the primary storage device after determining that the requested file is stored in the primary storage device, wherein the program logic determines whether the delay time exceeds the maximum delay time occurs after determining that the requested file is stored in the secondary storage device, and wherein the program logic retrieves the requested file from the storage device after determining that the delay time does not exceed the maximum delay time by retrieving the requested file from the secondary storage device.

16. The system of claim 14, wherein the primary storage system has a faster data transfer rate than the secondary storage system.

17. The system of claim 14, wherein a cost per unit of storage for the primary storage system is greater than the cost per unit of storage for the secondary storage system.

18. The system of claim 14, wherein the primary storage comprises at least one hard disk drive and the secondary storage comprises at least one tape cartridge.

28. The system of claim 14, wherein the secondary storage device has more storage space than the primary storage device, further comprising:

storing files retrieved from the server over the network in the primary storage device; and

migrating files from the primary storage device to the secondary storage that are removed from the primary storage device to make room for more recent files retrieved from the server.

29. The system of claim 28, further comprising:

retrieving the requested file from the primary storage device if the requested file is in the primary storage device, wherein retrieving the requested file from the storage system if the determined delay time does not exceed the maximum delay time comprises retrieving the requested file from the secondary storage device.

19. An article of manufacture for use in programming a computer system to process file requests for files maintained in a server that is capable of being accessed over a network, the article of manufacture comprising a computer program in a computer useable medium accessible to the computer system, wherein the computer program is capable of causing the computer system to perform:

receiving a request for a file maintained in the server;

determining whether a copy of the requested file is stored in a storage system;

determining a delay time associated with retrieving the copy of the requested file from the storage system after determining that the storage system includes the copy of the requested file;

determining whether the delay time exceeds a maximum delay time;

estimating a network response time to retrieve the requested file from the server over the network;

retrieving the requested file from the storage system to return to the request after determining that the delay time does not exceed the maximum delay time;

retrieving the requested file from the storage system when the delay time is greater than the maximum delay time if the network response time is greater than the maximum delay time; and

retrieving the requested file from the server over the network to return to the request after determining that the delay time exceeds the maximum delay time.

20. The article of manufacture of claim 19, wherein the maximum delay time is a value related to the data transfer capabilities of the storage system.

21. The article of manufacture of claim 19, wherein determining the delay time comprises estimating a time to process all file requests queued against the storage system.

22. The article of manufacture of claim 21, wherein estimating the time to process all file requests queued against the storage system comprises:

determining the delay time for each queued file request by adding (1) a set-up time estimating time needed to ready the storage system for data transfer operations and (2) a data transfer time to transfer the data of the requested file from the secondary storage; and

summing the delay time for each queued file request to estimate the time to process all file requests queued against the storage system.

23. The article of manufacture of claim 22, wherein the data transfer time for a file request queued against the storage system is determined by:

providing a data transfer rate of the storage system; and

dividing the file size of the file request queued against the storage system by the data transfer rate.

24. The article of manufacture of claim 19, wherein the storage system comprises a primary storage device and a secondary storage device, wherein retrieving the requested file from the storage system comprises retrieving the requested file from one of the primary and secondary storage devices.

25. The article of manufacture of claim 24, wherein determining whether the requested file is in the storage system comprises determining whether the requested file is stored in one of the primary and secondary storage devices, further comprising retrieving the requested file from the primary storage device after determining that the requested file is stored in the primary storage device, wherein determining whether the delay time exceeds the maximum delay time occurs after determining that the requested file is stored in the secondary storage device, and wherein retrieving the requested file from the storage device after determining that the delay time does not exceed the maximum delay time comprises retrieving the requested file from the secondary storage device.

30. The article of manufacture of claim 24, wherein the secondary storage device has more storage space than the primary storage device, further comprising:

storing files retrieved from the server over the network in the primary storage device; and

migrating files from the primary storage device to the secondary storage that are removed from the primary storage device to make room for more recent files retrieved from the server.

31. The article of manufacture of claim 30, further comprising:

retrieving the requested file from the primary storage device if the requested file is in the primary storage device, wherein retrieving the requested file from the storage system if the determined delay time does not exceed the maximum delay time comprises retrieving the requested file from the secondary storage device.