Accessing stored files from multiple storage devices

• US 6,003,045 A
• Filed: 09/17/1997
• Issued: 12/14/1999
• Est. Priority Date: 09/17/1997
• Status: Expired due to Term

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: International Business Machines Corporation
• Inventors: Freitas, Daynerd Kaena, McBrearty, Gerald Francis, Shieh, Johnny Meng-Han, Maddalozzo, John Jr.
• Primary Examiner(s): Lintz, Paul R.
• Assistant Examiner(s): Colbert, Ella
• Application Number:
  US08/931,880
• Time in Patent Office: 818 Days
• Field of Search: 707/1, 707/205, 364/222.81, 364/243.4, 364/282.1, 345/327, 711/114
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0613 in relation to throughput
• CPC Class Codes: G06F 3/0655 Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
• CPC Class Codes: G06F 3/0676 Magnetic disk device
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/61 taking into account QoS or priority requirements
• CPC Class Codes: H04L 67/62 Establishing a time schedule for servicing the requests
• CPC Class Codes: H04L 69/14 Multichannel or multilink protocols
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: Y10S 707/99931 Database or file accessing
• CPC Class Codes: Y10S 707/99956 File allocation

Abstract

A method and apparatus is provided in which a data file acquisition program is operable to determine the data transfer speed of a plurality of devices containing a predetermined data file. The methodology calculates a priority ordering of the devices based upon the data transfer speed, and divides the data file request into portions for parallel access and delivery of the requested data file such that all of the portions are delivered to the user at approximately the same time whereby faster devices will be requested to access and deliver larger file portions and relatively slower devices will be assigned to access and deliver relatively smaller portions of the requested data file. Upon receipt of the portions, the requested data file is assembled for further processing by the user.

Claims

1. A method for accessing a designated file from a plurality of storage devices, each of said plurality of storage devices containing a substantially complete copy of said designated file, said method comprising:

determining a number of storage devices containing at least one said substantially complete copy of said designated file;

defining a plurality of file segments, each of said file segments comprising a different portion of said designated file, said plurality of file segments corresponding in number to said plurality of storage devices; and

sending substantially parallel requests for said file segments to corresponding ones of said plurality of storage devices.

2. The method as set forth in claim 1 wherein said sending is accomplished substantially concurrently.

3. The method as set forth in claim 1 wherein said file segments are of differing sizes.

4. The method as set forth in claim 3 and further including:

determining data transfer speed of said storage devices; and

assigning different sizes of said file segments to different ones of said storage devices.

5. The method as set forth in claim 4 wherein said assigning is accomplished by assigning larger file segments to faster ones of said storage devices.

6. The method as set forth in claim 5 and further including:

assembling said file segments into said designated file upon receipt of said file segments from said plurality of storage devices.

7. The method as set forth in claim 1 wherein said plurality of storage devices are located throughout a distributed network, said accessing being accomplished from one terminal within said network.

8. The method as set forth in claim 7 and, before said defining, said method further including:

determining said plurality of storage devices containing copies of said designated file from a group of storage devices located within said network.

9. The method as set forth in claim 8 wherein said designated file is a data file.

10. A storage medium including machine readable indicia, said storage medium being selectively coupled to a reading device, said reading device being selectively coupled to processing circuitry within a computer system, said reading device being selectively operable to read said machine readable indicia and provide program signals representative thereof, said program signals being selectively effective for accessing a designated file from a plurality of storage devices, each of said plurality of storage devices containing a substantially complete copy of said designated file by accomplishing the steps of:

determining a number of storage devices containing at least one said substantially complete copy of said designated file;

defining a plurality of file segments, each of said file segments comprising a different portion of said designated file, said plurality of file segments corresponding in number to said plurality of storage devices; and

sending parallel requests for said file segments to corresponding ones of said plurality of storage devices.

11. The medium as set forth in claim 10 wherein said sending is accomplished substantially concurrently.

12. The medium as set forth in claim 10 wherein said file segments are of differing sizes.

13. The medium as set forth in claim 12 and further including:

determining data transfer speed of said storage devices; and

assigning different sizes of said file segments to different ones of said storage devices.

14. The medium as set forth in claim 13 wherein said assigning is accomplished by assigning larger file segments to faster ones of said storage devices.

15. The medium as set forth in claim 14 and further including:

assembling said file segments into said designated file upon receipt of said file segments from said plurality of storage devices.

16. The medium as set forth in claim 10 wherein said plurality of storage devices are located throughout a distributed network, said accessing being accomplished from one terminal within said network.

17. The medium as set forth in claim 16 and, before said defining, said program signals are further effective for:

determining said plurality of storage devices containing copies of said designated file from a group of storage devices located within said network.

18. The medium as set forth in claim 17 wherein said designated file is a data file.

19. An information processing system comprising:

a processing device;

a memory unit; and

a bus connecting said processing device and said memory unit, said processing device being selectively operable for executing a program from said memory for selectively accessing a designated file from a plurality of storage devices, each of said plurality of storage devices containing said designated file, said accessing being accomplished by;

determining a number of storage devices containing at least one substantially complete copy of said designated file;

defining a plurality of file segments, each of said file segments comprising a different portion of said designated file, said plurality of file segments corresponding in number to said plurality of storage devices; and

sending parallel requests for said file segments to corresponding ones of said plurality of storage devices.

20. The information processing system as set forth in claim 19 wherein said sending is accomplished substantially concurrently.

21. The information processing system as set forth in claim 20 wherein said file segments are of differing sizes.

22. The information processing system as set forth in claim 21 and further including:

means for determining data transfer speed of said storage devices; and

means for assigning different sizes of said file segments to different ones of said storage devices.

23. The information processing system as set forth in claim 22 wherein said assigning is accomplished by assigning larger file segments to faster ones of said storage devices.

24. The information processing system as set forth in claim 23 and further including:

means for assembling said file segments into said designated file upon receipt of said file segments from said plurality of storage devices.

25. The information processing system as set forth in claim 19 wherein said plurality of storage devices are located throughout a distributed network, said accessing being accomplished from one terminal within said network.

26. The information processing system as set forth in claim 25 and wherein, before said defining, said program signals are further effective for:

determining said plurality of storage devices containing copies of said designated file from a group of storage devices located within said network.

27. The information processing system as set forth in claim 26 wherein said designated file is a data file.