On-demand peer-to-peer storage virtualization infrastructure

• US 8,307,026 B2
• Filed: 07/17/2008
• Issued: 11/06/2012
• Est. Priority Date: 08/19/2004
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Gusler, Carl Phillip, Hamilton, Rick Allen II, Seaman, James Wesley, Waters, Timothy Moffett
• Primary Examiner(s): Hussain, Imad
• Application Number:
  US12/175,289
• Publication Number:
  US 20100017456A1
• Time in Patent Office: 1,573 Days
• Field of Search: 709/200
• US Class Current: 709/200
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 2211/1057 Parity-multiple bits-RAID6, i.e. RAID 6 implementations
• CPC Class Codes: G06F 2211/1059 Parity-single bit-RAID5, i.e. RAID 5 implementations
• CPC Class Codes: G06F 9/5011 the resources being hardware resources other than CPUs, Servers and Terminals
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/104 Peer-to-peer [P2P] networks
• CPC Class Codes: H04L 67/1068 Discovery involving direct consultation or announcement among potential requesting and potential source peers
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

An on-demand virtual drive from dedicated storage on a plurality of partners in a peer-to-peer network uses an agent installed on each of the partners. The agent has a contributing program and a requesting program. The contributing program creates a first storage unit and a second storage unit, formatting the second storage unit so that it is not visible to the operating system of the partner and transmitting the size of the second storage unit to the other partners. The requesting partner creates a virtual drive using space on selected partner'"'"'s second drives, and directs data blocks in and out of the virtual drive. A rules engine incorporating RAID algorithms governs the selection of the partners and allocation of available space.

Claims

1. A computer system for providing on-demand distributed storage in a peer-to-peer network, the computer system comprising:

one or more processors, one or more computer-readable memories and one or more computer-readable tangible storage devices;

program instructions, stored on at least one of the one or more computer-readable tangible storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, to communicate and share data of a first computer of a plurality of computers in the peer-to-peer network with one or more other computers of the plurality of computers in the peer-to-peer network;

program instructions, stored on at least one of the one or more computer-readable tangible storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, to allocate an available storage unit on the first computer into a first storage unit and a second storage unit, wherein the first computer has an operating system;

program instructions, stored on at least one of the one or more computer-readable tangible storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, to format the second storage unit so that the second storage unit is not visible to the operating system of the first computer;

program instructions, stored on at least one of the one or more computer-readable tangible storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, to transmit, from the first computer to one or more other computers of the plurality of computers in the peer-to-peer network, an availability time that a first space is available in the second storage unit; and

program instructions, stored on at least one of the one or more computer-readable tangible storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, responsive to the availability time elapsing, to clear the first space of stored data, wherein the stored data was entered into the first space by a direct communication over the peer-to-peer network from a second computer of the plurality of computers to the first computer.

2. The computer system of claim 1 wherein the availability time further comprises a time after which the first space in the second storage unit may be withdrawn from further availability.

3. The computer system of claim 1 further comprising:

program instructions, stored on at least one of the one or more computer-readable tangible storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, to listen for a demand for storage from a requesting computer of the plurality of computers;

program instructions, stored on at least one of the one or more computer-readable tangible storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, to perform a scan to determine an amount of physical storage available in each of a plurality of storage units of each computer of the plurality of computers other than the requesting computer;

program instructions, stored on at least one of the one or more computer-readable tangible storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, responsive to performing the scan, to select a plurality of contributing computers from the plurality of computers other than the requesting computer;

program instructions, stored on at least one of the one or more computer-readable tangible storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, responsive to selecting the plurality of contributing computers, to allocate a plurality of spaces, each space of the plurality of spaces being allocated from a different contributing computer storage unit of a plurality of contributing computer storage units;

program instructions, stored on at least one of the one or more computer-readable tangible storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, to create a virtual drive from the plurality of spaces; and

program instructions, stored on at least one of the one or more computer-readable tangible storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, to direct one or more data blocks in and out of the virtual drive.

4. The computer system of claim 3 further comprising:

program instructions, stored on at least one of the one or more computer-readable tangible storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, responsive to completing the scan, to issue an instruction to the plurality of contributing computers.

5. The computer system of claim 4 wherein the instruction specifies the availability time.

6. The computer system of claim 4 wherein the instruction specifies which of the plurality of contributing computer storage units to utilize to combine space into the virtual drive.

7. The computer system of claim 4 wherein the instruction conserves network resources in selecting the plurality of contributing computers.

8. The computer system of claim 4 wherein the instruction incorporates a RAID algorithm.

9. The computer system of claim 8 wherein the RAID algorithm is RAID 1.

10. The computer system of claim 8 wherein the RAID algorithm is RAID 3.

11. The computer system of claim 8 wherein the RAID algorithm is RAID 5.

12. The of computer system claim 8 wherein the RAID algorithm is RAID 6.

13. The of computer system claim 8 wherein the RAID algorithm is RAID 10.

14. The computer system of claim 1 further comprising:

program instructions, stored on at least one of the one or more computer-readable tangible storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, to determine, by a threshold value, a storage unit size.

15. A method for providing on-demand storage in a peer-to-peer network, the method comprising;

a computer of a plurality of computers in the peer-to-peer network communicating and sharing data with one or more other computers of the plurality of computers in the peer-to-peer network;

the computer allocating an available storage unit on the computer into a first storage unit and a second storage unit, wherein the computer has an operating system;

the computer formatting the second storage unit so that second storage unit is not visible to the operating system;

the computer transmitting to one or more other computers of the plurality of computers in the peer-to-peer network an availability time that a first space is available in the second storage unit; and

the computer, responsive to the availability time elapsing, clearing the first space of stored data, wherein the stored data was entered into the first space by a direct communication over the peer-to-peer network from a second computer of the plurality of computers to the computer.

16. The method of claim 15 further comprising:

the computer listening for a demand for storage from a requesting computer of the plurality of computers;

the computer performing a scan to determine an amount of physical storage available in each of a plurality of storage units of each of the plurality of computers other than the requesting computer;

the computer, responsive to performing the scan, selecting a plurality of contributing computers from the plurality of computers other than the requesting computer; and

the computer, responsive to selecting the plurality of contributing computers, allocating a plurality of spaces, each space of the plurality of spaces being allocated from a different contributing computer storage unit of a plurality of contributing computer storage units;

the computer creating a virtual drive from the plurality of spaces; and

the computer directing one or more data blocks in and out of the virtual drive.

17. A computer system comprising one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage devices and program instructions which are stored on the one or more storage devices for execution by the one or more processors via the one or more memories and when executed by the one or more processors perform the method of claim 15.

18. A computer program product comprising one or more computer-readable, tangible storage devices and computer-readable program instructions which are stored on the one or more storage devices and when executed by one or more processors, perform the method of claim 15.

19. A computer program product for providing on-demand distributed storage in a peer-to-peer network, the computer program product comprising:

one or more computer-readable tangible storage devices;

program instructions, stored on at least one of the one or more computer-readable tangible storage devices, to communicate and share data of a first computer of a plurality of computers in the peer-to-peer network with one or more other computers of the plurality of computers in the peer-to-peer network;

program instructions, stored on at least one of the one or more computer-readable tangible storage devices, to allocate a first available storage unit on the first computer into a first storage unit and a second storage unit, wherein the first computer has an operating system;

program instructions, stored on at least one of the one or more computer-readable tangible storage devices, to format the second storage unit so that second storage unit is not visible to the operating system of the first computer;

program instructions, stored on at least one of the one or more computer-readable tangible storage devices, to specify an availability time that a first space is available in the second storage unit; and

program instructions, stored on at least one of the one or more computer-readable tangible storage devices, responsive to the availability time elapsing, to clear the first space of stored data, wherein the stored data was entered into the first space by a direct communication over the peer-to-peer network from a second computer of the plurality of computers to the first computer.

20. The computer program product of claim 19 further comprising:

program instructions, stored on at least one of the one or more computer-readable tangible storage devices, to listen for a demand for storage from a requesting computer of the plurality of computers;

program instructions, stored on at least one of the one or more computer-readable tangible storage devices, to perform a scan to determine an amount of physical storage available in each of a plurality of storage units of each of the plurality of computers other than the requesting computer;

program instructions, stored on at least one of the one or more computer-readable tangible storage devices, responsive to performing the scan, to select a plurality of contributing computers from the plurality of computers other than the requesting computer;

program instructions, stored on at least one of the one or more computer-readable tangible storage devices, responsive to selecting the plurality of contributing computers, to allocate a plurality of spaces from a plurality of contributing computer storage units;

program instructions, stored on at least one of the one or more computer-readable tangible storage devices, to create a virtual drive from the plurality of spaces; and

program instructions, stored on at least one of the one or more computer-readable tangible storage devices, to direct one or more data blocks in and out of the virtual drive.