Object-level migration in a partition-based distributed file system

• US 6,772,161 B2
• Filed: 12/19/2001
• Issued: 08/03/2004
• Est. Priority Date: 12/19/2001
• Status: Expired due to Fees

• Current Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Mahalingam, Mallik, Muntz, Daniel A., Zhang, Zheng, Karamanolis, Christos
• Primary Examiner(s): Mizrahi, Diane D.
• Assistant Examiner(s): MOFIZ, APU M
• Application Number:
  US10/024,937
• Publication Number:
  US 20030115438A1
• Time in Patent Office: 958 Days
• Field of Search: 707/4, 707/10, 707/100, 707/102, 707/104.1, 707/204, 709/203, 710/74, 711/120, 711/132, 715/500, 717/103
• US Class Current: 1/1
• CPC Class Codes: G06F 16/119 Details of migration of file systems migration mechanisms in storage systems G06F3/0647
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: Y10S 707/99953 Recoverability

Abstract

Method and system for moving an object from a source partition server to a target partition server in a distributed file system having multiple partition servers. Each object has at least one associated and linked parent object, and each partition server owns a subset of objects of the file system. The object migration is accomplished by creating a copy in a target partition server of a selected object from a source partition server. At the source partition server, a forwarding link is created that references the copy in the target partition server. The copy is linked to the parent object of the selected object, and requests for access to the selected object are responded to with the forwarding link.

Claims

1. A computer-implemented method for moving an object from a source partition server to a target partition server in a distributed file system having multiple partition servers, wherein each object has at least one associated and linked parent object, and each partition server owns a subset of objects of the file system, comprising:

creating a copy in a target partition server of a selected object from a source partition server;

establishing at the source partition server a forwarding link that references the copy in the target partition server;

linking the copy to the parent object of the selected object; and

responding to requests for access to the selected object with the forwarding link.

2. The method of claim 1, further comprising returning the object and forwarding link in the source partition server to available space in the file system after all links between the selected object and the at least one parent object have been updated to reference the copy in the target partition server.

3. The method of claim 1, changing links between the selected object and the at least one parent object to reference the copy in the target partition server.

4. The method of claim 3, changing client-cached file handles from referencing the selected object to reference the copy in the target partition server.

5. The method of claim 4, wherein the selected object has a source-parent object and further comprising:

creating a back pointer from the copy to the source-parent object; and

creating a forward pointer from the source-parent object to the copy.

6. The method of claim 5, further comprising deleting in the selected object a back pointer to the source-parent object.

7. The method of claim 6, further comprising:

temporarily creating the copy as a child of a target-parent object and creating a back pointer from the copy to the target-parent object; and

after creating the back pointer in the copy to the source-parent object, deleting the back-pointer to the target-parent object.

8. The method of claim 7, further comprising:

maintaining a reference count of links between the selected object and the at least one parent object;

adjusting the reference count as each link between the selected object and the at least one parent object is changed to reference the copy in the target partition server; and

returning the selected object and forwarding link to available space in the file system after a selected period of time that begins when the reference count indicates that no remaining namespace links reference the selected object.

9. The method of claim 1, further comprising:

queueing access requests from requesters for the selected object while creating the copy and establishing the forwarding link; and

responding with the forwarding link to requesters of queued access requests after the object has been moved.

10. An apparatus for moving an object from a source partition server to a target partition server in a distributed file system having multiple partition servers, wherein each object has at least one associated and linked parent object, and each partition server owns a subset of objects of the file system, comprising:

means for creating a copy in a target partition server of a selected object from a source partition server;

means for establishing at the source partition server a forwarding link that references the copy in the target partition server;

means for linking the copy to the parent object of the selected object; and

means for responding to requests for access to the selected object with the forwarding link.

11. A computer-readable medium configured with computer program code for moving an object from a source partition server to a target partition server in a distributed file system having multiple partition servers, wherein each object has at least one associated and linked parent object, and each partition server owns a subset of objects of the file system, the computer program code configured to cause a computer to perform the steps comprising:

creating a copy in a target partition server of a selected object from a source partition server;

establishing at the source partition server a forwarding link that references the copy in the target partition server;

linking the copy to the parent object of the selected object; and

responding to requests for access to the selected object with the forwarding link.

12. A distributed file management system, comprising:

a plurality of partition servers configured for ownership of a set of logical volumes of logically related file system objects, each partition server configured to control access to the set of logical volumes owned by the partition server, wherein each object has at least one associated and linked parent object;

wherein one of the partition servers functions as a source partition server and another of the partition servers functions as a target partition server in response to a migration request that specifies migration of a selected object from the source partition server to the target partition server, and each of the partition servers is adapted to selectably function as a source partition server or a target partition server;

wherein the target partition server is adapted to create a copy of the selected object from a source partition server, and link the copy to the parent object of the selected object; and

wherein the source partition server is adapted to establish a forwarding link that references the copy in the target partition server, and respond to requests for access to the selected object with the forwarding link.

13. The system of claim 12, wherein the source partition server is further adapted to return the object and forwarding link in the source partition server to available space in the file system after all links between the selected object and the at least one parent object have been updated to reference the copy in the target partition server.

14. The system of claim 12, wherein the source partition server is further adapted to change links between the selected object and the at least one parent object to reference the copy in the target partition server.

15. The system of claim 14, wherein the selected object has a source-parent object, and the target partition server is further adapted to create a back pointer from the copy to the source-parent object, and the source partition server is further adapted to create a forward pointer from the source-parent object to the copy.

16. The system of claim 15, wherein the source partition server is further adapted to delete in the selected object a back pointer to the source-parent object.

17. The system of claim 16, wherein the target partition server is further adapted to temporarily create the copy as a child of a target-parent object and create a back pointer from the copy to the target-parent object, and delete the back-pointer to the target-parent object after the back pointer in the copy to the source-parent object is created.

18. The system of claim 17, wherein the source partition server is further adapted to maintain a reference count of links between the selected object and the at least one parent object, adjust the reference count as each link between the selected object and the at least one parent object is changed to reference the copy in the target partition server, and return the selected object and forwarding link to available space in the file system after a selected period of time that begins when the reference count indicates that no remaining namespace links reference the selected object.

19. The system of claim 12, wherein the source partition server is further adapted to queue access requests from requesters for the selected object while creating the copy and establishing the forwarding link, and respond with the forwarding link to requesters of queued access requests after the object has been moved.