Updating references to a migrated object in a partition-based distributed file system

• US 6,775,672 B2
• Filed: 12/19/2001
• Issued: 08/10/2004
• Est. Priority Date: 12/19/2001
• Status: Expired due to Fees

• Current Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Zhang, Zheng, Mahalingam, Mallik, Karamanolis, Christos, Muntz, Daniel A.
• Primary Examiner(s): Mizrahi, Diane D.
• Assistant Examiner(s): Mofiz, Apu M
• Application Number:
  US10/024,940
• Publication Number:
  US 20030115439A1
• Time in Patent Office: 965 Days
• Field of Search: 707/4, 707/10, 707/100, 707/102, 707/103.R, 707/104.1, 707/205, 709/203, 709/234, 709/235, 709/238, 709/245, 709/248, 710/74, 715/500.1, 717/102, 717/109, 711/120
• US Class Current: 1/1
• CPC Class Codes: G06F 16/119 Details of migration of file systems migration mechanisms in storage systems G06F3/0647
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: Y10S 707/99953 Recoverability

Abstract

Method and arrangement for updating references to a migrated object in a distributed file system. A migrated object is an object has moved from a source partition server to a target partition server. Each object has an associated parent object and each partition server owns a subset of objects of the file system. A set of forward pointers that reference one or more child objects of the parent object is maintained in each parent object. In the migrated object a set of back pointers is maintained that reference one or more parent objects having forward pointers to the migrated object. To each partition server that owns a parent object of the migrated object, an update request is transmitted. The forward pointers in each parent object are updated in response to the update request.

Claims

1. A computer-implemented method for updating references to a migrated object that has moved from a source partition server to a target partition server in a distributed file system having a plurality of partition servers, wherein each object has an associated parent object and each partition server owns a subset of objects of the file system, comprising:

maintaining in each parent object a set of forward pointers that reference one or more child objects of the parent object;

maintaining in the migrated object a set of back pointers that reference one or more parent objects having forward pointers to the migrated object;

transmitting an update request to each partition server that owns a parent object of the migrated object; and

updating the forward pointers in each parent object in response to the update request.

2. The method of claim 1, further comprising:

establishing at the source partition server a forwarding link that references the migrated object in the target partition server;

in response to an access request from a client for the migrated object received at the source partition server, transmitting the forwarding link to the client; and

updating each cached file handle that references the migrated object in the source partition server to reference the migrated object in the target partition server.

3. The method of claim 2, further comprising:

for each back pointer in the migrated object, identifying a partition server that owns a parent object of the migrated object; and

transmitting each update request to a partition server from the identifying step.

4. The method of claim 3, further comprising:

maintaining a reference count of back pointers in the migrated object; and

for each transmitted update request, adjusting the reference count; and

returning the migrated object and forwarding link in the source partition server to available space in the file system after a selected period of time that begins when the reference count indicates that no remaining parent objects reference the object in the source partition server.

5. The method of claim 2, further comprising:

in response to an access request for the migrated object received from a client at the source partition server, identifying a partition server that owns a parent object of the migrated object; and

transmitting an update request to the partition server from the identifying step.

6. The method of claim 5, further comprising determining the partition server that owns a parent object of the migrated object from information included in the access request.

7. The method of claim 6, wherein the access request includes a logical volume identifier of the parent object, and the logical volume identifier identifies a set of logically related objects in the distributed file system.

8. The method of claim 6, wherein the access request includes an i-node number of the parent object.

9. An apparatus for updating references to a migrated object that has moved from a source partition server to a target partition server in a distributed file system having a plurality of partition servers, wherein each object has an associated parent object and each partition server owns a subset of objects of the file system, comprising:

means for maintaining in each parent object a set of forward pointers that reference one or more child objects of the parent object;

means for maintaining in the migrated object a set of back pointers that reference one or more parent objects having forward pointers to the migrated object;

means for transmitting an update request to each partition server that owns a parent object of the migrated object; and

means for updating the forward pointers in each parent object in response to the update request.

10. A computer-readable medium configured with computer program code for updating references to a migrated object that has moved from a source partition server to a target partition server in a distributed file system having a plurality of partition servers, wherein each object has an associated parent object and each partition server owns a subset of objects of the file system, the computer program code configured to cause a computer to perform the steps comprising:

maintaining in each parent object a set of forward pointers that reference one or more child objects of the parent object;

maintaining in the migrated object a set of back pointers that reference one or more parent objects having forward pointers to the migrated object;

transmitting an update request to each partition server that owns a parent object of the migrated object; and

updating the forward pointers in each parent object in response to the update request.

11. A distributed file management system, comprising:

a plurality of partition servers configured for ownership of a set of logical volumes of logically related file system objects, each object having an associated parent object and each partition server configured to control access to the set of logical volumes owned by the partition server;

wherein each partition server is further configured to maintain in each parent object a set of forward pointers that reference one or more child objects of the parent object, and for a migrated object that has moved from a source partition server to a target partition server, maintain a set of back pointers that reference one or more parent objects having forward pointers to the migrated object, transmit an update request to each partition server that owns a parent object of the migrated object, and update the forward pointers in each parent object in response to the update request.

12. The system of claim 11, wherein each partition server is further configured to establish a forwarding link that references the migrated object in the target partition server when the partition server is the source partition server, transmit the forwarding link to a client in response to an access request from the client for the migrated object, and update each cached file handle that references the migrated object to reference the migrated object in the target partition server.

13. The system of claim 12, wherein each partition server is further configured to identify a partition server that owns a parent object of the migrated object for each back pointer in the migrated object when the partition server is the source partition server, and transmit each update request to a partition server from the identifying step.

14. The system of claim 13, wherein each partition server is further configured to maintain a reference count of back pointers in the migrated object when the partition server is the source partition server, adjusting the reference count for each transmitted update request, and return the migrated object and forwarding link in the source partition server to available space in the file system after a selected period of time that begins when the reference count indicates that no remaining parent objects reference the object in the source partition server.