GRANULAR DATA SELF-HEALING

• US 20170249334A1
• Filed: 02/26/2016
• Published: 08/31/2017
• Est. Priority Date: 02/26/2016
• Status: Active Grant

• Current Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Original Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Inventors: Karampuri, Pranith Kumar, Darcy, Jeffrey J.
• Granted Patent: US 11,157,459 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/11 File system administration, e.g. details of archiving or snapshots file system backup G06F11/14
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/178 Techniques for file synchronisation in file systems
• CPC Class Codes: G06F 16/1844 Management specifically adapted to replicated file systems

Abstract

A granular data self-healing manager in a file system is described. A first storage server of the file system receives a request to perform an operation on the data file. The operation is to be performed on a first replica of the data file stored at the first storage server and a second replica of the data file stored at a second storage server of the file system. The first storage server configures first metadata associated with a first index file to indicate that the operation is to be performed on a first portion of the first replica. The first storage server determines the second replica is an outdated state indicating that the operation on the second replica has not been performed by the second storage server. In response to the second replica being in the outdated state, updating a first portion of the second replica identified in view of the first metadata and corresponding to the first portion of the first replica.

Claims

1. A method comprising:

receiving, by a first storage server of a file system, a request to perform an operation on a data file, wherein the operation is to be performed on a first replica of the data file stored at the first storage server and a second replica of the data file stored at a second storage server of the file system;

configuring, by the first storage server, a first metadata associated with a first index file to indicate that the operation is to be performed on a first portion of the first replica, wherein the first index file logically divides the data file into a first segment of a plurality of segments, and wherein at least the first segment of the plurality of segments of the data file is further logically subdivided into a plurality of portions, the plurality of portions comprising the first portion;

determining, by the first storage server, the second replica is an outdated state indicating that the operation on the second replica has not been performed by the second storage server; and

responsive to the second replica being in the outdated state, updating a first portion of the second replica identified in view of the first metadata and corresponding to the first portion of the first replica.

2. The method of claim 1, further comprising:

performing the operation on the first replica of the data file stored at the first storage server;

receiving an indication that the operation on the second replica of the data file stored at the second storage server has been performed; and

responsive to the first replica and the second replica being in a current state, configuring the first metadata to an original state, wherein the current state of the first replica indicates that the operation has been performed on the first replica.

3. The method of claim 1, further comprising:

performing the operation on the first replica of the data file stored at the first storage server;

updating, by the first storage server, the first metadata of the first index file to indicate the first portion of the first replica that has been modified;

receiving, by the first storage server, an indication that the second replica of the data file stored at the second storage server is in the outdated state; and

updating the first portion of the second replica identified in view of the updated first metadata.

4. The method of claim 3, further comprising:

subsequent to updating the first portions of the second replica, configuring the first metadata to an original state.

5. The method of claim 1, further comprising:

determining, by the first storage server in view of the request, the first index file associated with the first replica using an offset indicator and a length indicator contained in the request, wherein the offset indicator and the length indicator to identify one or more bit ranges of the data file on which the operation is to be performed.

6. The method of claim 5, wherein the determining the first index file associated with the first replica comprises:

locating the first index file using a universally unique identifier (UUID) associated with the first index file; and

if the first index file is not located using the UUID, creating the first index file and associating the first index file with the UUID.

7. The method of claim 1, wherein configuring the first metadata associated with the first index file to indicate that the operation is to be performed on the first portion of the first replica comprises:

modifying bits of a bitmap to indicate that the operation is to be performed on the first portion of the first replica, the bitmap corresponding to a segment of the first replica, wherein the bits represent portions of the corresponding segment.

8. The method of claim 1, further comprising:

receiving, by the first storage server from a client machine, a lock on the first replica of the data file to prevent additional operations to be performed on the first replica.

9. A system comprising:

a memory; and

a processing device, coupled to the memory, to;

determine, by a first storage server, a second replica of a data file associated with a second storage server is in an outdated state, the outdated state indicating that an operation on the second replica has not been performed by the second storage server, wherein the operation has been performed on a first replica of the data file stored at the first storage server in response to receiving a request to perform the operation on the data file;

determine, by the first storage server, a first portion of the first replica on which the operation has been performed using a first metadata associated with a first index file; and

responsive to the second replica being in the outdated state, update a first portion of the second replica identified in view of the first metadata and corresponding to the first portion of the first replica.

10. The system of claim 9, the processing device further to:

perform the operation on the first replica of the data file stored at the first storage server;

receive an indication that the operation on the second replica of the data file stored at the second storage server has been performed; and

responsive to the first replica and the second replica are in a current state, configure the first metadata to an original state, wherein the current state of the first replica indicates that the operation has been performed on the first replica.

11. The system of claim 9, the processing device further to:

perform the operation on the first replica of the data file stored at the first storage server;

update, by the first storage server, the first metadata of the first index file to indicate the first portion of the first replica has been modified;

receive, by the first storage server, an indication that the second replica of the data file stored at the second storage server is in the outdated state; and

update the first portion of the second replica identified in view of the updated first metadata.

12. The system of claim 11, the processing device further to:

subsequent to updating the first portion of the second replica, configure the first metadata to an original state.

13. The system of claim 9, the processing device further to:

receive, by the first storage server of file system, a request to perform the operation on the data file, wherein the operation is to be performed on the first replica of the data file stored at the first storage server and the second replica of the data file stored at the second storage server of the file system;

determine, by the first storage server in view of the request, the first index file associated with the first replica using an offset indicator and a length indicator contained in the request, wherein the offset indicator and the length indicator identify one or more bit ranges of the data file on which the operation is to be performed.

14. The system of claim 13, wherein to determine the first index file associated with the first replica, the processing device further to:

locate the first index file using a universally unique identifier (UUID) associated with the first index file; and

if the first index file is not located using the UUID, create the first index file and associating the first index file with the UUID.

15. The system of claim 9, the processing device further to:

configure the first metadata associated with the first index file to indicate that the operation is to be performed on the first portion of the first replica.

16. A non-transitory computer-readable medium containing instruction that, when executed by a processing device, cause the processing device to:

receive, by the processing device of a first storage server of a file system, a request to perform an operation on a data file, wherein the operation is to be performed on a first replica of the data file stored at the first storage server and a second replica of the data file stored at a second storage server of the file system;

configure, by the first storage server, a first metadata associated with a first index file to indicate that the operation is to be performed on a first portion of the first replica, wherein the first index file logically divides the data file into a first segment of a plurality of segments, and wherein at least the first segment of the plurality of segments of the data file is further logically subdivided into a plurality of portions, the plurality of portions comprising the first portion;

determine, by the first storage server, the second replica is an outdated state indicating that the operation on the second replica has not been performed by the second storage server; and

responsive to the second replica being in the outdated state, update a first portion of the second replica identified in view of the first metadata and corresponding to the first portion of the first replica.

17. The non-transitory computer-readable medium of claim 16, the processing device further to:

perform the operation on the first replica of the data file stored at the first storage server;

receive an indication that the operation on the second replica of the data file stored at the second storage server has been performed; and

responsive to the first replica and the second replica being in a current state, configure the first metadata to an original state, wherein the current state of the first replica indicates that the operation has been performed on the first replica.

18. The non-transitory computer-readable medium of claim 16, the processing device further to:

subsequent to updating the first portion of the second replica, configure the first metadata to an original state.

19. The non-transitory computer-readable medium of claim 16, the processing device further to:

determine, by the first storage server in view of the request, the first index file associated with the first replica using an offset indicator and a length indicator contained in the request, wherein the offset indicator and the length indicator identify one or more bit ranges of the data file on which the operation is to be performed.

20. The non-transitory computer-readable medium of claim 16, wherein to configure the first metadata associated with the first index file to indicate that the operation is to be performed on the first portion of the first replica, the processing device further to:

modify bits of a bitmap to indicate that the operation is to be performed on the first portion of the first replica, the bitmap corresponding to a segment of the first replica, wherein the bits represent portions of the corresponding segment.