FILE CLASSIFICATION IN A DISTRIBUTED FILE SYSTEM

• US 20160140140A1
• Filed: 11/17/2014
• Published: 05/19/2016
• Est. Priority Date: 11/17/2014
• Status: Active Grant

• Current Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Original Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Inventors: Darcy, Jeffrey Jon
• Granted Patent: US 10,417,192 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A file may be identified and a plurality of rules associated with a plurality of storage servers may be received. An order for the rules may be identified. A particular storage server of the plurality of storage servers that satisfies a condition for each of the rules in view of the order for the rules and a characteristic associated with each of the plurality of storage servers. The file may be stored at the particular storage server that satisfies the condition for each of the rules.

Claims

1. A method comprising:

receiving a plurality of rules associated with a plurality of storage servers;

identifying an order for the plurality of rules;

determining, by a processing device, a particular storage server of the plurality of storage servers that satisfies a condition for each of the plurality of rules in view of the order for the plurality of rules and a characteristic associated with each of the plurality of storage servers; and

storing a file at the particular storage server of the plurality of storage servers that satisfies the condition for each of the plurality of rules.

2. The method of claim 1, wherein the storing of the file is in response to a request to perform a rebalancing operation associated with the plurality of storage servers.

3. The method of claim 2, wherein the storing of the file in response to the request to perform the rebalancing operation comprises migrating the identified file to the particular storage server that satisfies the condition for each of the plurality of rules from another storage server of the plurality of storage servers.

4. The method of claim 2, wherein the plurality of storage servers are associated with a distributed file system, and wherein the rebalancing operation is associated with a changing of the configuration of the plurality of storage servers associated with the distributed file system.

5. The method of claim 4, wherein the changing of the configuration of the plurality of storage servers is associated with an adding or removing of at least one storage server of the plurality of storage servers, and wherein the rebalancing operation is associated with a distribution of a plurality of files stored at the plurality of storage servers.

6. The method of claim 1, wherein the determining of the particular storage server of the plurality of storage servers that satisfies the condition for each of the plurality of rules in view of the order for the plurality of rules and the characteristic associated with each of the plurality of storage servers comprises:

identifying a first set of storage servers from the plurality of storage servers with a first characteristic that satisfies a first condition associated with a first rule of the plurality of rules specified by the order for the plurality of rules; and

identifying the particular storage server from the first set of storage servers with a second characteristic that satisfies a second condition associated with the second rule of the plurality of rules specified by the order for the plurality of rules.

7. The method of claim 1, wherein a final rule specified by the order for the plurality rules corresponds to matching a calculated hash number associated with the file with a hash number range associated with the particular storage server.

8. A system, comprising:

a memory; and

a processing device operatively coupled with the memory and to;

receive a plurality of rules associated with a plurality of storage servers;

identify an order for the plurality of rules;

determine a particular storage server of the plurality of storage servers that satisfies a condition for each of the plurality of rules in view of the order for the plurality of rules and a characteristic associated with each of the plurality of storage servers; and

store at least one file at the particular storage server of the plurality of storage servers that satisfies the condition for each of the plurality of rules

9. The system of claim 8, wherein the storing of the at least one file is in response to a request to perform a rebalancing operation associated with the plurality of storage servers.

10. The system of claim 9, wherein the storing of the at least one file in response to the request to perform the rebalancing operation comprises migrating the identified file to the particular storage server that satisfies the condition for each of the plurality of rules from another storage server of the plurality of storage servers.

11. The system of claim 9, wherein the plurality of storage servers are associated with a distributed file system, and wherein the rebalancing operation is associated with a changing of the configuration of the plurality of storage servers associated with the distributed file system.

12. The system of claim 11, wherein the changing of the configuration of the plurality of storage servers is associated with an adding or removing of at least one storage server of the plurality of storage servers, and wherein the rebalancing operation is associated with a distribution of a plurality of files stored at the plurality of storage servers.

13. The system of claim 8, wherein the determining of the particular storage server of the plurality of storage servers that satisfies the condition for each of the plurality of rules in view of the order for the plurality of rules and the characteristic associated with each of the plurality of storage servers comprises:

identifying a first set of storage servers from the plurality of storage servers with a first characteristic that satisfies a first condition associated with a first rule of the plurality of rules specified by the order for the plurality of rules; and

identifying the particular storage server from the first set of storage servers with a second characteristic that satisfies a second condition associated with the second rule of the plurality of rules specified by the order for the plurality of rules.

14. The system of claim 8, wherein a final rule specified by the order for the plurality rules corresponds to matching a calculated hash number associated with the file with a hash number range associated with the particular storage server.

15. A non-transitory machine-readable storage medium including data that, when accessed by a processing device, cause the processing device to perform operations comprising:

identifying a file;

receiving a plurality of rules associated with a plurality of storage servers;

identifying an order for the plurality of rules;

determining a particular storage server of the plurality of storage servers that satisfies a condition for each of the plurality of rules in view of the order for the plurality of rules and a characteristic associated with each of the plurality of storage servers; and

storing the file at the particular storage server of the plurality of storage servers that satisfies the condition for each of the plurality of rules.

16. The non-transitory machine-readable storage medium of claim 15, wherein a final rule specified by the order for the plurality rules corresponds to matching a calculated hash number associated with the file with a hash number range associated with the particular storage server.

17. The non-transitory machine-readable storage medium of claim 16, wherein the storing of the file is in response to a request to perform a rebalancing operation associated with the plurality of storage servers, and wherein the storing of the file in response to the request to perform the rebalancing operation comprises migrating the identified file to the particular storage server that satisfies the condition for each of the plurality of rules from another storage server of the plurality of storage servers.

18. The non-transitory machine-readable storage medium of claim 16, wherein the plurality of storage servers are associated with a distributed file system, and wherein the rebalancing operation is associated with a changing of the configuration of the plurality of storage servers associated with the distributed file system.

19. The non-transitory machine-readable storage medium of claim 18, wherein the changing of the configuration of the plurality of storage servers is associated with an adding or removing of at least one storage server of the plurality of storage servers, and wherein the rebalancing operation is associated with a distribution of a plurality of files stored at the plurality of storage servers.

20. The non-transitory machine-readable storage medium of claim 15, wherein the determining of the particular storage server of the plurality of storage servers that satisfies the condition for each of the plurality of rules in view of the order for the plurality of rules and the characteristic associated with each of the plurality of storage servers comprises:

identifying a first set of storage servers from the plurality of storage servers with a first characteristic that satisfies a first condition associated with a first rule of the plurality of rules specified by the order for the plurality of rules; and

identifying the particular storage server from the first set of storage servers with a second characteristic that satisfies a second condition associated with the second rule of the plurality of rules specified by the order for the plurality of rules.