Systems and methods for load balancing drives and servers by pushing a copy of a frequently accessed file to another disk drive

• US 10,079,878 B2
• Filed: 01/26/2015
• Issued: 09/18/2018
• Est. Priority Date: 01/29/2001
• Status: Expired due to Fees

• Current Assignee: Overland Storage Incorporated (Silicon Valley Technology Partners LLC)
• Original Assignee: Overland Storage Incorporated (Silicon Valley Technology Partners LLC)
• Inventors: Ulrich, Thomas R., Schweitzer, James R., Bolstad, Gregory D., Randall, Jay G., Staub, John R.
• Primary Examiner(s): Lee, Tammy Eunhye
• Application Number:
  US14/605,839
• Publication Number:
  US 20150142869A1
• Time in Patent Office: 1,331 Days
• Field of Search: None
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: G06F 9/5083 Techniques for rebalancing the load in a distributed system
• CPC Class Codes: H04L 67/1014 based on the content of a request

Abstract

A file system that balances the loading of filers and the capacity of drives that are associated with the filers is described. The file system includes a first disk drive that includes a first unused capacity and a second disk drive that includes a second unused capacity, wherein the second unused capacity is smaller than the first unused capacity. The file system further includes a first filer that is configured to fill requests from clients through access to at least the first disk drive. The file system further includes a second filer that is configured to fill requests from clients through access to at least the second disk drive. The second filer is configured to select an infrequently accessed file from the second disk drive and to push the infrequently accessed files to the first disk drive, thereby improving a balance of unused capacity between the first and second disk drives without substantially affecting a loading for each of the first and second filers.

Claims

1. A load balancing system, comprising:

at least one processor;

a first server configured to fill requests from clients through access to at least a first disk drive; and

a second server configured to fill requests from clients through access to at least a second disk drive, the second server configured to;

determine statistical information regarding access to one or more files on at least one of the first disk drive or the second disk drive,

determine file access frequency information for the one or more files based on the statistical information,

select a file from the second disk drive determined to be infrequently accessed relative to other files of the one or more files, and

push the file to the first disk drive via communication with the first server, such that clients will generate requests to the first server instead of the second server when requesting the file,

wherein the file requests to the first server are generated using a file handle for the pushed file that is stored by the clients.

2. The load balancing system of claim 1, wherein the second server is further configured to:

determine size information for the one or more files, and

select the file from the second disk drive based at least in part on the size information.

3. The load balancing system of claim 1, wherein first disk drive includes a first unused capacity and the second disk drive includes a second unused capacity that is smaller than the first unused capacity.

4. The load balancing system of claim 1, wherein the second server pushes the file through communication with the first disk drive.

5. The load balancing system of claim 1, wherein the first server further comprises a server profile comprising information about the first server, and wherein the second server is further configured to select and push the file to the first disk drive based on the server profile.

6. The load balancing system of claim 5, wherein the information about the first server comprises attributes of the first server.

7. The load balancing system of claim 5, wherein the information about the first server comprises performance data of resources connected to the first server.

8. The load balancing system of claim 5, wherein the information about the first server comprises performance data of the first server.

9. The load balancing system of claim 5, wherein the information about the first server comprises substantially static information.

10. The load balancing system of claim 5, wherein the information about the first server comprises dynamic information.

11. A first load balancing storage device comprising:

at least one interface configured for communication with clients, a first disk drive and a second load balancing storage device, the second load balancing storage device configured to fill requests from the clients through access to a second disk drive; and

at least one processor configured to;

determine statistical information regarding access to one or more files on at least one of the first disk drive or the second disk drive,

determine file access frequency information for the one or more files based on the statistical information,

select a file from the first disk drive determined to be infrequently accessed relative to other files of the one or more files, and

push the file to the second disk drive via the at least one interface, wherein the at least one processor pushes the file through communication with the second load balancing storage device, such that the clients will generate requests to the second load balancing storage device instead of the first disk drive when requesting the file,

wherein the file requests to the second load balancing storage device are generated using a file handle for the pushed file that is stored by the clients.

12. The load balancing storage device of claim 11, wherein the at least one processor is further configured to:

determine size information for the one or more files, and

select the file from the first disk drive based at least in part on the size information.

13. The load balancing storage device of claim 11, wherein the at least one processor pushes the file through communication with the second disk drive.

14. The load balancing storage device of claim 11, wherein the second load balancing storage device further comprises a file server.

15. The load balancing storage device of claim 14, wherein the file server comprises a memory for storing information about the file server, and wherein the at least one processor is further configured to select and push the file to the second disk drive based on the information about the file server.

16. The load balancing storage device of claim 15, wherein the information about the file server comprises performance data of the file server.

17. A computer-implemented method for load balancing, comprising:

receiving file requests from clients via a first communication channel by a first load balancing storage device;

accessing, from the first load balancing storage device via a second communication channel, a first disk drive in response to a file request received from a client;

determining statistical information regarding access to one or more files on the first disk drive using the first load balancing storage device;

determining file access frequency information for the one or more files based on the statistical information using the first load balancing storage device;

selecting a file from the first disk drive determined to be infrequently accessed relative to other files of the one or more files using the first load balancing storage device; and

pushing, via a third communication channel, the file to a second disk drive using the first load balancing storage device, wherein the first load balancing storage device pushes the file through communication with a second load balancing storage device, such that clients will generate requests to the second load balancing storage device instead of the first load balancing storage device when requesting the file,

wherein the file requests to the second load balancing storage device are generated using a file handle for the pushed file that is stored by the clients.

18. The computer implemented method of claim 17, further comprising determining size information for the one or more files using the first load balancing storage device, wherein the selecting the file is based at least in part on the size information.

19. The computer implemented method of claim 17 wherein at least one of the first load balancing storage device and the second load balancing storage device comprises a server.

20. The computer implemented method of claim 17 further comprising pushing the file through communication with the second disk drive via using the first load balancing storage device.