Intelligent file system based power management for shared storage that migrates groups of files based on inactivity threshold

• US 8,006,111 B1
• Filed: 09/21/2007
• Issued: 08/23/2011
• Est. Priority Date: 09/21/2007
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Faibish, Sorin, Bixby, Peter, Tzelnic, Percy
• Primary Examiner(s): WANG, ALBERT C
• Application Number:
  US11/859,100
• Time in Patent Office: 1,432 Days
• Field of Search: 713/320, 713/324, 711/114, 711/165
• US Class Current: 713/324
• CPC Class Codes: G06F 1/3221 of disk drive devices
• CPC Class Codes: G06F 1/3268 Power saving in hard disk drive
• CPC Class Codes: G06F 1/3287 by switching off individual functional units in the computer system
• CPC Class Codes: G06F 16/1737 for reducing power consumption or coping with limited storage space, e.g. in mobile devices saving storage space on storage devices G06F3/0608; power saving in storage systems G06F3/0625
• CPC Class Codes: G06F 3/0625 Power saving in storage systems
• CPC Class Codes: G06F 3/0649 Lifecycle management
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

A file server includes active storage containing frequently accessed files, and active/inactive disk drives for containing infrequently accessed files. Groups of the files having become inactive in the active storage are successively migrated to respective evacuated active/inactive disk drives so that each active/inactive disk drive is loaded with files having a similar probability of access when access to the active/inactive disk drive reaches an inactivity threshold for powering down the active/inactive disk drive. Storage of the active/inactive disk drives is reclaimed when an oldest group of the files is archived or when an active/inactive disk drive is evacuated by migrating files from the active/inactive disk drive to storage having been released in other disk drives by promotion of files for client access to the promoted files. Therefore, recovery of storage can be planned and scheduled in advance and performed efficiently in a background process.

Claims

1. A method of operating a file server for power savings, the file server including active storage containing frequently accessed files, and active/inactive disk drives for containing infrequently accessed files, said method comprising:

(a) successively migrating groups of the files from the active storage to respective evacuated ones of the active/inactive disk drives, the files in each group of files being migrated when the files in said each group of files become inactive in the active storage, wherein the files in said each group of files are selected to have a similar probability of access when access to the active/inactive disk drive containing said each group of files reaches an inactivity threshold for powering down the active/inactive disk drive containing said each group of files; and

(b) powering down the disk drive containing said each group of files when access to the active/inactive disk drive containing said each groups of files reaches the inactivity threshold for powering down the active/inactive disk drive containing said each group of files;

wherein said method further includes computing a respective expulsion time for each of the files in the active storage, the respective expulsion time specifying when said each of the files in the active storage should be migrated from the active storage to one of the active/inactive disk drives for power savings, and placing said each of the files in the active storage on an expulsion list ordered by the respective expulsion time, and at the respective expulsion times, successively migrating the files in each group of the files from the expulsion list to the active/inactive disk drive for containing said each group of files.

2. The method as claimed in claim 1, wherein the active storage includes at least a first level of relatively high-speed active storage and a second level of relatively low-speed active storage, and wherein the method further includes migrating the files from the first level of relatively high-speed active storage to the second level of relatively low-speed active storage based on inactivity of access to the files in the first level of relatively high-speed storage, and wherein files having been accessed after migration to the second level of relatively low-speed active storage require a greater time of access inactivity in the second level of relatively low-speed storage for migration to one of the active/inactive disk drives than files that have not been accessed after migration to the second level of relatively low-speed active storage.

3. A method of operating a file server for power savings, the file server including active storage containing frequently accessed files, and active/inactive disk drives for containing infrequently accessed files, said method comprising:

(a) successively migrating groups of the files from the active storage to respective evacuated ones of the active/inactive disk drives, the files in each group of files being when the files in said each group of files become inactive in the active storage, wherein the files in said each group of files are selected to have a similar probability of access when access to the active/inactive disk drive containing said each group of files reaches an inactivity threshold for powering down the active/inactive disk drive containing said each group of files; and

(b) powering down the disk drive containing said each group of files when access to the active/inactive disk drive containing said each group of files reaches the inactivity threshold for powering down the active/inactive disk drive containing said each group of files;

wherein said method further includes maintaining the active/inactive disk drives containing the groups of files in a queue, the respective evacuated one of the active/inactive disk drives becoming a youngest one of the active/inactive disk drives on the queue once each group of files is migrated from the active storage to the respective evacuated one of the active/inactive disk drives, and successively evacuating files from an oldest active/inactive one of the disk drives from the queue, and taking the respective active/inactive disk drive becoming a youngest one of the disk drives in the queue from a pool of evacuated disk drives, and returning the oldest active/inactive disk drive from the queue to the pool of evacuated disk drives once the oldest active/inactive disk drive from the queue has been evacuated.

4. The method as claimed in claim 3, which further includes evacuating files from the oldest active/inactive one of the disk drives from the queue by migrating the files from the oldest active/inactive one of the disk drives from the queue to an archival storage unit.

5. The method as claimed in claim 3, which further includes promoting a plurality of files from the active/inactive disk drives in the queue to the active storage and releasing storage of the plurality of files from the active/inactive disk drives in the queue in response to client requests for access to the plurality of files, and evacuating files from the oldest active/inactive one of the disk drives from the queue by migrating files from the oldest active/inactive one of the disk drives from the queue to the released storage of at least some of the plurality of files.

6. The method as claimed in claim 3, which further includes promoting a plurality of files from the active/inactive disk drives in the queue to the active storage and releasing storage of the plurality of files from the active/inactive disk drives in the queue in response to client requests for access to the plurality of files, and evacuating a not yet inactive one of the active/inactive disk drives in the queue in order to save power by migrating files from the not yet inactive one of the active/inactive disk drives in the queue to the released storage of at least some of the plurality of files.

7. A method of operating a file server for power savings, the file server including active storage containing frequently accessed files, and active/inactive disk drives for containing infrequently accessed files, said method comprising:

(a) successively migrating groups of the files from the active storage to respective evacuated ones of the active/inactive disk drives, the files in each group of files being migrated when the files in said each group of files become inactive in the active storage, wherein the files in said each group of files are selected to have a similar probability of access when access to the active/inactive disk drive containing said each group of files reaches an inactivity threshold for powering down the active/inactive disk drive containing said each group of files; and

(b) powering down the disk drive containing said each group of files when access to the active/inactive disk drive containing said each group of files reaches the inactivity threshold for powering down the active/inactive disk drive containing said each group of files;

wherein said method further includes maintaining a map in the active storage of used and unused storage in each active/inactive disk drive containing files, and accessing the map to plan for evacuation of at least one active/inactive disk drive by file migration from said at least one active/inactive disk drive in the queue to unused storage of at least one other active/inactive disk drive.

8. A method of operating a file server for power savings, the file server including active storage containing frequently accessed files, and active/inactive disk drives for containing infrequently accessed files, said method comprising:

(a) successively migrating groups of the files from the active storage to respective evacuated ones of the active/inactive disk drives, the files in each group of files being migrated when the files in said each group of files become inactive in the active storage, wherein the files in said each group of files are selected to have a similar probability of access when access to the active/inactive disk drive containing said each group of files reaches an inactivity threshold for powering down the active/inactive disk drive containing said each group of files; and

(b) powering down the disk drive containing said each group of files when access to the active/inactive disk drive containing said each group of files reaches the inactivity threshold for powering down the active/inactive disk drive containing said each group of files;

wherein said method further includes creating a respective stub file in the active storage pointing to each file in each of the active/inactive disk drives when said each file is migrated from the active storage to said each of the active/inactive disk drives, the stub file including a copy of multiple ones of the first blocks of said each file in said each of the active/inactive disk drives.

9. A method of operating a file server for power savings, the file server including active storage containing frequently accessed files, and active/inactive disk drives for containing infrequently accessed files, said method comprising:

(a) successively migrating groups of the files from the active storage to respective evacuated ones of the active/inactive disk drives, the files in each group of files being migrated when the files in said each group of files become inactive in the active storage, wherein the files in said each group of files are selected to have a similar probability of access when access to the active/inactive disk drive containing said each group of files reaches an inactivity threshold for powering down the active/inactive disk drive containing said each group of files; and

(b) powering down the disk drive containing said each groups of files when access to the active/inactive disk drive containing said each group of files reaches the inactivity threshold for powering down the active/inactive disk drive containing said each group of files;

wherein said method further includes creating a respective stub file in the active storage pointing to each file in each of the active/inactive disk drives when said each file is migrated from the active storage to said each of the active/inactive disk drives, the stub file including an offline flag, the offline flag indicating whether or not said each of the active/inactive disk drives is in an inactive mode.

10. A method of operating a file server for power savings, the file server including active storage containing frequently accessed files, and active/inactive disk drives for containing infrequently accessed files, said method comprising:

(a) successively migrating groups of the files from the active storage to respective evacuated ones of the active/inactive disk drives, the files in each group of files being migrated when the files in said each group of files become inactive in the active storage, wherein the files in said each group of files are selected to have a similar probability of access when access to the active/inactive disk drive containing said each group of files reaches an inactivity threshold for powering down the active/inactive disk drive containing said each group of files; and

(b) powering down the disk drive containing said each groups of files when access to the active/inactive disk drive containing said each group of files reaches the inactivity threshold for powering down the active/inactive disk drive containing said each group of files;

wherein at least one file in at least one of the active/inactive disk drives is a read-only file, and the method further includes responding to a client request to read said at least one file by creating a copy of said at least one file in the active storage without deleting said at least one file from said at least one of the active/inactive disk drives, and when the copy of said at least one file becomes inactive in the active storage, deleting the copy of said at least one file from the active storage.

11. A method of operating a file server for power savings, the file server including active storage containing frequently accessed files, and active/inactive disk drives for containing infrequently accessed files, said method comprising:

(a) successively migrating groups of the files from the active storage to respective evacuated ones of the active/inactive disk drives, the files in each group of files being migrated when the files in said each group of files become inactive in the active storage, wherein the files in said each group of files are selected to have a similar probability of access when access to the active/inactive disk drive containing said each group of files reaches an inactivity threshold for powering down the active/inactive disk drive containing said each group of files; and

(b) powering down the disk drive containing said each group of files when access to the active/inactive disk drive containing said each group of files reaches the inactivity threshold for powering down the active/inactive disk drive containing said each group of files;

wherein said method further includes scheduling access to one of the active/inactive disk drives at a future time, and sending a power prefetch command to said one of the active/inactive disk drives so that said one of the active/inactive disk drives responds to the power prefetch command by transitioning from an inactive state to an active state by the future time, and accessing said one of the active/inactive disk drives at the future time.

12. A method of operating a file server for power savings, the file server including active storage containing frequently accessed files, and active/inactive disk drives for containing infrequently accessed files, said method comprising:

(a) successively migrating groups of the files from the active storage to respective evacuated ones of the active/inactive disk drives, the files in each group of files being migrated when the files in said each group of files become inactive in the active storage, the active/inactive disk drives containing the groups of files being maintained in a queue by taking a respective active/inactive disk drive becoming a youngest one of the disk drives in the queue from a pool of evacuated disk drives, and returning an oldest active/inactive disk drive from the queue to the pool of evacuated disk drives once the oldest active/inactive disk drive from the queue has been evacuated;

(b) responding to client requests for access to specified files in the active/inactive disks by promoting the specified files to the active storage and releasing storage of the specified files from the active/inactive disks containing the specified files;

(c) powering down the active/inactive disk drive containing said each group of files when access to the active/inactive disk drive containing said each group of files reaches an inactivity threshold for powering down the active/inactive disk drive containing said each group of files;

(d) maintaining a map in the active storage of used and unused storage in the active/inactive disk drives in the queue; and

(e) accessing the map to plan for evacuation of at least one of the active/inactive disk drives in the queue by migrating files from said at least one of the active/inactive disk drives in the queue to released storage of at least some of the specified files; and

then executing the plan to evacuate said at least one of the active/inactive disk drives in the queue.

13. The method as claimed in claim 12, which further includes selecting the files in each group of files to have a similar probability of access when access to the active/inactive disk drive containing said each group of files reaches an inactivity threshold for powering down the active/inactive disk drive containing said each group of files by computing a respective expulsion time for each of the files in the active storage, the respective expulsion time specifying when said each of the files in the active storage should be migrated from the active storage to one of the active/inactive disk drives for power savings, and maintaining an expulsion list of files in the active storage, the expulsion list being ordered by the respective expulsion time.

14. The method as claimed in claim 12, wherein the active storage includes at least a first level of relatively high-speed active storage and a second level of relatively low-speed active storage, and wherein the method further includes migrating the files from the first level of relatively high-speed active storage to the second level of relatively low-speed active storage based on inactivity of access to the files in the first level of relatively high-speed storage, and wherein files having been accessed after migration to the second level of relatively low-speed active storage require a greater time of access inactivity in the second level of relatively low-speed storage for migration to an active/inactive disk drive than files that have not been accessed after migration to the second level of relatively low-speed active storage.

15. A file server comprising:

at least one data processor programmed for responding to client requests for file access;

active storage coupled to said at least one data processor for client access to frequently accessed files in the active storage; and

active/inactive disk drives coupled to said at least one data processor for client access to infrequently accessed files in the active/inactive disk drives, each of the active/inactive disk drives having a power savings capability of powering down from an active state to a normally inactive state when access to said each of the active/inactive disk drives reaches an inactivity threshold;

wherein said at least one data processor is further programmed for successively migrating groups of the files from the active storage to respective evacuated ones of the active/inactive disk drives, the files in each group of files being migrated when the files in said each group of files become inactive in the active storage, and maintaining a queue of the active/inactive disk drives by migrating said each group of the files from the active storage to a respective evacuated active/inactive disk drive becoming a youngest active/inactive disk drive on the queue, promoting files in the active/inactive disk drives in the queue to the active storage in response to client requests for access to the files in the active/inactive disk drives in the queue, and evacuating files from an oldest active/inactive disk drive from the queue, and the respective active/inactive disk drive becoming a youngest one of the disk drives in the queue is taken from a pool of evacuated disk drives, and the oldest active/inactive disk drive from the queue is returned to the pool of evacuated disk drives once the oldest active/inactive disk drive from the queue has been evacuated.

16. The file server as claimed in claim 15, wherein the active storage includes at least a first level of relatively high-speed active storage and a second level of relatively low-speed active storage, and wherein said at least one data processor is programmed for migrating the files from the first level of relatively high-speed active storage to the second level of relatively low-speed active storage based on inactivity of access to the files in the first level of relatively high-speed storage, and wherein files having been accessed after migration to the second level of relatively low-speed active storage require a greater time of access inactivity in the second level of relatively low-speed storage for migration to the evacuated active/inactive disk drive becoming the youngest active/inactive disk drive on the queue than files that have not been accessed after migration to the second level of relatively low-speed active storage.

17. The file server as claimed in claim 15, wherein said at least one data processor is programmed for evacuating files from the oldest disk drive from the queue to an archival storage unit.

18. The file server as claimed in claim 15, wherein said at least one data processor is programmed for evacuating a not yet inactive one of the active/inactive disk drives in the queue for power savings by migrating files from the not yet inactive one of the active/inactive disk drives to released storage of files promoted from younger active/inactive disk drives in the queue.

19. The file server as claimed in claim 15, wherein said at least one data processor is programmed for maintaining a map in the active storage of used and unused storage in the active/inactive disk drives containing the infrequently accessed files, and accessing the map in the active storage for planning evacuation of at least one of the active/inactive disk drives containing the infrequently accessed files by migration of the infrequently accessed files in said at least one of the active/inactive files to unused storage of other ones of the active/inactive disk drives.