Variable drive health determination and data placement

• US 10,204,017 B2
• Filed: 05/06/2015
• Issued: 02/12/2019
• Est. Priority Date: 03/29/2012
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Brooker, Marc J., Holgers, Tobias L., Parthasarathy, Madhuvanesh, Wei, Danny
• Primary Examiner(s): Bonzo, Bryce P
• Assistant Examiner(s): Arcos, Jeison C
• Application Number:
  US14/705,892
• Publication Number:
  US 20150234716A1
• Time in Patent Office: 1,378 Days
• CPC Class Codes: G06F 11/008 Reliability or availability analysis
• CPC Class Codes: G06F 11/1458 Management of the backup or restore process
• CPC Class Codes: G06F 11/30 Monitoring
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3419 by assessing time
• CPC Class Codes: G06F 11/3485 for I/O devices
• CPC Class Codes: G06F 12/02 Addressing or allocation; Relocation program address sequencing G06F9/00; arrangements for selecting an address in a digital store G11C8/00
• CPC Class Codes: G06F 2201/815 Virtual middleware or OS functionality using virtual machines to implement generic software techniques for error detection or fault masking G06F11/1484
• CPC Class Codes: G06F 2201/86 Event-based monitoring
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0653 Monitoring storage devices or systems
• CPC Class Codes: G06F 3/0683 Plurality of storage devices

Abstract

The relative health of data storage drives may be determined based, at least in some aspects, on data access information and/or other drive operation information. In some examples, upon receiving the operation information from a computing device, a health level of a drive may be determined. The health level determination may be based at least in part on operating information received from a client entity. Additionally, a storage space allocation instruction or operation may be determined for execution. The allocation instruction or operation determined to be performed may be based at least in part on the determined health level.

Claims

1. A computer-implemented method, comprising:

receiving operating information associated with a first data storage device, the operating information indicating an ability to perform operations on data stored in the first data storage device;

determining, based at least in part on the operating information, a first health level for the first data storage device, the first health level determined from a plurality of possible health levels in a sliding scale of health;

receiving an operational parameter associated with a first data object stored in the first data storage device, wherein the operational parameter indicates first performance criteria associated with the first data object;

determining, based at least in part on the operational parameter, that the first health level of the first data storage device is lower than a first predetermined level associated with the first performance criteria;

causing the first data object to be stored in a second data storage device with a second health level in the sliding scale of health that meets the first performance criteria; and

preventing additional data from being stored in the first data storage device.

2. The computer-implemented method of claim 1, wherein preventing the additional data from being stored includes causing one or more actions to be performed that disable reading or writing to storage space of the first data storage device of a second data object.

3. The computer-implemented method of claim 1, wherein the first performance criteria is based at least in part on a number of lost data packets during a client read or write operation of the first data object.

4. The computer-implemented method of claim 1, wherein the performance criteria is based at least in part on at least one of a desired reliability level, a desired performance level, a desired persistence level, or a desired security level for the first data object.

17. The computer-implemented method of claim 1, further comprising reallocating storage space of the first data storage device to enable storage, by the first data storage device, of a third data object with a third operational parameter that is associated with a third predetermined level that is equal to or higher than the first predetermined level.

18. The computer-implemented method of claim 1, wherein at least one of the operational parameter or the second operational parameter are defined in a request to store the first data object or the second data object.

5. A system, comprising:

one or more processors;

memory with instructions that, if executed by the one or more processors, cause the system to;

determine a first health level of a first storage system, wherein the first health level is based at least in part on operational data associated with the first storage system and on a sliding scale of health;

determine that the first health level indicates a suspect health level, the suspect health level indicating a higher probability of failure than a storage system operating normally;

determine that the first health level fails a set of one or more criteria associated with a first data object stored within the first storage system;

allocate space in a second storage system with a second health level on the sliding scale of health that at least meets the set of one or more criteria;

store the first data object in the second storage system; and

prevent one or more new data objects from being stored on the first storage system.

6. The system of claim 5, wherein the memory further includes instructions that, if executed by the one or more processors, cause the system to determine that the second health level indicates a lower probability of failure than the first health level.

7. The system of claim 5, wherein the memory further includes instructions that, if executed by the one or more processors, cause the system to cause the first data object to be stored in a third storage system.

8. The system of claim 5, wherein the memory further includes instructions that, if executed by the one or more processors, cause the system to reallocate storage space of the first storage system such that it is available for storing a second data object associated with the one or more criteria.

9. The system of claim 5, wherein the memory further includes instructions that, if executed by the one or more processors, cause the system to cause one or more actions to be performed that disable writing to a storage area of the first storage system.

10. The system of claim 5, wherein the operational data is based at least in part on a latency for a read request made, by a client entity, to the first storage system.

11. The system of claim 5, wherein the operational data is based at least in part on a latency for a write request made, by a client entity, to the first storage system.

12. The system of claim 5, wherein the first health level further comprises a particular health level selected from a multi-variable sliding scale of health levels.

13. The system of claim 12, wherein determining that the health level of the first storage system fails a set of one or more criteria is based at least in part on a location, of the first storage system, on the sliding scale of health levels.

19. The system of claim 5, wherein the suspect health level is based at least in part on the set of one or more criteria.

14. One or more non-transitory computer-readable media collectively storing computer-executable instructions that, if executed by one or more processors of a computer system, cause the computer system to:

determine, based at least in part on operation information of a remote storage system, a health level of the remote storage system, the health level selected from one or more health levels in a sliding scale of health;

receive a first criterion associated with data stored in the remote storage system;

determine, based at least in part on the health level and the first criterion, storage space allocation associated with data stored in the remote storage system; and

allocate space in the remote storage system based at least in part on the storage space allocation, by at least;

storing the data in a second remote storage system with a second health level relative to a predefined level; and

preventing new data from being written to the remote storage system.

15. The one or more non-transitory computer-readable media of claim 14, wherein the remote storage system is attached to a client entity separate from the computer system.

16. The one or more non-transitory computer-readable media of claim 14, wherein the sliding scale of health comprises at least a healthy level, a suspect level that is less healthy than the healthy level, and an unhealthy level that is less healthy than the suspect level.

20. The one or more non-transitory computer-readable media of claim 14, wherein the sliding scale of health is associated with the first criterion.