Shingled repair set for writing data

• US 9,098,451 B1
• Filed: 11/21/2014
• Issued: 08/04/2015
• Est. Priority Date: 11/21/2014
• Status: Active Grant

• Current Assignee: Rubrik, Inc.
• Original Assignee: Igneous Systems, Inc. (Rubrik, Inc.)
• Inventors: Rakitzis, Triantaphyllos Byron, Hughes, Jeffrey Douglas, Bhageshpur, Kiran V.
• Primary Examiner(s): Wilson, Yolanda L
• Application Number:
  US14/550,466
• Time in Patent Office: 256 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1084 Degraded mode, e.g. caused by single or multiple storage removals or disk failures
• CPC Class Codes: G06F 11/1096 Parity calculation or recalculation after configuration or reconfiguration of the system
• CPC Class Codes: G06F 11/3034 where the computing system component is a storage system, e.g. DASD based or network based digital input from or digital output to record carriers G06F3/06; digital recording or reproducing G11B20/18; for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: G06F 11/3058 Monitoring arrangements for monitoring environmental properties or parameters of the computing system or of the computing system component, e.g. monitoring of power, currents, temperature, humidity, position, vibrations thermal management in cooling arrangements of a computing system G06F1/206
• CPC Class Codes: G06F 11/3442 for planning or managing the needed capacity
• CPC Class Codes: G06F 2201/81 Threshold
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

Embodiments are directed towards writing data to a shingle of storage devices enabling storage devices not in the shingle to be turned off. A shingle may be a sub-group of more than one storage devices selected from a larger group of storage devices. A plurality of data repair sets may be written to various subsets of the storage devices in the shingle. Each data repair set may include data block(s) and repair block(s)—with each block being stored on a different storage device in the shingle. When a condition is satisfied, the shingle may be modified to either remove at least one storage device from the shingle, add at least one other storage device to the shingle, or both. In various embodiments, the at least one other storage device may be a storage device in the group of storage devices that is not currently included in the shingle.

Claims

1. A method for storing data across a storage system, comprising:

establishing a shingle of storage devices, wherein the shingle refers to a logical organization of a sub-group of more than one storage device selected from a larger group of storage devices;

writing a plurality of data repair sets to one or more subsets of the storage devices in the shingle, wherein each data repair set includes at least one data block and at least one repair block, and wherein each block is stored on a different storage device in the one or more subsets in the shingle; and

when a condition is satisfied, modifying the shingle to remove at least one storage device from the shingle and to add at least one other storage device to the shingle, wherein the at least one other storage device is in the group of storage devices and currently non-included in the shingle, and wherein the at least one removed storage device is removed from a logical tail of the shingle'"'"'s organization of the sub-group of storage devices and the at least one other storage device is added to a logical head of the shingle'"'"'s organization of the sub-group of storage devices.

2. The method of claim 1, further comprising, powering down the at least one removed storage device.

3. The method of claim 1, further comprising, powering up the at least one added other storage device.

4. The method of claim 1, further comprising, when a storage capacity of at least one of the storage devices in the shingle exceeds a predetermined threshold, satisfying the condition.

5. The method of claim 1, further comprising satisfying the condition based on a predetermined time period.

6. The method of claim 1, further comprising:

when a capacity condition is satisfied for the group of storage device, determining a new group of storage devices; and

determining a new shingle that logically organizes a new sub-group of storage devices from the larger new group of storage devices.

7. The method of claim 1, wherein modifying the shingle includes wrapping the shingle to a lowest ordered storage device in the group of storage devices that was previously removed from the shingle.

8. A system for storing data across a storage system, comprising:

a group of storage devices; and

at least one network device that performs actions, including

establishing a shingle of storage devices, wherein the shingle refers to a logical organization of a sub-group of more than one storage device selected from the larger group of storage devices;

writing a plurality of data repair sets to one or more subsets of the storage devices in the shingle, wherein each data repair set includes at least one data block and at least one repair block, and wherein each block is stored on a different storage device in the one or more subsets in the shingle; and

when a condition is satisfied, modifying the shingle to remove at least one storage device from the shingle and to add at least one other storage device to the shingle, wherein the at least one other storage device is in the group of storage devices and currently non-included in the shingle, and wherein the at least one removed storage device is removed from a logical tail of the shingle'"'"'s organization of the sub-group of storage devices and the at least one other storage device is added to a logical head of the shingle'"'"'s organization of the sub-group of storage devices.

9. The system of claim 8, further comprising, powering down the at least one removed storage device.

10. The system of claim 8, further comprising, powering up the at least one added other storage device.

11. The system of claim 8, further comprising, when a storage capacity of at least one of the storage devices in the shingle exceeds a predetermined threshold, satisfying the condition.

12. The system of claim 8, further comprising:

when a capacity condition is satisfied for the group of storage device, determining a new group of storage devices; and

determining a new shingle that logically organizes a new sub-group of storage devices from the larger new group of storage devices.

13. The system of claim 8, wherein modifying the shingle includes wrapping the shingle to a lowest ordered storage device in the group of storage devices that was previously removed from the shingle.

14. A network computer for storing data across a storage system, comprising:

a memory that stores instructions; and

a processor that executes the instructions to perform actions, including

establishing a shingle of storage devices, wherein the shingle refers to a logical organization of a sub-group of more than one storage device selected from a larger group of storage devices;

writing a plurality of data repair sets to one or more subsets of the storage devices in the shingle, wherein each data repair set includes at least one data block and at least one repair block, and wherein each block is stored on a different storage device in the one or more subsets in the shingle; and

when a condition is satisfied, modifying the shingle to remove at least one storage device from the shingle and to add at least one other storage device to the shingle, wherein the at least one other storage device is in the group of storage devices and currently non-included in the shingle, and wherein the at least one removed storage device is removed from a logical tail of the shingle'"'"'s organization of the sub-group of storage devices and the at least one other storage device is added to a logical head of the shingle'"'"'s organization of the sub-group of storage devices.

15. The network computer of claim 14, wherein the processor that executes the instructions performs further actions, comprising, powering down the at least one removed storage device.

16. The network computer of claim 14, wherein the processor that executes the instructions performs further actions, comprising, when a storage capacity of at least one of the storage devices in the shingle exceeds a predetermined threshold, satisfying the condition.

17. The network computer of claim 14, wherein the processor that executes the instructions performs further actions, comprising, satisfying the condition based on a predetermined time period.

18. The network computer of claim 14, wherein the processor that executes the instructions performs further actions, comprising:

when a capacity condition is satisfied for the group of storage device, determining a new group of storage devices; and

determining a new shingle that logically organizes a new sub-group of storage devices from the larger new group of storage devices.

19. The network computer of claim 14, wherein modifying the shingle includes wrapping the shingle to a lowest ordered storage device in the group of storage devices that was previously removed from the shingle.

20. A processor readable non-transitory storage media that includes instructions for storing data across a storage system, wherein execution of the instructions by a processor performs actions, comprising:

establishing a shingle of storage devices, wherein the shingle refers to a logical organization of a sub-group of more than one storage device selected from a larger group of storage devices;

writing a plurality of data repair sets to one or more subsets of the storage devices in the shingle, wherein each data repair set includes at least one data block and at least one repair block, and wherein each block is stored on a different storage device in the one or more subsets in the shingle; and

when a condition is satisfied, modifying the shingle to remove at least one storage device from the shingle and to add at least one other storage device to the shingle, wherein the at least one other storage device is in the group of storage devices and currently non-included in the shingle, and wherein the at least one removed storage device is removed from a logical tail of the shingle'"'"'s organization of the sub-group of storage devices and the at least one other storage device is added to a logical head of the shingle'"'"'s organization of the sub-group of storage devices.

21. The media of claim 20, further comprising, powering down the at least one removed storage device.

22. The media of claim 20, further comprising, powering up the at least one added other storage device.

23. The media of claim 20, further comprising, when a storage capacity of at least one of the storage devices in the shingle exceeds a predetermined threshold, satisfying the condition.

24. The media of claim 20, further comprising satisfying the condition based on a predetermined time period.

25. The media of claim 20, further comprising:

when a capacity condition is satisfied for the group of storage device, determining a new group of storage devices; and

determining a new shingle that logically organizes a new sub-group of storage devices from the larger new group of storage devices.

26. The media of claim 20, wherein modifying the shingle includes wrapping the shingle to a lowest ordered storage device in the group of storage devices that was previously removed from the shingle.