Management of storage in a storage network

• US 9,727,268 B2
• Filed: 12/20/2013
• Issued: 08/08/2017
• Est. Priority Date: 01/08/2013
• Status: Active Grant

• Current Assignee: Lyve Minds, Inc. (Seagate Technology Holdings Plc)
• Original Assignee: Lyve Minds, Inc. (Seagate Technology Holdings Plc)
• Inventors: Pasetto, Rick, Sewerynek, Stephen, Kaiser, Christian M.
• Primary Examiner(s): Dudek, Jr., Edward
• Application Number:
  US14/137,680
• Publication Number:
  US 20140195769A1
• Time in Patent Office: 1,327 Days
• CPC Class Codes: G06F 11/00 Error detection; Error correction; Monitoring error detection, correction or monitoring in information storage based on relative movement between record carrier and transducer G11B20/18; monitoring, i.e. supervising the progress of recording or reproducing G11B27/36; in static stores G11C29/00
• CPC Class Codes: G06F 12/023 Free address space management
• CPC Class Codes: G06F 16/178 Techniques for file synchronisation in file systems
• CPC Class Codes: G06F 16/275 Synchronous replication
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0613 in relation to throughput
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/0649 Lifecycle management
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/0653 Monitoring storage devices or systems
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A storage block may include a first portion allocated for storage of network data associated with a storage network. The storage network may include the storage block and one or more other storage blocks. The storage block may further include a second portion allocated for storage of local data. The local data may be associated with one or more programs of a device that includes the storage block. Additionally, the storage block may include a third portion as free space of the storage block. The third portion may be maintained at approximately a target size through adjustments made to an amount of network data stored on the first portion.

Claims

1. A method of managing storage allocation on a storage block, the method comprising:

allocating a first portion of the storage block for storage of network data associated with a storage network including the storage block and one or more other storage blocks;

allocating a second portion of the storage block for storage of local data associated with one or more programs of a device that includes the storage block;

allocating a third portion of the storage block as free space of the storage block, the third portion having a target size based on a target amount of free space on the storage block, the target size being based on;

average file size of data files of the network data and average file size of data files of the local data;

maintaining the third portion at approximately the target size by adjusting an amount of network data stored on the first portion while maintaining an amount of local data stored on the second portion;

determining whether an overall size of the network data is larger than available space on the first portion; and

in response to determining that the overall size of the network data is larger than the available space on the first portion, storing, on the first portion, a catalog of data including information about data files of the network data and storing a subset of the data files of the network data on the first portion instead of storing all the data files of the network data on the first portion in response to determining that the overall size of the network data is smaller than the available space on the first portion.

2. The method of claim 1, wherein maintaining the third portion at approximately the target size comprises adding network data to the first portion from the one or more other storage blocks of the storage network when an actual size of the third portion is greater than the target size of the third portion.

3. The method of claim 2, further comprising adding the network data to the first portion according to instructions received from storage network manager of the storage network.

4. The method of claim 1. wherein maintaining the third portion at approximately the target size comprises removing network data from the first portion when an actual size of the third portion is less than the target size of the third portion.

5. The method of claim 4, further comprising removing one or more data files of the network data designated as secondary copies first.

6. The method of claim 4, further comprising removing the network data according to instructions received from a storage network manager of the storage network.

7. The method of claim 1, wherein the target size is a percentage of a total storage capacity of the storage block or a fixed amount of storage space.

8. A storage block comprising:

a first portion allocated for storage of network data associated with a storage network including one or more other storage blocks;

a second portion allocated for storage of local data associated with one or more programs of a device that includes the storage block; and

a third portion allocated as free space of the storage block, the third portion being maintained at approximately a target size through addition and subtraction of an amount of network data stored on the first portion while maintaining an amount of local data stored on the second portion.

9. The storage block of claim 8, wherein, to maintain the third portion at approximately the target size, network data is added to the first portion from the one or more other storage blocks of the storage network when an actual size of the third portion is greater than the target size of the third portion.

10. The storage block of claim 9, wherein the network data is added according to instructions received from a storage network manager of the storage network.

11. The storage block of claim 8, wherein to maintain the third portion at approximately the target size, network data is removed from the first portion when an actual size of the third portion is less than the target size of the third portion.

12. The storage block of claim 11, wherein the network data is removed according to instructions received from a storage network manager of the storage network.

13. The storage block of claim 11, wherein one or more data files the network data that are designated as secondary copies are removed first.

14. The storage block of claim 8, wherein the target size is a percentage of a total storage capacity of the storage block or a fixed amount of storage space.

15. The storage block of claim 8, wherein the target size is based on one or more of the following:

average file sizes of data files of the network data and average file sizes of data files of the local data.

16. A non-transitory computer-readable storage medium including instructions that cause a system to perform operations to manage storage allocation on a storage agent, the operations comprising:

allocating a first portion of a storage block for storage of network data associated with a storage network including the storage block and one or more other storage blocks;

allocating a second portion of the storage block for storage of local data associated with one or more programs of a device that includes the storage block;

allocating a third portion of the storage block as free space of the storage block, the third portion having a target size associated with a target amount of free space on the storage block; and

maintaining the third portion at approximately the target size by addition and subtraction of an amount of network data stored on the first portion while maintaining an amount of local data stored on the second storage block.

17. The non-transitory computer-readable storage medium of claim 16, wherein maintaining the third portion at approximately the target size comprises adding network data to the first portion from the one or more other storage blocks of the storage network when an actual size of the third portion is greater than the target size of the third portion.

18. The non-transitory computer-readable storage medium of claim 16, wherein maintaining the third portion at approximately the target size comprises removing network data from the first portion when an actual size of the third portion is less than the target size of the third portion.

19. The non-transitory computer-readable storage medium of claim 16, wherein the target size is based on one or more of the following:

average file sizes of data files of the network data and average file sizes of data files of the local data.

20. The non-transitory computer-readable storage medium of claim 16, wherein the operations further include removing secondary copies of data files based on a desired redundancy of data.