Optimized virtual storage fabric

• US 10,021,185 B1
• Filed: 08/22/2013
• Issued: 07/10/2018
• Est. Priority Date: 08/22/2013
• Status: Active Grant

• Current Assignee: CA, Inc. (d/b/a CA Technologies) (Broadcom, Inc.)
• Original Assignee: CA, Inc. (d/b/a CA Technologies) (Broadcom, Inc.)
• Inventors: Kleinschnitz, Jr., Donald Joseph, Danielson, Debra Jean
• Primary Examiner(s): Serrao, Ranodhi
• Assistant Examiner(s): Fiorillo, James
• Application Number:
  US13/973,578
• Time in Patent Office: 1,783 Days
• Field of Search: 709203, 709217, 711117, 718104
• CPC Class Codes: G06F 16/185 Hierarchical storage management [HSM] systems, e.g. file migration or policies thereof details of archiving G06F16/11
• CPC Class Codes: G06F 9/50 Allocation of resources, e.g. of the central processing unit [CPU]
• CPC Class Codes: G06F 9/5011 the resources being hardware resources other than CPUs, Servers and Terminals
• CPC Class Codes: G06F 9/5072 Grid computing
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

The disclosed embodiments included a system, apparatus, method, and computer program product for optimizing the storage of data based at least in part on cost and service levels utilizing a cloud-based virtual storage fabric. Those embodiments are configured to compile operational information for service offerings that provide data storage at different storage locations, determine the costs of migrating that data to and storing that data at each of those storage locations utilizing the operational information, designate at which storage location each datum is to be stored based in part on those costs, and designate at least one datum for migration from one of the storage locations to another if the cost of storing that datum at that storage location is determined to be greater than the costs of migrating and storing that datum at the other storage location.

Claims

1. A method comprising:

compiling operational information for a plurality of service offerings, the plurality of service offerings being configured to provide data storage at a plurality of storage locations on a network;

determining a cost of migrating each of a plurality of data to each of the plurality of storage locations utilizing the operational information;

determining a cost of storing each of the plurality of data at each of the plurality of storage locations utilizing the operational information;

designating at which of the plurality of storage locations each of the plurality of data is to be stored based on the cost of migrating each of a plurality of data to each of the plurality of storage locations and the cost of storing each of the plurality of data at each of the plurality of storage locations;

migrating at least one of the plurality of data from a first location of the plurality of storage locations to a second location of the plurality of storage locations in response to determining that the cost of continuing to store the at least one data at the first storage location is greater than the cost of migrating the at least one data to the second storage location and the cost of storing the at least one data at the second storage location;

wherein the plurality of storage locations comprise the first location, the second location, and a third location;

designating the at least one data for storage at the first location until a first storage volume is reached;

designating the at least one data for storage at a second location after the first storage volume is reached and until a second storage volume is reached;

designating the at least one data for storage at the third location after the second storage volume is reached; and

wherein it is more costly to migrate the at least one data to and store the at least one data at the first location than the second location after the first storage volume is reached, and it is more costly to migrate the at least one data to and store the at least one data at the second location than the third location after the second storage volume is reached.

2. The method of claim 1, further comprising:

determining a relationship each of the plurality of data has with at least one other data from among the plurality of data; and

assigning a classification to each of the plurality of data utilizing content extracted from each of the plurality of data and the relationship determined for each of the plurality of data,

wherein designating which of the plurality of locations each of the plurality of data is to be stored also is based on the classification of each of the plurality of data.

3. The method of claim 1, further comprising:

storing a first set of data from the plurality of data at the first location;

determining that it is less costly to migrate the first set of data and store the first set of data at a second location from among the plurality of locations than at the first location after a predetermined storage threshold is reached at the first location;

designating the first set of data for migration from the first location to the second location when the predetermined storage threshold is reached; and

designating a second set of data from the plurality of data for storage at the second location after the predetermined storage threshold is reached.

4. The method of claim 1, further comprising:

gathering user preferences for receiving service offerings via a user preference portal; and

filtering out, from the plurality of service offerings, a service offering that does not provide services in accordance with the user preferences,

wherein determining the cost of storing each of the plurality of data at each of the plurality of storage locations comprises excluding the service offering that is filtered out from the plurality of service offerings.

5. The method of claim 1, further comprising:

abstracting the plurality of service offerings as a single service;

gathering user preferences for receiving the single service via a user preference portal; and

migrating data from the first location to the second location in the background of the single service.

6. The method of claim 1, wherein determining the cost of storing each of the plurality of data at each of the plurality of storage locations comprises determining the cost of storing the at least one data at one location of the plurality of storage locations by determining the cost of amortizing storage devices at that one storage location.

7. A non-transitory computer program product that is configured to be executed by a processor, the computer program product comprising:

computer-readable program code configured to compile operational information for a plurality of service offerings, the plurality of service offerings being configured to provide data storage at a plurality of storage locations on a network;

computer-readable program code configured to determine a cost of migrating each of a plurality of data to each of the plurality of storage locations utilizing the operational information;

computer-readable program code configured to determine a cost of storing each of the plurality of data at each of the plurality of storage locations utilizing the operational information;

computer-readable program code configured to designate at which of the plurality of storage locations each of the plurality of data is to be stored based on the cost of migrating each of a plurality of data to each of the plurality of storage locations and the cost of storing each of the plurality of data at each of the plurality of storage locations;

computer-readable program code configured to designate at least one of the plurality of data for migration from a first location of the plurality of storage locations to a second location of the plurality of storage locations if the cost of continuing to store the at least one data at the first storage location is determined to be greater than the cost of migrating the at least one data to the second storage location and the cost of storing the at least one data at the second storage location;

wherein the plurality of storage locations comprise the first location, the second location, and a third location;

computer-readable program code configured to designate the at least one data for storage at the first location until a first storage volume is reached,

computer-readable program code configured to designate the at least one data for storage at a second location after the first storage volume is reached and until a second storage volume is reached, and

computer-readable program code configured to designate the at least one data for storage at the third location after the second storage volume is reached;

wherein it is more costly to migrate the at least one data to and store the at least one data at the first location than the second location after the first storage volume is reached; and

wherein it is more costly to migrate the at least one data to and store the at least one data at the second location than the third location after the second storage volume is reached.

8. The non-transitory computer program product of claim 7, further comprising:

computer-readable program code configured to determine a relationship each of the plurality of data has with at least one other data from among the plurality of data; and

computer-readable program code configured to assign a classification to each of the plurality of data utilizing content extracted from each of the plurality of data and the relationship determined for each of the plurality of data,

wherein the computer-readable program code configured to designate at which of the plurality of locations each of the plurality of data is to be stored also bases its designation on the classification of each of the plurality of data.

9. The non-transitory computer program product of claim 7, further comprising:

computer-readable program code configured to store a first set of data from the plurality of data at the first location;

computer-readable program code configured to designate the first set of data for migration from the first location to the second location when;

it is determined that it is less costly to migrate the first set of data and store the first set of data at a second location from among the plurality of locations than at the first location after a predetermined storage threshold is reached at the first location, and

the predetermined storage threshold is reached; and

computer-readable program code configured to designate a second set of data from the plurality of data for storage at the second location after the predetermined storage threshold is reached.

10. The non-transitory computer program product of claim 7, further comprising:

computer-readable program code configured to gather user preferences for receiving service offerings; and

computer-readable program code configured to filter out, from the plurality of service offerings, a service offering that does not provide services in accordance with the user preferences,

wherein the computer-readable program code configured to determine the cost of storing each of the plurality of data at each of the plurality of storage locations is configured to exclude the service offering that is filtered out from the plurality of service offerings.

11. The non-transitory computer program product of claim 7, further comprising:

computer-readable program code configured to abstract the plurality of service offerings as a single service; and

computer-readable program code configured to gather user preferences for receiving the single service,

wherein the computer-readable program code configured to designate at least one of the plurality of data for migration is configured to migrate data the first location to the second location in the background of the single service.

12. The non-transitory computer program product of claim 7, wherein the computer-readable program code configured to determine the cost of storing each of the plurality of data at each of the plurality of storage locations is configured to determine the cost of storing the at least one data at one storage location of the plurality of storage locations based on the cost of amortizing storage devices at that one storage location.

13. An apparatus comprising:

computer-readable program code embodied on a computer program product; and

a processor configured to execute the computer-readable program code,

wherein, when the processor executes the computer-readable program code, the apparatus is configured to;

compile operational information for a plurality of service offerings, the plurality of service offerings being configured to provide data storage at a plurality of storage locations on a network;

determine a cost of migrating each of a plurality of data to each of the plurality of storage locations utilizing the operational information;

determine a cost of storing each of the plurality of data at each of the plurality of storage locations utilizing the operational information;

designate at which of the plurality of storage locations each of the plurality of data is to be stored based on the cost of migrating each of a plurality of data to each of the plurality of storage locations and the cost of storing each of the plurality of data at each of the plurality of storage locations;

migrate at least one of the plurality of data from a first location of the plurality of storage locations to a second location of the plurality of storage locations if the cost of continuing to store the at least one data at the first storage location is determined to be greater than the cost of migrating the at least one data to the second storage location and the cost of storing the at least one data at the second storage location;

wherein the plurality of storage locations comprise the first location, the second location, and a third location;

designate the at least one data for storage at the first location until a first storage volume is reached,

designate the at least one data for storage at a second location after the first storage threshold is reached and until a second storage volume is reached, and

designate the at least one data for storage at the third location after the second volume threshold is reached;

wherein it is more costly to migrate the at least one data to and store the at least one data at the first location than the second location after the first storage volume is reached; and

wherein it is more costly to migrate the at least one data to and store the at least one data at the second location than the third location after the second storage volume is reached.

14. The apparatus of claim 13, wherein, when the processor executes the computer-readable program code, the apparatus is further configured to:

determine a relationship each of the plurality of data has with at least one other data from among the plurality of data; and

assign a classification to each of the plurality of data utilizing content extracted from each of the plurality of data and the relationship determined for each of the plurality of data,

wherein designating which of the plurality of locations each of the plurality of data is to be stored also is based on the classification of each of the plurality of data.

15. The apparatus of claim 13, wherein, when the processor executes the computer-readable program code, the apparatus is further configured to:

store a first set of data from the plurality of data at the first location;

determine that it is less costly to migrate the first set of data and store the first set of data at a second location from among the plurality of locations than at the first location after a predetermined storage threshold is reached at the first location;

designate the first set of data for migration from the first location to the second location when the predetermined storage threshold is reached; and

designate a second set of data from the plurality of data for storage at the second location after the predetermined storage threshold is reached.

16. The apparatus of claim 13, wherein, when the processor executes the computer-readable program code, the apparatus is further configured to:

gather user preferences for receiving service offerings via a user preference portal;

filter out, from the plurality of service offerings, a service offering that does not provide services in accordance with the user preferences; and

when determining the cost of storing each of the plurality of data at each of the plurality of storage locations, exclude the service offering that is filtered out from the plurality of service offerings.

17. The apparatus of claim 13, wherein, when the processor executes the computer-readable program code, the apparatus is further configured to:

abstract the plurality of service offerings as a single service;

gather user preferences for receiving the single service via a user preference portal; and

migrate data from the first location to the second location in the background of the single service.

18. The apparatus of claim 13, wherein determining the cost of storing each of the plurality of data each of the plurality of storage locations comprises determining the cost of storing the at least one data at one storage location of the plurality of storage locations based on the cost of amortizing storage devices at that one storage location.