Co-located clouds, vertically integrated clouds, and federated clouds

• US 9,361,263 B1
• Filed: 06/28/2012
• Issued: 06/07/2016
• Est. Priority Date: 12/21/2011
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Florissi, Patricia G. S., Vijendra, Sudhir
• Primary Examiner(s): Mejia, Anthony
• Application Number:
  US13/535,796
• Time in Patent Office: 1,440 Days
• Field of Search: 709/200, 709/217
• US Class Current: 1/1
• CPC Class Codes: G06F 15/161 Computing infrastructure, e.g. computer clusters, blade chassis or hardware partitioning casings, cabinets, racks or drawers for data centers H05K5/00
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 9/5072 Grid computing
• CPC Class Codes: G16B 50/00 ICT programming tools or database systems specially adapted for bioinformatics
• CPC Class Codes: G16B 50/30 Data warehousing; Computing architectures

Abstract

A computer implemented method, program product, and apparatus for managing big data clouds comprising co-locating a big data storage cloud with a second big data cloud to enable streamlined information flow between the clouds.

Claims

1. An apparatus comprising:

a co-location module enabled to operate on one or more processors, wherein the co-location module is configured to co-locate big data storage clouds to enable streamlined information flow between the big data storage clouds,

wherein the big data storage cloud comprises at least one resource selected from a group consisting of compute resources and storage resources,

wherein the co-locating minimizes the distance between big data storage cloud including minimizing the distance between the resources of the big data storage clouds,

wherein an information infrastructure layer enables the big data storage clouds to communicate between themselves, wherein the information infrastructure stores metadata about the big data storage clouds;

wherein the information infrastructure layer is enabled to allow a cloud of the big data storage clouds to subscribe to information from another of the big data storage clouds wherein the infrastructure layer notifies a subscribed cloud when information to which it is subscribed is modified, and

wherein the information infrastructure layer is enabled to allow a cloud of the big data storage clouds to publish information for consumption by another of the big data storage clouds to the infrastructure layer;

wherein job and task trackers communicatively coupled to the infrastructure layer monitor execution of one or more jobs in one or more of the big data storage clouds.

2. The apparatus of claim 1 further comprising:

an integrating module enabled to operate on one or more processors, wherein the integrating module is configured to integrate information transfer flow between the big data storage clouds through the use of rest interfaces.

3. The apparatus of claim 2 further comprising:

a vertically integration module enabled to operate on one or more processors, wherein the integrating module is configured to vertically integrate the big data storage clouds.

4. The apparatus of claim 3 further comprising:

A federation module enabled to operate on one or more processors, wherein the federation module is configured to federate the big data storage clouds.

5. The apparatus of claim 4 further comprising:

an ensurance module enabled to operate on one or more processors, wherein the ensurance module is configured to ensure any GRC compliance and service methodology is located on a dedicated cloud.

6. The apparatus of claim 5 further comprising:

—

a data analysis module enabled to operate on one or more processors, wherein the data analysis module is configured for analysis based on streamlined information flow between the clouds.

7. A computer program product comprising:

a non-transitory computer readable medium encoded with computer executable program code, the code configured to enable the execution of;

co-locating big data storage clouds to enable streamlined information flow between the big data storage clouds,

wherein the big data storage cloud comprises at least one resource selected from a group consisting of compute resources and storage resources,

wherein the co-locating minimizes the distance between big data storage cloud including minimizing the distance between the resources of the big data storage clouds,

wherein an information infrastructure layer enables big data storage clouds to communicate between themselves via the information infrastructure layer wherein the information infrastructure stores metadata about the big data storage clouds,

wherein the information infrastructure layer is enabled to allow a cloud of the big data storage clouds to subscribe to information from another of the big data storage clouds wherein the infrastructure layer notifies a subscribed cloud when information to which it is subscribed is modified, and

wherein the information infrastructure layer is enabled to allow a cloud of the big data storage clouds to publish information for consumption by another of the big data storage clouds to the infrastructure layer;

wherein job and task trackers communicatively coupled to the infrastructure layer monitor execution of one or more jobs in one or more of the big data storage clouds.

8. The computer program product of claim 7 the code further configured to enable the execution of:

integrating information transfer flow between the big data storage clouds through the use of rest interfaces.

9. The computer program product of claim 8 the code further configured to enable the execution of:

vertically integrating the big data storage clouds.

10. The computer program product of claim 9 the code further configured to enable the execution of:

federating the big data storage clouds.

11. The computer program product of claim 10 the code further configured to enable the execution of:

ensuring any GRC compliance and service methodology is located on a dedicated cloud.

12. The computer program product of claim 11 wherein data analysis is based on streamlined information flow between the big data storage clouds.

20. The computer program product of claim 10 the code further configured to enable the execution of:

passing big data meta information between the big data storage clouds.

13. A computer implemented method for managing big data clouds comprising:

co-locating big data storage clouds to enable streamlined information flow between the big data storage clouds,

wherein the big data storage cloud comprises at least one resource selected from a group consisting of compute resources and storage resources,

wherein the co-locating minimizes the distance between big data storage cloud including minimizing the distance between the resources of the big data storage clouds,

wherein an information infrastructure layer enables big data storage clouds to communicate between themselves via the information infrastructure layer wherein the information infrastructure stores metadata about the big data storage clouds;

wherein the information infrastructure layer is enabled to allow a cloud of the big data storage clouds to subscribe to information from another of the big data storage clouds wherein the infrastructure layer notifies a subscribed cloud when information to which it is subscribed is modified, and

wherein the information infrastructure layer is enabled to allow a cloud of the big data storage clouds to publish information for consumption by another of the big data storage clouds to the infrastructure layer;

wherein job and task trackers communicatively coupled to the infrastructure layer monitor execution of one or more jobs in one or more of the big data storage clouds.

14. The method of claim 13 further comprising:

integrating information transfer flow between the big data storage clouds through the use of rest interfaces.

15. The method of claim 14 further comprising:

vertically integrating the big data storage clouds.

16. The method of claim 15 further comprising:

federating the big data storage clouds.

17. The method of claim 16:

ensuring any GRC compliance and service methodology is located on a dedicated cloud.

18. The method of claim 16 wherein data analysis is based on streamlined information flow between the big data storage clouds.

19. The method of claim 16 wherein big data meta information is passed between the big data storage clouds.