Method and system for unified technological stack management for relational databases

• US 10,331,627 B2
• Filed: 08/09/2016
• Issued: 06/25/2019
• Est. Priority Date: 11/13/2013
• Status: Active Grant

• Current Assignee: Cellco Partnership, Inc. (Verizon Communications Inc.)
• Original Assignee: Cellco Partnership, Inc. (Verizon Communications Inc.)
• Inventors: Singh, Shivinder, Bhimaraju, Madhu, Reddy, Krishna
• Primary Examiner(s): Chau, Dung K
• Application Number:
  US15/232,312
• Publication Number:
  US 20160350328A1
• Time in Patent Office: 1,050 Days
• Field of Search: 707803
• CPC Class Codes: G06F 16/178 Techniques for file synchronisation in file systems
• CPC Class Codes: G06F 16/21 Design, administration or maintenance of databases
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Abstract

An approach is described for providing unified technological stack management (e.g., via a global storage instance) where metadata is delocalized from storage nodes. The approach includes creating a global storage instance, wherein the global storage instance contains metadata for a storage layer including a plurality of storage nodes, and wherein the global storage instance is delocalized from the plurality of storage nodes. The approach also includes receiving a database operation request from an operating system layer. The approach further includes mediating the database operation request between the operating system layer and the storage layer using the global storage instance.

Claims

1. A method comprising:

invoking, by a platform server of a service provider, a global storage instance to maintain a global repository for metadata of a plurality of nodes, the nodes being associated with an operating system layer for managing the metadata, wherein the global storage instance includes a plurality of metadata sets and a plurality of storage blocks, and wherein the metadata is delocalized from the plurality of nodes; and

directing, via the global storage instance, communication between the nodes and a storage layer that stores data objects accessible by any one of the nodes, the storage layer being geographically different from the nodes.

2. A method of claim 1, further comprising:

receiving a request by the global storage instance to locate one of the storage blocks that can perform the request; and

communicating with the operating system to locate metadata to find a file object for the request.

3. A method of claim 2, further comprising:

upon determining a successful transaction, updating the one storage block; and

synchronizing database buffers, the operating system, and associated ones of the storage blocks.

4. A method of claim 2, further comprising:

determining a custom algorithm to communicate with the nodes to carry out an operation specified by a database operation request,

wherein the custom algorithm is specific to interfacing with particular ones of the nodes and/or versions of operating systems on the particular ones of the nodes.

5. A method of claim 1, further comprising:

determining which ones of the nodes may join the operating system layer to access the stored data objects.

6. A method of claim 1, wherein the metadata sets include information relating to file type, device node, file ownership, or access information, the access information specifying particular ones of the data objects within the storage layer.

7. A method of claim 1, further comprising:

receiving a request to create a storage location as part of a rebalancing process of the plurality of nodes;

causing an addition or a removal of one or more the nodes based on the request;

determining storage capacity of resultant nodes from the addition or the removal of one or more the nodes; and

distributing the metadata across the resultant nodes in response to the determination.

8. A method of claim 1, wherein each of the nodes includes a database and a storage management component, and the storage layer includes a plurality of diskgroups, the method further comprising:

performing, by the global storage instance, one or more functions of the storage management components;

or

operating, by the global storage instance, in a master-slave model with the storage management components.

9. A method of claim 8, further comprising:

determining that file content resides on a particular one of the storage management components based on the metadata.

10. A system comprising:

a platform server,

a plurality of nodes;

a memory storing instructions;

at least one processor, communicatively coupled to the memory and configured to execute the instructions, to cause the platform server,

maintained by a service provider, configured to invoke a global storage instance to maintain a global repository for metadata of the plurality of nodes, the nodes being associated with an operating system layer for managing the metadata, wherein the global storage instance includes a plurality of metadata sets and a plurality of storage blocks, and wherein the metadata is delocalized from the plurality of nodes,

wherein the global storage instance directs communication between the nodes and a storage layer that stores data objects accessible by any one of the nodes, the storage layer being geographically different from the nodes.

11. A system of claim 10, wherein the global storage instance is further configured to:

receive a request to locate one of the storage blocks that can perform the request; and

communicate with the operating system to locate metadata to find a file object for the request.

12. A system of claim 11, wherein the global storage instance is further configured to:

upon determining a successful transaction, update the one storage block; and

synchronize database buffers, the operating system, and associated ones of the storage blocks.

13. A system of claim 11, wherein the global storage instance is further configured to determine a custom algorithm to communicate with the nodes to carry out an operation specified by a database operation request,

wherein the custom algorithm is specific to interfacing with particular ones of the nodes and/or versions of operating systems on the particular ones of the nodes.

14. A system of claim 10, wherein the global storage instance is further configured to determine which ones of the nodes may join the operating system layer to access the stored data objects.

15. A system of claim 10, wherein the metadata sets include information relating to file type, device node, file ownership, or access information, the access information specifying particular ones of the data objects within the storage layer.

16. A system of claim 10, wherein the global storage instance is further configured to:

receive a request to create a storage location as part of a rebalancing process of the plurality of nodes;

cause an addition or a removal of one or more the nodes based on the request;

determine storage capacity of resultant nodes from the addition or the removal of one or more the nodes; and

distribute the metadata across the resultant nodes in response to the determination.

17. A system of claim 10, wherein each of the nodes includes a database and a storage management component, and the storage layer includes a plurality of diskgroups, the global storage instance being further configured to:

perform one or more functions of the storage management components;

or

operate, by the global storage instance, in a master-slave model with the storage management components.

18. A system of claim 17, wherein the global storage instance is further configured to determine that file content resides on a particular one of the storage management components based on the metadata.

19. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus operated by a service provider to perform at least the following,

maintain a global storage instance that maintains a global repository for metadata of a storage layer, the storage layer including a plurality of storage nodes operated by the service provider for a corresponding plurality of clients, wherein the global storage instance is delocalized from the storage nodes;

receive a database operation request from an operating system layer;

mediate the database operation request between the operating system layer and the storage layer using the metadata of the storage nodes; and

update the metadata of the storage nodes based on metadata locally updated at one or more of the storage nodes that completed the database operation request.

20. An apparatus according to claim 19, wherein the apparatus is further caused to:

determine a custom algorithm to communicate with the storage nodes to carry out an operation specified by the database operation request,

wherein the custom algorithm is specific to interfacing with particular ones of the storage nodes and/or versions of operating systems on the particular ones of the storage nodes.