Distributed data management system
First Claim
1. A method for storing data objects among a plurality of database management nodes operating on a plurality of computers in communication with each other over a computer network, the method comprising:
- maintaining a global data structure in at least one of the database management nodes, wherein the global data structure maps each logical data store of a plurality of logical data stores to a corresponding one of the database management nodes in which the logical data store is stored and, upon receipt of a key value identifying a data object, provides an identity of a database management node storing a logical data store in which the data object is stored;
storing a first data object in a first logical data store selected from the plurality of logical data stores, wherein the first logical data store corresponds to a key value of the first data object;
upon determining that memory consumption of a first database management node corresponding to the first logical data store exceeds a predetermined threshold, sending requests from the first database management node to one or more of the plurality of database management nodes in order to determine whether any one of the plurality of database management nodes has memory to accommodate the first logical data store;
identifying a second database management node from the one or more of the plurality of database management nodes that responds to the requests with replies affirming having memory to accommodate the first logical data store;
enabling migration of the first logical data store from the first database management node to the second database management node to rebalance memory consumption among the database management nodes while simultaneously allowing concurrent and non-blocking access to data objects stored in other logical data stores that are not involved in the migration; and
blocking access to logical data stores that are being migrated until the migration successfully completes.
3 Assignments
0 Petitions
Accused Products
Abstract
A distributed data management system has multiple virtual machine nodes operating on multiple computers that are in communication with each other over a computer network. Each virtual machine node includes at least one data store or “bucket” for receiving data. A digital hash map data structure is stored in a computer readable medium of at least one of the multiple computers to configure the multiple virtual machine nodes and buckets to provide concurrent, non-blocking access to data in the buckets, the digital hash map data structure including a mapping between the virtual machine nodes and the buckets. The distributed data management system employing dynamic scalability in which one or more buckets from a virtual machine node reaching a memory capacity threshold are transferred to another virtual machine node that is below its memory capacity threshold.
12 Citations
17 Claims
-
1. A method for storing data objects among a plurality of database management nodes operating on a plurality of computers in communication with each other over a computer network, the method comprising:
-
maintaining a global data structure in at least one of the database management nodes, wherein the global data structure maps each logical data store of a plurality of logical data stores to a corresponding one of the database management nodes in which the logical data store is stored and, upon receipt of a key value identifying a data object, provides an identity of a database management node storing a logical data store in which the data object is stored; storing a first data object in a first logical data store selected from the plurality of logical data stores, wherein the first logical data store corresponds to a key value of the first data object; upon determining that memory consumption of a first database management node corresponding to the first logical data store exceeds a predetermined threshold, sending requests from the first database management node to one or more of the plurality of database management nodes in order to determine whether any one of the plurality of database management nodes has memory to accommodate the first logical data store; identifying a second database management node from the one or more of the plurality of database management nodes that responds to the requests with replies affirming having memory to accommodate the first logical data store; enabling migration of the first logical data store from the first database management node to the second database management node to rebalance memory consumption among the database management nodes while simultaneously allowing concurrent and non-blocking access to data objects stored in other logical data stores that are not involved in the migration; and blocking access to logical data stores that are being migrated until the migration successfully completes. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A non-transitory computer-readable storage medium comprising instructions for storing data objects among a plurality of database management nodes operating on a plurality of computers in communication with each other over a computer network by carrying out the steps of:
-
maintaining a global data structure in at least one of the database management nodes, wherein the global data structure maps each logical data store of a plurality of logical data stores to a corresponding one of the database management nodes in which the logical data store is stored and, upon receipt of a key value identifying a data object, provides an identity of a database management node storing a logical data store in which the data object is stored; storing a first data object in a first logical data store selected from the plurality of logical data stores, wherein the first logical data store corresponds to a key value of the first data object; upon determining that memory consumption of a first database management node corresponding to the first logical data store exceeds a predetermined threshold, sending requests from the first database management node to one or more of the plurality of database management nodes in order to determine whether any one of the plurality of database management nodes has memory to accommodate the first logical data store; identifying a second database management node from the one or more of the plurality of database management nodes that responds to the requests with replies affirming having memory to accommodate the first logical data store; enabling migration of the first logical data store from the first database management node to the second database management node to rebalance memory consumption among the database management nodes while simultaneously allowing concurrent and non-blocking access to data objects stored in other logical data stores that are not involved in the migration; and blocking access to logical data stores that are being migrated until the migration successfully completes. - View Dependent Claims (8, 9, 10, 11, 12)
-
-
13. A distributed data management system comprising a plurality of computers, each computer including a memory and in communication with each other over a computer network, wherein the plurality of computers are configured to support execution of a plurality database management nodes and are configured to:
-
maintain a global data structure in at least one of the database management nodes, wherein the global data structure maps each logical data store of a plurality of logical data stores to a corresponding one of the database management nodes in which the logical data store is stored and, upon receipt of a key value identifying a data object, provides an identity of a database management node storing a logical data store in which the data object is stored; store a first data object in a first logical data store selected from the plurality of logical data stores, wherein the first logical data store corresponds to a key value of the first data object; upon determining that memory consumption of a first database management node corresponding to the first logical data store exceeds a predetermined threshold, send requests from the first database management node to one or more of the plurality of database management nodes in order to determine whether any one of the plurality of database management nodes has memory to accommodate the first logical data store; identify a second database management node from the one or more of the plurality of database management nodes that responds to the requests with replies affirming having memory to accommodate the first logical data store; enable migration of the first logical data store from the first database management node to the second database management node to rebalance memory consumption among the database management nodes while simultaneously allowing concurrent and non-blocking access to data objects stored in other logical data stores that are not involved in the migration; and blocking access to logical data stores that are being migrated until the migration successfully completes. - View Dependent Claims (14, 15, 16, 17)
-
Specification