Hierarchical diff files
First Claim
Patent Images
1. A method of organizing data in a database system comprising:
- via a swarm database having one or more nodes comprising one or more processors and memory, the memory of the one or more nodes storing one or more programs to be executed by the one or more processors,identifying data to store in one or more tables on a bucket,wherein the bucket is an allocation of a partitioned storage in a node of the one or more nodes, the bucket having at least one replica and no two of the same bucket replicas reside on the same node; and
assigning to each of the identified data an identifier and a data storage hierarchical level of a plurality of hierarchical levels, wherein the plurality of hierarchical levels includes;
a first level indicative of the oldest data in the one or more tables on the bucket,a second level indicative of newer stored data in the one or more tables on the bucket, anda third level indicative of the most recent stored data in the one or more tables on the bucket;
mapping to an index and storing each of the data in accordance with the index and assigned hierarchical level, the storing including writing data to a row in a table on the bucket of a node of the one or more nodes by a writer daemon and recording a write operation of the writing into a transaction log of the node;
receiving write operations from the writer daemon; and
combining write tasks of a bucket for a predetermined time period by a bucket daemon.
4 Assignments
0 Petitions
Accused Products
Abstract
A method of organizing a data in a database system using a swarm database system that has one or more nodes comprising one or more processors and memory, the memory of the one or more nodes storing one or more programs to be executed by the one or more processors. Identifying data to store in one or more tables on a bucket, wherein the bucket is a allocation of a partitioned storage in a node of the one or more nodes. Assigning to each of the identified data an identifier and a data storage hierarchical level of a plurality of hierarchical levels.
82 Citations
10 Claims
-
1. A method of organizing data in a database system comprising:
via a swarm database having one or more nodes comprising one or more processors and memory, the memory of the one or more nodes storing one or more programs to be executed by the one or more processors, identifying data to store in one or more tables on a bucket, wherein the bucket is an allocation of a partitioned storage in a node of the one or more nodes, the bucket having at least one replica and no two of the same bucket replicas reside on the same node; and assigning to each of the identified data an identifier and a data storage hierarchical level of a plurality of hierarchical levels, wherein the plurality of hierarchical levels includes; a first level indicative of the oldest data in the one or more tables on the bucket, a second level indicative of newer stored data in the one or more tables on the bucket, and a third level indicative of the most recent stored data in the one or more tables on the bucket; mapping to an index and storing each of the data in accordance with the index and assigned hierarchical level, the storing including writing data to a row in a table on the bucket of a node of the one or more nodes by a writer daemon and recording a write operation of the writing into a transaction log of the node; receiving write operations from the writer daemon; and combining write tasks of a bucket for a predetermined time period by a bucket daemon. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
8. A system for organizing data in a database system comprising:
a swarm database having at least two nodes, each node having one or more processors and memory, each node in communication with one another and configured to, receive data; assign to the received data an identifier and a data storage hierarchical level, wherein the hierarchical levels include; a first level indicative of the oldest data in one or more tables on the bucket; a second level indicative of newer stored data in the one or more tables on the bucket, and a third level indicative of the most recent stored data in the one or more tables on the bucket;
map the data to an index;store the data on a bucket in one of the nodes, in accordance with the mapped index and assigned hierarchical level, including writing data to a row in a table on the bucket of a node of the one or more nodes by a writer daemon and recording a write operation of the writing into a transaction log of the node, wherein the bucket is a unique allocation of a partitioned data storage in each node, the bucket having at least one replica and no two of the same bucket replicas reside on the same node; and copy the data in a replica of the bucket, wherein the replica of the bucket is located on a node different than the bucket; receive write operations from the writer daemon; and combine write tasks of a bucket for a predetermined time period by a bucket daemon. - View Dependent Claims (9, 10)
Specification