Generating and using temporal data partition revisions
First Claim
Patent Images
1. A method comprising:
- obtaining, at a server computer that executes a data management application, a data partition included in a data stream that is generated by a data source and streamed by the data source, the data partition comprising a single temporal release of a portion of a data table, wherein the portion of the data table is released multiple times over multiple temporal releases, and wherein the data partition comprises a record comprising a data point and a timestamp that indicates a time at which the data point was generated by the data source;
analyzing, by the server computer, contents of the data partition, a header associated with the data partition, and base data stored at a data store to determine whether the data partition corresponds to a new partition or an update of a base data partition stored at the data store, the base data partition comprising a base data point and a base data timestamp associated with the base data;
if a determination is made that the data partition corresponds to the new partition, storing, by the server computer, the new partition as part of the base data at the data store;
if a determination is made that the data partition corresponds to the update, computing, by the server computer, a revision comprisinga revision identifier associated with the revision,a delta that defines a change made to the base data point by the revision, andthe timestamp that indicates the time at which the data point was generated by the data source; and
storing, by the server computer, the revision as revision data that is stored separately from the base data partition.
1 Assignment
0 Petitions
Accused Products
Abstract
Concepts and technologies are disclosed herein for generating and using temporal data partition revisions. In some embodiments, a server computer can execute a data management application. The server computer can obtain a data partition associated with a data stream. The data partition can include a data point and a timestamp. The server computer can analyze the timestamp to determine if the data partition corresponds to an update of a base data record. If the server computer determines that the data corresponds to an update, the server computer can compute a revision comprising a delta and a timestamp and store the revision.
-
Citations
19 Claims
-
1. A method comprising:
-
obtaining, at a server computer that executes a data management application, a data partition included in a data stream that is generated by a data source and streamed by the data source, the data partition comprising a single temporal release of a portion of a data table, wherein the portion of the data table is released multiple times over multiple temporal releases, and wherein the data partition comprises a record comprising a data point and a timestamp that indicates a time at which the data point was generated by the data source; analyzing, by the server computer, contents of the data partition, a header associated with the data partition, and base data stored at a data store to determine whether the data partition corresponds to a new partition or an update of a base data partition stored at the data store, the base data partition comprising a base data point and a base data timestamp associated with the base data; if a determination is made that the data partition corresponds to the new partition, storing, by the server computer, the new partition as part of the base data at the data store; if a determination is made that the data partition corresponds to the update, computing, by the server computer, a revision comprising a revision identifier associated with the revision, a delta that defines a change made to the base data point by the revision, and the timestamp that indicates the time at which the data point was generated by the data source; and storing, by the server computer, the revision as revision data that is stored separately from the base data partition. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A system comprising:
-
a processor; and a memory that stores computer-executable instructions that, when executed by the processor, cause the processor to perform operations comprising obtaining a data partition included in a data stream that is generated by a data source and streamed by the data source, the data partition comprising a single temporal release of a portion of a data table, wherein the portion of the data table is released multiple times over multiple temporal releases, and wherein the data partition comprises a record comprising a data point and a timestamp that indicates a time at which the data point was generated by the data source, analyzing contents of the data partition, a header associated with the data partition, and base data stored at a data store to determine whether the data partition corresponds to a new partition or an update of a base data partition stored at the data store, the base data partition comprising a base data point and a base data timestamp associated with the base data, if a determination is made that the data partition corresponds to the new partition, storing the new partition as part of the base data at the data store, if a determination is made that the data partition corresponds to the update, computing a revision comprising a revision identifier associated with the revision, a delta that defines a change made to the base data point by the revision, and the timestamp that indicates the time at which the data point was generated by the data source, and storing the revision as revision data that is stored separately separate from the base data partition. - View Dependent Claims (11, 12, 13, 14)
-
-
15. A computer storage medium having computer-executable instructions stored thereon that, when executed by a processor, cause the processor to perform operations comprising:
-
obtaining a data partition included in a data stream that is generated by a data source and streamed by the data source, the data partition comprising a single temporal release of a portion of a data table, wherein the portion of the data table is released multiple times over multiple temporal releases, and wherein the data partition comprises a record comprising a data point and a timestamp that indicates a time at which the data point was generated by the data source; analyzing contents of the data partition, a header associated with the data partition, and base data stored at a data store to determine whether the data partition corresponds to a new partition or an update of a base data partition stored at the data store, the base data partition comprising a base data point and a base data timestamp associated with the base data; if a determination is made that the data partition corresponds to the new partition, storing the new partition as part of the base data at the data store; if a determination is made that the data partition corresponds to the update, computing a revision comprising a revision identifier associated with the revision, a delta that defines a change made to the base data point by the revision, and the timestamp that indicates the time at which the data point was generated by the data source; and storing the revision as revision data that is stored separately from the base data partition. - View Dependent Claims (16, 17, 18, 19)
-
Specification