Elastic data storage system

• US 10,642,821 B2
• Filed: 03/17/2017
• Issued: 05/05/2020
• Est. Priority Date: 03/17/2017
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Jadidi, Amir H., Psenicnik, Rudolf
• Primary Examiner(s): Nguyen, Kim T
• Application Number:
  US15/462,609
• Publication Number:
  US 20180268013A1
• Time in Patent Office: 1,145 Days
• Field of Search: 715733
• CPC Class Codes: G06F 12/0868 Data transfer between cache memory and other subsystems, e.g. storage devices or host systems
• CPC Class Codes: G06F 12/0875 with dedicated cache, e.g. instruction or stack
• CPC Class Codes: G06F 12/0891 using clearing, invalidating or resetting means
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/2282 Tablespace storage structures; Management thereof
• CPC Class Codes: G06F 16/2358 Change logging, detection, and notification replication G06F16/27
• CPC Class Codes: G06F 16/2453 Query optimisation
• CPC Class Codes: G06F 2212/465 Structured object, e.g. database record
• CPC Class Codes: G06F 2212/601 Reconfiguration of cache memory

Abstract

Disclosed herein are techniques for implementing a database system that provides flexible organizational aspects while retaining the ability to process and respond to database queries in an efficient manner. In particular, the techniques involve utilizing characteristics of both entity-attribute-value (EAV) database technologies and relational database technologies to provide a hybrid approach that exploits a large number of their benefits while eliminating a large number of their deficiencies. According to some embodiments, the techniques can involve implementing at least one central storage repository (configured to implement an EAV-style database), where the central storage repository provides information to at least one distributor to enable the establishment of at least one cached table (implemented in accordance with relational-style databases) within at least one cached storage device. In turn, the cached storage device can process fetch-based queries issued by client computing devices in a highly efficient manner.

Claims

1. A method for updating distributed cached tables associated with a database, the method comprising, at a computing device:

receiving and executing at least one database change query;

analyzing the at least one database change query against cached table storage configuration information to determine whether an update to at least one cached table is required; and

in response to determining that the update to the at least one cached table is required;

providing, to at least one distributor associated with the cached table storage configuration information, database delta information that reflects the execution of the at least one database change query, and

updating at least one revisions table in accordance with the update, wherein the at least one revisions table;

establishes snapshots that correspond to updates that are made to the database by recording different database change queries received at the computing device, and

enables any snapshot of the database to be restored via a single database change query that causes all entries within the at least one revisions table that were written subsequent to the particular snapshot to be deleted.

2. The method of claim 1, wherein the at least one database change query comprises a database update query, a database insertion query, or a database deletion query.

3. The method of claim 1, wherein the cached table storage configuration information identifies at least one cached table storage that stores the at least one cached table.

4. The method of claim 3, wherein the at least one cached table storage services fetch queries issued by client methods.

5. The method of claim 1, wherein the update to the at least one cached table is required if the at least one database change query modifies data that corresponds to the at least one cached table.

6. The method of claim 1, wherein, in response to receiving the database delta information, the at least one distributor causes the at least one cached table to be updated to reflect the database delta information.

7. The method of claim 1, wherein the update to the at least one cache table involves creating, updating, or deleting the at least one cache table.

8. The method of claim 7, wherein updating the at least one cache table comprises adding or deleting at least one property associated with the at least one cache table.

9. At least one non-transitory computer readable storage medium configured to store instructions that, when executed by at least one processor included in a computing device, cause the computing device to update distributed cached tables associated with a database, by carrying out steps that include:

receiving and executing at least one database change query;

analyzing the at least one database change query against cached table storage configuration information to determine whether an update to at least one cached table is required; and

in response to determining that the update to the at least one cached table is required;

providing, to at least one distributor associated with the cached table storage configuration information, database delta information that reflects the execution of the at least one database change query, and

updating at least one revisions table in accordance with the update, wherein the at least one revisions table;

establishes snapshots that correspond to updates that are made to the database by recording different database change queries received at the computing device, and

enables any snapshot of the database to be restored via a single database change query that causes all entries within the at least one revisions table that were written subsequent to the particular snapshot to be deleted.

10. The at least one non-transitory computer readable storage medium of claim 9, wherein the at least one database change query comprises a database update query, a database insertion query, or a database deletion query.

11. The at least one non-transitory computer readable storage medium of claim 9, wherein the cached table storage configuration information identifies at least one cached table storage that stores the at least one cached table.

12. The at least one non-transitory computer readable storage medium of claim 11, wherein the at least one cached table storage services fetch queries issued by client methods.

13. The at least one non-transitory computer readable storage medium of claim 9, wherein the update to the at least one cached table is required if the at least one database change query modifies data that corresponds to the at least one cached table.

14. The at least one non-transitory computer readable storage medium of claim 9, wherein, in response to receiving the database delta information, the at least one distributor causes the at least one cached table to be updated to reflect the database delta information.

15. A computing device configured to update distributed cached tables associated with a database, the computing device comprising:

at least one processor; and

at least one memory storing instructions that, when executed by the at least one processor, cause the computing device to perform steps that include;

receiving and executing at least one database change query;

analyzing the at least one database change query against cached table storage configuration information to determine whether an update to at least one cached table is required; and

in response to determining that the update to the at least one cached table is required;

providing, to at least one distributor associated with the cached table storage configuration information, database delta information that reflects the execution of the at least one database change query, and

updating at least one revisions table in accordance with the update, wherein the at least one revisions table;

establishes snapshots that correspond to updates that are made to the database by recording different database change queries received at the computing device, and

enables any snapshot of the database to be restored via a single database change query that causes all entries within the at least one revisions table that were written subsequent to the particular snapshot to be deleted.

16. The computing device of claim 15, wherein the at least one database change query comprises a database update query, a database insertion query, or a database deletion query.

17. The computing device of claim 15, wherein the cached table storage configuration information identifies at least one cached table storage that stores the at least one cached table.

18. The computing device of claim 17, wherein the at least one cached table storage services fetch queries issued by client methods.

19. The computing device of claim 15, wherein the update to the at least one cached table is required if the at least one database change query modifies data that corresponds to the at least one cached table.

20. The computing device of claim 15, wherein, in response to receiving the database delta information, the at least one distributor causes the at least one cached table to be updated to reflect the database delta information.