Systems, methods, and apparatuses for fixing logical or physical corruption in databases using LSM trees

• US 9,720,954 B2
• Filed: 02/22/2017
• Issued: 08/01/2017
• Est. Priority Date: 12/19/2012
• Status: Active Grant

• Current Assignee: Salesforce.com, Inc.
• Original Assignee: Salesforce.com, Inc.
• Inventors: Wilding, Mark
• Primary Examiner(s): VO, TRUONG V
• Application Number:
  US15/438,952
• Publication Number:
  US 20170177657A1
• Time in Patent Office: 160 Days
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 11/1474 in transactions G06F16/20 takes precedence
• CPC Class Codes: G06F 16/215 Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/2379 Updates performed during online database operations; commit processing
• CPC Class Codes: G06F 2201/80 Database-specific techniques
• CPC Class Codes: G06F 2201/805 Real-time
• CPC Class Codes: G06F 2201/82 Solving problems relating to consistency ensuring consistency in mirrored systems G06F11/2064

Abstract

In accordance with disclosed embodiments, there are provided methods, systems, and apparatuses for fixing logical or physical corruption in databases using LSM trees including, for example, means for storing records in a LSM database at the host organization; processing transactions to the LSM database by writing the transactions into immutable extents for subsequent merge into the LSM database; recording a history of the transactions in a log; identifying corruption in at least one of the records of the LSM database represented within the immutable extents prior to use of the immutable extents in the LSM database; and correcting the identified corruption to the at least one of the records of the LSM database based at least in part on the recorded history of the transactions in the log during live operation of the LSM database. Other related embodiments are disclosed.

Claims

1. A method in a host infrastructure having a processor and a memory therein, wherein the method comprises:

causing records to be stored in a log-structured merge (LSM) storage;

writing transactions to a transaction log and then flushing at least a portion of the transaction log to cause the at least the portion of the transaction log to be stored into one or more extents in the LSM storage, wherein the transactions are updates to, deletions of, or creation of records;

receiving an identification of corruption in;

at least one corrupted transaction of the transactions,

at least one corrupted record of the records, or

both;

locating, in response to the receiving the identification of the corruption, compensating transaction data in the transaction log, wherein the compensating transaction data is usable to restore the at least one corrupted transaction, the at least one corrupted record, or both;

generating a compensating transaction based on the compensating transaction data from the transaction log and the stored record from the LSM storage; and

sending the compensating transaction to the LSM storage.

2. The method of claim 1, wherein the sending further comprises directly applying a compensating SQL transaction as the compensating transaction.

3. The method of claim 1, wherein the sending further comprises applying, via an application program interface, a compensating SQL transaction as the compensating transaction.

4. The method of claim 1, wherein the compensating transaction includes a compensating record which is an uncorrupted version of a logically-corrupted record, and further comprising adding the compensating record to supersede the logically-corrupted record.

5. The method of claim 4, further comprising performing a merge to delete the logically-corrupted record.

6. The method of claim 1, further comprising notifying a user when the causing the records to be stored is an extraordinary transaction.

7. The method of claim 6, wherein the causing the records to be stored is an extraordinary transaction when at least one of:

one or more edits to the records are made outside of normal business hours;

the one or more edits to the records originate from a location which does not match prior usage;

the one or more edits to the records originate from a location which does not match expected usage;

the one or more edits to the records originate from an IP address which does not match prior usage;

or

the one or more edits to the records originate from an IP address which does not match expected usage.

8. The method of claim 1, further comprising identifying corruption in at least one of the records of the LSM storage by triggering error messages to users for any queries to the LSM storage having the identified corruption within the query claim scope.

9. The method of claim 1, wherein the corruption constitutes logical corruption;

and further comprising presenting a historical records view to a user interface based on the transaction log, the historical records view displaying one or more corrupted records updated during a time range configurable at the user interface.

10. The method of claim 9, further comprising:

receiving a first user input selecting one or more of the corrupted records updated during the time range; and

receiving a second user input specifying one or more edits to rectify the logical corruption in the one or more corrupted records.

11. The method of claim 9, further comprising presenting a preview of other records affected by a proposed compensating transaction to the user interface prior to proceeding with the proposed compensating transaction.

12. The method of claim 9, further comprising:

storing an Organization Identifier (OrgID) and a User Identifier (UserID) within the recorded history of the transactions in the transaction log, the OrgID and UserID identifying which infrastructure and which user is associated with every transaction recorded; and

wherein presenting the historical records view to the user interface comprises restricting the historical records displayed based on an evaluation of the OrgID and the UserID stored in the log and based on access rights associated with a user of the user interface.

13. The method of claim 9, further comprising:

receiving a selection from the user interface specifying one of the displayed corrupted records updated during the time range;

presenting a record editor to the user interface having the corrupted record corresponding to the selection populated therein;

receiving user input to the fields of the corrupted record corresponding to the selection from the record editor at the user interface; and

generating a compensating transaction for the corrupted record corresponding to the selection using the user input to the fields of the record.

14. The method of claim 1, wherein the host infrastructure implements the method via computing architecture of the host infrastructure including at least the processor and the memory, a user interface operates at a user client device located remotely from the host infrastructure and communicatively interfaces with the host infrastructure via a public Internet, and the host infrastructure operates as a cloud-based service provider to the user client device.

15. The method of claim 1, wherein the host infrastructure provides a multi-tenant database system via the LSM storage and the computing architecture of the host infrastructure, the multi-tenant database system has elements of hardware and software which are shared by a plurality of separate and distinct customer infrastructures, and each of the separate and distinct customer infrastructures is remotely located from the host infrastructure.

16. The method of claim 1, further comprising identifying corruption in at least one of the records of the LSM storage by identifying logical corruption in response to user input at a logical corruption user interface, wherein the user input indicates that a selected record is to be corrected via a compensating transaction.

17. A non-transitory computer readable storage media having instructions stored thereon which, when executed by a processor in a host infrastructure, cause the host infrastructure to perform operations, comprising:

causing records to be stored in a log-structured merge (LSM) storage;

writing transactions to a transaction log and then flushing at least a portion of the transaction log to cause the at least the portion of the transaction log to be stored into one or more extents in the LSM storage, wherein the transactions are updates to, deletions of, or creation of records;

receiving an identification of corruption in;

at least one corrupted transaction of the transactions,

at least one corrupted record of the records, or

both;

locating, in response to the receiving the identification of the corruption, compensating transaction data in the transaction log, wherein the compensating transaction data is usable to restore the at least one corrupted transaction, the at least one corrupted record, or both;

generating a compensating transaction based on the compensating transaction data from the transaction log and the stored record from the LSM storage; and

sending the compensating transaction to the LSM storage.

18. The non-transitory computer readable storage media of claim 17, wherein the sending further comprises directly applying a compensating SQL transaction as the compensating transaction.

19. The non-transitory computer readable storage media of claim 17, wherein the sending further comprises applying, via an application program interface, a compensating SQL transaction as the compensating transaction.

20. The non-transitory computer readable storage media of claim 17, wherein the compensating transaction includes a compensating record which is an uncorrupted version of a logically-corrupted record, and further comprising adding the compensating record to supersede the logically-corrupted record.

21. The non-transitory computer readable storage media of claim 20, wherein the instructions cause the processor to perform further operations comprising:

performing a merge to delete the logically-corrupted record.

22. The non-transitory computer readable storage media of claim 17, wherein the instructions cause the processor to perform further operations comprising:

notifying a user when the causing the records to be stored is an extraordinary transaction.

23. The non-transitory computer readable storage media of claim 22, wherein the causing the records to be stored is an extraordinary transaction when at least one of:

one or more edits to the records are made outside of normal business hours;

the one or more edits to the records originate from a location which does not match prior usage;

the one or more edits to the records originate from a location which does not match expected usage;

the one or more edits to the records originate from an IP address which does not match prior usage;

or

the one or more edits to the records originate from an IP address which does not match expected usage.

24. The non-transitory computer readable storage media of claim 17, wherein the instructions cause the processor to perform further operations comprising:

identifying corruption in at least one of the records of the LSM storage by triggering error messages to users for any queries to the LSM storage having the identified corruption within the query claim scope.

25. The non-transitory computer readable storage media of claim 17, wherein the corruption constitutes logical corruption;

and further comprising presenting a historical records view to a user interface based on the transaction log, the historical records view displaying one or more corrupted records updated during a time range configurable at the user interface.

26. The non-transitory computer readable storage media of claim 25, wherein the instructions cause the processor to perform further operations comprising:

receiving a first user input selecting one or more of the corrupted records updated during the time range; and

receiving a second user input specifying one or more edits to rectify the logical corruption in the one or more corrupted records.

27. The non-transitory computer readable storage media of claim 25, wherein the instructions cause the processor to perform further operations comprising:

presenting a preview of other records affected by a proposed compensating transaction to the user interface prior to proceeding with the proposed compensating transaction.

28. The non-transitory computer readable storage media of claim 25, wherein the instructions cause the processor to perform further operations comprising:

storing an Organization Identifier (OrgID) and a User Identifier (UserID) within the recorded history of the transactions in the transaction log, the OrgID and UserID identifying which infrastructure and which user is associated with every transaction recorded,

wherein presenting the historical records view to the user interface comprises restricting the historical records displayed based on an evaluation of the OrgID and the UserID stored in the log and based on access rights associated with a user of the user interface.

29. The non-transitory computer readable storage media of claim 25, wherein the instructions cause the processor to perform further operations comprising:

receiving a selection from the user interface specifying one of the displayed corrupted records updated during the time range;

presenting a record editor to the user interface having the corrupted record corresponding to the selection populated therein;

receiving user input to the fields of the corrupted record corresponding to the selection from the record editor at the user interface; and

generating a compensating transaction for the corrupted record corresponding to the selection using the user input to the fields of the record.

30. The non-transitory computer readable storage media of claim 17, wherein the host infrastructure implements the method via computing architecture of the host infrastructure including at least the processor and the memory, a user interface operates at a user client device located remotely from the host infrastructure and communicatively interfaces with the host infrastructure via a public Internet, and the host infrastructure operates as a cloud-based service provider to the user client device.

31. The non-transitory computer readable storage media of claim 17, wherein the host infrastructure provides a multi-tenant database system via the LSM storage and the computing architecture of the host infrastructure, the multi-tenant database system has elements of hardware and software which are shared by a plurality of separate and distinct customer infrastructures, and each of the separate and distinct customer infrastructures is remotely located from the host infrastructure.

32. The non-transitory computer readable storage media of claim 17, wherein the instructions cause the processor to perform further operations comprising:

identifying corruption in at least one of the records of the LSM storage by identifying logical corruption in response to user input at a logical corruption user interface, wherein the user input indicates a selected record is to be corrected via a compensating transaction.

33. A system, comprising:

a log-structured merge (LSM) storage configured to store records;

a query interface configured to write transactions to a transaction log and then flush at least a portion of the transaction log to cause the at least the portion of the transaction log to be stored into one or more extents in the LSM storage, wherein the transactions are updates to, deletions of, or creation of records;

a transaction log configured to record a history of the transactions;

a logical corruption locator configured to locate logical corruption in at least one of the transactions or the records of the LSM storage; and

a logical corruption editor configured to;

receive an identification of corruption in;

at least one corrupted transaction of the transactions,

at least one corrupted record of the records, or

both; and

locate, in response to the receiving the identification of the corruption, compensating transaction data in the transaction log, wherein the compensating transaction data is usable to restore the at least one corrupted transaction, the at least one corrupted record, or both;

generate a compensating transaction based on the compensating transaction data from the transaction log and the stored record from the LSM storage; and

send the compensating transaction to the LSM storage.

34. The system of claim 33, further comprising a historical record viewer engine configured to present, based on the transaction log, a historical records view via a user interface, wherein the historical records view displays one or more records updated during a time range configurable at the user interface.

35. The system of claim 34, further comprising a logical corruption user interface engine configured to:

receive a first user input selecting one or more of the corrupted records updated during the time range; and

receive a second user input specifying edits to rectify the logical corruption in the one or more corrupted records.

36. The system of claim 33, further comprising a user interface configured to:

operate at a user client device, wherein the user client device is located remotely from the system; and

communicatively interface with the system via a public Internet,

wherein the system is configured to operate at a host infrastructure as a cloud-based service provider to the user client device, and the cloud-based service provider is configured to host customer data within a multi-tenant database system at the host infrastructure on behalf of the user.