Data access statement translation

• US 9,535,948 B1
• Filed: 12/16/2013
• Issued: 01/03/2017
• Est. Priority Date: 12/16/2013
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Cuthbert, David Allen, Li, Shuo
• Primary Examiner(s): Leroux, Etienne
• Application Number:
  US14/107,288
• Time in Patent Office: 1,114 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/2452 Query translation

Abstract

Techniques are described for dynamic translation of data access statements. A first set of statements is sent by an executing process to access a first data storage that supports a first query language. The first set of statements is intercepted and translated into a second set of statements configured to access a second data storage that supports a second query language. The second set of statements may be executed on the second data storage, and the result data set may be sent to the executing process that generated the first set of statements. The first and second storages may employ different data storage formats, such as relational and non-relational storage formats. The behavior of the executing process may be monitored to determine the feasibility of modifying the source code of the process to employ a different query language.

Claims

1. A computer-implemented method, comprising:

intercepting a first set of statements sent by an executing application, the first set of statements configured to be executed on a relational data storage to generate a first result data set, the first set of statements described using first query language that is a version of Structured Query Language (SQL) supported by the relational data storage;

translating the first set of statements into a second set of statements described using a second query language that is different than the first query language;

executing the second set of statements on a non-relational data storage that supports the second query language;

receiving a second result data set from the non-relational data storage, the second result data set generated from the executing of the second set of statements on the non-relational data storage;

sending the second result data set to the executing application; and

after receiving the second result data set, determining whether the executing application exhibits one or more of a failure, an error, or an exception when the second set of statements are executed on the non-relational data storage.

2. The method of claim 1, wherein:

the non-relational data storage includes a key-value store; and

the determining is based on a comparison of the first result data set obtained from executing the first set of statements on the relational data storage and the second result data set obtained from the executing of the second set of statements on the non-relational data storage.

3. The method of claim 1, wherein:

the relational data storage stores a first set of data according to a relational data storage format; and

the non-relational data storage stores a second set of data according to a non-relational data storage format, the second set of data being substantially similar to at least a portion of the first set of data.

4. The method of claim 1, wherein the translating of the first set of statements into the second set of statements further comprises:

parsing the first set of statements to generate a parse tree for the first set of statements, the parsing based on a first grammar for the version of SQL supported by the relational data storage; and

traversing the parse tree to generate the second set of statements, including determining at least one statement in the second set of statements based on at least one subset of nodes of the parse tree.

5. A system, comprising:

at least one computing device configured to implement one or more services, wherein the one or more services are configured to;

intercept a first set of statements sent by an executing application, the first set of statements configured to be executed on a first data storage to generate a first result data set, the first set of statements described using a first query language supported by the first data storage;

translate the first set of statements into a second set of statements described using a second query language that is different than the first query language;

generate a second result data set from executing the second set of statements on a second data storage that supports the second query language;

send the second result data set to the executing application; and

determine whether the executing application exhibits one or more of a failure, an error, or an exception when the second set of statements are executed on the second data storage.

6. The system of claim 5, wherein:

the first data storage stores a first set of data according to a first data storage format;

the second data storage stores a second set of data according to a second data storage format that is different than the first data storage format, the second set of data being substantially similar to at least a portion of the first set of data; and

the first data storage and the second data storage support different transaction models.

7. The system of claim 5, wherein the first data storage and the second data storage include a relational data storage and a non-relational data storage.

8. The system of claim 5, wherein the translating of the first set of statements into the second set of statements further comprises:

parsing the first set of statements to generate a parse data structure for the first set of statements, the parsing based on a first grammar for the first query language; and

traversing the parse data structure to generate the second set of statements, including determining at least one statement in the second set of statements based at least partly on at least one subset of nodes of the parse data structure.

9. The system of claim 8, wherein the parse data structure is a parse tree.

10. The system of claim 8, wherein the determining of the at least one statement in the second set of statements is further based on at least one inversion table included in the second data storage.

11. The system of claim 5, wherein the one or more services are configured to:

determine whether the executing application exhibits one or more of a failure, an error, or an exception after receiving the second result data set.

12. The system of claim 5, wherein the one or more services are further configured to:

determine a first set of credentials enabling access to the first data storage;

determine a second set of credentials corresponding to the first set of credentials, the second set of credentials enabling access to the second data storage; and

employ the second set of credentials to execute the second set of statements on the second data storage.

13. The system of claim 5, wherein:

the first query language is a version of Structured Query Language (SQL) supported by the first data storage; and

the first set of statements is configured to perform one or more of a select operation, an insert operation, an update operation, an inner join operation, a left outer join operation, a right outer join operation, a full outer join operation, a cross join operation, or a delete operation.

14. The system of claim 5, wherein:

the one or more services are further configured to;

execute the first set of statements on the first data storage to generate the first result data set; and

compare the first result data set to the second result data set.

15. One or more computer-readable media storing instructions which, when executed by at least one processor, instruct the at least one processor to perform actions comprising:

accessing a first set of statements sent by an application, the first set of statements configured to be executed on a first data storage to generate a first result data set the first set of statements described using a first query language supported by the first data storage;

translating the first set of statements into a second set of statements described using a second query language that is different than the first query language;

generating a second result data set from executing the second set of statements on a second data storage that supports the second query language;

sending the second result data set to the application; and

comparing the first result data set and the second result data set.

16. The one or more computer-readable media of claim 15, wherein:

the first data storage stores a first set of data according to a first data storage format; and

the second data storage stores a second set of data according to a second data storage format that is different than the first data storage format, the second set of data being substantially similar to at least a portion of the first set of data.

17. The one or more computer-readable media of claim 15, wherein the first data storage and the second data storage include a relational data storage and a non-relational data storage.

18. The one or more computer-readable media of claim 15, wherein

the first query language is a version of Structured Query Language (SQL) supported by the first data storage;

and

the first set of statements is configured to perform one or more of a select operation, an insert operation, an update operation, an inner join operation, a left outer join operation, a right outer join operation, a full outer join operation, a cross join operation, or a delete operation.

19. The one or more computer-readable media of claim 15, the actions further comprising:

determining a first set of credentials enabling access to the first data storage;

determining a second set of credentials corresponding to the first set of credentials, the second set of credentials enabling access to the second data storage; and

employing the second set of credentials to execute the second set of statements on the second data storage.

20. The one or more computer-readable media of claim 15, wherein the translating of the first set of statements into the second set of statements further comprises:

parsing the first set of statements to generate a parse data structure for the first set of statements, the parsing based on a first grammar for the first query language; and

traversing the parse data structure to generate the second set of statements, including determining at least one statement in the second set of statements based at least partly on at least one subset of nodes of the parse data structure.