STEP EDITOR FOR DATA PREPARATION

• US 20170109389A1
• Filed: 10/14/2015
• Published: 04/20/2017
• Est. Priority Date: 10/14/2015
• Status: Active Grant

• Current Assignee: DataRobot, Inc.
• Original Assignee: Paxata, Inc. (DataRobot, Inc.)
• Inventors: Matthews, Michael, Timourian, Ian, Chen, Jing, Gutnik, Lilia, Kwok, Whitman, Bardoliwalla, Nenshad Dinshaw, Brewster, Dave, Tso, Victor Tze-Yeuan
• Granted Patent: US 10,642,815 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/23 Updating
• CPC Class Codes: G06F 16/24539 using cached or materialised query results
• CPC Class Codes: G06F 16/248 Presentation of query results

Abstract

Using a step editor for data preparation includes: receiving an indication of a user input with respect to at least some of a set of sequenced data preparation operations on a set of data; generating, using one or more processors, a signature based at least in part on the set of sequenced data preparation operations, references to the set of data, and the user input; using the generated signature to determine whether there exists a cached result associated with the set of sequenced data preparation operations, the references to the set of data, and the user input; based at least in part on the determination, obtaining a data traversal program representing a result associated with the set of sequenced operations, the references to the set of data, and the user input; and providing output based at least in part on the result represented by the obtained data traversal program.

Claims

1. A system, comprising:

one or more processors configured to;

receive an indication of a user input with respect to at least some of a set of sequenced data preparation operations on a set of data;

generate a signature based at least in part on the set of sequenced data preparation operations, references to the set of data, and the user input;

use the generated signature to determine whether there exists a cached result associated with the set of sequenced data preparation operations, the references to the set of data, and the user input;

based at least in part on the determination, obtain a data traversal program representing a result associated with the set of sequenced operations, the references to the set of data, and the user input; and

provide output based at least in part on the result represented by the obtained data is traversal program; and

a memory coupled to the one or more processors and configured to provide the one or more processors with instructions.

2. The system of claim 1 wherein the user input includes muting an operation in the set of sequenced data preparation operations.

3. The system of claim 1 wherein the user input includes deleting a step in the set of sequenced data preparation operations.

4. The system of claim 1 wherein the user input includes stepping backwards through the set of sequenced data preparation operations.

5. The system of claim 1 wherein the user input includes stepping forwards through the set of sequenced data preparation operations.

6. The system of claim 1 wherein in the event that there exists a cached result associated with the set of sequenced data preparation operations, the references to the set of data, and the user input, obtaining the data traversal program includes retrieving the existing cached result, and wherein the existing cached result is represented at least in part by the obtained data traversal program.

7. The system of claim 1 wherein in the event that there does not exist a cached result associated with the set of sequenced data preparation operations, the references to the set of data, and the user input, obtaining the data traversal program includes generating the data traversal program based at least in part on the set of sequenced data preparation operations, the set of data, and the user input.

8. The system of claim 7, wherein the data traversal program is generated for rows visible in a user interface.

9. The system of claim 1 wherein the signature comprises a hash based at least in part on the set of sequenced data preparation operations, the references to the set of data, and the user input.

10. The system of claim 1 wherein the data traversal program indicates how to assemble one or more affected columns in one or more sets of data to derive the result represented by the data traversal program.

11. The system of claim 1 wherein a data preparation operation comprises an operation that transforms a set of data.

12. The system of claim 1 wherein providing output includes causing the output to be displayed.

13. A method, comprising:

receiving an indication of a user input with respect to at least some of a set of sequenced data preparation operations on a set of data;

generating, using one or more processors, a signature based at least in part on the set of sequenced data preparation operations, references to the set of data, and the user input;

using the generated signature to determine whether there exists a cached result associated with the set of sequenced data preparation operations, the references to the set of data, and the user input;

based at least in part on the determination, obtaining a data traversal program representing a result associated with the set of sequenced operations, the references to the set of data, and the user input; and

providing output based at least in part on the result represented by the obtained data traversal program.

14. The method of claim 13 wherein the user input includes muting an operation in the set of sequenced data preparation operations.

15. The method of claim 13 wherein the user input includes deleting a step in the set of sequenced data preparation operations.

16. The method of claim 13 wherein the user input includes stepping backwards through the set of sequenced data preparation operations.

17. The method of claim 13 wherein the user input includes stepping forwards through the set of sequenced data preparation operations.

18. The method of claim 13 wherein in the event that there exists a cached result associated with the set of sequenced data preparation operations and the user input, obtaining the data traversal program includes retrieving the existing cached result, and wherein the existing cached result is represented at least in part by the obtained data traversal program.

19. The method of claim 13 wherein in the event that there does not exist a cached result associated with the set of sequenced data preparation operations and the user input, obtaining the data traversal program includes generating the data traversal program based at least in part on the set of sequenced data preparation operations and the user input.

20. A computer program product embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

receiving an indication of a user input with respect to at least some of a set of sequenced data preparation operations on a set of data;

generating a signature based at least in part on the set of sequenced data preparation operations, references to the set of data, and the user input;

using the generated signature to determine whether there exists a cached result associated with the set of sequenced data preparation operations, the references to the set of data, and the user input;

based at least in part on the determination, obtaining a data traversal program representing a result associated with the set of sequenced operations, the references to the set of data, and the user input; and

providing output based at least in part on the result represented by the obtained data traversal program.