Error assignment for computer programs

• US 10,409,667 B2
• Filed: 06/15/2017
• Issued: 09/10/2019
• Est. Priority Date: 06/15/2017
• Status: Active Grant

• Current Assignee: Salesforce.com, Inc.
• Original Assignee: Salesforce.com, Inc.
• Inventors: Donaldson, J. Justin, Tarevern, Hormoz, Hameed, Sadiya, Srivastava, Siddharth, Jiang, Feifei
• Primary Examiner(s): Duncan, Marc
• Assistant Examiner(s): Gibson, Jonathan D
• Application Number:
  US15/624,000
• Publication Number:
  US 20180365091A1
• Time in Patent Office: 817 Days
• CPC Class Codes: G06F 11/0706 the processing taking place on a specific hardware platform or in a specific software environment
• CPC Class Codes: G06F 11/0751 Error or fault detection not based on redundancy power supply failures G06F1/30; network fault management H04L41/06
• CPC Class Codes: G06F 11/0772 Means for error signaling, e.g. using interrupts, exception flags, dedicated error registers
• CPC Class Codes: G06F 11/0784 Routing of error reports, e.g. with a specific transmission path or data flow
• CPC Class Codes: G06F 11/079 Root cause analysis, i.e. error or fault diagnosis in a hardware test environment G06F11/22; in a software test environment G06F11/36
• CPC Class Codes: G06N 3/02 Neural networks
• CPC Class Codes: G06N 3/04 Architecture, e.g. interconnection topology
• CPC Class Codes: G06N 3/08 Learning methods

Abstract

An online system identifies an assignment for a computer program error indicated in an error message by applying an assignment model to token sequences identified in the error message. The error message includes a sequence of execution paths of the computer program. Each execution path indicates a function call active in computer memory when the error was generated. In other words, the error message allows tracking of the sequence of nested paths up to the point where the error was generated. In one example, the error message is a stack trace message that reports active stack frames in computer memory during the execution of the program.

Claims

1. A computer implemented method, comprising:

receiving an error message indicating error that occurred during execution of a computer program, wherein the error message includes a sequence of execution paths of the computer program;

extracting a plurality of token sequences in the error message, wherein each token sequence includes a sequence of token identifiers identified from the execution paths of the error message;

generating an output by applying a neural network model to the extracted plurality of token sequences;

determining an assignment for the error indicated by the error message based on the output of the neural network model; and

providing the error message and corresponding error assignment record to a user associated with the assignment.

2. The computer implemented method of claim 1, wherein each execution path from the sequence of execution paths represents a function call active in computer memory when the error was generated.

3. The computer implemented method of claim 1, further comprising encoding each token identifier from the plurality of token sequences into a one-hot encoded vector.

4. The computer implemented method of claim 1, wherein each token sequence in the plurality of token sequences includes token identifiers corresponding to a same programming element type.

5. The computer implemented method of claim 4, wherein each token sequence includes token identifiers corresponding to an object-oriented class programming element.

6. The computer implemented method of claim 1, wherein the error message is a stack trace message that reports active stack frames in computer memory during execution of the computer program.

7. A non-transitory computer readable storage medium comprising computer executable code that when executed by one or more processors causes the one or more processors to perform operations comprising:

receiving an error message indicating error that occurred during execution of a computer program, wherein the error message includes a sequence of execution paths of the computer program;

identifying a plurality of token sequences in the error message, wherein each token sequence includes a sequence of token identifiers identified from the execution paths of the error message;

generating an output by applying a neural network model to the identified plurality of token sequences.

determining an assignment for the error indicated by the error message based on the output of the neural network model; and

providing the error message to a user associated with the assignment.

8. The non-transitory computer readable storage medium of claim 7, wherein each execution path from the sequence of execution paths represents a function call active in computer memory when the error was generated.

9. The non-transitory computer readable storage medium of claim 7, wherein the computer executable code further causes the one or more processors to perform operations comprising encoding each token identifier in the plurality of token sequences into a one-hot encoded vector.

10. The non-transitory computer readable storage medium of claim 7, wherein each token sequence in the plurality of token sequences includes token identifiers corresponding to a same programming element type.

11. The non-transitory computer readable storage medium of claim 10, wherein each token sequence includes token identifiers corresponding to an object-oriented class programming element.

12. The non-transitory computer readable storage medium of claim 7, wherein the error message is a stack trace message that reports active stack frames in computer memory during execution of the computer program.

13. A system comprising:

one or more computer processors; and

a non-transitory computer readable storage medium comprising computer executable code that when executed by the one or more processors causes the one or more processors to perform operations comprising;

receiving an error message indicating error that occurred during execution of a computer program, wherein the error message includes a sequence of execution paths of the computer program;

identifying a plurality of token sequences in the error message, wherein each token sequence includes a sequence of token identifiers identified from the execution paths of the error message;

generating an output by applying a neural network model to the identified plurality of token sequences;

determining an assignment for the error indicated by the error messaged based on the output of the neural network model; and

providing the error message to a user associated with the assignment.

14. The system of claim 13, wherein each execution path from the sequence of execution paths represents a function call active in computer memory when the error was generated.

15. The system of claim 13, wherein the computer executable code further causes the one or more processors to perform operations comprising encoding each token identifier from the plurality of token sequences into a one-hot encoded vector.

16. The system of claim 13, wherein each token sequence in the plurality of token sequences includes token identifiers corresponding to a same programming element type.

17. The system of claim 13, wherein each token sequence includes token identifiers corresponding to an object-oriented class programming element.

18. The system of claim 13, wherein the error message is a stack trace message that reports active stack frames in computer memory during execution of the computer program.