Method and system for testing sections of large speech applications

• US 8,661,411 B2
• Filed: 12/02/2005
• Issued: 02/25/2014
• Est. Priority Date: 12/02/2005
• Status: Expired due to Fees

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Agapi, Ciprian, Metz, Brent D.
• Primary Examiner(s): Dao, Thuy
• Assistant Examiner(s): Chowdhury, Ziaul A
• Application Number:
  US11/292,833
• Publication Number:
  US 20070129947A1
• Time in Patent Office: 3,007 Days
• Field of Search: None
• US Class Current: 717/124
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites

Abstract

A method and system for testing code within a speech application. A test file can be automatically generated to verify the functionality of a new section of code within a graphical call flow builder application. A user can specify through a wizard two points on a path identifying the code section to be tested. The wizard can generate a test file and configure a path to a new subpath. Values are assigned to graphical call flow prompts along the path. Thus, the new code section is reached under the same path conditions for allowing repeatable testing. The system can include a test harness to test a new code section from within a context of the speech application, and a test controller for transitioning to the new code section. The test controller can run the test harness within the speech application to evaluate a functionality of the new code section.

Claims

1. A method executed by a processing unit for testing computer executable software code of a speech application, the speech application containing at least one path describing a call flow, the at least one path represented as a sequence of prompts graphically connected together, the method comprising acts of:

detecting a new code section of computer executable software code which has not been previously validated by execution of an evaluation process;

associating a subpath specified by a developer with said new code section, wherein the subpath is a portion of said at least one path;

identifying a first path through the speech application to said new code section;

configuring the first path to said new code section, wherein the act of configuring comprises automatically assigning a value to one or more variables associated with one or more prompts along said first path, and making a transition to said new code section;

generating a test file for automatically testing said new code section based on a test entry on a drop-down menu list, wherein the drop-down menu includes a wizard feature for graphically identifying the subpath; and

executing the test file to evaluate the new code section, wherein the act of executing the test file comprises providing one or more test examples in response to at least one prompt of the new code section, and evaluating at least one functionality of the new code section based on a response of the new code section to the one or more test examples.

2. The method of claim 1, further comprising looping around said new code section to continuously test the subpath, wherein said subpath is a sequence of conditional events directing a call flow within said speech application.

3. The method of claim 1, wherein the act of assigning values comprises collecting Dual Tone Multi-Frequency (DTMF) responses along said first path to said new code section.

4. The method of claim 1, wherein said method isolates said new code section for evaluating at least one functionality of said new code section by satisfying a path condition of said speech application.

5. The method of claim 1, further comprising:

publishing said speech application to a configured test server; and

running a test harness on said configured test server, wherein said configured test server provides the one or more test examples to said test harness for evaluating the at least one functionality of said new code section.

6. The method of claim 1, wherein the act of assigning values comprises collecting voice responses along said first path to said new code section.

7. A computer-implemented method for generating at least one test file for a speech application, the speech application containing at least one path describing a call flow, the at least one path represented as a sequence of prompts graphically connected together, the method comprising:

identifying a new code section to be tested within said speech application, wherein said new subpath code section has not been previously validated by execution of an evaluation process;

associating a subpath specified by a developer with said new code section, wherein the subpath is a portion of said at least one path;

detecting a first path to said new code section;

establishing at least one path condition for the first path that corresponds to a configuration of the speech application, wherein the first path provides a transition to said new code section, wherein establishing at least one path condition for the first path comprises automatically assigning a value to one or more variables associated with one or more prompts along said first path; and

inserting said subpath and said at least one path condition into said test file,

wherein generating at least one test file for the speech application is based on a test entry on a drop-down menu list, wherein the drop-down menu includes a wizard feature for graphically identifying the subpath.

8. The method of claim 7, further comprising:

publishing said speech application to a configured test server;

generating a loop around said subpath; and

running said speech application in accordance with said test file, wherein said test file evaluates at least one functionality of said new code section by repeating testing of said subpath, as determined by said loop.

9. A system for testing computer executable software code for a speech application, the speech application containing at least one path describing a call flow, the at least one path represented as a sequence of prompts graphically connected together, the system comprising:

a test harness configured to;

detect a new code section added to said speech application, wherein the new code section has not previously been tested by an evaluation process;

associate a subpath specified by a developer with said new code section, wherein the subpath is a portion of said at least one path;

identify a first path through the speech application to said new code section;

provide one or more test examples to at least one prompt of the new code section; and

evaluate at least one functionality of the new code section of computer executable software code which has not been previously validated by the evaluation process;

a test server comprising at least one processor configured to run said test harness;

a test controller configured to;

configure the first path to said new code section by automatically assigning a value to one or more variables associated with one or more prompts along said first path to satisfy a path condition, and making a transition to said new code section; and

run said test harness on said test server, wherein said test harness evaluates the at least one functionality of said new code section; and

a test entry on a drop-down menu list for generating a test file for automatically testing said new code section, wherein said drop-down menu includes a wizard feature for graphically identifying the subpath.

10. The system of claim 9, wherein said test harness determines appropriate grammar values along the first path leading to said new code section.

11. The system of claim 9, wherein the test controller assigns values to one or more guard variables within prompts along the first path, said guard variables directing a call flow to said new code section.

12. The system of claim 9, further comprising a publisher for submitting said speech application to said configured test server;

and,

said configured test server provides the one or more test examples to said test harness for evaluating the at least one functionality of said new code section.