Test harness for a speech server

• US 20060224392A1
• Filed: 03/31/2005
• Published: 10/05/2006
• Est. Priority Date: 03/31/2005
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Ramakrishna, Anand, Kershaw, Daniel Jeremy, Herron, Daniel T.
• Granted Patent: US 7,653,547 B2
• Time in Patent Office: Days
• US Class Current: 704/270.100
• CPC Class Codes: G10L 15/28 Constructional details of speech recognition systems

Abstract

One aspect of the present invention relates to simulating an interaction between a client and a server. A session is established between the client and the server to conduct a test. Testing data is transmitted from the client to the server. The server processes the testing data and provides an in-band signal indicative of a response based on the testing data. The server also provides an out-of-band signal indicative of testing synchronization information related to the test.

Claims

1. A method of simulating an interaction between a client and a server, comprising:

establishing a session between the client and the server to conduct a test;

transmitting simulated data from the client to the server; and

processing the simulated data in order to provide an in-band signal indicative of a response and an out-of-band signal indicative of testing synchronization information related to the test, wherein the response and the testing information are based on the simulated data.

2. The method of claim 1 wherein the simulated data is speech data.

3. The method of claim 1 wherein the response is a prompt requesting additional information.

4. The method of claim 1 wherein the testing synchronization information includes a present dialog state.

5. The method of claim 1 wherein the testing synchronization information includes a recognition result.

6. The method of claim 1 and further comprising establishing multiple sessions between the client and the server.

7. The method of claim 1 and further comprising comparing the testing synchronization information with expected information.

8. The method of claim 1 wherein the out-of-band signal is based on an application communication interface.

9. A computer readable medium having instructions for testing a speech application, the instructions comprising:

transmitting speech data to the speech application;

receiving a prompt and a recognition result based on the speech data; and

comparing the prompt and the recognition result with an expected prompt and an expected recognition result.

10. The computer readable medium of claim 9 wherein the instructions further comprise logging a failure if the recognition result does not match the expected recognition result.

11. The computer readable medium of claim 9 wherein the instructions further comprise logging a failure if the prompt does not match the expected prompt.

12. The computer readable medium of claim 9 wherein the instructions further comprise measuring latency between transmitting the speech data and receiving the prompt.

13. The computer readable medium of claim 9 wherein the instructions further comprise transmitting further speech data based on the prompt.

14. The computer readable medium of claim 9 wherein the instructions further comprise simulating silence based on the prompt.

15. The computer readable medium of claim 9 wherein the instructions further comprise configuring testing parameters to test the speech application.

16. The computer readable medium of claim 9 wherein the instructions further comprise identifying an audio file containing the speech data.

17. A method for testing a speech application having a plurality of dialog states, comprising:

receiving information from the speech application indicative of a present dialog state; and

comparing the present dialog state with an expected dialog state.

18. The method of claim 17 and further comprising logging a failure if the present dialog state does not match an expected dialog state.

19. The method of claim 17 and further comprising transmitting speech data based on the present dialog state.

20. The method of claim 19 and further comprising receiving a recognition result based on the speech data and comparing the recognition result to the speech data.

21. (canceled)

22. (canceled)