Method and system for evaluating automatic speech recognition telephone services
First Claim
1. A method for evaluating telephone services provided by speech recognition, the method comprising:
- interfacing over a telephone network with a speech recognition service, the speech recognition service having plural nodes and plural glossaries, each glossary applicable to one or more nodes of the service;
submitting speech utterance samples to the speech recognition service, the speech utterance samples associated with a node having plural glossaries; and
determining the response of the speech recognition service to each speech utterance sample.
6 Assignments
0 Petitions
Accused Products
Abstract
A method and system for evaluating telephone services provided by speech recognition interfaces an evaluation engine with a voice recognition service over a telephone system to submit speech utterance samples to the voice recognition service, receive the response of the voice recognition service to the sample utterances, and determine error and recognition of the sample utterances by the voice recognition service by comparing actual voice recognition service responses to expected responses. The evaluation engine permits evaluation of a voice recognition service for plural glossaries in different contexts, such as through predetermined nodes of a voice recognition service menu having plural glossaries.
-
Citations
20 Claims
-
1. A method for evaluating telephone services provided by speech recognition, the method comprising:
-
interfacing over a telephone network with a speech recognition service, the speech recognition service having plural nodes and plural glossaries, each glossary applicable to one or more nodes of the service; submitting speech utterance samples to the speech recognition service, the speech utterance samples associated with a node having plural glossaries; and determining the response of the speech recognition service to each speech utterance sample. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A system for evaluating a telephone service provided by speech recognition, the service having plural nodes, each node having one or more glossaries, the system comprising:
-
a library of sample speech utterances; a map of one or more of the telephone service nodes; a telephone system interface operable to communicate with the service through a telephone network; and an evaluation engine interfaced with the library, the map, and the telephone interface, the evaluation engine operable to submit speech utterance samples to the service at one or more nodes and to determine the response of the service. - View Dependent Claims (12, 13, 14, 15, 16)
-
-
17. A method for evaluating a voice recognition telephone service, the method comprising:
-
establishing communication with the voice recognition service through a telephone network; submitting a first sample utterance associated with a first sample speaker to plural predetermined nodes of the telephone service; and comparing the response of the telephone service for each predetermined node with an expected response to determine recognition error rates. - View Dependent Claims (18, 19, 20)
-
Specification