Natural language system and method based on unisolated performance metric
First Claim
Patent Images
1. A method, comprising:
- obtaining first data comprising audio data processed by a natural language understanding (NLU) system at least in part by using a first NLU model, a first N-best list of word sequences generated by using a first speech recognition model to recognize at least a portion of the audio data, and associated NLU data indicating how the audio data was understood by the NLU system; and
modifying, using at least one hardware processor, the first speech recognition model and the first NLU model based at least in part on the first data, including using the first N-best list of word sequences, to obtain a second speech recognition model and a second NLU model.
2 Assignments
0 Petitions
Accused Products
Abstract
A natural language business system and method is developed to understand the underlying meaning of a person'"'"'s speech, such as during a transaction with the business system. The system includes a speech recognition engine, and action classification engine, and a control module. The control module causes the system to execute an inventive method wherein the speech recognition and action classification models may be recursively optimized on an unisolated performance metric that is pertinent to the overall performance of the natural language business system, as opposed to the isolated model-specific criteria previously employed.
43 Citations
20 Claims
-
1. A method, comprising:
-
obtaining first data comprising audio data processed by a natural language understanding (NLU) system at least in part by using a first NLU model, a first N-best list of word sequences generated by using a first speech recognition model to recognize at least a portion of the audio data, and associated NLU data indicating how the audio data was understood by the NLU system; and modifying, using at least one hardware processor, the first speech recognition model and the first NLU model based at least in part on the first data, including using the first N-best list of word sequences, to obtain a second speech recognition model and a second NLU model. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A system, comprising:
-
at least one hardware processor; and at least one computer readable storage medium storing processor-executable instructions that, when executed by the at least one hardware processor, cause the at least one hardware processor to perform; obtaining first data comprising audio data processed by a natural language understanding (NLU) system at least in part by using a first NLU model, a first N-best list of word sequences generated by using a first speech recognition model to recognize at least a portion of the audio data, and associated NLU data indicating how the audio data was understood by the NLU system; and modifying the first speech recognition model and the first NLU model based at least in part on the first data, including using the first N-best list of word sequences, to obtain a second speech recognition model and a second NLU model. - View Dependent Claims (10, 11, 12, 13, 14)
-
-
15. At least one non-transitory computer-readable storage medium that stores processor-executable instructions that, when executed by at least one hardware processor, cause the at least one hardware processor to perform a method comprising:
-
obtaining first data comprising audio data processed by a natural language understanding (NLU) system at least in part by using a first NLU model, a first N-best list of word sequences generated by using a first speech recognition model to recognize at least a portion of the audio data, and associated NLU data indicating how the audio data was understood by the NLU system; and modifying the first speech recognition model and the first NLU model based at least in part on the first data, including using the first N-best list of word sequences, to obtain a second speech recognition model and a second NLU model. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification