Method and system for conveying an example in a natural language understanding application
First Claim
1. A system for facilitating development, in a natural language understanding (NLU) application development environment, of an NLU model associated with an NLU application, the system comprising:
- at least one processor;
a database storing information used for training one or more NLU models;
at least one non-transitory computer-readable storage medium encoded with instructions that, when executed by the at least one processor, cause the at least one processor to perform;
obtaining at least one expected user entry and a corresponding desired routing destination;
applying the NLU model to the at least one expected user entry to determine whether the NLU model associates the at least one expected user entry with the desired routing destination;
when it is determined that the NLU model associates the at least one expected user entry with the desired routing destination, selecting the at least one expected user entry for presentation to a user in a help message of the NLU application as an example of input the user could provide to be routed to the desired routing destination; and
when it is determined that the NLU model does not associate the at least one expected user entry with the desired routing destination;
training the NLU model using training data accessed in the database to associate the at least one expected user entry with the desired routing destination; and
validating that the trained NLU model associates the at least one expected user entry with the desired routing destination.
3 Assignments
0 Petitions
Accused Products
Abstract
A method (300) and system (100) is provided to add the creation of examples at a developer level in the generation of Natural Language Understanding (NLU) models, tying the examples into a NLU sentence database (130), automatically validating (310) a correct outcome of using the examples, and automatically resolving (316) problems the user has using the examples. The method (300) can convey examples of what a caller can say to a Natural Language Understanding (NLU) application. The method includes entering at least one example associated with an existing routing destination, and ensuring an NLU model correctly interprets the example unambiguously for correctly routing a call to the routing destination. The method can include presenting the example sentence in a help message (126) within an NLU dialogue as an example of what a caller can say for connecting the caller to a desired routing destination. The method can also include presented a failure dialogue for displaying at least one example that failed to be properly interpreted to ensure that ambiguous or incorrect examples are not presented in a help message.
56 Citations
20 Claims
-
1. A system for facilitating development, in a natural language understanding (NLU) application development environment, of an NLU model associated with an NLU application, the system comprising:
-
at least one processor; a database storing information used for training one or more NLU models; at least one non-transitory computer-readable storage medium encoded with instructions that, when executed by the at least one processor, cause the at least one processor to perform; obtaining at least one expected user entry and a corresponding desired routing destination; applying the NLU model to the at least one expected user entry to determine whether the NLU model associates the at least one expected user entry with the desired routing destination; when it is determined that the NLU model associates the at least one expected user entry with the desired routing destination, selecting the at least one expected user entry for presentation to a user in a help message of the NLU application as an example of input the user could provide to be routed to the desired routing destination; and when it is determined that the NLU model does not associate the at least one expected user entry with the desired routing destination; training the NLU model using training data accessed in the database to associate the at least one expected user entry with the desired routing destination; and validating that the trained NLU model associates the at least one expected user entry with the desired routing destination. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A method for facilitating, in a natural language understanding (NLU) application development environment, of an NLU model associated with an NLU application, the method comprising:
using at least one processor and a database storing information used for training one or more NLU models to perform; obtaining at least one expected user entry and a corresponding desired routing destination; applying the NLU model to the at least one expected user entry to determine whether the NLU model associates the at least one expected user entry with the desired routing destination; when it is determined that the NLU model associates the at least one expected user entry with the desired routing destination, selecting the at least one expected user entry for presentation to a user during in a help message of the NLU application as an example of input the user could provide to be routed to the desired routing destination; and when it is determined that the NLU model does not associate the at least one expected user entry with the desired routing destination; training the NLU model using training data accessed in the database to associate the at least one expected user entry with the desired routing destination; and validating that the trained NLU model associates the at least one expected user entry with the desired routing destination. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
15. At least one non-transitory computer-readable storage medium encoded with instructions that, when executed by a computer system, cause the computer system to perform a method for facilitating, in a natural language understanding (NLU) application development environment, of an NLU model associated with an NLU application, the method comprising:
-
obtaining at least one expected user entry and a corresponding desired routing destination; applying the NLU model to the at least one expected user entry to determine whether the NLU model associates the at least one expected user entry with the desired routing destination; when it is determined that the NLU model associates the at least one expected user entry with the desired routing destination, selecting the at least one expected user entry for presentation to a user during in a help message of the NLU application as an example of input the user could provide to be routed to the desired routing destination; and when it is determined that the NLU model does not associate the at least one expected user entry with the desired routing destination; training the NLU model using training data accessed in an NLU database to associate the at least one expected user entry with the desired routing destination; and validating that the trained NLU model associates the at least one expected user entry with the desired routing destination. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification