Method and system for conveying an example in a natural language understanding application
First Claim
1. A method for facilitating development of a natural language understanding (NLU) model associated with an NLU application executing on a computer system comprising a combination of hardware and software, the method comprising acts of:
- receiving, from a developer of the NLU application, at least one expected user entry and a corresponding desired routing destination;
determining whether the NLU model associates the at least one expected user entry with the desired routing destination, the determining comprising;
interpreting the at least one expected user entry via the NLU model to determine an actual routing destination for the at least one expected user entry, andcomparing the actual routing destination to the desired routing destination;
if it is determined that the actual routing destination of the at least one expected user entry matches the desired routing destination, selecting the at least one expected user entry for presentation to a user during a help prompt of the NLU application as an example of a legitimate utterance the user could speak to be routed to the desired routing destination; and
if it is determined that the actual routing destination does not match the desired routing destination;
(i) adding the at least one expected user entry to an NLU entry data set associated with the NLU model, and(ii) training the NLU model to associate the at least one expected user entry with the desired routing destination.
3 Assignments
0 Petitions
Accused Products
Abstract
A method (300) and system (100) is provided to add the creation of examples at a developer level in the generation of Natural Language Understanding (NLU) models, tying the examples into a NLU sentence database (130), automatically validating (310) a correct outcome of using the examples, and automatically resolving (316) problems the user has using the examples. The method (300) can convey examples of what a caller can say to a Natural Language Understanding (NLU) application. The method includes entering at least one example associated with an existing routing destination, and ensuring an NLU model correctly interprets the example unambiguously for correctly routing a call to the routing destination. The method can include presenting the example sentence in a help message (126) within an NLU dialogue as an example of what a caller can say for connecting the caller to a desired routing destination. The method can also include presented a failure dialogue for displaying at least one example that failed to be properly interpreted to ensure that ambiguous or incorrect examples are not presented in a help message.
37 Citations
22 Claims
-
1. A method for facilitating development of a natural language understanding (NLU) model associated with an NLU application executing on a computer system comprising a combination of hardware and software, the method comprising acts of:
-
receiving, from a developer of the NLU application, at least one expected user entry and a corresponding desired routing destination; determining whether the NLU model associates the at least one expected user entry with the desired routing destination, the determining comprising; interpreting the at least one expected user entry via the NLU model to determine an actual routing destination for the at least one expected user entry, and comparing the actual routing destination to the desired routing destination; if it is determined that the actual routing destination of the at least one expected user entry matches the desired routing destination, selecting the at least one expected user entry for presentation to a user during a help prompt of the NLU application as an example of a legitimate utterance the user could speak to be routed to the desired routing destination; and if it is determined that the actual routing destination does not match the desired routing destination; (i) adding the at least one expected user entry to an NLU entry data set associated with the NLU model, and (ii) training the NLU model to associate the at least one expected user entry with the desired routing destination. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. At least one non-transitory computer-readable medium encoded with instructions that, when executed by a computer system, cause the computer system to perform a method for facilitating development of a natural language understanding (NLU) model associated with an NLU application executing on a computer system comprising a combination of hardware and, the method comprising acts of:
-
receiving, from a developer of the NLU application, at least one expected user entry expected user entry and a corresponding to-a desired routing destination; determining whether the NLU model associates the at least one expected user entry with the desired routing destination, the determining comprising; interpreting the at least one expected user entry via the NLU model to determine an actual routing destination for the at least one expected user entry, and expected user entry, and comparing the actual routing destination to the desired routing destination; if it is determined that the actual routing destination does not match the desired routing destination of the at least one expected user entry matches the desired routing destination, selecting the at least one expected user entry for presentation to a user during a help prompt of the NLU application as an example of a legitimate utterance the user could speak to be routed to the desired routing destination; and if it is determined that the actual routing destination does not match the desired routing destination; (i) adding the at least one expected user entry to an NLU entry data set associated with the NLU model, and (ii) training the NLU model to associate the at least one expected user entry with the desired routing destination. - View Dependent Claims (16, 17, 18)
-
-
19. An apparatus for facilitating development of a computer-implemented natural language understanding (NLU) model associated with an NLU application, the apparatus comprising:
-
at least one computer-readable medium encoded with instructions; and at least one processing unit coupled to the at least one computer-readable medium, wherein upon execution of the instructions by the at least one processing unit, the at least one processing unit; receives, from a developer of the NLU application, at least one expected user entry and a corresponding desired routing destination; determines whether the NLU model associates the at least one expected user entry with the desired routing destination, the determining comprising; interpreting the at least one expected user entry via the NLU model to determine an actual routing destination for the at least one expected user entry, and comparing the actual routing destination to the desired routing destination; if it is determined that the actual routing destination of the at least one expected user entry matches the desired routing destination, selects the at least one expected user entry for presentation to a user during a help prompt of the NLU application as an example of a legitimate utterance the user could speak to be routed to the desired routing destination; and if it is determined that the actual routing destination does not match the desired routing destination; adds the at least one expected user entry to an NLU entry data set associated with the NLU model, and trains the NLU model to associate the at least one expected user entry with the desired routing destination. - View Dependent Claims (20, 21, 22)
-
Specification