System and method of determining a domain and/or an action related to a natural language input
First Claim
1. A computer-implemented method to confirm whether a domain determined for a natural language input using a semantic pattern matching technique is correct based on outputs of the semantic pattern matching technique and a domain determined for the natural language input and outputs using statistics-based natural language processing, the method being implemented on a computer system having one or more physical processors programmed with computer program instructions which, when executed, perform the method, the method comprising:
- receiving, at the computer system, a natural language (NL) input;
determining, by the computer system, based on the semantic pattern matching technique, a first information domain for the NL input, and a feature value set comprising information indicating a first confidence score from the semantic pattern matching technique, the first confidence score indicating a level of confidence that the first information domain for the NL input determined by the semantic pattern matching technique is correct;
determining, by the computer system, based on the statistics-based natural language processing, a second information domain for the NL input, and a second confidence score indicating a level of confidence that the second information domain for the NL input determined by the statistics-based natural language processing is correct;
providing, by the computer system, the first information domain determined by the semantic pattern matching technique, the feature value set, the second information domain determined by the statistics-based natural language processing, and the second confidence score as input to a classifier engine;
determining, by the computer system, using the classifier engine, a third confidence score different from both the first confidence score and the second confidence score, that indicates a level of confidence that the first information domain determined by the semantic pattern matching technique has been confirmed as correctly identified based on the first information domain determined by the semantic pattern matching technique, the feature value set, the second information domain determined by the statistics-based natural language processing, and the second confidence score;
comparing, by the computer system, the third confidence score with a predefined threshold confidence score that indicates the first information domain determined by the semantic pattern matching technique is confirmed as correctly identified; and
determining, by the computer system, whether the first information domain determined by the semantic pattern matching technique is confirmed based on the comparison.
7 Assignments
0 Petitions
Accused Products
Abstract
The disclosure relates to methods, systems and other embodiments directed to determining an information domain match for a natural language (NL) input (e.g., a spoken utterance), and confirming whether the NL input is correctly matched to the information domain. For example, after receiving an NL input, a first information domain to which the NL input belongs and a feature value set may be determined based on a semantic pattern matching technique. Further, a second information domain to which the NL input belongs, and a corresponding confidence score related to the second information domain may be determined. The second information domain may be determined based on a first statistical classification technique. Based on the determined feature value set and the confidence score related to the second information domain, it may be confirmed whether the NL input correctly belongs to the first information domain, e.g., based on a second statistical classification technique.
-
Citations
20 Claims
-
1. A computer-implemented method to confirm whether a domain determined for a natural language input using a semantic pattern matching technique is correct based on outputs of the semantic pattern matching technique and a domain determined for the natural language input and outputs using statistics-based natural language processing, the method being implemented on a computer system having one or more physical processors programmed with computer program instructions which, when executed, perform the method, the method comprising:
-
receiving, at the computer system, a natural language (NL) input; determining, by the computer system, based on the semantic pattern matching technique, a first information domain for the NL input, and a feature value set comprising information indicating a first confidence score from the semantic pattern matching technique, the first confidence score indicating a level of confidence that the first information domain for the NL input determined by the semantic pattern matching technique is correct; determining, by the computer system, based on the statistics-based natural language processing, a second information domain for the NL input, and a second confidence score indicating a level of confidence that the second information domain for the NL input determined by the statistics-based natural language processing is correct; providing, by the computer system, the first information domain determined by the semantic pattern matching technique, the feature value set, the second information domain determined by the statistics-based natural language processing, and the second confidence score as input to a classifier engine; determining, by the computer system, using the classifier engine, a third confidence score different from both the first confidence score and the second confidence score, that indicates a level of confidence that the first information domain determined by the semantic pattern matching technique has been confirmed as correctly identified based on the first information domain determined by the semantic pattern matching technique, the feature value set, the second information domain determined by the statistics-based natural language processing, and the second confidence score; comparing, by the computer system, the third confidence score with a predefined threshold confidence score that indicates the first information domain determined by the semantic pattern matching technique is confirmed as correctly identified; and determining, by the computer system, whether the first information domain determined by the semantic pattern matching technique is confirmed based on the comparison. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A system to confirm whether a domain determined for a natural language input using a semantic pattern matching technique is correct based on outputs of the semantic pattern matching technique and a domain determined for the natural language input and outputs using statistics-based natural language processing, the system comprising:
-
one or more physical processors programmed with computer program instructions which, when executed, cause the one or more physical processors to; receive a natural language (NL) input; determine, based on the semantic pattern matching technique, a first information domain for the NL input, and a feature value set comprising information indicating first confidence score from the semantic pattern matching technique, the first confidence score indicating a level of confidence that the first information domain for the NL input determined by the semantic pattern matching technique is correct; determine, based on the statistics-based natural language processing, a second information domain for the NL input, and a second confidence score indicating a level of confidence that the second information domain for the NL input determined by the statistics-based natural language processing is correct; provide the first information domain determined by the semantic pattern matching technique, the feature value set, the second information domain determined by the statistics-based natural language processing, and the second confidence score as input to a classifier engine; determine, using the classifier engine, a third confidence score that indicates a level of confidence that the first information domain determined by the semantic pattern matching technique has been confirmed as correctly identified based on the first information domain determined by the semantic pattern matching technique, the feature value set, the second information domain determined by the statistics-based natural language processing, and the second confidence score; compare the third confidence score with a predefined threshold confidence score that indicates the first information domain determined by the semantic pattern matching technique is confirmed as correctly identified; and determine whether the first information domain determined by the semantic pattern matching technique is confirmed based on the comparison. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20)
-
Specification