SYSTEM AND METHOD FOR TRAINING A CLASSIFIER FOR NATURAL LANGUAGE UNDERSTANDING
First Claim
1. A method comprising:
- receiving a map which identifies categories of human transcribed utterances;
receiving a plurality of machine generated transcriptions;
processing each machine transcription in the plurality of machine transcriptions via a plurality of natural language understanding classifiers, to yield a machine map, the machine map comprising a plurality of classifications and a classification score for each machine transcription in the plurality of machine transcriptions; and
generating, via a processor, silver annotated data by combining the map and the machine map.
2 Assignments
0 Petitions
Accused Products
Abstract
Disclosed herein are systems, methods, and computer-readable storage devices for building classifiers in a semi-supervised or unsupervised way. An example system implementing the method can receive a human-generated map which identifies categories of transcriptions. Then the system can receive a set of machine transcriptions. The system can process each machine transcription in the set of machine transcriptions via a set of natural language understanding classifiers, to yield a machine map, the machine map including a set of classifications and a classification score for each machine transcription in the set of machine transcriptions. Then the system can generate silver annotated data by combining the human-generated map and the machine map. The algorithm can include different branches for when the machine transcription is available, when partial results are available, when no results are found for the machine transcription, and so forth.
-
Citations
20 Claims
-
1. A method comprising:
-
receiving a map which identifies categories of human transcribed utterances; receiving a plurality of machine generated transcriptions; processing each machine transcription in the plurality of machine transcriptions via a plurality of natural language understanding classifiers, to yield a machine map, the machine map comprising a plurality of classifications and a classification score for each machine transcription in the plurality of machine transcriptions; and generating, via a processor, silver annotated data by combining the map and the machine map. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A system comprising:
-
a processor; and a computer-readable storage medium storing instructions which, when executed by the processor, cause the processor to perform operations comprising; receiving a map which identifies categories of transcriptions; receiving a plurality of machine transcriptions; processing each machine transcription in the plurality of machine transcriptions via a plurality of natural language understanding classifiers, to yield a machine map, the machine map comprising a plurality of classifications and a classification score for each machine transcription in the plurality of machine transcriptions; and generating silver annotated data by combining the map and the machine map. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A computer-readable storage device storing instructions which, when executed by a computing device, cause the computing device to perform operations comprising:
-
receiving a map which identifies categories of transcriptions; receiving a plurality of machine transcriptions; processing each machine transcription in the plurality of machine transcriptions via a plurality of natural language understanding classifiers, to yield a machine map, the machine map comprising a plurality of classifications and a classification score for each machine transcription in the plurality of machine transcriptions; and generating silver annotated data by combining the human generated map and the machine map. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification