Answer category data classifying using dynamic thresholds
First Claim
1. A system for managing confidence data in a question-answering environment, the system comprising:
- a processor; and
a computer readable storage medium having program instructions embodied therewith, the program instructions executable by the processor to cause the system to;
sort, based on a set of answer categories for a subject matter, a first set of a plurality of answers into a first answer category and a second set of the plurality of answers into a second answer category, each of the first set corresponding to at least one of a third set of a plurality of confidence scores and each of the second set corresponding to at least one of a fourth set of the plurality of confidence scores, the plurality of confidence scores representing confidence of answers to a query submitted to a question-answering system;
classify confidence scores of the third set into one of a plurality of confidence buckets using a first threshold;
determine a fifth set of a plurality of thresholds using the plurality of confidence scores; and
classify unclassified confidence scores of the third set into one of the plurality of confidence buckets using the fifth set of the plurality of thresholds.
1 Assignment
0 Petitions
Accused Products
Abstract
Managing confidence data in a question-answering environment is disclosed. Managing confidence data can include sorting, based on a set of answer categories for a subject matter, a first set of a plurality of answers into a first answer category. The first set can correspond to at least one of a third set of a plurality of confidence scores and the second set can correspond to at least one of a fourth set of the plurality of confidence scores. Managing confidence data can include classifying confidence scores of the third set into one of a plurality of confidence buckets using a first threshold and determining a fifth set of a plurality of thresholds using the plurality of confidence scores. Managing confidence data can include classifying unclassified confidence scores of the third set into one of the plurality of confidence buckets using the fifth set of the plurality of thresholds.
-
Citations
12 Claims
-
1. A system for managing confidence data in a question-answering environment, the system comprising:
-
a processor; and a computer readable storage medium having program instructions embodied therewith, the program instructions executable by the processor to cause the system to; sort, based on a set of answer categories for a subject matter, a first set of a plurality of answers into a first answer category and a second set of the plurality of answers into a second answer category, each of the first set corresponding to at least one of a third set of a plurality of confidence scores and each of the second set corresponding to at least one of a fourth set of the plurality of confidence scores, the plurality of confidence scores representing confidence of answers to a query submitted to a question-answering system; classify confidence scores of the third set into one of a plurality of confidence buckets using a first threshold; determine a fifth set of a plurality of thresholds using the plurality of confidence scores; and classify unclassified confidence scores of the third set into one of the plurality of confidence buckets using the fifth set of the plurality of thresholds. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A computer program product for managing confidence data in a question-answering environment, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to perform a method comprising:
-
sorting, based on a set of answer categories for a subject matter, a first set of a plurality of answers into a first answer category and a second set of the plurality of answers into a second answer category, each of the first set corresponding to at least one of a third set of a plurality of confidence scores and each of the second set corresponding to at least one of a fourth set of the plurality of confidence scores, the plurality of confidence scores representing confidence of answers to a query submitted to a question-answering system; classifying confidence scores of the third set into one of a plurality of confidence buckets using a first threshold; determining a fifth set of a plurality of thresholds using the plurality of confidence scores; and classifying unclassified confidence scores of the third set into one of the plurality of confidence buckets using the fifth set of the plurality of thresholds. - View Dependent Claims (10, 11, 12)
-
Specification