Confidence indicators for automated suggestions
First Claim
1. A method, comprising:
- determining a confidence indicator (CI) for at least one candidate class for an incoming message received in a response management system, each CI being a function of previous selections of the candidate class for previous messages having one or more similar features, wherein each determined CI represents a likelihood that the corresponding candidate class matches the incoming message;
identifying one or more candidate classes that match the incoming message based on class weights that are functions of each of the determined CIs;
calculating a classification accuracy measure that is a function of the class weights; and
selecting between a manual and an automatic classification mode of operation by comparing the calculated classification accuracy measure to a predetermined threshold.
2 Assignments
0 Petitions
Accused Products
Abstract
Systems, computer program products, and associated methods provide for selecting between manual and automatic operating modes based upon previous experience as quantified by confidence indicators. Confidence indicators are values that may each represent a likelihood that an associated candidate class or candidate object matches an incoming message, for example. Confidence indicator values may be updated according to previous manual selections or rejections of the associated class or object, for example. In an exemplary response management system, the selections may be for modes of operation that relate to classification of an incoming message, and/or suggestion of objects, for example.
-
Citations
20 Claims
-
1. A method, comprising:
-
determining a confidence indicator (CI) for at least one candidate class for an incoming message received in a response management system, each CI being a function of previous selections of the candidate class for previous messages having one or more similar features, wherein each determined CI represents a likelihood that the corresponding candidate class matches the incoming message;
identifying one or more candidate classes that match the incoming message based on class weights that are functions of each of the determined CIs;
calculating a classification accuracy measure that is a function of the class weights; and
selecting between a manual and an automatic classification mode of operation by comparing the calculated classification accuracy measure to a predetermined threshold. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A method, comprising:
-
determining a confidence indicator (CI) for at least one candidate object associated with a candidate class for an incoming message received in a response management system, each CI being a function of previous selections of the object for previous messages having the same class as the corresponding candidate class, wherein each determined CI represents a likelihood that a corresponding object matches the incoming message;
identifying one or more candidate objects that match the incoming message based on object weights that are functions of each of the determined CIs;
calculating a suggestion accuracy measure that is a function of the object weights; and
selecting between a manual and an automatic suggestion mode of operation by comparing the calculated suggestion accuracy measure to a predetermined threshold. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A computer program product tangibly embodied in an information carrier and containing instructions that, when executed on a processor, cause the processor to perform operations, the operations comprising:
-
determining a class confidence indicator (CCI) for at least one candidate class for an incoming message received in a response management system, each CCI being a function of previous selections of the candidate class for previous messages having one or more similar features, wherein each determined CCI represents a likelihood that a corresponding candidate class matches the incoming message;
identifying one or more candidate classes that match the incoming message based on class weights that are functions of each of the determined CCIs;
calculating a classification accuracy measure that is a function of the class weights; and
selecting between a manual and an automatic classification mode of operation by comparing the calculated classification accuracy measure to a predetermined threshold. - View Dependent Claims (20)
-
Specification