Explainable and automated decisions in computer-based reasoning systems
First Claim
1. A method comprising:
- receiving a request for a suggested action based on an input context, in a case-based reasoning system, wherein the case-based reasoning system includes a case-based reasoning model;
determining one or more candidate cases based on the input context in the case-based reasoning system, wherein the one or more candidate cases include respective one or more candidate actions;
determining the suggested action based on the respective one or more candidate actions;
determining a certainty score based on the suggested action, wherein the certainty score is determined based on a conviction function associated with;
removing a suggested case associated with the suggested action from the case-based reasoning model; and
adding the suggested case into the case-based reasoning model,wherein the conviction function is a measure of how much information the suggested case distorts the case-based reasoning model;
responding to the request for suggested action with the suggested action and the certainty score;
when the certainty score is beyond a certain threshold, causing control of a controllable system based on the suggested action;
when the certainty score is not beyond the certain threshold;
determining one or more explanation factors for the suggested action determined based at least in part on the input context;
providing the one or more explanation factors in response to the request for the suggested action;
wherein the method is performed by one or more computing devices.
4 Assignments
0 Petitions
Accused Products
Abstract
The techniques herein include using an input context to determine a suggested action. One or more explanations may also be determined and returned along with the suggested action. The one or more explanations may include (i) one or more most similar cases to the suggested case (e.g., the case associated with the suggested action) and, optionally, a conviction score for each nearby cases; (ii) action probabilities, (iii) excluding cases and distances, (iv) archetype and/or counterfactual cases for the suggested action; (v) feature residuals; (vi) regional model complexity; (vii) fractional dimensionality; (viii) prediction conviction; (ix) feature prediction contribution; and/or other measures such as the ones discussed herein, including certainty. In some embodiments, the explanation data may be used to determine whether to perform a suggested action.
5 Citations
18 Claims
-
1. A method comprising:
-
receiving a request for a suggested action based on an input context, in a case-based reasoning system, wherein the case-based reasoning system includes a case-based reasoning model; determining one or more candidate cases based on the input context in the case-based reasoning system, wherein the one or more candidate cases include respective one or more candidate actions; determining the suggested action based on the respective one or more candidate actions; determining a certainty score based on the suggested action, wherein the certainty score is determined based on a conviction function associated with; removing a suggested case associated with the suggested action from the case-based reasoning model; and adding the suggested case into the case-based reasoning model, wherein the conviction function is a measure of how much information the suggested case distorts the case-based reasoning model; responding to the request for suggested action with the suggested action and the certainty score; when the certainty score is beyond a certain threshold, causing control of a controllable system based on the suggested action; when the certainty score is not beyond the certain threshold; determining one or more explanation factors for the suggested action determined based at least in part on the input context; providing the one or more explanation factors in response to the request for the suggested action; wherein the method is performed by one or more computing devices. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A system for performing a machine-executed operation involving instructions, wherein said instructions are instructions which, when executed by one or more computing devices, cause performance of a process comprising:
-
receiving a request for a suggested action based on an input context, in a case-based reasoning system, wherein the case-based reasoning system includes a case-based reasoning model; determining one or more candidate cases based on the input context in the case-based reasoning system, wherein the one or more candidate cases include respective one or more candidate actions; determining the suggested action based on the respective one or more candidate actions; determining a certainty score based on the suggested action, wherein the certainty score is determined based on a conviction function associated with; removing a suggested case associated with the suggested action from the case-based reasoning model; and adding the suggested case into the case-based reasoning model, wherein the conviction function is a measure of how much information is required to describe a position of the suggested case relative to existing cases in the case-based reasoning model; responding to the request for suggested action with the suggested action and the certainty score; when the certainty score is beyond a certain threshold, causing control of a controllable system based on the suggested action; when the certainty score is not beyond the certain threshold; determining one or more explanation factors for the suggested action determined based at least in part on the input context; providing the one or more explanation factors in response to the request for the suggested action. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A method comprising:
-
receiving a request for a suggested action based on an input context, in a case-based reasoning system, wherein the case-based reasoning system includes a case-based reasoning model; determining one or more candidate cases based on the input context in the case-based reasoning system, wherein the one or more candidate cases include respective one or more candidate actions; determining the suggested action based on the respective one or more candidate actions, wherein the suggested action is associated with a suggested case, wherein the suggested case has multiple features; determining a certainty score based on the suggested action, wherein the certainty score is determined based on a conviction function associated with; determining feature prediction contributions of the multiple features of the suggested case; holding each feature of the multiple features out from the case-based reasoning model; and including each feature of the multiple features in the case-based reasoning model; wherein the conviction function is a measure of how important the multiple features of the suggested case are in making predictions in the case-based reasoning model; responding to the request for suggested action with the suggested action and the feature prediction contributions; when the feature prediction contributions for certain features of the multiple features are beyond a certain threshold, causing control of a controllable system based on the suggested action; when the feature prediction contributions for the certain features are not beyond the certain threshold; determining one or more explanation factors for the suggested action determined based at least in part on the input context; providing the one or more explanation factors in response to the request for the suggested action; wherein the method is performed by one or more computing devices. - View Dependent Claims (16, 17, 18)
-
Specification