Human Resource Selection Based on Readability of Unstructured Text Within an Individual Case Safety Report (ICSR) and Confidence of the ICSR

• US 20190325999A1
• Filed: 04/20/2018
• Published: 10/24/2019
• Est. Priority Date: 04/20/2018
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Bao, Sheng Hua, Perera, Pathirage, Ramakrishnan, Cartic
• Granted Patent: US 10,957,431 B2
• Time in Patent Office: Days
• CPC Class Codes: G16H 10/20 for electronic clinical trials or questionnaires
• CPC Class Codes: G16H 10/60 for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: G16H 15/00 ICT specially adapted for medical reports, e.g. generation or transmission thereof
• CPC Class Codes: G16H 70/40 relating to drugs, e.g. their side effects or intended usage

Abstract

Mechanisms are provided that implement a drug-adverse event causality evaluation engine to identify human resource selections based on a readability of unstructured text within an individual case safety report (ICSR) and a confidence value of the ICSR. The drug-adverse event causality evaluation engine receives the ICSR from a cognitive system. The drug-adverse event causality evaluation engine analyzes the ICSR to determine a readability value of the ICSR. The drug-adverse event causality evaluation engine determines whether or not an assessment, by a human reviewer, of the ICSR is required based on a combination of the readability value of the ICSR and the confidence value. The drug-adverse event causality evaluation engine outputs an indication of whether human reviewer assessment is required.

Claims

1. A method, in a data processing system comprising at least one processor and at least one memory, the at least one memory comprising instructions that are executed by the at least one processor to cause the at least one processor to be configured to implement a drug-adverse event causality evaluation engine to identify human resource selections based on a readability of unstructured text within an individual case safety report (ICSR) and a confidence value of the ICSR, the method comprising:

receiving, by the drug-adverse event causality evaluation engine, the ICSR from a cognitive system;

analyzing, by the drug-adverse event causality evaluation engine, the unstructured natural language text within the ICSR to determine a readability value of the ICSR;

determining, by the drug-adverse event causality evaluation engine, whether or not an assessment, by a human reviewer, of the ICSR is required based on a combination of the readability value of the ICSR and the confidence value; and

outputting, by the drug-adverse event causality evaluation engine, an indication of whether human reviewer assessment is required.

3. The method of claim 1, wherein determining whether or not assessment, by the human reviewer, of the ICSR is required further comprises:

determining, by the drug-adverse event causality evaluation engine, a level of expertise of the human reviewer required to review the ICSR based on the measure of readability and the confidence value.

5. The method of claim 1, wherein determining whether or not assessment, by the human reviewer, of the ICSR is required further comprises:

calculating, by the drug-adverse event causality evaluation engine, a sum of a weighted measure of readability and a weighted confidence value.

6. The method of claim 1, wherein determining whether or not assessment, by the human reviewer, of the ICSR is required further comprises:

utilizing, by the drug-adverse event causality evaluation engine, a first threshold to determine whether assessment, by the human reviewer, of the ICSR is required; and

utilizing, by the drug-adverse event causality evaluation engine, one or more other thresholds to determine a level of expertise of the human reviewer required to review the ICSR in response to assessment by the human reviewer of the ICSR being required.

7. The method of claim 1, wherein the cognitive system is a pharmacovigilance cognitive medical system.

2. The method of claim I, wherein the confidence value is determined based on normalizing a probability value that indicates a level of confidence of an algorithm within the cognitive system that generated the ICSR.

4. The method of claim I, wherein determining whether or not assessment, by the human reviewer, of the ICSR is required further comprises:

determining, by the drug-adverse event causality evaluation engine, a number of human reviewers required to review the ICSR based on the measure of readability and the confidence value.

8. A computer program product comprising a computer readable storage medium having a computer readable program stored therein, wherein the computer readable program, when executed on a data processing system, causes the data processing system to implement a drug-adverse event causality evaluation engine to identify human resource selections based on a readability of unstructured text within an individual case safety report (ICSR) and a confidence value of the ICSR, and further causes the data processing system to:

receive, by the drug-adverse event causality evaluation engine, the ICSR from a cognitive system;

analyze, by the drug-adverse event causality evaluation engine, the ICSR to determine a readability value of the ICSR;

determine, by the drug-adverse event causality evaluation engine, whether or not an assessment, by a human reviewer, of the ICSR is required based on a combination of the readability value of the ICSR and the confidence value; and

output, by the drug-adverse event causality evaluation engine, an indication of whether human reviewer assessment is required.

9. The computer program product of claim 8, wherein the confidence value is determined based on normalizing a probability value that indicates a level of confidence of an algorithm within the cognitive system that generated the ICSR.

10. The computer program product of claim 8, wherein the computer readable program to determine whether or not assessment, by the human reviewer, of the ICSR is required further causes the data processing system to:

determine, by the drug-adverse event causality evaluation engine, a level of expertise of the human reviewer required to review the ICSR based on the measure of readability and the confidence value

11. The computer program product of claim 8, wherein the computer readable program to determine whether or not assessment, by the human reviewer, of the ICSR is required further causes the data processing system to:

determine, by the drug-adverse event causality evaluation engine, a number of human reviewers required to review the ICSR based on the measure of readability and the confidence value.

12. The computer program product of claim 8, wherein the computer readable program to determine whether or not assessment, by the human reviewer, of the ICSR is required further causes the data processing system to:

calculate, by the drug-adverse event causality evaluation engine, a sum of a weighted measure of readability and a weighted confidence value.

13. The computer program product of claim 8, wherein the computer readable program to determine whether or not assessment, by the human reviewer, of the ICSR is required further causes the data processing system to:

utilize, by the drug-adverse event causality evaluation engine, a first threshold to determine whether assessment, by the human reviewer, of the ICSR is required; and

utilize, by the drug-adverse event causality evaluation engine, one or more other thresholds to determine a level of expertise of the human reviewer required to review the ICSR in response to assessment by the human reviewer of the ICSR being required.

14. The computer program product of claim 8, wherein the cognitive system is a pharmacovigilance cognitive medical system.

15. A data processing system comprising:

at least one processor; and

at least one memory coupled to the at least one processor, wherein the at least one memory comprises instructions Which, when executed by the at least one processor, cause the at least one processor to implement a drug-adverse event causality evaluation engine to identify human resource selections based on a readability of unstructured text within an individual case safety report (ICSR) and a confidence value of the ICSR, and further cause the at least one processor to;

receive, by the drug-adverse event causality evaluation engine, the ICSR from a cognitive system;

analyze, by the drug-adverse event causality evaluation engine, the ICSR to determine a readability value of the ICSR;

determine, by the drug-adverse event causality evaluation engine, whether or not an assessment, by a human reviewer, of the ICSR is required based on a combination of the readability value of the ICSR and the confidence value; and

output, by the drug-adverse event causality evaluation engine, an indication of whether human reviewer assessment is required.

16. The data processing system of claim 15, wherein the confidence value is determined based on normalizing a probability value that indicates a level of confidence of an algorithm within the cognitive system that generated the ICSR.

17. The data processing system of claim 15, wherein the instructions to determine whether or not assessment, by the human reviewer, of the ICSR is required further cause the at least one processor to:

determine, by the drug-adverse event causality evaluation engine, a level of expertise of the human reviewer required to review the ICSR based on the measure of readability and the confidence value.

18. The data processing system of claim 15, wherein the instructions to determine whether or not assessment, by the human reviewer, of the ICSR is required further cause the at least one processor to:

determine, by the drug-adverse event causality evaluation engine, a number of human reviewers required to review the ICSR based on the measure of readability and the confidence value.

19. The data processing system of claim 15, wherein the instructions to determine whether or not assessment, by the human reviewer, of the ICSR is required further cause the at least one processor to:

calculate, by the drug-adverse event causality evaluation engine, a sum of a weighted measure of readability and a weighted confidence value.

20. The data processing system of claim 15, wherein the instructions to determine whether or not assessment, by the human reviewer, of the ICSR is required further cause the at least one processor to:

utilize, by the drug-adverse event causality evaluation engine, a first threshold to determine whether assessment, by the human reviewer, of the ICSR is required; and

utilize, by the drug-adverse event causality evaluation engine, one or more other thresholds to determine a level of expertise of the human reviewer required to review the ICSR in response to assessment by the human reviewer of the ICSR being required.