Methods and systems for selective modification to one of a plurality of components in an engine

• US 10,325,296 B2
• Filed: 12/12/2017
• Issued: 06/18/2019
• Est. Priority Date: 09/23/2010
• Status: Active Grant

• Current Assignee: Solventum Intellectual Properties Company (Solventum Corp.)
• Original Assignee: MModal IP LLC (3M Company)
• Inventors: Koll, Detlef, Polzin, Thomas
• Primary Examiner(s): Shaawat, Mussa A
• Application Number:
  US15/839,037
• Publication Number:
  US 20180101879A1
• Time in Patent Office: 553 Days
• CPC Class Codes: G06Q 30/04 Billing or invoicing

Abstract

A method for selective modification to one of a plurality of components includes receiving, by an engine, a draft transcript including at least one concept content. The method includes accessing, by a first component in a plurality of components executed by the engine, a mapping between content data and codes to identify a code mapped to the at least one concept content. The method includes modifying the draft transcript to include the identified code. The method includes receiving input representing a status of the identified code. The method includes accessing a data structure storing an indication that the first component identified the code. The method includes modifying a reliability score for the first component. The method includes determining that the first component has a reliability score that fails to satisfy a predetermined threshold. The method includes modifying execution of the first component, based on the determination.

Claims

1. A method for selective modification to one of a plurality of components in an engine, the method comprising:

receiving, by an engine executing on a computing device, a draft transcript including at least one concept content;

accessing, by a first component in a plurality of components executed by the engine, a mapping between content data and codes to identify a code mapped to the at least one concept content;

modifying, by the first component, the draft transcript to include the identified code;

storing, by the first component, in a data structure stored by the computing device, an indication that (i) the concept content satisfied a condition of a rule accessed by the first component and (ii) the first component generated the identified code;

receiving, by the computing device, input representing a status of the identified code;

modifying, by a code feedback module executed by the computing device, the draft transcript based on the received input;

accessing, by a code feedback module executed by the engine, the data structure storing the indication that the first component identified the code;

modifying, by the code feedback module, a reliability score for the first component, based on the received input, the reliability score representing an estimate of a degree to which the first component generates accurate output;

determining, by the code feedback module, that the first component has a reliability score that fails to satisfy a predetermined threshold;

modifying, by the engine, the first component to indicate that execution of the component for subsequent generation of at least one code requires additional review before inclusion of the at least one code in a second draft transcript, based on the determination;

receiving, by the engine, a second draft transcript including at least a second concept content;

accessing, by the first component in the plurality of components executed by the engine, the mapping between content data and codes to identify a second code mapped to the at least a second concept content;

requesting review of the identified second code; and

modifying, by the first component, the second draft transcript to include the identified code upon receiving approval of the generated second code.

2. The method of claim 1, wherein accessing the data structure storing the indication that the first component identified the code further comprises identifying a first sub-component and a second sub-component of the first component, the first sub-component determining whether the at least one concept satisfies a first condition associated with the first sub-component and the second sub-component determining whether the at least one concept satisfies a second condition associated with the second sub-component.

3. The method of claim 2, wherein modifying the reliability score further comprises:

determining that both the first sub-component and the second sub-component determined that the at least one concept satisfied the associated condition;

determining that the received input indicated that the identified code was incorrectly associated with the at least one concept;

decreasing a first reliability score associated with the first sub-component; and

decreasing a second reliability score associated with the second sub-component.

4. The method of claim 2, wherein modifying the reliability score further comprises:

determining that the first sub-component determined that the at least one concept satisfied the associated condition;

determining that the second sub-component determined that the at least one concept failed to satisfy the associated condition;

determining that the received input indicated that the identified code was incorrectly associated with the at least one concept;

decreasing a first reliability score associated with the first sub-component; and

increasing a second reliability score associated with the second sub-component.

5. The method of claim 1, further comprising:

accessing, by a second component in the plurality of components executed by the engine, the mapping between content data and codes to identify a second code mapped to a second concept content;

modifying, by the second component, the draft transcript to include the identified second code;

storing, by the second component, in a second data structure stored by the computing device, an indication that (i) the second concept content satisfied a condition of a second rule accessed by the second component and (ii) the second component generated the identified code;

receiving, by the computing device, input representing a status of the identified second code;

accessing, by the code feedback module, the second data structure storing the indication that the second component identified the second code; and

increasing, by the code feedback module, a reliability score for the second component, based on the received input.

6. The method of claim 1, wherein accessing the data structure storing the indication that the first component identified the code further comprises:

identifying the first component that generated the first code;

identifying, based on the received input, a concept relied upon by the first component to generate the first billing code;

identifying a first concept extraction component that identified the at least one concept content, based upon the concept relied upon by the first logic component;

modifying a reliability score for the first concept extraction component;

determining that the first concept extraction component has a reliability score that fails to satisfy a predetermined threshold; and

modifying the first component to indicate that execution of the first concept extraction component for subsequent generation of a second concept content requires additional review before inclusion of the second concept content in the draft transcript, based on the determination.

7. The method of claim 1, wherein modifying the draft transcript further comprises modifying the identified code.

8. A non-transitory computer-readable medium comprising computer-readable instructions tangibly stored on the computer-readable medium, wherein the instructions are executable by at least one computer processor to perform a method for selective modification to one of a plurality of components in an engine executing on a computing device, the method comprising:

receiving, by an engine executing on a computing device, a draft transcript including at least one concept content;

accessing, by a first component in a plurality of components executed by the engine, a mapping between content data and codes to identify a code mapped to the at least one concept content;

modifying, by the first component, the draft transcript to include the identified code;

storing, by the first component, in a data structure stored by the computing device, an indication that (i) the concept content satisfied a condition of a rule accessed by the first component and (ii) the first component generated the identified code;

receiving, by the computing device, input representing a status of the identified code;

modifying, by a code feedback module executed by the computing device, the draft transcript based on the received input;

accessing, by a code feedback module executed by the engine, the data structure storing the indication that the first component identified the code;

modifying, by the code feedback module, a reliability score for the first component, based on the received input, the reliability score representing an estimate of a degree to which the first component generates accurate output;

determining, by the code feedback module, that the first component has a reliability score that fails to satisfy a predetermined threshold;

modifying, by the engine, the first component to indicate that execution of the component for subsequent generation of at least one code requires additional review before inclusion of the at least one code in a second draft transcript, based on the determination;

receiving, by the engine, a second draft transcript including at least a second concept content;

accessing, by the first component in the plurality of components executed by the engine, the mapping between content data and codes to identify a second code mapped to the at least a second concept content;

requesting review of the identified second code; and

modifying, by the first component, the second draft transcript to include the identified code upon receiving approval of the generated second code.

9. The non-transitory computer-readable medium of claim 8, wherein instructions, for accessing the data structure storing the indication that the first component identified the code further comprise instructions for identifying a first sub-component and a second sub-component of the first component, the first sub-component determining whether the at least one concept satisfies a first condition associated with the first sub-component and the second sub-component determining whether the at least one concept satisfies a second condition associated with the second sub-component.

10. The non-transitory computer-readable medium of claim 9, wherein instructions for modifying the reliability score further comprise instructions for:

determining that both the first sub-component and the second sub-component determined that the at least one concept satisfied the associated condition;

determining that the received input indicated that the identified code was incorrectly associated with the at least one concept;

decreasing a first reliability score associated with the first sub-component; and

decreasing a second reliability score associated with the second sub-component.

11. The non-transitory computer-readable medium of claim 9, wherein instructions for modifying the reliability score further comprise instructions for:

determining that the first sub-component determined that the at least one concept satisfied the associated condition;

determining that the second sub-component determined that the at least one concept failed to satisfy the associated condition;

determining that the received input indicated that the identified code was incorrectly associated with the at least one concept;

decreasing a first reliability score associated with the first sub-component; and

increasing a second reliability score associated with the second sub-component.

12. The non-transitory computer-readable medium of claim 8, further comprising instructions for:

accessing, by a second component in the plurality of components executed by the engine, the mapping between content data and codes to identify a second code mapped to a second concept content;

modifying, by the second component, the draft transcript to include the identified second code;

storing, by the second component, in a second data structure stored by the computing device, an indication that (i) the second concept content satisfied a condition of a second rule accessed by the second component and (ii) the second component generated the identified code;

receiving, by the computing device, input representing a status of the identified second code;

accessing, by the code feedback module, the second data structure storing the indication that the second component identified the second code; and

increasing, by the code feedback module, a reliability score for the second component, based on the received input.

13. The non-transitory computer-readable medium of claim 8, wherein instructions for accessing the data structure storing the indication that the first component identified the code further comprise instructions for:

identifying the first component that generated the first code;

identifying, based on the received input, a concept relied upon by the first component to generate the first billing code;

identifying a first concept extraction component that identified the at least one concept content, based upon the concept relied upon by the first logic component;

modifying a reliability score for the first concept extraction component;

determining that the first concept extraction component has a reliability score that fails to satisfy a predetermined threshold; and

modifying the first component to indicate that execution of the first concept extraction component for subsequent generation of a second concept content requires additional review before inclusion of the second concept content in the draft transcript, based on the determination.

14. The non-transitory computer-readable medium of claim 8, wherein the instructions for modifying the draft transcript further comprise instructions for modifying the identified code.