Processing and Cross Reference of Realtime Natural Language Dialog for Live Annotations

• US 20160171983A1
• Filed: 12/11/2014
• Published: 06/16/2016
• Est. Priority Date: 12/11/2014
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Bufe, John P., Byron, Donna K., Pikovsky, Alexander, Winkler, Timothy
• Granted Patent: US 9,484,033 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

An approach is provided to receive audible speech and convert the received speech to text while the audible speech is being delivered to a user. An annotation candidate is identified in the text and an annotation reference relating to the identified annotation candidate is retrieved and presented to the user.

Claims

1. A method implemented by an information handling system that includes a memory and a processor, the method comprising:

receiving audible speech and converting received speech to text, wherein the audible speech is being delivered to a user;

identifying an annotation candidate included in the text;

retrieving an annotation reference relating to the identified annotation candidate; and

presenting the annotation reference to the user.

2. The method of claim 1 wherein the annotation reference is presented to the user while the audible speech is still being delivered.

3. The method of claim 1 further comprising:

parsing the text into a plurality of parts;

identifying a locatable entity as one of the parts; and

filtering the locatable entity, wherein the filtering results in the annotation candidate.

4. The method of claim 3 wherein the filtering further comprises:

identifying that the locatable entity is an uncommon entity.

5. The method of claim 4 further comprising:

generating a rarity score pertaining to the uncommon entity;

generating a phrase matching score pertaining to the uncommon entity;

generating a signal strength score pertaining to a context of the uncommon entity;

combining the rarity score, the phrase matching score, and signal strength score into an overall score; and

comparing the overall score to a threshold, wherein the retrieval of the annotation reference is performed in response to the overall score exceeding the threshold.

6. The method of claim 1 further comprising:

determining whether to present the annotation reference based on a number of a plurality of annotation references previously presented to the user in a given amount of time;

presenting the annotation reference in response to the number of the plurality of annotation references not exceeding a threshold; and

refraining from presenting the annotation reference in response to the number of the plurality of annotation references exceeding the threshold.

7. The method of claim 1 further comprising:

retrieving a delivery preference pertaining to the user, wherein the delivery preference is selected from the group consisting of a link and a text;

presenting an annotation link to the annotation reference in response to the delivery preference being the link; and

presenting an descriptive text of the annotation reference in response to the delivery preference being the text.

8. An information handling system comprising:

one or more processors;

one or more data stores accessible by at least one of the processors;

a memory coupled to at least one of the processors; and

a set of computer program instructions stored in the memory and executed by at least one of the processors in order to perform actions of;

receiving audible speech and converting received speech to text, wherein the audible speech is being delivered to a user;

identifying an annotation candidate included in the text;

retrieving an annotation reference relating to the identified annotation candidate; and

presenting the annotation reference to the user.

9. The information handling system of claim 8 wherein the annotation reference is presented to the user while the audible speech is still being delivered.

10. The information handling system of claim 8 wherein the actions further comprise:

parsing the text into a plurality of parts;

identifying a locatable entity as one of the parts; and

filtering the locatable entity, wherein the filtering results in the annotation candidate.

11. The information handling system of claim 10 wherein the filtering further comprises:

identifying that the locatable entity is an uncommon entity.

12. The information handling system of claim 11 wherein the actions further comprise:

generating a rarity score pertaining to the uncommon entity;

generating a phrase matching score pertaining to the uncommon entity;

generating a signal strength score pertaining to a context of the uncommon entity;

combining the rarity score, the phrase matching score, and signal strength score into an overall score; and

comparing the overall score to a threshold, wherein the retrieval of the annotation reference is performed in response to the overall score exceeding the threshold.

13. The information handling system of claim 8 wherein the actions further comprise:

determining whether to present the annotation reference based on a number of a plurality of annotation references previously presented to the user in a given amount of time;

presenting the annotation reference in response to the number of the plurality of annotation references not exceeding a threshold; and

refraining from presenting the annotation reference in response to the number of the plurality of annotation references exceeding the threshold.

14. The information handling system of claim 8 wherein the actions further comprise:

retrieving a delivery preference pertaining to the user, wherein the delivery preference is selected from the group consisting of a link and a text;

presenting an annotation link to the annotation reference in response to the delivery preference being the link; and

presenting an descriptive text of the annotation reference in response to the delivery preference being the text.

15. A computer program product stored in a computer readable storage medium, comprising computer program code that, when executed by an information handling system, causes the information handling system to perform actions comprising:

receiving audible speech and converting received speech to text, wherein the audible speech is being delivered to a user;

identifying an annotation candidate included in the text;

retrieving an annotation reference relating to the identified annotation candidate; and

presenting the annotation reference to the user.

16. The computer program product of claim 15 wherein the annotation reference is presented to the user while the audible speech is still being delivered.

17. The computer program product of claim 15 wherein the actions further comprise:

parsing the text into a plurality of parts;

identifying a locatable entity as one of the parts; and

filtering the locatable entity, wherein the filtering results in the annotation candidate.

18. The computer program product of claim 17 wherein the filtering further comprises:

identifying that the locatable entity is an uncommon entity.

19. The computer program product of claim 18 wherein the actions further comprise:

generating a rarity score pertaining to the uncommon entity;

generating a phrase matching score pertaining to the uncommon entity;

generating a signal strength score pertaining to a context of the uncommon entity;

combining the rarity score, the phrase matching score, and signal strength score into an overall score; and

comparing the overall score to a threshold, wherein the retrieval of the annotation reference is performed in response to the overall score exceeding the threshold.

20. The computer program product of claim 15 wherein the actions further comprise:

determining whether to present the annotation reference based on a number of a plurality of annotation references previously presented to the user in a given amount of time;

presenting the annotation reference in response to the number of the plurality of annotation references not exceeding a threshold; and

refraining from presenting the annotation reference in response to the number of the plurality of annotation references exceeding the threshold.