Method and apparatus for automatically identifying and annotating auditory signals from one or more parties

• US 10,244,368 B2
• Filed: 03/21/2018
• Issued: 03/26/2019
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Eolas Technologies, Inc.
• Original Assignee: Eolas Technologies, Inc.
• Inventors: Martin, David C., Doyle, Michael D.
• Primary Examiner(s): Perez, Julio R
• Application Number:
  US15/927,198
• Publication Number:
  US 20180213373A1
• Time in Patent Office: 370 Days
• Field of Search: 704251, 455413, 4554121, 4554122
• CPC Class Codes: H04M 2250/68 with means for recording information, e.g. telephone number during a conversation recording of telephone conversations H04M1/656
• CPC Class Codes: H04W 4/18 Information format or content conversion, e.g. adaptation by the network of the transmitted or received information for the purpose of wireless delivery to users or terminals

Abstract

In one embodiment, a mobile device application automatically identifies and annotates auditory signals from one or more parties.

Claims

1. A telecommunication system comprising:

one or more processors; and

a computer readable memory storing program code which, when executed by the one or more processors, causes the one or more processors to at least;

after a communication is established by a first electronic communication device and a second electronic communication device, receive, at the telecommunication system, from the first electronic communication device, digital auditory data corresponding to an ongoing conversation between a first person using the first electronic communication device and a second person using the second electronic communication device, the conversation including a plurality of words spoken by the first person and the second person during the ongoing conversation;

while the conversation is ongoing between the first person using the first electronic communication device and the second person using the second electronic communication device, responsive to one or more user requests associated with a displayed message bubble of converted text based on the digital auditory data, process the converted text of the displayed message bubble to identify a fact included in the converted text, wherein the displayed message bubble of converted text is displayed by the first electronic communication device, wherein the one or more user requests are received via the first electronic communication device, and wherein the first electronic communication device is configured to display the displayed message bubble of converted text after a pause duration satisfies a time threshold, the pause duration configured to be detected while the conversation is ongoing between the first person using the first electronic communication device and the second person using the second electronic communication device;

facilitate searching online reference material for information related to the identified fact;

and facilitate displaying of the information related to the identified fact by at least one of the first electronic communication device and the second electronic communication device.

2. The telecommunication system of claim 1, wherein the searching is to check accuracy of the identified fact.

3. The telecommunication system of claim 1, wherein the time threshold is an adjustable amount.

4. The telecommunication system of claim 1, wherein the displayed message bubble of converted text is one of a plurality of displayed message bubbles of converted text based on the digital auditory data, and wherein each one of the plurality of displayed message bubbles is a user-selectable message bubble displayed by the first electronic communication device.

5. The telecommunication system of claim 4, wherein the first electronic device is configured to display a user-selectable option menu based on a user-selection of the displayed message bubble of converted text.

6. The telecommunication system of claim 5, wherein the program code, when executed, causes the one or more processors to process the converted text of the displayed message bubble to identify the fact included in the converted text in response to a user selection of a fact-checking option included in the user-selected option menu.

7. The telecommunication system of claim 1, wherein the program code, when executed, causes the one or more processors to facilitate the displaying of the information related to the identified fact while the conversation is ongoing between the first person using the first electronic communication device and the second person using the second electronic communication device.

8. A telecommunication system comprising:

one or more processors; and

a computer readable memory storing program code which, when executed by the one or more processors, causes the one or more processors to at least;

after a communication is established by a first electronic communication device and a second electronic communication device, receive, at the telecommunication system, from the second electronic communication device, digital auditory data corresponding to an ongoing conversation between a first person using the first electronic communication device and a second person using the second electronic communication device, the conversation including a plurality of words spoken by the first person and the second person during the ongoing conversation;

while the conversation is ongoing between the first person using the first electronic communication device and the second person using the second electronic communication device, responsive to one or more user requests associated with a displayed message bubble of converted text based on the digital auditory data, process the converted text of the displayed message bubble to identify a fact included in the converted text, wherein the displayed message bubble of converted text is displayed by the first electronic communication device, wherein the one or more user requests are received via the first electronic communication device, and wherein the first electronic communication device is configured to display the displayed message bubble of converted text after a pause duration satisfies a time threshold, the pause duration configured to be detected while the conversation is ongoing between the first person using the first electronic communication device and the second person using the second electronic communication device;

facilitate searching online reference material for information related to the identified fact;

and facilitate displaying of the information related to the identified fact by at least one of the first electronic communication device and the second electronic communication device.

9. The telecommunication system of claim 8, wherein the searching is to check accuracy of the identified fact.

10. The telecommunication system of claim 8, wherein the time threshold is an adjustable amount.

11. The telecommunication system of claim 8, wherein the displayed message bubble of converted text is one of a plurality of displayed message bubbles of converted text based on the digital auditory data, and wherein each one of the plurality of displayed message bubbles is a user-selectable message bubble displayed by the first electronic communication device.

12. The telecommunication system of claim 11, wherein the first electronic device is configured to display a user-selectable option menu based on a user-selection of the displayed message bubble of converted text.

13. The telecommunication system of claim 12, wherein the program code, when executed, causes the one or more processors to process the converted text of the displayed message bubble to identify the fact included in the converted text in response to a user selection of a fact-checking option included in the user-selected option menu.

14. The telecommunication system of claim 8, wherein the program code, when executed, causes the one or more processors to facilitate the displaying of the information related to the identified fact while the conversation is ongoing between the first person using the first electronic communication device and the second person using the second electronic communication device.