Text caption error correction

• US 10,186,170 B1
• Filed: 04/11/2016
• Issued: 01/22/2019
• Est. Priority Date: 11/24/2009
• Status: Active Grant

• Current Assignee: Sorenson Ip Holdings, LLC
• Original Assignee: Sorenson Ip Holdings, LLC
• Inventors: Romriell, Joseph N., Brooksby, Scot, Roylance, Shane Arthur, Chevrier, Brian, Puzey, Robert Cochran
• Primary Examiner(s): Gauthier, Gerald
• Application Number:
  US15/096,087
• Time in Patent Office: 1,016 Days
• Field of Search: 379 52, 379 8813, 37920101, 379 8814, 379 9315, 37926502, 434362, 434156, 434112, 600301, 700 94, 704 3, 704365, 704235, 704240, 704251, 705 2, 705764, 709206, 717120, 717124, 725135, 715764, 715769
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting
• CPC Class Codes: G06F 40/232 Orthographic correction, e.g. spell checking or vowelisation
• CPC Class Codes: G06F 40/279 Recognition of textual entities
• CPC Class Codes: G09B 21/009 Teaching or communicating with deaf persons G09B21/04 takes precedence; deaf and dumb persons G09B21/00
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04L 12/66 Arrangements for connecting between networks having differing types of switching systems, e.g. gateways

Abstract

Systems and methods related to providing error correction in a text caption are disclosed. A method may comprise displaying a text caption including one or more blocks of text on each of a first device and a second device remote from the first device. The method may also include generating another block of text and replacing a block of text of the text caption with the other block of text. Furthermore, the method may include displaying the text caption on the second device having the block of text of the first text caption replaced by the other block of text.

Claims

1. A computer-implement method to provide error correction in a caption-based communication system, the method comprising:

receiving, at a communication system associated with a captioning service, a voice signal originating from a first communication device for broadcasting at a second communication device during a real-time communication session between the first communication device and the second communication device, the second communication device being associated with a hearing-impaired user;

generating, at the communication system, a text transcription of the voice signal during the real-time communication session using a speech recognition program;

providing, from the communication system to the second communication device, a block of text of the text transcription for presentation on an electronic display of the second communication device;

after providing the block of text to the second communication device, receiving, at the communication system, a correction corresponding to an error in the block of text;

generating, at the communication system, a replacement block of text responsive to receiving the correction, the replacement block of text including the block of text with the correction to the error in the block of text; and

providing the replacement block of text, from the communication system to the second communication device, as an inline correction for the error in the block of text with instructions for the second communication device to present the replacement block of text at a location of a presentation of the block of text in the electronic display of the second communication device, the replacement block of text provided only when the block of text is presented on the electronic display of the second communication device.

2. The method of claim 1, wherein the replacement block of text is provided only when the block of text is presented on the electronic display of the second communication device when a real-time conversation is occurring between a user of the first communication device and a user of the second communication device.

3. The method of claim 1, wherein the instructions for the second communication device include the second communication device presenting a visual indication on the electronic display that the replacement block of text has replaced the block of text as presented on the electronic display.

4. The method of claim 3, wherein the visual indication includes a tag on the replacement block of text.

5. The method of claim 4, wherein the tag on the replacement block of text includes highlighting of text corrected in the replacement block of text.

6. The method of claim 1, wherein the correction includes one or more of:

replacing text, inserting text, and deleting text.

7. The method of claim 1, wherein the block of text is a first block of text, wherein the text transcription including a plurality of blocks of text that includes the first block of text, each of the plurality of blocks of text including a plurality of words, wherein the first block of text of the plurality of blocks of text being distinguished from a second block of text of the plurality of blocks of text by words in the first block of text being offset from words in the second block of text, the offset between the first block of text and the second block of text being different than spaces between the words in the first block of text and the words in the second block of text when the first and second blocks of text are presented on an electronic display of the second communication device.

8. The method of claim 7, further comprising after providing the first block of text, providing, from the communication system to the second communication device, a second block of text of the plurality of blocks of text for presentation on an electronic display of the second communication device,

wherein receiving the correction occurs after providing the second block of text such that the replacement block of text is provided while the second block of text is presented in the electronic display of the second communication device.

9. A computer-implement method to provide error correction in a caption-based communication system, the method comprising:

receiving, at a communication system associated with a captioning service, a voice signal originating from a first communication device for broadcasting at a second communication device during a real-time communication session between the first communication device and the second communication device, the second communication device being associated with a hearing-impaired user;

generating, at the communication system, a text transcription of the voice signal during the real-time communication session using a speech recognition program, the text transcription including a plurality of blocks of text that each include a plurality of words, a first block of text of the plurality of blocks of text being distinguished from a second block of text of the plurality of blocks of text by words in the first block of text being offset from words in the second block of text, the offset between the first block of text and the second block of text being different than spaces between the words in the first block of text and the words in the second block of text when the first and second blocks of text are presented on an electronic display of the second communication device;

providing, from the communication system to the second communication device, the first block of text of the plurality of blocks of text for presentation on an electronic display of the second communication device;

after providing the first block of text, providing, from the communication system to the second communication device, the second block of text of the plurality of blocks of text for presentation on an electronic display of the second communication device;

after providing the second block of text to the second communication device, receiving, at the communication system, a correction corresponding to an error in the first block of text;

generating, at the communication system, a replacement block of text responsive to receiving the correction, the replacement block of text including the first block of text with the correction to the error in the first block of text; and

providing the replacement block of text, from the communication system to the second communication device, as an inline correction for the error in the first block of text with instructions for the second communication device to present the replacement block of text at a present location of a presentation of the first block of text in the electronic display of the second communication device while the second block of text is presented in the electronic display of the second communication device.

10. The method of claim 9, wherein the instructions for the second communication device include the second communication device presenting a visual indication on the electronic display that the replacement block of text has replaced the block of text as presented on the electronic display.

11. The method of claim 10, wherein the visual indication includes a tag on the replacement block of text.

12. The method of claim 11, wherein the tag on the replacement block of text includes highlighting of text corrected in the replacement block of text.

13. The method of claim 9, wherein the correction includes one or more of:

replacing text, inserting text, and deleting text.

14. The method of claim 9, wherein the replacement block of text is provided to the second communication device only when the first block of text is presented on the electronic display of the second communication device.

15. The method of claim 14, wherein the instructions for the second communication device include the second communication device presenting a visual indication on the electronic display that the replacement block of text has replaced the block of text as presented on the electronic display.

16. One or more non-transitory computer-readable media that include instructions that then performed by one or more computing systems perform operations, the operations comprising:

receiving, at a communication system associated with a captioning service, a voice signal originating from a first communication device for broadcasting at a second communication device during a real-time communication session between the first communication device and the second communication device, the second communication device being associated with a hearing-impaired user;

generating, at the communication system, a text transcription of the voice signal during the real-time communication session using a speech recognition program;

providing, from the communication system to the second communication device, a block of text of the text transcription for presentation on an electronic display of the second communication device;

after providing the block of text to the second communication device, receiving, at the communication system, a correction corresponding to an error in the block of text;

generating, at the communication system, a replacement block of text responsive to receiving the correction, the replacement block of text including the block of text with the correction to the error in the block of text; and

providing the replacement block of text, from the communication system to the second communication device, as an inline correction for the error in the block of text with instructions for the second communication device to present the replacement block of text at a location of a presentation of the block of text in the electronic display of the second communication device, the replacement block of text provided only when the block of text is presented on the electronic display of the second communication device.

17. The non-transitory computer-readable media of claim 16, wherein the replacement block of text is provided only when the block of text is presented on the electronic display of the second communication device when a real-time conversation is occurring between a user of the first communication device and a user of the second communication device.

18. The non-transitory computer-readable media of claim 16, wherein the instructions for the second communication device include the second communication device presenting a visual indication on the electronic display that the replacement block of text has replaced the block of text as presented on the electronic display.

19. The non-transitory computer-readable media of claim 18, wherein the visual indication includes a tag on the replacement block of text.

20. The non-transitory computer-readable media of claim 19, wherein the tag on the replacement block of text includes highlighting of text corrected in the replacement block of text.