Captioning communication systems

• US 10,051,207 B1
• Filed: 12/05/2016
• Issued: 08/14/2018
• Est. Priority Date: 11/12/2015
• Status: Active Grant

• Current Assignee: Sorenson Ip Holdings, LLC
• Original Assignee: Sorenson Ip Holdings, LLC
• Inventors: Roylance, Shane, Boehme, Kenneth, Nola, Pat, Walker, III, Merle Lamar
• Primary Examiner(s): El-Zoobi, Maria
• Application Number:
  US15/369,582
• Time in Patent Office: 617 Days
• Field of Search: None
• CPC Class Codes: G09B 21/009 Teaching or communicating with deaf persons G09B21/04 takes precedence; deaf and dumb persons G09B21/00
• CPC Class Codes: H04L 61/4594 Address books, i.e. directories containing contact information about correspondents telephone directories in user terminals H04M1/27453
• CPC Class Codes: H04L 65/1069 Session establishment or de-establishment
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 67/561 Adding application-functional data or data for application control, e.g. adding metadata
• CPC Class Codes: H04M 1/2757 by data transmission, e.g. downloading
• CPC Class Codes: H04M 1/72478 for hearing-impaired users
• CPC Class Codes: H04N 5/278 Subtitling
• CPC Class Codes: H04N 7/141 between two video terminals, e.g. videophone telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q

Abstract

A method to generate a contact list may include receiving an identifier of a first communication device at a captioning system. The first communication device may be configured to provide first audio data to a second communication device. The second communication device may be configured to receive first text data of the first audio data from the captioning system. The method may further include receiving and storing contact data from each of multiple communication devices at the captioning system. The method may further include selecting the contact data from the multiple communication devices that include the identifier of the first communication device as selected contact data and generating a contact list based on the selected contact data. The method may also include sending the contact list to the first communication device to provide the contact list as contacts for presentation on an electronic display of the first communication device.

Claims

1. A method to transcribe videos in a video communication system, the method comprising:

obtaining, at a first communication device, a notification from a message server regarding a video message that includes video data and audio data and is provided to the message server from a second communication device, the video message provided to the message server from the second communication device in response to the first communication device not participating in a video communication with the second communication device;

sending, to the message server from the first communication device, a request for the video message;

in response to the request for the video message, obtaining the video message at the first communication device from the message server;

presenting, by the first communication device, the video message, the presenting including presenting the video data and the audio data;

sending, from the first communication device to a transcription system, the audio data from the video message without sending the video data from the video message to the transcription system;

in response to sending the audio data, obtaining, at the first communication device, text data from the transcription system, the text data including a transcription of the audio data and being generated by the transcription system; and

presenting, by the first communication device, the text data concurrently with the video message.

2. The method of claim 1, wherein the video message and the text data are presented by the first communication device to a hearing-impaired user of the second communication device.

3. The method of claim 1, further comprising:

storing the text data;

presenting, by the first communication device, the video message a second time; and

in response to presenting the video message the second time, presenting the stored text data by the first communication device.

4. The method of claim 3, wherein the text data is stored by the first communication device.

5. The method of claim 3, wherein the text data is stored by the message server or the transcription system.

6. The method of claim 3, wherein the text data is stored embedded in the video message.

7. The method of claim 1, wherein the text data is first text data, the method further comprising:

sending, to the message server from the first communication device, a second request for the video message;

in response to the second request, obtaining the video message at the first communication device from the message server a second time;

presenting, by the first communication device, the video message for a second time;

sending, from the first communication device to the transcription system, the audio data from the video message for a second time without sending the video data to the transcription system;

in response to sending the audio data for the second time, obtaining, at the first communication device, second text data from the transcription system; and

presenting, by the first communication device, the second text data concurrently with the presentation of the video message for the second time.

8. The method of claim 7, wherein the second text data includes an edited block of text different from a corresponding block of text in the first text data such that the second text data is different from the first text data.

9. The method of claim 1, wherein the text data is generated at the transcription system with assistance of a live call assistant.

10. The method of claim 1, wherein the transcription system includes the message server.

11. At least one non-transitory computer readable media configured to store one or more instructions that when executed by at least one computing system cause the at least one computing system to perform the method of claim 1.

12. A method to transcribe videos in a video communication system, the method comprising:

obtaining, at a first communication device, a video that includes video data and audio data, the video provided to the first communication device from a storage server, the video provided to the storage server from a second communication device;

sending, from the first communication device to a transcription system, the audio data from the video without sending the video data to the transcription system;

in response to sending the audio data, obtaining, at the first communication device, text data from the transcription system, the text data including a transcription of the audio data; and

presenting, by the first communication device, the video, including the video data and the audio data, concurrently with the text data.

13. The method of claim 12, further comprising:

storing the text data;

presenting, by the first communication device, the video a second time; and

in response to presenting the video the second time, presenting the stored text data.

14. The method of claim 13, wherein the text data is stored in the first communication device.

15. The method of claim 12, wherein the text data is first text data and the video is provided to the storage server from the second communication device in response to the first communication device not participating in a video communication with the second communication device, wherein the method further comprises:

obtaining the video at the first communication device from the storage server a second time;

sending, from the first communication device to the transcription system, the audio data from the video for a second time without sending the video data to the transcription system;

in response to sending the audio data for the second time, obtaining, at the first communication device, second text data from the transcription system; and

presenting, by the first communication device, the second text data concurrently with the presentation of the video for the second time.

16. The method of claim 15, wherein the second text data includes an edited block of text different from a corresponding block of text in the first text data such that the second text data is different from the first text data.

17. At least one non-transitory computer readable media configured to store one or more instructions that when executed by at least one computing system cause the at least one computing system to perform the method of claim 12.

18. A method to transcribe videos in a video communication system, the method comprising:

obtaining, at a message server, a video message that includes video data and audio data from a first communication device, the video message provided to the message server from the first communication device in response to a second communication device not participating in a video communication with the first communication device;

sending a notification to the second communication device from the message server regarding the video message;

obtaining a request for the video message from the second communication device;

in response to the request for the video message, sending the video message to the second communication device;

after sending the video message, obtaining, from the second communication device, the audio data from the video at a transcription system without the video data;

generating text data of the audio data, the text data including a transcription of the audio data; and

sending the text data from the transcription system to the second communication device, the second communication device configured to present the text data concurrently with the video message.

19. The method of claim 18, wherein the text data is first text data, the method further comprising:

obtaining, at the message server from the second communication device, a second request for the video message;

in response to the request for the video message, sending the video message to the second communication device for a second time;

after sending the video message, obtaining, from the second communication device, the audio data from the video at the transcription system without the video data for a second time;

generating second text data of the audio data, the second text data including a transcription of the audio data; and

sending the second text data from the transcription system to the second communication device, the second communication device configured to present the second text data concurrently with the video message.

20. At least one non-transitory computer readable media configured to store one or more instructions that when executed by at least one computing system cause the at least one computing system to perform the method of claim 18.