Automatic connection to a transcription system

• US 10,230,842 B2
• Filed: 10/09/2017
• Issued: 03/12/2019
• Est. Priority Date: 03/25/2015
• Status: Active Grant

• Current Assignee: Sorenson Ip Holdings, LLC
• Original Assignee: Sorenson Ip Holdings, LLC
• Inventors: Chevrier, Brian, Stimpson, Michael S.
• Primary Examiner(s): El-Zoobi, Maria
• Application Number:
  US15/728,384
• Publication Number:
  US 20180034960A1
• Time in Patent Office: 519 Days
• Field of Search: 379 37- 52
• CPC Class Codes: H04M 1/2475 for a hearing impaired user
• CPC Class Codes: H04M 1/72478 for hearing-impaired users
• CPC Class Codes: H04M 11/10 with dictation recording and playback systems
• CPC Class Codes: H04M 2201/40 using speech recognition
• CPC Class Codes: H04M 3/42391 where the subscribers are hearing-impaired persons, e.g. telephone devices for the deaf
• CPC Class Codes: H04M 7/0042 where the data service is a text-based messaging service H04M7/0054 takes precedence

Abstract

Apparatuses and methods are disclosed for automatically connecting to a relay service and establish a captioning communication session during a call between a hearing-impaired user and a far-end user. The apparatus includes communication elements configured to receive captions from a relay service, and a processor configured to automatically connect to the relay service and establish a captioning communication session during a call responsive to a determination that a connection to the relay service failed during a time in which the hearing-impaired user desired captions to be enabled. A method includes determining captions are desired by the hearing-impaired user at a first time to be enabled for display to the communication device during a call, detecting a failed connection to the relay service at a second time, and automatically connecting with the relay service and establishing a new captioning communication session at a third time during the call.

Claims

1. A communication device comprising:

one or more non-transitory media configured to store instructions; and

a processor coupled to the one or more non-transitory media, the processor configured to execute instruction to cause the communication device to perform operations, the operations comprising;

establish a communication session with a remote device to communicate audio data there between during the communication session;

detect that captioning is enabled for the communication session based on a first user indication obtained by the communication device;

in response to the captioning being enabled, establish a captioning communication session between the communication device and a remote caption service;

receive text data from the remote caption service during the communication session based on the audio data communicated during the communication session;

detect an error in transmission of the audio data to the remote caption service during the captioning communication session, the error in transmission not in response to obtaining, at the communication device, a second user indication to disable captioning; and

while maintaining the communication session with the remote device and in response to determining the captioning communication session has been terminated, automatically establishing a second captioning communication session with the remote caption service.

2. The communication device of claim 1, wherein the first user indication with the communication device occurs during the communication session.

3. The communication device of claim 1, wherein the communication session is a video communication session.

4. The communication device of claim 1, wherein detecting the error in transmission of the audio data to the remote caption service is based on detecting the error after sending a ping message to the remote caption service.

5. The communication device of claim 1, wherein detecting the error in transmission of the audio data to the remote caption service is based on receiving a termination message from the remote caption service indicating that a call assistant at the remote caption service terminated the captioning communication session.

18. The communication device of claim 1, wherein the operations further comprise:

receive second text data from the remote caption service during the second captioning communication session and the communication session based on the audio data communicated during the second captioning communication session and the communication session;

determine a termination of the communication session based on an indication from one or more of the remote device and the communication device;

after the termination of the communication session and before termination of the second captioning communication session, continue to obtain the second text data based on the audio data; and

in response to the termination of the communication session, terminate the second captioning communication session.

6. A method to provide captions, the method comprising:

establishing a communication session with a remote device to communicate audio data between the remote device and a communication device during the communication session;

detecting that captioning is enabled for the communication session based on a first user indication obtained by the communication device;

in response to the captioning being enabled, establishing a captioning communication session between the communication device and a remote caption service;

receiving text data from the remote caption service during the communication session based on the audio data communicated during the communication session;

detecting an error in transmission of the audio data to the remote caption service during the captioning communication session, the error in transmission not in response to obtaining, at the communication device, a second user indication to disable captioning; and

while maintaining the communication session with the remote device and in response to determining the captioning communication session has been terminated, automatically establishing a second captioning communication session with the remote caption service.

7. The method of claim 6, wherein the first user indication with the communication device occurs during the communication session.

8. The method of claim 6, wherein the communication session is a video communication session.

9. The method of claim 6, wherein detecting the error in transmission of the audio data to the remote caption service is based on detecting the error after sending a ping message to the remote caption service.

10. The method of claim 6, wherein detecting the error in transmission of the audio data to the remote caption service is based on receiving a termination message from the remote caption service indicating that a call assistant at the remote caption service terminated the captioning communication session.

11. One or more non-transitory computer readable media that includes instructions, which in response to being executed by one or more processors, cause a system to perform operations, the operations comprising the method of claim 6.

19. The method of claim 6, further comprising:

receiving second text data from the remote caption service during the second captioning communication session and the communication session based on the audio data communicated during the second captioning communication session and the communication session;

determining a termination of the communication session based on an indication from one or more of the remote device and the communication device;

after the termination of the communication session and before termination of the second captioning communication session, continuing to obtain the second text data based on the audio data; and

in response to the termination of the communication session, terminating the second captioning communication session.

12. A method to provide captions, the method comprising:

obtaining an initiation request to establish a communication session between a first device and a second device to direct first audio data from the first device to the second device and to direct second audio data from the second device to the first device;

establishing a first captioning communication session with a remote caption service;

during the first captioning communication session and the communication session, directing the second audio data to the remote caption service;

during the first captioning communication session and the communication session, obtaining, at the first device, first text data from the remote caption service, the first text data including a transcription of the second audio data;

determining, during the communication session and without termination of the communication session, that the first captioning communication session has been terminated, wherein the termination is not based on a request from the first device;

in response to the communication session continuing and the determination of the termination of the first captioning communication session that is not based on the request from the first device, automatically establishing a second captioning communication session with the remote caption service;

during the second captioning communication session and the communication session, directing the second audio data to the remote caption service;

during the second captioning communication session and the communication session, obtaining, at the first device, second text data from the remote caption service, the second text data including a transcription of the second audio data;

determining a termination of the communication session based on an indication from one or more of the first device and the second device;

in response to the termination of the communication session, terminating the second captioning communication session; and

after termination of the communication session and before termination of the second captioning communication session, continuing to obtain the second text data based on the second audio data.

13. The method of claim 12, wherein the communication session is a video communication session.

14. The method of claim 12, further comprising establishing the communication session between the first device and the second device.

15. The method of claim 12, wherein establishing the first captioning communication session with the remote caption service is in response to establishing the communication session or obtaining the initiation request.

16. The method of claim 12, further comprising detecting that captioning is enabled for the communication session based on a first user indication obtained by the first device.

17. One or more non-transitory computer readable media that includes instructions, that in response to being executed by one or more processors, cause a system to perform operations, the operations comprising the method of claim 12.