Methods for using a caption device with a mobile device

• US 9,622,052 B1
• Filed: 11/11/2015
• Issued: 04/11/2017
• Est. Priority Date: 10/02/2013
• Status: Active Grant

• Current Assignee: Sorenson Ip Holdings, LLC
• Original Assignee: Sorenson Ip Holdings, LLC
• Inventors: Pan, Jasper Cheekeong
• Primary Examiner(s): Doan, Kiet
• Application Number:
  US14/938,797
• Time in Patent Office: 517 Days
• Field of Search: 455466, 4554141, 455566, 4554122, 455418, 1 1, 379 52, 370355, 370466
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: H04M 1/72478 for hearing-impaired users
• CPC Class Codes: H04M 2201/40 using speech recognition speech recognition per se G10L15/00
• CPC Class Codes: H04M 3/42391 where the subscribers are hearing-impaired persons, e.g. telephone devices for the deaf
• CPC Class Codes: H04M 3/4936 Speech interaction details speech recognition per se G10L15/00
• CPC Class Codes: H04W 4/12 Messaging; Mailboxes; Announcements

Abstract

A communication system including a caption device and a mobile device configured to engage in communication with each other. The caption device is configured to receive a text signal originating at a relay service, the text signal corresponding to a far-end voice signal originating at a far-end device. The caption device is configured to display text corresponding to the text signal on a display. The relay service is configured to receive the far-end voice signal, and transmit the text signal to the caption device. The mobile device is configured to receive the far-end voice signal, and transmit the far-end voice signal to the relay service. A method of facilitating a captioned conversation between a far-end user and a near-end user having a caption device includes establishing communication between a caption device and a mobile device, and between the caption device and a relay service.

Claims

1. A method of facilitating a captioned communication session between a far-end user and a near-end user having a caption device, the method comprising:

establishing local communication between a caption device and a mobile device in a sync mode, the caption device and the mobile device having different identification numbers for receiving incoming calls;

receiving an incoming call from a far-end device to the mobile device;

automatically routing the incoming call from the mobile device to the near-end communication device;

answering the incoming call at the near-end communication device;

transmitting a far-end voice signal received from the far-end communication device to a remote captioning service;

receiving a text signal from the remote captioning service at the caption device, the text signal comprising a text transcript corresponding to the far-end voice signal; and

displaying the text captions on an electronic display of the caption device.

2. The method of claim 1, wherein receiving the text signal from the remote captioning service includes receiving the text signal at the caption device directly from the relay service.

3. The method of claim 1, wherein receiving the text signal from the remote captioning service includes receiving the text signal from the remote captioning service through the mobile device.

4. The method of claim 1, wherein transmitting the far-end voice signal to the remote captioning service includes routing the far-end voice signal from the far-end device to the relay service through the caption device.

5. The method of claim 1, wherein transmitting the far-end voice signal to the remote captioning service includes routing the far-end voice signal from the far-end device to the remote captioning service through the mobile device.

6. The method of claim 1, wherein establishing local communication between the caption device and the mobile device in the sync mode is responsive to a user input at the mobile device.

7. The method of claim 1, wherein establishing local communication between the caption device and the mobile device in the sync mode is responsive to a user input at the caption device.

8. The method of claim 1, wherein establishing local communication between the caption device and the mobile device in the sync mode is responsive to at least one of the mobile device or the caption device automatically detecting the other device'"'"'s presence without user input.

9. The method of claim 1, further comprising:

enabling a first microphone and a first speaker of the caption device during the sync mode; and

disabling a second microphone and a second speaker of the mobile device during the sync mode.

10. The method of claim 1, further comprising:

enabling a first microphone and a first speaker of the mobile device during the sync mode; and

disabling a second microphone and a second speaker of the caption device during the sync mode.

11. The method of claim 1, further comprising disabling communication between the caption device and the mobile device responsive to exiting the sync mode while maintaining the communication session between the far-end communication device and the mobile device as a voice only call without text captions.

12. The method of claim 11, further comprising re-establishing communication between the caption device and the mobile device responsive to the sync mode being re-selected.

13. The method of claim 11, further comprising:

establishing communication between the mobile device and a different caption device responsive to the sync-mode being re-selected;

receiving the text signal from the remote captioning service at the different caption device; and

displaying the text captions on an electronic display of the different caption device.

14. The method of claim 1, wherein establishing local communication between the caption device and the mobile device in the sync mode includes a wireless connection therebetween.

15. A method of facilitating a captioned communication session, the method comprising:

capturing a near-end voice signal for a near-end communication device during a communication session with a far-end communication device, wherein the communication session is assisted by a remote captioning service that provides text captions of at least a far-end voice signal during the communication session;

transmitting the near-end voice signal from the near-end communication device to the far-end communication device through a mobile device that is locally coupled with the near-end communication device;

receiving the far-end voice signal from the far-end communication device through the mobile communication device to the near-end communication device;

transmitting the far-end voice signal directly from the near-end communication device to the remote captioning service;

receiving a text signal directly from the remote captioning service to the near-end communication device, the text signal corresponding to text captions of the far-end voice signal generated by the remote captioning service; and

displaying the text captions on an electronic display of the near-end communication device.

16. The method of claim 15, further comprising syncing the near-end communication device and the mobile device prior to receiving an incoming call to establish the communication session.

17. The method of claim 15, further comprising syncing the near-end communication device and the mobile device after receiving and answering an incoming call to establish the communication session.

18. A method of facilitating a captioned communication session, the method comprising:

capturing a near-end voice signal for a near-end communication device during a communication session with a far-end communication device, wherein the communication session is assisted by a remote captioning service that provides text captions of at least a far-end voice signal during the communication session;

transmitting the near-end voice signal from the near-end communication device to the far-end communication device through a mobile device that is locally coupled with the near-end communication device;

receiving the far-end voice signal from the far-end communication device through the mobile communication device to the near-end communication device;

transmitting the far-end voice signal from the mobile device to the remote captioning service;

receiving a text signal from the remote captioning service to the near-end communication device through the mobile device, the text signal corresponding to text captions of the far-end voice signal generated by the remote captioning service; and

displaying the text captions on an electronic display of the near-end communication device.

19. The method of claim 18, further comprising syncing the near-end communication device and the mobile device responsive to at least one of a user input at the mobile device, a user input at the near-end communication device, or an automatic syncing without a user input.

20. A method of facilitating a captioned communication session, the method comprising:

capturing a near-end voice signal for a near-end communication device during a communication session with a far-end communication device, wherein the communication session is assisted by a remote captioning service that provides text captions of at least a far-end voice signal during the communication session;

transmitting the near-end voice signal from the near-end communication device directly to the far-end communication device;

receiving the far-end voice signal from the far-end communication device to the near-end communication device through a mobile device that is locally coupled with the near-end communication device;

transmitting the far-end voice signal from the near-end communication device to the remote captioning service through the mobile device;

receiving a text signal from the remote captioning service to the near-end communication device through the mobile device, the text signal corresponding to text captions of the far-end voice signal generated by the remote captioning service; and

displaying the text captions on an electronic display of the near-end communication device.