Device independent text captioned telephone service

• US 10,469,660 B2
• Filed: 01/05/2016
• Issued: 11/05/2019
• Est. Priority Date: 06/29/2005
• Status: Active Grant

• Current Assignee: Ultratech Incorporated (Veeco Instruments Incorporated)
• Original Assignee: Ultratech Incorporated (Veeco Instruments Incorporated)
• Inventors: Engelke, Robert M, Colwell, Kevin R, Vitek, Troy D
• Primary Examiner(s): Woo, Stella L.
• Application Number:
  US14/988,407
• Publication Number:
  US 20170187873A1
• Time in Patent Office: 1,400 Days
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04M 1/2473 Telephone terminals interfacing a personal computer, e.g. using an API (Application Programming Interface) details of API H04M7/0021
• CPC Class Codes: H04M 1/2475 for a hearing impaired user
• CPC Class Codes: H04M 1/2535 adapted for voice communication over an Internet Protocol [IP] network Voice over Internet Protocol (VoIP) network equipment and services H04M7/006; implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP] H04L69/16
• CPC Class Codes: H04M 2201/14 Delay circuits; Timers
• CPC Class Codes: H04M 2201/40 using speech recognition speech recognition per se G10L15/00
• CPC Class Codes: H04M 2201/60 Medium conversion
• CPC Class Codes: H04M 2242/04 for emergency applications
• CPC Class Codes: H04M 3/42042 Notifying the called party of information on the calling party details within substation equipment H04M1/57, signalling details H04Q3/72
• CPC Class Codes: H04M 3/42161 via computer interface
• CPC Class Codes: H04M 3/42195 Arrangements for calling back a calling subscriber when the wanted subscriber ceases to be busy H04M3/48
• CPC Class Codes: H04M 3/42382 Text-based messaging services in telephone networks such as PSTN/ISDN, e.g. User-to-User Signalling or Short Message Service for fixed networks
• CPC Class Codes: H04M 3/42391 where the subscribers are hearing-impaired persons, e.g. telephone devices for the deaf
• CPC Class Codes: H04M 3/533 Voice mail systems

Abstract

A communication system and method for displaying text captions corresponding to voice communications between an assisted user'"'"'s mobile wireless device and a separate hearing user'"'"'s device includes at least one communication component configured to enable the appliance to communicate with a relay, a display, and a processor operably coupled to the at least one communication component and the display. The processor is configured to enable the assisted user to establish an association between the appliance and the mobile device, receive text originating at the relay, the text corresponding to a transcript of the hearing user'"'"'s voice signal originating at the hearing user'"'"'s device, and cause text captions corresponding to the received text to be displayed on the display.

Claims

1. A communication system, comprising:

a wireless mobile device that includes a mobile device processor and a mobile device display;

an appliance including a display configured to display text captions corresponding to voice communications between a wireless mobile device and a hearing user'"'"'s device that is located remotely from the appliance to enable an assisted user using the mobile device to participate in communication sessions with a hearing user using the hearing user'"'"'s device, wherein the appliance has a first network address and the mobile device is associated with a second address that is different than the first network address and wherein the appliance is independent of the mobile device, the first and second addresses useable to link to the appliance and the mobile device for communication therewith, respectively, the mobile device including a mobile device display and a processor, the appliance comprising;

at least one communication component configured to enable the appliance to communicate with a relay;

an appliance display; and

an appliance processor operably coupled to the at least one communication component and the display;

wherein, the mobile device processor is configured to, upon an incoming call being received by the mobile device, present a first indication of the call via the mobile device display;

the appliance processor configured to;

upon answering an incoming call, while at least one of the mobile device and the appliance is used by the assisted user to communicate via voice signals with the hearing user'"'"'s device, independent of any user action to associate the mobile device and the appliance subsequent to the call being received, receive text originating at the relay, the text corresponding to a transcript of the hearing user'"'"'s voice signal originating at the hearing user'"'"'s device, wherein the text signal is received from the relay; and

(ii) cause text captions corresponding to the received text to be displayed on the appliance display; and

wherein the mobile device is only wirelessly linked to other devices within the communication system.

2. The communication system of claim 1, wherein the mobile device is used by the assisted user to communicate via voice signals with the hearing user.

3. The communication system of claim 1, wherein the first indication indicates the identity of the hearing user that is calling the assisted user.

4. The communication system of claim 1, wherein the at least one communication component comprises a wireless transceiver.

5. The communication system of claim 1, wherein the second address is a telephone number.

6. The communication system of claim 1, wherein the appliance further comprises a speaker and a microphone and wherein the assisted user listens to a hearing user'"'"'s voice signal via the speaker and the assisted user'"'"'s voice signal is captured via the microphone and is transmitted to the hearing user'"'"'s device.

7. The communication system of claim 1, further comprising the relay, wherein the relay is configured to:

receive the hearing user'"'"'s voice signal; and

transmit the text comprising the text transcript corresponding to the hearing user'"'"'s voice signal directly to the appliance without passing through the mobile phone device.

8. The communication system of claim 7 wherein an association between the appliance and the mobile device is established at the relay.

9. The communication system of claim 1 wherein the mobile device is configured to receive the hearing user'"'"'s voice signal from the hearing user'"'"'s device.

10. The communication system of claim 1 wherein the mobile device is a cellular device.

11. The communication system of claim 1 wherein the appliance processor is further configured to disable captioning without disconnecting a call between the mobile device and the hearing user'"'"'s device.

12. The communication system of claim 1 wherein the mobile device can be used to facilitate a phone call independent of the appliance.

13. The communication system of claim 1 wherein the appliance receives the text signal directly from the relay without passing through the mobile device.

14. The communication system of claim 1 wherein the association is a temporary association and wherein the mobile device can be associated with any of several different appliances to facilitate communication.

15. The communication system of claim 1 wherein the association is a temporary association and wherein the appliance can be associated with any of several different mobile devices to facilitate communication.

16. The communication system of claim 1 further including the relay and wherein the hearing user'"'"'s voice signal is received at the relay directly from the hearing user'"'"'s device.

17. The communication system of claim 1 wherein the mobile phone device is useable to answer the incoming call and, wherein, the hearing user'"'"'s voice signal is presented to the relay immediately upon the incoming call being answered.

18. The communication system of claim 1 wherein the computer device is a palm type computer device.

19. The communication system of claim 1 wherein the computer device is a portable computing device.

20. The communication system of claim 1 wherein the appliance is a wireless device.

21. The communication system of claim 20 further including a wireless router wherein the appliance communicates wirelessly through the wireless router.

22. The communication system of claim 1 wherein the appliance processor is further configured to, upon an incoming call being received by the mobile device, presenting a second indication of the call via the appliance display screen.

23. The communication system of claim 1 wherein the appliance device processor is configured to, upon initiation of a call between the mobile device and the hearing user'"'"'s device, establish a communication link with the relay that is independent of the mobile device.

24. The communication system of claim 23 wherein the appliance receives text originating at the relay via the communication link.

25. A method to facilitate communication within a communication system between a hearing assisted user using both a computer device and a wireless mobile phone device that is independent of the computer device and a hearing user using a hearing user'"'"'s device, the computer device including a first display and the mobile phone device including a second display, the method comprising the steps of:

upon an incoming call being received by the mobile phone device, presenting a first indication of the call via the second display;

upon answering the incoming call, independent of any user action to associate the mobile phone device and the computer device subsequent to the call being received;

establishing a communication link between the mobile phone device and the hearing user'"'"'s device for voice communications wherein the voice communications include transmission of an assisted user'"'"'s voice signal to the hearing user'"'"'s device and receiving and audibly broadcasting the hearing user'"'"'s voice signal to the assisted user;

(ii) receiving text communications corresponding to the hearing user'"'"'s voice signal from a relay at the computer device; and

(iii) presenting text captions corresponding to the text communications via the first display; and

wherein the mobile device is only wirelessly linked to other communication devices within the communication system.

26. The method of claim 25 wherein the hearing user'"'"'s voice signal is transmitted to the relay without passing through the computer device.

27. The method of claim 26 wherein the hearing user'"'"'s device provides the hearing use'"'"'s voice signal directly to the relay.

28. The method of claim 25 wherein the text communications are transmitted directly to the computer device.

29. The method of claim 25 wherein each of the mobile phone device and the computing device is associated with a different address on at least one network.

30. The method of claim 29 wherein the mobile phone device is associated with a phone number and the computer device is associated with an IP address.

31. The method of claim 25 wherein the step of associating includes using at least one of the mobile phone device and the computer device to link to the relay and to provide information identifying the other of the computer device and the mobile phone device.

32. The method of claim 25 wherein the mobile phone device includes a microphone and wherein the mobile phone device captures the assisted user'"'"'s voice signal.

33. The method of claim 25 wherein the mobile phone device includes a speaker and wherein the step of audibly broadcasting the hearing user'"'"'s voice signal to the assisted user includes broadcasting the hearing user'"'"'s voice signal via the speaker included in the mobile phone device.

34. The method of claim 25 wherein the mobile phone device is a cellular phone device.

35. The method of claim 25 also for use with a relay, the method further including the steps of, at the relay:

receiving the hearing user'"'"'s voice signal; and

transmitting the text captions corresponding to the hearing user'"'"'s voice signal directly to the computer device.

36. The method of claim 25 wherein the computer device is a portable computing device.

37. The method of claim 25 wherein the computer device is a palm type computing device.

38. A method to facilitate communication within a communication system between a hearing assisted user using a computer device and a wireless mobile phone device that is independent of the computer device and a hearing user using a hearing user'"'"'s device, the computer device including a first display and the mobile phone device including a second display, the method comprising the steps of:

upon an incoming call being received by the mobile phone device, presenting a first indication of the call via at least one of the first and second displays;

independent of any user action to associate the mobile phone device and the computer device subsequent to the call being received;

establishing a communication link between the mobile phone device and the hearing user'"'"'s device for voice communications in which hearing user'"'"'s voice signals are received at the mobile phone device and are broadcast by the mobile phone device and assisted user'"'"'s voice signals are transmitted to the hearing user'"'"'s device;

(ii) transmitting the hearing user'"'"'s voice signal to a relay;

receiving text communications at the computer device that are generated by the relay where the text communications comprise transcription of the hearing user'"'"'s voice signal initially transmitted by the hearing user'"'"'s device; and

(iii) presenting the text communications as captions on the first display for viewing by the assisted user; and

wherein the mobile phone device is only wirelessly linked to other devices within the communication system.

39. The method of claim 38 further including the steps of, upon an incoming call being received by the mobile phone device, presenting a second indication via the second display.

40. The method of claim 39 wherein one of the first and second indications indicates identity of a calling party and the other of the first and second indications indicates that the call is a text assisted call.

41. The method of claim 38 wherein the step of presenting a first indication of the call via at least one of the first and second displays presents the indication via the second display.

42. The method of claim 38 wherein the step of presenting a first indication of the call via at least one of the first and second displays presents separate indications via the first and second displays.

43. The method of claim 38 wherein the mobile phone device is wirelessly linked to the relay.

44. The method of claim 38 wherein the hearing user'"'"'s voice is presented to the relay without passing through the computer device.

45. The method of claim 38 wherein the hearing user'"'"'s voice is presented to the relay without passing through the mobile phone device.