System for text assisted telephony

• US 9,967,380 B2
• Filed: 01/29/2016
• Issued: 05/08/2018
• Est. Priority Date: 08/23/2001
• Status: Expired due to Fees

• Current Assignee: Ultratech Incorporated (Veeco Instruments Incorporated)
• Original Assignee: Ultratech Incorporated (Veeco Instruments Incorporated)
• Inventors: Engelke, Robert M, Colwell, Kevin R
• Primary Examiner(s): WOO, STELLA L
• Application Number:
  US15/010,199
• Publication Number:
  US 20170187858A1
• Time in Patent Office: 830 Days
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04M 1/21 Combinations with auxiliary equipment, e.g. with clocks or memoranda pads
• CPC Class Codes: H04M 1/2155 Acoustic coupling
• CPC Class Codes: H04M 1/2475 for a hearing impaired user
• CPC Class Codes: H04M 1/271 controlled by voice recognition
• CPC Class Codes: H04M 1/724 User interfaces specially adapted for cordless or mobile telephones
• CPC Class Codes: H04M 11/066 Telephone sets adapted for data transmision
• CPC Class Codes: H04M 11/08 specially adapted for optional reception of entertainment or informative matter
• CPC Class Codes: H04M 2201/40 using speech recognition speech recognition per se G10L15/00
• CPC Class Codes: H04M 2201/60 Medium conversion
• CPC Class Codes: H04M 2250/74 with voice recognition means voice activated dialling H04M1/271; voice recognition algorithms G10L15/00
• CPC Class Codes: H04M 3/42161 via computer interface
• CPC Class Codes: H04M 3/42382 Text-based messaging services in telephone networks such as PSTN/ISDN, e.g. User-to-User Signalling or Short Message Service for fixed networks
• CPC Class Codes: H04M 3/42391 where the subscribers are hearing-impaired persons, e.g. telephone devices for the deaf

Abstract

A communication system including a hard of hearing user'"'"'s captioned device, the captioned device including a display screen and a processor. The processor in the captioned device is configured to: establish communication with a hard of hearing user'"'"'s phone device that is independent of the hard of hearing user'"'"'s captioned device, receive a text communication originating at a relay, the text communication corresponding to a transcription of the hearing user'"'"'s voice signal, and display a text caption corresponding to the text communication on the display of the hard of hearing user'"'"'s captioned device.

Claims

1. A communication system comprising:

a hard of hearing user'"'"'s captioned device, the captioned device including a display screen and a processor, the processor in the captioned device configured to;

establish communication with a hard of hearing user'"'"'s phone device that is independent of the hard of hearing user'"'"'s captioned device;

receive a text communication originating at a relay, the text communication corresponding to a transcription of a hearing user'"'"'s voice signal; and

display a text caption corresponding to the text communication on the display of the hard of hearing user'"'"'s captioned device;

wherein at least one of the captioned device and the hard of hearing user'"'"'s phone device is configured to establish a first communication link directly with the relay for routing the hearing user'"'"'s voice signal to the relay; and

wherein the captioned device includes an activation button which, when selected, initiates a communication link with the relay and transmission of the hearing user'"'"'s voice signal to the relay for transcription into text.

2. The communication system of claim 1 wherein the captioned device establishes communication with the hard of hearing user'"'"'s phone device via an acoustic coupling to the hard of hearing user'"'"'s phone device.

3. The communication system of claim 1 wherein the captioned device is configured to establish communication with the hard of hearing user'"'"'s phone device in response to a user input.

4. The communication system of claim 1 wherein the captioned device further comprises a button and wherein the captioned device is further configured to receive the hearing user'"'"'s voice signal responsive to a detection of a user selecting the button.

5. The communication system of claim 1 wherein the captioned device comprises a communication connection configured to establish the communication with the hard of hearing user'"'"'s phone device.

6. The communication system of claim 5 wherein the communication connection includes at least one of an acoustic coupling to the phone device and an electrical connection to the phone device.

7. The communication system of claim 5 wherein the communication connection includes an electrical connection between the phone device and the captioned device.

8. The communication system of claim 1 wherein the processor is configured to establish the communication link to the relay responsive to selection of the activation button and to transmit the hearing user'"'"'s voice signal to the relay after the communication link is established.

9. The communication system of claim 1 wherein the captioned device establishes communication with the hard of hearing user'"'"'s phone device such that the hearing user'"'"'s voice signal is received at the captioned device.

10. The communication system of claim 1 wherein an action from the hard of hearing user establishes communication between the hard of hearing user'"'"'s phone device and the captioned device.

11. The communication system of claim 1 wherein the hard of hearing user'"'"'s phone device can be used independently of the captioned device to facilitate a voice conversation with a hearing user using the hearing user'"'"'s device.

12. The communication system of claim 1 wherein the captioned device receives the text communication from the relay on the first communication link.

13. The communication system of claim 1 wherein the hard of hearing user'"'"'s phone device is a hard of hearing user'"'"'s cellular phone device.

14. The communication system of claim 13 wherein the hard of hearing user'"'"'s cellular phone device can be used independent of the captioned device to facilitate a voice conversation with a hearing user using the hearing user'"'"'s device.

15. The communication system of claim 13 wherein the step of establishing communication includes coupling the hard of hearing user'"'"'s cellular phone device to the captioned device.

16. The communication system of claim 15 wherein the step of coupling the hard of hearing user'"'"'s cellular device to the captioned device includes physically coupling the hard of hearing user'"'"'s cellular device to the captioned device.

17. The communication system of claim 16 wherein the step of coupling the hard of hearing user'"'"'s cellular phone device to the captioned device includes forming an electrical connection between the hard of hearing user'"'"'s phone device and the captioned device.

18. The communication system of claim 16 wherein the step of coupling the hard of hearing user'"'"'s cellular phone device to the captioned device includes establishing an acoustic coupling between the hard of hearing user'"'"'s phone device and the captioned device.

19. A communication system comprising:

a hard of hearing user'"'"'s captioned device, the captioned device including a display screen and a processor, the processor in the captioned device configured to;

establish communication with a hard of hearing user'"'"'s phone device that is independent of the hard of hearing user'"'"'s captioned device;

receive a text communication originating at a relay, the text communication corresponding to a transcription of a hearing user'"'"'s voice signal; and

display a text caption corresponding to the text communication on the display of the hard of hearing user'"'"'s captioned device;

wherein at least one of the captioned device and the hard of hearing user'"'"'s phone device is configured to establish a first communication link directly with the relay for routing the hearing user'"'"'s voice signal to the relay; and

wherein the captioned device routes the hearing user'"'"'s voice signal from the hard of hearing user'"'"'s phone device to the relay.

20. A communication system comprising:

a hard of hearing user'"'"'s captioned device, the captioned device including a display screen and a processor, the processor in the captioned device configured to;

establish communication with a hard of hearing user'"'"'s phone device that is independent of the hard of hearing user'"'"'s captioned device;

receive a text communication originating at a relay, the text communication corresponding to a transcription of a hearing user'"'"'s voice signal; and

display a text caption corresponding to the text communication on the display of the hard of hearing user'"'"'s captioned device;

wherein at least one of the captioned device and the hard of hearing user'"'"'s phone device is configured to establish a first communication link directly with the relay for routing the hearing user'"'"'s voice signal to the relay; and

wherein the captioned device is configured to receive the text communication directly from the relay without passing through the hard of hearing user'"'"'s phone device.

21. A communication system comprising:

a hard of hearing user'"'"'s captioned device, the captioned device including a display screen and a processor, the processor in the captioned device configured to;

establish communication with a hard of hearing user'"'"'s phone device that is independent of the hard of hearing user'"'"'s captioned device;

receive a text communication originating at a relay, the text communication corresponding to a transcription of a hearing user'"'"'s voice signal; and

display a text caption corresponding to the text communication on the display of the hard of hearing user'"'"'s captioned device;

wherein at least one of the captioned device and the hard of hearing user'"'"'s phone device is configured to establish a first communication link directly with the relay for routing the hearing user'"'"'s voice signal to the relay; and

wherein the captioned device establishes the first communication link with the relay.

22. A communication system comprising:

a hard of hearing user'"'"'s captioned device, the captioned device including a display screen and a processor, the processor in the captioned device configured to;

establish communication with a hard of hearing user'"'"'s phone device that is independent of the hard of hearing user'"'"'s captioned device;

receive a text communication originating at a relay, the text communication corresponding to a transcription of a hearing user'"'"'s voice signal; and

display a text caption corresponding to the text communication on the display of the hard of hearing user'"'"'s captioned device;

wherein at least one of the captioned device and the hard of hearing user'"'"'s phone device is configured to establish a first communication link directly with the relay for routing the hearing user'"'"'s voice signal to the relay; and

wherein the captioned device receives the text communication from the relay on a second communication link that is independent of the first communication link.

23. The communication system of claim 22 wherein the second communication link is a wireless communication link.

24. The communication system of claim 22 wherein the captioned device receives the text communication directly via the second communication link without passing through the hard of hearing user'"'"'s phone device.

25. The communication system of claim 22 wherein the second communication link is a cellular communication link.

26. A communication system comprising:

a hard of hearing user'"'"'s captioned device, the captioned device including a display screen and a processor, the processor of the captioned device configured to;

establish communication with a hard of hearing user'"'"'s phone device that is independent of the hard of hearing user'"'"'s captioned device;

receive a text communication originating at a relay, the text communication corresponding to a transcription of a hearing user'"'"'s voice signal; and

display a text caption corresponding to the text communication on the display of the hard of hearing user'"'"'s captioned device;

wherein the captioned device further comprises an input device configured to detect a selection of a caption button, wherein the processor is configured to establish a communication link to the relay responsive to selection of the caption button and to transmit the hearing user'"'"'s voice signal to the relay after the communication link is established.

27. The communication system of claim 26 wherein the captioned device establishes communication with the hard of hearing user'"'"'s phone device via an acoustic coupling to the hard of hearing user'"'"'s phone device.

28. The communication system of claim 26 wherein the captioned device is configured to establish communication with the hard of hearing user'"'"'s phone device in response to a user input.

29. The communication system of claim 28 wherein the captioned device further comprises a button and wherein the captioned device is further configured to receive the hearing user'"'"'s voice signal responsive to a detection of a user selecting the button.

30. The communication system of claim 26 wherein the captioned device comprises a communication connection configured to establish the communication with the hard of hearing user'"'"'s phone device.

31. The communication system of claim 26 wherein the captioned device establishes communication with the hard of hearing user'"'"'s phone device such that the hearing user'"'"'s voice signal is received at the captioned device.

32. The communication system of claim 31 wherein an action from the hard of hearing user establishes communication between the hard of hearing user'"'"'s phone device and the captioned device.

33. The communication system of claim 32 wherein the hard of hearing user'"'"'s phone device can be used independently of the captioned device to facilitate a voice conversation with a hearing user using the hearing user'"'"'s device.

34. The communication system of claim 33 wherein the captioned device receives the text communication from the relay on the first communication link.

35. The communication system of claim 33 wherein the captioned device receives the text communication from the relay on a second communication link that is independent of the first communication link.

36. The communication system of claim 35 wherein the second communication link is a wireless communication link.

37. The communication system of claim 35 wherein the captioned device receives the text communication directly via the second communication link without passing through the hard of hearing user'"'"'s phone device.

38. The communication system of claim 35 wherein the second communication link is a cellular communication link.

39. The communication system of claim 35 wherein the hard of hearing user'"'"'s phone device is a hard of hearing user'"'"'s cellular phone device.

40. The communication system of claim 39 wherein the hard of hearing user'"'"'s cellular phone device can be used independent of the captioned device to facilitate a voice conversation with a hearing user using the hearing user'"'"'s device.

41. The communication system of claim 35 wherein the hard of hearing user'"'"'s phone device is a hard of hearing user'"'"'s cellular phone device.

42. A communication system comprising:

a hard of hearing user'"'"'s captioned device, the captioned device including a display screen and a processor, the captioned device configured to;

establish communication with a hard of hearing user'"'"'s wireless phone device that is independent of the hard of hearing user'"'"'s captioned device;

receive a hearing user'"'"'s voice signal originating at a hearing user'"'"'s phone device from the hard of hearing user'"'"'s phone device;

establish a first communication link with a relay;

route the hearing user'"'"'s voice signal via the first communication link to the relay for transcription;

receive a text communication originating at the relay on a second communication link that is separate from the first communication link, the text communication corresponding to a transcription of the hearing user'"'"'s voice signal; and

display a text caption corresponding to the text communication on the display.

43. The communication system of claim 42 wherein the captioned device routes the hearing user'"'"'s voice signal through the hard of hearing user'"'"'s phone device to the relay.

44. The communication system of claim 42 wherein the captioned device is configured to receive the text communication directly from the relay without passing through the hard of hearing user'"'"'s phone device.

45. The communication system of claim 42 wherein the captioned device is configured to establish communication with the hard of hearing user'"'"'s phone device in response to a user input.

46. The communication system of claim 45 wherein the captioned device further comprises a button and wherein the captioned device is further configured to receive the hearing user'"'"'s voice signal responsive to a detection of a user selecting the button.

47. The communication system of claim 42 wherein the captioned device comprises a communication connection configured to establish the communication with the hard of hearing user'"'"'s phone device.

48. The communication system of claim 42 wherein the captioned device establishes communication with the hard of hearing user'"'"'s phone device such that the hearing user'"'"'s voice signal is received at the captioned device.

49. The communication system of claim 42 wherein an action from the hard of hearing user establishes communication between the hard of hearing user'"'"'s phone device and the captioned device.

50. The communication system of claim 42 wherein the hard of hearing user'"'"'s phone device can be used independently of the captioned device to facilitate a voice conversation with a hearing user using the hearing user'"'"'s device.

51. The communication system of claim 50 wherein the captioned device receives the text communication from the relay on the first communication link.

52. The communication system of claim 50 wherein the captioned device receives the text communication from the relay on a second communication link that is independent of the first communication link.

53. The communication system of claim 52 wherein the second communication link is a wireless communication link.

54. The communication system of claim 42 wherein the captioned device receives the text communication directly via the second communication link without passing through the hard of hearing user'"'"'s phone device.

55. The communication system of claim 54 wherein the second communication link is a cellular communication link.

56. A communication system, comprising:

a hard of hearing user'"'"'s captioned device, the captioned device including a display screen and a processor, the processor of the captioned device configured to;

establish communication with a hard of hearing user'"'"'s phone device that is independent of the hard of hearing user'"'"'s captioned device;

receive a text communication originating at a relay, a text communication corresponding to a transcription of a hearing user'"'"'s voice signal; and

display a text caption corresponding to the text communication on the display of the hard of hearing user'"'"'s captioned device;

wherein the captioned device establishes communication with the hard of hearing user'"'"'s phone device such that the hearing user'"'"'s voice signal is received at the captioned device.

57. The communication system of claim 56 wherein the captioned device is configured to establish communication with the hard of hearing user'"'"'s phone device in response to a user input.

58. The communication system of claim 56 wherein the captioned device further comprises a button and wherein the captioned device is further configured to receive the hearing user'"'"'s voice signal responsive to a detection of a user selecting the button.

59. The communication system of claim 56 wherein the captioned device comprises a communication connection configured to establish the communication with the hard of hearing user'"'"'s phone device.

60. The communication system of claim 56 wherein an action from the hard of hearing user establishes communication between the hard of hearing user'"'"'s phone device and the captioned device.

61. The communication system of claim 60 wherein the hard of hearing user'"'"'s phone device can be used independently of the captioned device to facilitate a voice conversation with a hearing user using the hearing user'"'"'s device.

62. The communication system of claim 61 wherein the hard of hearing user'"'"'s phone device is a hard of hearing user'"'"'s cellular phone device.

63. The communication system of claim 62 wherein the hard of hearing user'"'"'s cellular phone device can be used independent of the captioned device to facilitate a voice conversation with a hearing user using the hearing user'"'"'s device.