Conversion of communicated speech to text for tranmission as RF modulated base band video

• US 5,774,857 A
• Filed: 11/15/1996
• Issued: 06/30/1998
• Est. Priority Date: 11/15/1996
• Status: Expired due to Term

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Motorola, Inc. (Motorola Solutions, Inc.)
• Inventors: Newlin, Douglas J.
• Primary Examiner(s): Hudspeth, David R.
• Assistant Examiner(s): Storm, Donald L.
• Application Number:
  US08/751,048
• Time in Patent Office: 592 Days
• Field of Search: 704/235, 704/3, 704/270, 704/200, 704/201, 704/231, 704/271, 704/276, 704/251, 704/255, 704/257, 348/468
• US Class Current: 704/271
• CPC Class Codes: G09B 21/009 Teaching or communicating with deaf persons G09B21/04 takes precedence; deaf and dumb persons G09B21/00
• CPC Class Codes: G09B 21/04 Devices for conversing with the deaf-blind
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

Apparatuses, systems, and a method provide for a visual display of speech, such as the visual display of a received audio signal in telecommunications, especially useful for the hearing impaired. The preferred apparatus includes a network interface that is coupleable to a first communication channel to receive an audio signal; a radio frequency (RF) modulator to convert a baseband output video signal to a RF output video signal and to transmit the RF output video signal on a second communication channel for video display; and a processor coupled to the network interface and to the RF modulator for running a set of program instructions to convert the received audio signal to a text representation of speech, and to further convert the text to the baseband output video signal. The RF output video signal, when displayed on a video display, provides the visual display of speech. The preferred apparatus may also include a speech generation subsystem.

Claims

1. An apparatus for the visualization of speech, the apparatus comprising:

a network interface, the network interface coupleable to a first communication channel for reception of a first audio signal to form a received audio signal;

a radio frequency modulator to convert a baseband output video signal to a radio frequency output video signal and to transmit the radio frequency output video signal on a second communication channel for video display; and

a processor arrangement, the processor arrangement coupled to the network interface and to the radio frequency modulator, the processor arrangement responsive, through a set of program instructions, to convert the received audio signal to a text representation of speech, and to further convert the text representation of speech to the baseband output video signal.

2. The apparatus of claim 1, further comprising a user interface coupled to the network interface and to the processor arrangement, the user interface for reception of a control signal of a plurality of control signals.

3. The apparatus of claim 2, wherein the user interface is further coupleable to a physical interface for entry of the plurality of control signals.

4. The apparatus of claim 3, wherein the physical interface is a telephone.

5. The apparatus of claim 3, wherein the physical interface is a keyboard.

6. The apparatus of claim 3, wherein the physical interface is a computer.

7. The apparatus of claim 1, wherein the processor arrangement has a plurality of operating modes, the plurality of operating modes including a telephony operating mode and a speech visualization operating mode, the processor arrangement further responsive to select the speech visualization operating mode in response to a control signal.

8. The apparatus of claim 1, wherein the processor arrangement further comprises:

a microprocessor subsystem;

a memory coupled to the microprocessor subsystem; and

a speech visualization processor coupled to the microprocessor subsystem and to the memory.

9. The apparatus of claim 8, wherein the speech visualization processor further comprises:

a speech recognition processor; and

an on screen display processor coupled to the speech recognition processor.

10. The apparatus of claim 8, wherein the speech visualization processor further comprises:

a speech recognition processor; and

a closed caption encoder coupled to the speech recognition processor.

11. The apparatus of claim 1, wherein the processor arrangement is further responsive to receive input text to form received text and to convert the received text into a second audio signal;

and wherein the network interface is further coupleable the first communication channel for the transmission of the second audio signal to form a transmitted audio signal.

12. The apparatus of claim 11, wherein the processor arrangement is further coupleable to a physical interface for entry of the input text.

13. The apparatus of claim 12 wherein the physical interface is a keyboard.

14. The apparatus of claim 12 wherein the physical interface is a computer.

15. The apparatus of claim 1, wherein the processor arrangement further comprises:

a microprocessor subsystem;

a memory coupled to the microprocessor subsystem;

a speech visualization processor coupled to the microprocessor subsystem and to the memory; and

a speech generation processor coupled to the microprocessor subsystem and to the memory.

16. The apparatus of claim 15, wherein the speech generation processor further comprises:

a text capture processor;

a text-to-speech processor coupled to the text capture processor; and

a speech synthesizer coupled to the text-to-speech processor.

17. The apparatus of claim 1, wherein the network interface is a cable network interface.

18. The apparatus of claim 1, wherein the network interface is an ISDN interface.

19. The apparatus of claim 1, wherein the network interface is a POTS telephony interface.

20. The apparatus of claim 1, wherein the first audio signal is a portion of a combined audio/video signal.

21. An apparatus for visualization of received speech and for generation of transmissible speech, the apparatus comprising:

a network interface, the network interface coupleable to a first communication channel for reception of a first audio signal to form a received audio signal and for transmission of a second audio signal to form a transmitted audio signal;

a radio frequency modulator to convert a baseband output video signal to a radio frequency output video signal and to transmit the radio frequency output video signal on a second communication channel for video display; and

a processor arrangement, the processor arrangement coupled to the network interface and to the radio frequency modulator, the processor arrangement coupleable to a physical interface for entry of input text, the processor arrangement responsive, through a set of program instructions, to convert the received audio signal to a text representation of speech, and to further convert the text representation of speech to the baseband output video signal, the processor arrangement further responsive to capture the input text and convert the input text to a speech signal, and to further convert the speech signal to the second audio signal.

22. A method for the visualization of speech, the method comprising:

(a) receiving a first audio signal to form a received audio signal;

(b) converting the received audio signal to a text representation;

(c) converting the text representation to a baseband output video signal;

(d) modulating the baseband output signal to a radio frequency output video signal;

(e) transmitting the radio frequency output video signal for visual display of the text representation of the received audio signal.

23. The method of claim 22, further comprising:

(f) receiving input text to form received input text;

(g) converting the received input text to a speech signal;

(h) converting the speech signal to second audio signal; and

(i) transmitting the second audio signal to form a transmitted audio signal.

24. The method of claim 22, wherein prior to step (a), the method further comprising:

detecting a request for service;

providing a user indication;

collecting signaling information; and

in response to a first control signal, selecting a speech visualization mode.

25. The method of claim 24, further comprising:

in response to a second control signal, selecting a speech generation mode.

26. The method of claim 24, wherein an ordinary telephony mode is transparently selected in the absence of the first control signal.