System and method of teleconferencing with the deaf or hearing-impaired

• US 6,618,704 B2
• Filed: 12/01/2000
• Issued: 09/09/2003
• Est. Priority Date: 12/01/2000
• Status: Expired due to Fees

• Current Assignee: Pendragon Networks LLC (Pendrell Corporation)
• Original Assignee: International Business Machines Corporation
• Inventors: Epstein, Edward Adam, Basson, Sara H., Kanevsky, Dimitri, Fairweather, Peter G.
• Primary Examiner(s): Banks-Harold, Marsha D.
• Assistant Examiner(s): Han, Qi
• Application Number:
  US09/727,878
• Publication Number:
  US 20020069069A1
• Time in Patent Office: 1,012 Days
• Field of Search: 345/758, 715/523, 704/271, 704/260, 709/204
• US Class Current: 704/271
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2021/065 Aids for the handicapped in understanding

Abstract

A system and method is provided for real time teleconferencing, where one of the participants is deaf or hearing-impaired. In one aspect of the system and method, each participant has an Automatic Speech Recognition (ASR) system and a chat service system, such as AOL Instant Messenger™. Each participant may have a different type of ASR system, as well as a different type of chat service system. It is not necessary that the deaf or hearing-impaired participant have an ASR system. For each participant, the participant'"'"'s ASR system transcribes the speech of the participant and provides it to the participant'"'"'s chat service system, which translates the transcribed text into the chat service message in the format of the participant'"'"'s chat service system. An Integration Server receives all the participant'"'"'s chat messages, which have various formats, and translates them into the format used by the chat service system of the deaf or hearing-impaired participant, thus allowing her to see the transcribed text of the conversation between the other participants. In addition, the deaf or hearing-impaired participant inputs text to her chat service system, which creates a formatted message text. The Integration Server receives this formatted chat message and translates it into the formats of the remaining participant'"'"'s chat service systems, so that the remaining participants see the comments of the deaf or hearing-impaired participant. In other aspects, the teleconferencing system and method is used to connect disparate chat service systems, without necessarily including a deaf or hearing-impaired participant.

Claims

1. A computer-based method of teleconferencing between at least two participants, where at least one of the participants is deaf or hearing-impaired, the method comprising the steps of:

transcribing, using an Automatic Speech Recognition (ASR) system, speech of one of the participants, to produce transcribed text;

translating transcribed text into a chat transmission format using a first chat service system, said translation resulting in a first chat format text;

translating said first chat format text to a second chat format text; and

receiving said second chat format text at a second chat service system, said second chat service system being used by a deaf or hearing-impaired participant;

whereby the deaf or hearing-impaired participant may read the transcribed text of the speech of other participants.

2. The computer-based method as recited in claim 1, further comprising the steps of:

transmitting said second chat format text from the second chat service system, said transmitted second chat format text being input by the deaf or hearing-impaired participant into the second chat service system;

translating the transmitted second chat format text to a first chat format text; and

receiving the translated first chat format text at the first chat service system;

whereby a participant, using the first chat service system, may read the input text of the deaf or hearing-impaired participant.

3. The computer-based method as recited in claim 2, further comprising the step of:

synthesizing a human voice to speak the received first chat format text aloud so that a participant may hear it.

4. The computer-based method as recited in claim 1, wherein each participant, except for the at least one deaf or hearing-impaired participant, has an ASR system and a chat service system for performing the transcribing speech step and the translating transcribed text step, respectively.

5. A system for teleconferencing between at least two participants, where at least one of the participants is deaf or hearing-impaired, the system comprising:

at least one Automatic Speech Recognition (ASR) system for transcribing speech of at least one of the participants in order to produce transcribed text;

at least one first chat service system for receiving transcribed text and translating the received transcribed text into a chat transmission format, thus producing a first chat format text;

at least one means for translating the first chat format text to a second chat format text; and

at least one second chat service system, which is being used by a deaf or hearing-impaired participant, for receiving second chat format text;

whereby the deaf or hearing-impaired participant may read the transcribed text of the speech of other participants.

6. The system as recited in claim 5, further comprising:

means for transmitting a second chat format text from the second chat service system, said transmitted second chat format text being input by the deaf or hearing-impaired participant into the second chat service system; and

means for translating the transmitted second chat format text to a first chat format text;

whereby a participant, using the first chat service system, may read the input text of the deaf or hearing-impaired participant.

7. The system as recited in claim 6, further comprising:

a text-to-speech synthesizer for synthesizing a human voice to speak the translated first chat format text aloud so that a participant may hear it.

8. The system as recited in claim 5, wherein, for each participant, except for the at least one deaf or hearing-impaired participant, the system further comprises:

an Automatic Speech Recognition (ASR) system for transcribing speech of the participant in order to produce transcribed text; and

a participant chat service system for receiving transcribed text and translating the received transcribed text into a chat transmission format, thus producing participant chat format text.

9. The system as recited in claim 8, the system further comprising:

at least one means for translating any participant chat format text to a second chat format text.

10. A computer system for teleconferencing between at least two participants, where at least one of the participants is deaf or hearing-impaired, the computer system comprising:

at least one computer-readable memory including;

code that performs Automatic Speech Recognition of speech of at least one of the participants in order to produce transcribed text;

code that performs a first chat service for receiving transcribed text and translating the received transcribed text into a chat transmission format, thus producing a first chat format text;

code that translates the first chat format text to a second chat format text; and

code that performs a second chat service for receiving the second chat format text;

whereby the deaf or hearing-impaired participant, using the second chat service, may read the transcribed text of the speech of other participants.

11. The computer system as recited in claim 10, wherein the at least one computer-readable memory further comprises:

code that enables transmission of a second chat format text from the second chat service, said transmitted second chat format text being input by the deaf or hearing-impaired participant into the second chat service; and

code that translates the transmitted second chat format text to a first chat format text;

whereby a participant, using the first chat service system, may read the input text of the deaf or hearing-impaired participant.

12. The computer system as recited in claim 11, wherein the at least one computer-readable memory further comprises:

code that performs text-to-speech synthesis in order that a synthesized human voice speaks the received first chat format text aloud so that a participant may hear it.

13. A method of providing teleconferencing comprising the steps of:

receiving a request for teleconferencing ASR training service, said request including information concerning participants in the requested teleconference;

maintaining a communication link with at least two chat service systems, where each of the participants has access to one of the chat service systems;

generating a price for performing the requested teleconference;

receiving all chat service system text messages from the chat service systems;

translating each of the chat service system text messages into chat formats used by the chat service systems; and

transmitting each of the translated chat service system text messages to the chat service systems;

wherein each of the chat service systems receives every chat service system text message generated by all other chat service systems and every received chat service system text message is in a format compatible with the respective chat service systems.