Systems and methods for automated audio transcription, translation, and transfer

• US 20020161578A1
• Filed: 04/26/2001
• Published: 10/31/2002
• Est. Priority Date: 04/26/2001
• Status: Active Grant

• Current Assignee: Courtroom Connect
• Original Assignee: Speche Communications, Inc.
• Inventors: Brand, David A., Estrin, Laurence H., Brand, Stephen, Saindon, Richard J.
• Granted Patent: US 6,820,055 B2
• Time in Patent Office: Days
• US Class Current: 704/235
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

The present invention relates to systems and methods for audio processing. For example, the present invention provides systems and methods for receiving live speech, converting the speech to text, and transferring the text to a user. As desired, the speech or text can be translated into one or more different languages. Systems and methods for real-time conversion and transmission of speech and text are provided.

Claims

1. A system comprising a processor, said processor configured to receive multimedia information and encode a plurality of information streams comprising a separately encoded first information stream and a separately encoded second information stream from said multimedia information, said first information stream comprising audio information and said second information stream comprising text information.

2. The system of claim 1, wherein said multimedia information comprises information selected from live event audio, speech audio, and motion picture audio.

3. The system of claim 1, further comprising a speech to text converter, wherein said speech to text converter is configured to produce text from said multimedia information and to provide said text to said processor.

4. The system of claim 3, wherein said speech to text converter comprises a stenograph.

5. The system of claim 3, wherein said speech to text converter comprises an error corrector configured to confirm text accuracy prior to providing said text to said processor.

6. The system of claim 1, further comprising a conference bridge configured to receive said multimedia information, wherein said conference bridge is configured to provide said multimedia information to said processor.

7. The system of claim 1, further comprising a delay component configured to receive said multimedia information, delay at least a portion of said multimedia information, and send said delayed portion of said multimedia information to said processor.

8. The system of claim 1, further comprising a text to speech converter configured to convert at least a portion of said text information to audio.

9. The system of claim 1, further comprising a language translator configured to receive said text information and convert said text information from a first language into one or more other languages.

10. The system of claim 1, wherein said processor is further configured to transmit a viewer output signal comprising said second information stream.

11. The system of claim 10, wherein said viewer output signal further comprises said first information stream.

12. The system of claim 1, wherein said processor is configured to receive information from a viewer.

14. The method of claim 13, further comprising the step of transmitting said translated encoded translated text to a foreign country.

15. The method of claim 14, further comprising the step of displaying said encoded translated text to a viewer in said foreign country.

16. The method of claim 15, further comprising the step of generating translated audio from said encoded translated text.

17. The method of claim 13, further comprising the step of synchronizing said encoded translated text with said motion picture audio to generate and a sub-titled motion picture.

19. The method of claim 18, wherein said audio information is from multimedia information and wherein said providing said streaming text information to a hearing impaired viewer comprises providing streaming text information synchronized with said multimedia information.

20. The method of claim 18, wherein said providing said streaming text information to a hearing impaired viewer comprises providing a cumulative complete transcript of said audio information to said hearing impaired viewer.

13. A method for providing a motion picture translation comprising:

a) providing;

i) motion picture audio information;

ii) a speech-to-text converter;

iii) a language translator; and

iv) a processor that encodes text and audio information;

b) processing said motion picture audio information with said speech-to-text converter to generate a text translation of said motion picture audio information;

c) processing said text translation with said language translator to generate translated text; and

d) encoding said translated text with said processor to generate encoded translated text.

18. A method for providing text for hearing impaired individuals comprising:

a) providing;

i) audio information;

ii) a speech-to-text converter; and

iii) a processor that encodes streaming text information;

b) processing said audio information with said speech-to-text converter to generate text information; and

c) encoding said text information into streaming text information with said processor; and

d) providing said streaming text information to a hearing impaired viewer.