AUTO-TRANSLATION FOR MULTI USER AUDIO AND VIDEO

• US 20170357643A1
• Filed: 07/31/2017
• Published: 12/14/2017
• Est. Priority Date: 12/12/2011
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Kristjansson, Trausti, Huang, John, Lin, Yu-Kuan, Tyan, Hung-ying, Uszkoreit, Jakob David, Estelle, Joshua James, Wang, Chung-yi, Buryak, Kirill, Konishi, Yusuke
• Granted Patent: US 10,372,831 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04M 2203/2061 Language aspects
• CPC Class Codes: H04M 2242/12 Language recognition, selection or translation arrangements
• CPC Class Codes: H04M 3/56 Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities video conference systems H04N7/15
• CPC Class Codes: H04M 3/568 audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

The disclosed subject matter provides a system, computer readable storage medium, and a method providing an audio and textual transcript of a communication. A conferencing services may receive audio or audio visual signals from a plurality of different devices that receive voice communications from participants in a communication, such as a chat or teleconference. The audio signals representing voice (speech) communications input into respective different devices by the participants. A translation services server may receive over a separate communication channel the audio signals for translation into a second language. As managed by the translation services server, the audio signals may be converted into textual data. The textual data may be translated into text of different languages based the language preferences of the end user devices in the teleconference. The translated text may be further translated into audio signals.

Claims

1. A system comprising:

a conferencing services server to exchange text and audio data signals between end user devices communicatively coupled to the conferencing services server, the text and audio data signals representing communication in a first spoken language;

a data storage for storing data including text and audio data signals;

a translation services server communicatively coupled to a first of the end user devices, wherein the translation services server is configured to manage the translation of the text or audio data signals representing communication in the first spoken language received from the first end user device into text or audio data in a second spoken language and return the translated text or audio data to a second of the end user devices;

a speech-to-text processor coupled to the translation services server and configured to;

convert first spoken language audio data signals into first language text corresponding to the communication in the first spoken language;

a translation processor coupled to the translation services server and configured to;

translate the first language text into text in a second language; and

store the second language text in the data storage; and

a text-to-speech processor coupled to the translation services server and configured to;

convert the second language text into audio signals representing a spoken version of the second language text; and

store the second language audio signals in the data storage.

2-19. -19. (canceled)