Translating languages

• US 10,817,673 B2
• Filed: 06/13/2018
• Issued: 10/27/2020
• Est. Priority Date: 08/05/2010
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Lebeau, Michael J., Jitkoff, John Nicholas
• Primary Examiner(s): He, Jialong
• Application Number:
  US16/007,718
• Publication Number:
  US 20180293229A1
• Time in Patent Office: 867 Days
• CPC Class Codes: G06F 40/40 Processing or translation of natural language natural language analysis G06F40/20; semantic analysis G06F40/30
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04M 2203/2061 Language aspects
• CPC Class Codes: H04M 2242/12 Language recognition, selection or translation arrangements
• CPC Class Codes: H04M 2250/58 including a multilanguage function
• CPC Class Codes: H04M 3/42348 Location-based services which utilize the location information of a target

Abstract

A method, performed on a server, of translating between languages includes receiving first audio data for a first language from a mobile device, translating the first audio data to second audio data for a second language, receiving an indication that the mobile device has moved between two locations, and sending the second audio data to the mobile device in response to the indication.

Claims

1. A method comprising:

receiving, at a computing device, from a first client device, first audio data in a first language, a first language identifier indicating the first language as a source language of translation for any audio data received from the first client device, and a second language identifier indicating a second language as a translation target language for any audio data to be transmitted to a second client device, the first client device executing a translation application configured to;

display a language selection input screen on the first client device;

receive, in the language selection input screen, a first input indication indicating selection of the first language identifier and a second input indication indicating selection of the second language identifier; and

transmit the first audio data in the first language, the first language identifier, and the second language identifier to the computing device;

in response to receiving the first audio data, the first language identifier, and the second language identifier;

recognizing, by the computing device, the first language identifier to identify the first language as the source language of translation for the first audio;

recognizing, by the computing device, the second language identifier to identify the second language as the translation target language for the second audio; and

generating, by the computing device, second audio data corresponding to a first translation of the first audio data in the first language to the second language;

transmitting the second audio data from the computing device to the second client device, the second audio data when received by the second client device causing the second client device to audibly output the second audio data;

receiving, at the computing device, third audio data from the second client device, the third audio data in the second language;

generating, by the computing device, fourth audio data corresponding to a second translation of the third audio data in the second language to the first language; and

transmitting the fourth audio data from the computing device to the first client device, the fourth audio data when received by the first client device causing the first client device to audibly output the fourth audio data.

2. The method of claim 1, further comprising, when receiving the first audio data and the second language identifier from the first client device, determining the first language based on a geographical location of the first client device.

3. The method of claim 1, further comprising:

receiving an identity of the second client device from the first client device; and

using the identity of the second client device to transmit the second audio data to the second client device.

4. The method of claim 1, further comprising, after generating the second audio data:

storing, by the computing device, the second audio data in non-transitory memory; and

receiving, at the computing device from the second client device, a request to provide the second audio data to the second client device,

wherein the computing device transmits the second audio data to the second client device in response to receiving the request to provide the second audio data.

5. The method of claim 1, further comprising, after generating the fourth audio data:

storing, at the computing device, the fourth audio data in non-transitory memory; and

receiving, at the computing device from the first client device, a request to provide the fourth audio data to the first client device,

wherein the computing device transmits the fourth audio data to the first client device in response to receiving the request to provide the fourth audio data.

6. The method of claim 1, wherein the first audio data is captured by a microphone associated with the first client device.

7. The method of claim 1, wherein the third audio data is captured by a microphone associated with the second client device.

8. The method of claim 7, wherein the third audio data is captured by the microphone associated with the second client device after the second client device audibly outputs the second audio data.

9. The method of claim 1, wherein the first client device and the second client device are paired.

10. A system comprising:

one or more processors; and

one or more storage devices in communication with the one or more processors and storing instructions, that when executed on the one or more processors, cause the one or more processors to perform operations comprising;

receiving, from a first client device, first audio data in a first language, a first language identifier indicating the first language as a source language of translation for any audio data received from the first client device, and a second language identifier indicating a second language as a translation target language for any audio data to be transmitted to a second client device, the first client device executing a translation application configured to;

display a language selection input screen on the first client device;

receive, in the language selection input screen, a first input indication indicating selection of the first language identifier and a second input indication indicating selection of the second language identifier; and

transmit the first audio data in the first language, the first language identifier, and the second language identifier to the computing device;

in response to receiving the first audio data, the first language identifier, and the second language identifier;

recognizing the first language identifier to identify the first language as the source language of translation for the first audio;

recognizing the second language identifier to identify the second language as the translation target language for the second audio; and

generating second audio data corresponding to a first translation of the first audio data in the first language to the second language;

transmitting the second audio data to the second client device, the second audio data when received by the second client device causing the second client device to audibly output the second audio data;

receiving third audio data from the second client device, the third audio data in the second language;

generating fourth audio data corresponding to a second translation of the third audio data in the second language to the first language; and

transmitting the fourth audio data to the first client device, the fourth audio data when received by the first client device causing the first client device to audibly output the fourth audio data.

11. The system of claim 10, wherein the operations further comprise, when receiving the first audio data and the second language identifier from the first client device, determining the first language based on a geographical location of the first client device.

12. The system of claim 10, wherein the operations further comprise:

receiving an identity of the second client device from the first client device; and

using the identity of the second client device to transmit the second audio data to the second client device.

13. The system of claim 10, wherein the operations further comprise, after generating the second audio data:

storing, by the computing device, the second audio data in non-transitory memory; and

receiving, at the computing device from the second client device, a request to provide the second audio data to the second client device,

wherein the computing device transmits the second audio data to the second client device in response to receiving the request to provide the second audio data.

14. The system of claim 10, wherein the operations further comprise, after generating the fourth audio data:

storing, at the computing device, the fourth audio data in non-transitory memory; and

receiving, at the computing device from the first client device, a request to provide the fourth audio data to the first client device,

wherein the computing device transmits the fourth audio data to the first client device in response to receiving the request to provide the fourth audio data.

15. The system of claim 10, wherein the first audio data is captured by a microphone associated with the first client device.

16. The system of claim 10, wherein the third audio data is captured by a microphone associated with the second client device.

17. The system of claim 16, wherein the third audio data is captured by the microphone associated with the second client device after the second client device audibly outputs the second audio data.

18. The system of claim 10, wherein the first client device and the second client device are paired.