Translating languages in response to device motion

• US 8,386,231 B2
• Filed: 09/29/2011
• Issued: 02/26/2013
• Est. Priority Date: 08/05/2010
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: LeBeau, Michael J., Jitkoff, John Nicholas
• Primary Examiner(s): He, Jialong
• Application Number:
  US13/249,129
• Publication Number:
  US 20120035908A1
• Time in Patent Office: 516 Days
• Field of Search: 704 2- 5, 704/8
• US Class Current: 704/2
• CPC Class Codes: G06F 40/40 Processing or translation of natural language natural language analysis G06F40/20; semantic analysis G06F40/30
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04M 2203/2061 Language aspects
• CPC Class Codes: H04M 2242/12 Language recognition, selection or translation arrangements
• CPC Class Codes: H04M 2250/58 including a multilanguage function
• CPC Class Codes: H04M 3/42348 Location-based services which utilize the location information of a target

Abstract

A method, performed on a server, of translating between languages includes receiving first audio data for a first language from a mobile device, translating the first audio data to second audio data for a second language, receiving an indication that the mobile device has moved between two locations, and sending the second audio data to the mobile device in response to the indication.

Claims

1. A method, performed on a server, which is part of a process for translating between languages, the method comprising:

receiving first audio data in a first language from a mobile device;

identifying the first language;

receiving second audio data in a second language from the mobile device;

identifying the second language;

receiving an indication that the mobile device has moved between two users, wherein movement of mobile device comprises at least moving the mobile device angularly relative to a predefined reference; and

in response to the indication that the mobile device has moved;

sending, to the mobile device, translation data that corresponds to audio data translated from one language into another language;

wherein, in a case that the mobile device has moved from a first location to a second location, the translation data corresponds to received audio data translated into the second language and, in a case that the mobile device has moved from the second location to the first location, the translation data corresponds to the received audio data translated into the first language; and

wherein subsequent operations of the server for translating between the first language and the second language are triggered automatically by subsequent indications that the mobile device has moved.

2. The method of claim 1, further comprising:

generating first text in the first language based on received audio data;

translating the first text to the second text in the second language; and

generating the translation data from the second text.

3. The method of claim 2, further comprising:

sending the first text or the second text to at least one of the mobile device and a computer.

4. The method of claim 1, wherein identifying the first language or the second language comprises:

identifying a geographic location of the mobile device; and

designating the first language or the second language based on the geographic location.

5. The method of claim 1, wherein identifying at least one of the first language or the second language comprises:

providing language options to the mobile device;

receiving one or more selections from among the language options; and

designating one or more of the first language and the second language based on the one or more selections.

6. One or more non-transitory machine-readable media storing instructions that are executable by one or more processing devices for translating between languages, the instructions being executable to perform operations comprising:

receiving first audio data in a first language from a mobile device;

identifying the first language;

receiving second audio data in a second language from the mobile device;

identifying the second language;

receiving an indication that the mobile device has moved between two users, wherein movement of the mobile device comprises at least moving the mobile device angularly relative to a predefined reference; and

in response to the indication that the mobile device has moved;

sending, to the mobile device, translation data that corresponds to audio data translated from one language into another language;

wherein, in a case that the mobile device has moved from a first location to a second location, the translation data corresponds to received audio data translated into the second language and, in a case that the mobile device has moved from the second location to the first location, the translation data corresponds to the received audio data translated into the first language; and

wherein subsequent operations of the server for translating between the first language and the second language are triggered automatically by subsequent indications that the mobile device has moved.

7. The one or more non-transitory machine-readable media of claim 6, wherein the operations comprise:

generating first text in the first language based on received audio data;

translating the first text to second text in the second language; and

generating the translation data from the second text.

8. The one or more non-transitory machine-readable media of claim 6, wherein identifying the first language or the second language comprises:

identifying a geographic location of the mobile device; and

designating the first language or the second language based on the geographic location.

9. The one or more non-transitory machine-readable media of claim 6, wherein the operations comprise:

after sending the second audio, receiving, from the mobile device, a request for a different translation of the received audio data.

10. The one or more non-transitory machine-readable media of claim 6, wherein identifying at least one of the first language or second language comprises:

providing language options to the mobile device;

receiving one or more selections from among the language options; and

designating one or more of the first language and the second language based on the one or more selections.

11. One or more non-transitory machine-readable media storing instructions that are executable by one Or more processing devices for translating between languages, the instructions being executable to perform operations comprising:

at a server;

receiving first audio data in a first language from a mobile device;

identifying the first language;

receiving second audio data in a second language from the mobile device;

identifying the second language;

receiving an indication that the mobile device has moved between two users, wherein movement of the mobile device comprises at least moving the mobile device angularly relative to a predefined reference; and

in response to the indication that the mobile device has moved;

sending, to the mobile device, translation data that corresponds to audio data translated from one language into another language;

wherein, in a case that the mobile device has moved from a first location to a second location, the translation data corresponds to received audio data translated into the second language and,in a case that the mobile device has moved from the second location to the first location, the translation data corresponds to the received audio data translated into the first language; and

wherein subsequent operations of the server for translating between the first language and the second language are triggered automatically by subsequent indications that the mobile device has moved;

at the mobile device;

receiving the translation data; and

playing audio based on the translation data.

12. The one or more non-transitory machine-readable media of claim 11, further comprising instructions that executable by the one or more processing devices to perform operations comprising:

generating first text in the first language based on received audio data;

translating the first text to second tent in the second language; and

generating the translation data from the second text.

13. The one or more non-transitory machine-readable media of claim 12, further comprising instructions that are executable by the one or more processing devices to perform operations comprising:

sending, from the server, the first text or the second text to at least one of the mobile device and a computer.

14. The one or more non-transitory machine-readable media of claim 11, wherein identifying the first language or the second language comprises:

identifying, at the server, a geographic location of the mobile device; and

designating, at the server, at least one of the first language and the second language based on the geographic location.

15. An electronic system for translating between languages, the electronic system comprising:

one or more processing devices; and

one or moremachine-readable media storing instructions. that are executable by the one or more processing devices to perform operations comprising;

receiving first audio data in a first language from a mobile device;

identifying the first language;

receiving second audio data in a second language from the mobile device;

identifying the second language;

receiving an indication that the mobile device has moved between two users, wherein movement of the mobile device comprises at least moving the mobile device angularly relative to a predefined reference; and

in response to the indication that the mobile device has moved;

sending, to the mobile device, translation data that corresponds to audio data translated from one language into another language;

wherein, in a case that the mobile device has moved from a first location to a second location, the translation data corresponds to received audio data translated into the second language and,in a case that the mobile device has moved from the second location to the first location, the translation data corresponds to the received audio data translated into the first language; and

wherein subsequent operations of the server for translating between the first language and the second language are triggered automatically by subsequent indications that the mobile device has moved.

16. The electronic system of claim 15, wherein the operations comprise:

generating first text in the first language based on received audio data;

translating the first text to second text in the second language; and

generating the translation data from the second text.

17. The electronic system of claim 16, wherein the operations comprise:

sending the first text or the second text to at least one of the mobile device and a computer.

18. The electronic system of claim 15, wherein identifying the first language or the second language comprises:

identifying a geographic location of the mobile device; and

designating the first language or the second language based on the geographic location.

19. The electronic system of claim 15, wherein the operations comprise:

after sending the second audio, receiving, from the mobile device, a request for a different translation of the received audio data.

20. The electronic system of claim 15, wherein identifying at least one of the first language or the second language comprises:

providing language options to the mobile device;

receiving one or more selections from among the language options; and

designating one or more of the first language and the second language based on the one or more selections.