Systems and methods for multi-user multi-lingual communications

• US 9,031,829 B2
• Filed: 06/03/2014
• Issued: 05/12/2015
• Est. Priority Date: 02/08/2013
• Status: Expired due to Fees

• Current Assignee: Mz Ip Holdings, LLC (AppLovin Corporation)
• Original Assignee: Machine Zone, Inc. (AppLovin Corporation)
• Inventors: Leydon, Gabriel, Orsini, Francois, Bojja, Nikhil
• Primary Examiner(s): COLUCCI, MICHAEL C
• Application Number:
  US14/294,675
• Publication Number:
  US 20140303961A1
• Time in Patent Office: 343 Days
• Field of Search: 704/2, 704/4, 704/3, 704/270.1, 704/246, 704/235, 704/1, 715/203, 709/224, 709/217, 709/206, 709/204, 707/718, 707/706, 705/14.41, 463/9, 463/31, 455/466, 434/362, 434/156
• US Class Current: 704/2
• CPC Class Codes: G06F 40/40 Processing or translation of natural language natural language analysis G06F40/20; semantic analysis G06F40/30
• CPC Class Codes: G06F 40/51 Translation evaluation
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 10/107 Computer-aided management of electronic mailing [e-mailing]
• CPC Class Codes: G06Q 30/0217 involving input on products or services in exchange for incentives or rewards
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 13/08 Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

Various embodiments described herein facilitate multi-lingual communications. The systems and methods of some embodiments enable multi-lingual communications through different modes of communication including, for example, Internet-based chat, e-mail, text-based mobile phone communications, postings to online forums, postings to online social media services, and the like. Certain embodiments implement communication systems and methods that translate text between two or more languages. Users of the systems and methods may be incentivized to submit corrections for inaccurate or erroneous translations, and may receive a reward for these submissions. Systems and methods for assessing the accuracy of translations are described.

Claims

1. A method implemented by data processing apparatus, the method comprising using one or more computers to perform operations comprising:

identifying a first language and a second language;

receiving a chatspeak audible message in the first language from a first person at a first chat client system who communicates in the first language;

converting the chatspeak audible message to a chatspeak text message in the first language;

transforming the chatspeak text message to a plain speak text message in the first language;

translating the plain speak text message to a corresponding plain speak text message in the second language;

transforming the corresponding plain speak text message to a corresponding chatspeak text message in the second language;

converting the corresponding chatspeak text message to a corresponding chatspeak audible message in the second language;

sending the corresponding chatspeak audible message to a second person at a second chat client system who communicates in the second language; and

receiving user feedback from a computing device of a user regarding an accuracy of at least one of the corresponding chatspeak text message and the corresponding chatspeak audible message.

2. The method of claim 1, wherein converting the chatspeak audible message to a chatspeak text message in the first language comprises providing the chatspeak audible message to a speech recognition system.

3. The method of claim 1, wherein transforming the chatspeak text message comprises:

identifying a chatspeak word or phrase in the chatspeak text message; and

replacing the chatspeak word or phrase with a non-chatspeak word or phrase.

4. The method of claim 2, wherein converting the corresponding chatspeak text message to a corresponding chatspeak audible message in the second language comprises providing the corresponding chatspeak text message to a text-to-speech system.

5. The method of claim 4, wherein at least one of the speech recognition system and the text-to-speech system utilizes data comprising a plurality of accents and dialects for each of the first and second languages.

6. The method of claim 5, wherein the data comprises chatspeak and plain speak formats for each of the first and second languages.

7. The method of claim 1, the operations further comprising offering an incentive to the user for providing the feedback.

8. The method of claim 7, wherein the incentive comprises at least one of a virtual good and a virtual currency, for use in an online game.

9. The method of claim 1, the operations further comprising processing the feedback to improve accuracy of at least one of a speech recognition system, a text-to-speech system, a text transformation system, and a text translation system.

10. The method of claim 1, wherein (a) transforming the chatspeak text message comprises utilizing a plurality of different transformation modules comprising a first transformation module and a second transformation module, (b) output from the first transformation module is used as input to the second transformation module, and (c) the different transformation modules comprise at least one of:

(i) a chatspeak module for identifying a chatspeak word or phrase in the initial message, and replacing the chatspeak word or phrase with a non-chatspeak word or phrase;

(ii) a spelling check module for performing a spelling check on the initial message;

(iii) an abbreviation module for identifying an abbreviation in the initial message, and replacing the abbreviation with a word or a phrase corresponding to the abbreviation;

(iv) an acronym module for identifying an acronym in the initial message, and replacing the acronym with a word or a phrase corresponding to the acronym;

(v) a colloquialism module for identifying a colloquial word or phrase in the initial message, and replacing the colloquial word or phrase with a word or a phrase representing the colloquial word or phrase; and

(vi) a profanity module for identifying a profane word or phrase in the initial message, and replacing the profane word or phrase with a non-profane word or phrase or removing the profane word or phrase.

11. A system comprising:

a computer readable medium having instructions stored thereon; and

a data processing apparatus configured to execute the instructions to perform operations comprising;

identifying a first language and a second language;

receiving a chatspeak audible message in the first language from a first person at a first chat client system who communicates in the first language;

converting the chatspeak audible message to a chatspeak text message in the first language;

transforming the chatspeak text message to a plain speak text message in the first language;

translating the plain speak text message to a corresponding plain speak text message in the second language;

transforming the corresponding plain speak text message to a corresponding chatspeak text message in the second language;

converting the corresponding chatspeak text message to a corresponding chatspeak audible message in the second language;

sending the corresponding chatspeak audible message to a second person at a second chat client system who communicates in the second language; and

receiving user feedback from a computing device of a user regarding an accuracy of at least one of the corresponding chatspeak text message and the corresponding chatspeak audible message.

12. The system of claim 11, wherein converting the chatspeak audible message to a chatspeak text message in the first language comprises providing the chatspeak audible message to a speech recognition system.

13. The system of claim 11, wherein transforming the chatspeak text message comprises:

identifying a chatspeak word or phrase in the chatspeak text message; and

replacing the chatspeak word or phrase with a non-chatspeak word or phrase.

14. The system of claim 12, wherein converting the corresponding chatspeak text message to a corresponding chatspeak audible message in the second language comprises providing the corresponding chatspeak text message to a text-to-speech system.

15. The system of claim 14, wherein at least one of the speech recognition system and the text-to-speech system utilizes data comprising a plurality of accents and dialects for each of the first and second languages.

16. The system of claim 15, wherein the data comprises chatspeak and plain speak formats for each of the first and second languages.

17. The system of claim 11, the operations further comprising offering an incentive to the user for providing the feedback.

18. The system of claim 17, wherein the incentive comprises at least one of a virtual good and a virtual currency, for use in an online game.

19. The system of claim 11, the operations further comprising processing the feedback to improve accuracy of at least one of a speech recognition system, a text-to-speech system, a text transformation system, and a text translation system.

20. The system of claim 11, wherein (a) transforming the chatspeak text message comprises utilizing a plurality of different transformation modules comprising a first transformation module and a second transformation module, (b) output from the first transformation module is used as input to the second transformation module, and (c) the different transformation modules comprise at least one of:

(i) a chatspeak module for identifying a chatspeak word or phrase in the initial message, and replacing the chatspeak word or phrase with a non-chatspeak word or phrase;

(ii) a spelling check module for performing a spelling check on the initial message;

(iii) an abbreviation module for identifying an abbreviation in the initial message, and replacing the abbreviation with a word or a phrase corresponding to the abbreviation;

(iv) an acronym module for identifying an acronym in the initial message, and replacing the acronym with a word or a phrase corresponding to the acronym;

(v) a colloquialism module for identifying a colloquial word or phrase in the initial message, and replacing the colloquial word or phrase with a word or a phrase representing the colloquial word or phrase; and

(vi) a profanity module for identifying a profane word or phrase in the initial message, and replacing the profane word or phrase with a non-profane word or phrase or removing the profane word or phrase.

21. A computer program product stored in one or more storage media for controlling a processing mode of a data processing apparatus, the computer program product being executable by the data processing apparatus to cause the data processing apparatus to perform operations comprising:

identifying a first language and a second language;

receiving a chatspeak audible message in the first language from a first person at a first chat client system who communicates in the first language;

converting the chatspeak audible message to a chatspeak text message in the first language;

transforming the chatspeak text message to a plain speak text message in the first language;

translating the plain speak text message to a corresponding plain speak text message in the second language;

transforming the corresponding plain speak text message to a corresponding chatspeak text message in the second language;

converting the corresponding chatspeak text message to a corresponding chatspeak audible message in the second language;

sending the corresponding chatspeak audible message to a second person at a second chat client system who communicates in the second language; and

receiving user feedback from a computing device of a user regarding an accuracy of at least one of the corresponding chatspeak text message and the corresponding chatspeak audible message.

22. The computer program product of claim 21, wherein converting the chatspeak audible message to a chatspeak text message in the first language comprises providing the chatspeak audible message to a speech recognition system.

23. The computer program product of claim 21, wherein transforming the chatspeak text message comprises:

identifying a chatspeak word or phrase in the chatspeak text message; and

replacing the chatspeak word or phrase with a non-chatspeak word or phrase.

24. The computer program product of claim 22, wherein converting the corresponding chatspeak text message to a corresponding chatspeak audible message in the second language comprises providing the corresponding chatspeak text message to a text-to-speech system.

25. The computer program product of claim 24, wherein at least one of the speech recognition system and the text-to-speech system utilizes data comprising a plurality of accents and dialects for each of the first and second languages.

26. The computer program product of claim 25, wherein the data comprises chatspeak and plain speak formats for each of the first and second languages.

27. The computer program product of claim 21, the operations further comprising offering an incentive to the user for providing the feedback.

28. The computer program product of claim 27, wherein the incentive comprises at least one of a virtual good and a virtual currency, for use in an online game.

29. The computer program product of claim 21, the operations further comprising processing the feedback to improve accuracy of at least one of a speech recognition system, a text-to-speech system, a text transformation system, and a text translation system.

30. The computer program product of claim 21, wherein (a) transforming the chatspeak text message comprises utilizing a plurality of different transformation modules comprising a first transformation module and a second transformation module, (b) output from the first transformation module is used as input to the second transformation module, and (c) the different transformation modules comprise at least one of:

(i) a chatspeak module for identifying a chatspeak word or phrase in the initial message, and replacing the chatspeak word or phrase with a non-chatspeak word or phrase;

(ii) a spelling check module for performing a spelling check on the initial message;

(iii) an abbreviation module for identifying an abbreviation in the initial message, and replacing the abbreviation with a word or a phrase corresponding to the abbreviation;

(iv) an acronym module for identifying an acronym in the initial message, and replacing the acronym with a word or a phrase corresponding to the acronym;

(v) a colloquialism module for identifying a colloquial word or phrase in the initial message, and replacing the colloquial word or phrase with a word or a phrase representing the colloquial word or phrase; and

(vi) a profanity module for identifying a profane word or phrase in the initial message, and replacing the profane word or phrase with a non-profane word or phrase or removing the profane word or phrase.