TRANSLITERATION OF TEXT ENTRY ACROSS SCRIPTS

• US 20180173695A1
• Filed: 12/21/2016
• Published: 06/21/2018
• Est. Priority Date: 12/21/2016
• Status: Active Grant

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Inventors: Pino, Juan Miguel, Funiak, Stanislav, Malpani, Mridul, Lochan, Guarav
• Granted Patent: US 10,402,489 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/02 Input arrangements using manually operated switches, e.g. using keyboards or dials
• CPC Class Codes: G06F 40/129 Handling non-Latin characters, e.g. kana-to-kanji conversion
• CPC Class Codes: G06F 40/216 using statistical methods
• CPC Class Codes: G06F 40/284 Lexical analysis, e.g. tokenisation or collocates
• CPC Class Codes: G06F 40/44 Statistical methods, e.g. probability models
• CPC Class Codes: G06F 40/53 Processing of non-Latin text kana-to-kanji conversion G06F40/129; vowelisation G06F40/232

Abstract

Embodiments are disclosed for transliterating text entries across different script systems. A method according to some embodiments includes steps of: receiving an input string in a first script system input using a keyboard; segmenting, using a probabilistic model, the input string into phonemes that correspond to characters or sets of characters in a second script system; converting the phonemes in the first script system into the characters or sets of characters in the second script system, the characters or sets of characters forming a word or a word prefix in the second script system; and outputting the word or the word prefix in the second script system.

Claims

1. A method for transliterating text entries across different script systems, comprising:

receiving an input string in a first script system input using a keyboard;

segmenting, using a probabilistic model, the input string into phonemes that correspond to characters or sets of characters in a second script system;

converting the phonemes in the first script system into the characters or sets of characters in the second script system, the characters or sets of characters forming a word or a word prefix in the second script system; and

outputting the word or the word prefix in the second script system.

2. The method of claim 1, wherein the receiving comprises:

receiving an input string in a first script system input using a hardware or software keyboard for inputting characters in the first script system.

3. The method of claim 1, wherein the converting comprises:

converting the phonemes in the first script system that is a Latin script system into the characters or sets of characters in the second script system, the characters or sets of characters forming a word or a word prefix in the second script system that is a non-Latin script system.

4. The method of claim 1, the segmenting comprises:

modeling, using a segmentation likelihood module of a probabilistic model, a probability that a segmentation candidate is a valid segmentation of the input string; and

segmenting, using the probabilistic model, the input string into phonemes that correspond to characters or sets of characters in a second script system based on the segmentation candidate.

5. The method of claim 1, further comprising:

identifying segmentation candidates of the input string, the segmentation candidates dividing the input string into phonemes; and

selecting a segmentation from the segmentation candidates using the probabilistic model.

6. The method of claim 5, wherein the identifying comprises:

modeling the segmentation candidates using a prefix tree, nodes of the prefix tree corresponding to possible phonemes extracted from the input string;

wherein nodes of a first level of the prefix tree correspond to possible first phonemes of the input string, and nodes of lower levels of the prefix tree correspond to possible phonemes that follow the possible first phonemes in the input string.

7. The method of claim 6, wherein a branch from a root to a leaf of the prefix tree corresponds to a segmentation candidate of the input string.

8. The method of claim 6, further comprising:

abandoning a branch of the prefix tree for computational efficiency, or merging nodes of the prefix tree that correspond to the same phoneme for computational or memory efficiency.

9. The method of claim 1, wherein the segmenting comprises:

modeling, using a prior probability distribution module of a probabilistic model, a probability of a word or a word prefix in the second script system showing up in priori texts written in the second script system; and

segmenting, using the probabilistic model, the input string into phonemes that correspond to characters or sets of characters in a second script system based on the modeled probability of the word of the word prefix in the second script system;

10. The method of claim 9, wherein the modeling a probability of a word or a word prefix in the second script system comprises:

generating a multiplication product of probabilities of characters of the word or the word prefix showing up in the priori texts written in the second script system.

11. The method of claim 9, wherein the modeling a probability of a word or a word prefix in the second script system comprises:

determining the probability of the word or the word prefix by a stochastic chain formed by characters of the word or the word prefix.

12. The method of claim 9, wherein the modeling a probability of a word or a word prefix in the second script system comprises:

determining the probability of the word or the word prefix by a lookup table or incrementally in a tree data structure.

13. The method of claim 9, further comprising:

including an additional multiplicative factor in the probabilistic model such that the probabilistic model prefer longer segmentations of simpler phonemes over shorter segmentations of more complicated phonemes.

14. The method of claim 1, the segmenting comprises:

modeling, using a decoding observation module of a probabilistic model, a probability of a phoneme in the first transcript system being transliterated into a character or a set of characters in the second transcript system; and

segmenting, using the probabilistic model, the input string into phonemes that correspond to characters or sets of characters in a second script system based on the modeled probability of the phoneme being transliterated into the character or the set of characters.

15. A non-transitory machine-readable storage medium comprising a program containing a set of instructions for causing a machine to execute procedures for transliterating text entries across different script systems, the procedures comprising:

receiving an input string in a first script system input using a keyboard;

segmenting, using a probabilistic model, the input string into phonemes that correspond to characters or sets of characters in a second script system;

converting the phonemes in the first script system into the characters or sets of characters in the second script system, the characters or sets of characters forming a word or a word prefix in the second script system; and

outputting the word or the word prefix in the second script system.

16. The storage medium of claim 15, wherein the procedures further comprise:

receiving a signal indicating that a cursor is moving back to correct the word or the word prefix; and

in response to the signal, replacing an output of the word or the word prefix in the second script system with an output of the input string in the first script system.

17. The storage medium of claim 16, wherein the procedures further comprise:

receiving an input to correct or append an additional string to the input string that has been previously entered to form a new input string;

segmenting, using the probabilistic model, the new input string into phonemes that correspond to characters or sets of characters in the second script system;

converting the phonemes in the first script system into the characters or sets of characters in the second script system, the characters or sets of characters forming a new word or a new word prefix in the second script system; and

outputting the new word or the new word prefix in the second script system.

18. The storage medium of claim 15, wherein the procedures further comprise:

presenting one or more transliteration candidates in the second script system;

receiving a signal indicating that one of the transliteration candidates is selected;

outputting the selected transliteration candidate in the second script system; and

recording the selection and increasing a probability associated with the selected transliteration candidate in the probabilistic model.

19. The storage medium of claim 15, wherein the procedures further comprise:

presenting an associated word or an associated suffix following the word or the word prefix being outputted, wherein the associated word or the associated suffix is predicted based on the word or the word prefix.

20. A computing device, comprising:

a keyboard component configured to enter an input string in a source script system;

a probabilistic model configured to;

receive the input string;

segment the input string into phonemes that correspond to characters or sets of characters in a second script system;

convert the phonemes in the first script system into the characters or sets of characters in the second script system, the characters or sets of characters forming a word or a word prefix in the second script system; and

an output component configured to output the word or the word prefix in the second script system.