System and method for intelligent language switching in automated text-to-speech systems

• US 10,388,269 B2
• Filed: 05/01/2017
• Issued: 08/20/2019
• Est. Priority Date: 09/10/2013
• Status: Active Grant

• Current Assignee: Hyundai Motor Company (Hyundai Motor Group), Kia Corp.
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Pulz, Gregory, Blanchard, Harry E., Zhang, Lan
• Primary Examiner(s): Spooner, Lamont M
• Application Number:
  US15/583,068
• Publication Number:
  US 20170236509A1
• Time in Patent Office: 841 Days
• Field of Search: 704 1- 10
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: G10L 13/047 Architecture of speech synthesisers
• CPC Class Codes: G10L 13/086 Detection of language

Abstract

Systems, methods, and computer-readable storage media for providing for intelligent switching of languages and/or pronunciations in a text-to-speech system. As the system receives text, the text is analyzed to identify portions which should have speech constructed using a pronunciation distinct from the remaining portions of the text. The text-to-speech system uses multiple pronunciation dictionaries to generate and produce speech corresponding to the text, where the identified portions of the text are in a different language or have a different accent from the remainder of the text. Having generated speech corresponding to the text in multiple languages, accents, or dialects, the system combines the portions, then communicates the speech to the text recipient.

Claims

1. A method comprising:

selecting, via a speech processing system, a first language for a first part of a text and a second language for a second part of the text;

generating, via the speech processing system and based on a first location of a device, first speech comprising a first portion corresponding to at least the first part of the text and a second portion corresponding to at least the second part of the text, the first portion in the first language and the second portion in the second language;

communicating the first speech to the device; and

when the device is at a second location;

generating, via the speech processing system, second speech from the text wherein the second speech comprises the first portion and the second portion both being in a same language; and

communicating the second speech to the device.

2. The method of claim 1, wherein the first language is a primary language of a recipient and the second language is selected based on an original pronunciation of the second part of the text.

3. The method of claim 2, wherein the first part of the text is an address number and the second part of the text is a street name.

4. The method of claim 1, wherein the first language and the second language correspond to distinct regional accents of a single language.

5. The method of claim 1, wherein one of the first language and the second language is selected based on one of an age, an ethnicity, and a language of a sender of the text.

6. The method of claim 1, further comprising:

receiving, from a recipient, input indicating a category corresponding to one of the first part of the text and the second part of the text.

7. The method of claim 1, wherein the generating of the first speech occurs on a mobile device.

8. The method of claim 1, further comprising identifying the first portion and the second portion using a first language pronunciation database corresponding to the first language and a second language pronunciation database corresponding to the second language.

9. The method of claim 1, wherein the first location differs from the second location.

10. A speech processing system comprising:

a processor; and

a computer-readable storage medium having instructions stored which, when executed by the processor, cause the processor to perform operations comprising;

selecting a first language for a first part of a text and a second language for a second part of the text;

generating, based on a first location of a device, first speech comprising a first portion corresponding to at least the first part of the text and a second portion corresponding to at least the second part of the text, the first portion in the first language and the second portion in the second language;

communicating the first speech to the device; and

when the device is at a second location;

generating second speech from the text wherein the second speech comprises the first portion and the second portion both being in a same language; and

communicating the second speech to the device.

11. The speech processing system of claim 10, wherein the first language is a primary language of a recipient, and the second language is selected based on an original pronunciation of the second part of the text.

12. The speech processing system of claim 11, wherein the first part of the text is an address number and the second part of the text is a street name.

13. The speech processing system of claim 10, wherein the first language and the second language correspond to distinct regional accents of a single language.

14. The speech processing system of claim 10, wherein one of the first language and the second language is selected based on one of an age, an ethnicity, and a language of a sender of the text.

15. The speech processing system of claim 10, wherein the computer-readable storage medium stores additional instructions which, when exceeded by the processor, cause the processor to perform operations further comprising:

receiving, from a recipient, input indicating a category corresponding to one of the first part of the text and the second part of the text.

16. The speech processing system of claim 10, wherein the generating of the first speech occurs on a mobile device.

17. The speech processing system of claim 10, wherein the computer-readable storage medium stores additional instructions which, when exceeded by the processor, cause the processor to perform operations further comprising:

identifying the first portion and the second portion using a first language pronunciation database corresponding to the first language and a second language pronunciation database corresponding to the second language.

18. The speech processing system of claim 10, wherein the first location differs from the second location.

19. A computer-readable storage device having instructions stored which, when executed by a speech processing system, cause the speech processing system to perform operations comprising:

selecting a first language for a first part of a text and a second language for a second part of the text;

generating, based on a first location of a device, first speech comprising a first portion corresponding to at least the first part of the text and a second portion corresponding to at least the second part of the text, the first portion in the first language and the second portion in the second language;

communicating the first speech to the device; and

when the device is at a second location;

generating second speech from the text wherein the second speech comprises the first portion and the second portion both being in a same language; and

communicating the second speech to the device.

20. The computer-readable storage device of claim 19, wherein the first language is a primary language of a recipient and the second language is selected based on an original pronunciation of the second part of the text.