Emotive text-to-speech system and method

• US 9,495,787 B2
• Filed: 11/05/2008
• Issued: 11/15/2016
• Est. Priority Date: 04/26/2007
• Status: Active Grant

• Current Assignee: Ford Global Technologies, LLC (Ford Motor Company)
• Original Assignee: Ford Global Technologies, LLC (Ford Motor Company)
• Inventors: Gusikhin, Oleg Yurievitch, MacNeille, Perry Robinson, Klampfl, Erica, Theisen, Kacie Alane, Filev, Dimitar Petrov, Chen, Yifan, Tonshal, Basavaraj
• Primary Examiner(s): MUSTAFA, IMRAN K
• Application Number:
  US12/265,359
• Publication Number:
  US 20090063154A1
• Time in Patent Office: 2,932 Days
• Field of Search: 701/1
• US Class Current: 1/1
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/18 for vehicle drivers or machine operators
• CPC Class Codes: A61B 5/4803 Speech analysis specially adapted for diagnostic purposes
• CPC Class Codes: A61B 5/7264 Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems neural networks per se G06N3/00; expert systems per se G06N5/00
• CPC Class Codes: A61B 5/744 Displaying an avatar, e.g. an animated cartoon character
• CPC Class Codes: B60W 2040/089 Driver voice
• CPC Class Codes: B60W 50/10 Interpretation of driver requests or demands
• CPC Class Codes: G01C 21/3608 using speech input, e.g. using speech recognition
• CPC Class Codes: G06F 2203/011 Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06N 3/006 based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
• CPC Class Codes: G06T 13/205 driven by audio data
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G10L 17/26 Recognition of special voice characteristics, e.g. for use in lie detectors; Recognition of animal voices

Abstract

Information about a device may be emotively conveyed to a user of the device. Input indicative of an operating state of the device may be received. The input may be transformed into data representing a simulated emotional state. Data representing an avatar that expresses the simulated emotional state may be generated and displayed. A query from the user regarding the simulated emotional state expressed by the avatar may be received. The query may be responded to.

Claims

1. An emotive text-to-speech system comprising:

a computer configured to

receive data representing a text stream and a simulated emotion to be expressed by an audio output;

selectively embed at least a portion of the data representing the simulated emotion in the data representing the text stream to form data representing an emotive text stream representing a spoken phrase having simulated emotional content; and

output the emotive text stream data for play by the audio output.

2. The system of claim 1 wherein the computer is further configured to parse the data representing the text stream into data representing parsed words.

3. The system of claim 2 wherein the computer is further configured to determine which of the data representing the parsed words are data representing emotive words.

4. The system of claim 3 wherein determining which of the data representing the parsed words are data representing emotive words includes comparing the data representing each of the parsed words with data representing a predetermined set of emotive words.

5. The system of claim 4 wherein the data representing each of the predetermined set of emotive words is linked with data representing at least one emotion.