Emotive engine and method for generating a simulated emotion for an information system

• US 8,812,171 B2
• Filed: 11/05/2008
• Issued: 08/19/2014
• Est. Priority Date: 04/26/2007
• Status: Active Grant

• Current Assignee: Ford Global Technologies, LLC (Ford Motor Company)
• Original Assignee: Ford Global Technologies, LLC (Ford Motor Company)
• Inventors: Filev, Dimitar Petrov, Gusikhin, Oleg Yurievitch, Syed, Fazal Urrahman, Klampfl, Erica, Giuli, Thomas J., Chen, Yifan
• Primary Examiner(s): Tarcza, Thomas
• Assistant Examiner(s): MUSTAFA, IMRAN K
• Application Number:
  US12/265,332
• Publication Number:
  US 20090055190A1
• Time in Patent Office: 2,113 Days
• Field of Search: 701/1, 704/270
• US Class Current: 701/1
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/18 for vehicle drivers or machine operators
• CPC Class Codes: A61B 5/4803 Speech analysis specially adapted for diagnostic purposes
• CPC Class Codes: A61B 5/7264 Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems neural networks per se G06N3/00; expert systems per se G06N5/00
• CPC Class Codes: A61B 5/744 Displaying an avatar, e.g. an animated cartoon character
• CPC Class Codes: B60W 2040/089 Driver voice
• CPC Class Codes: B60W 50/10 Interpretation of driver requests or demands
• CPC Class Codes: G01C 21/3608 using speech input, e.g. using speech recognition
• CPC Class Codes: G06F 2203/011 Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06N 3/006 based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
• CPC Class Codes: G06T 13/205 driven by audio data
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G10L 17/26 Recognition of special voice characteristics, e.g. for use in lie detectors; Recognition of animal voices

Abstract

Information about a device may be emotively conveyed to a user of the device. Input indicative of an operating state of the device may be received. The input may be transformed into data representing a simulated emotional state. Data representing an avatar that expresses the simulated emotional state may be generated and displayed. A query from the user regarding the simulated emotional state expressed by the avatar may be received. The query may be responded to.

Claims

1. A method of generating a simulated emotion for a vehicle information system, the method comprising:

receiving input representing at least one of audio and visual characteristics of a user;

generating, by a computer, data representing an emotional state of the user based on the input representing the at least one of audio and visual characteristics of the user;

receiving input representing an operating parameter of the vehicle;

generating, by the computer, data representing a simulated emotion to be expressed by at least one of an audio output and visual output based on the data representing the emotional state of the user and the input representing the operating parameter of the vehicle; and

outputting the data representing the simulated emotion for at least one of play by the audio output and display by the visual output

wherein generating data representing an emotional state of the user based on the input representing the at least one of audio and visual characteristics of the user includes analyzing at least one of a prosody, syntax and lexicon associated with the input representing the audio characteristics of the user.

2. The method of claim 1 further comprising receiving input representing a parameter indicative of a quality with which an agent is performing a task or function.

3. The method of claim 2 wherein the data representing the simulated emotion is further based on the input representing the parameter indicative of the quality with which the agent is performing the task or function.

4. The method of claim 1 further comprising generating data representing a query to the user regarding the user'"'"'s emotional state.

5. The method of claim 4 further comprising receiving input representing a response to the query and selecting which of the prosody, syntax and lexicon associated with the input representing the audio characteristics of the user to analyze based on the response to the query.

6. A method for generating a simulated emotion for a vehicle information system, the method comprising:

receiving, by a computer, input representing a spoken phrase from the user;

analyzing, by the computer, at least one of a prosody, syntax and lexicon associated with the input representing the spoken phrase to generate data representing an emotional state of the user;

generating data representing a query to the user regarding the user'"'"'s emotional state;

receiving input representing a response to the query;

selecting which of the prosody, syntax and lexicon associated with subsequently received input representing spoken phrases from the user to analyze based on the response to the query and the data representing the emotional state of the user to generate additional data representing the emotional state of the user;

receiving input representing at least one visual characteristic of the user;

receiving input representing an operating parameter of the vehicle;

applying at least one rule to at least one of the data representing the emotional state of the user, the input representing the at least one visual characteristic of the user and the input representing the operating parameter of the vehicle to identify data representing at least one simulated emotion to be expressed by an avatar; and

outputting the data representing the at least one identified simulated emotion for display by a visual output.

7. The method of claim 6 further comprising receiving input representing a command from the user specifying which of the data representing the emotional state of the user,

the input representing the at least one visual characteristic of the user and the input representing the operating parameter of the vehicle is to be used to identify the data representing the at least one simulated emotion to be expressed by the avatar.

8. The method of claim 6 further comprising determining which of the data representing the emotional state of the user, the input representing the at least one visual characteristic of the user and the input representing the operating parameter of the vehicle is to be used to identify the data representing the at least one simulated emotion to be expressed by the avatar.

9. The method of claim 8 wherein only the input representing the operating parameter of the vehicle is used to identify the data representing the at least one simulated emotion to be expressed by the avatar if the vehicle is moving.

10. The method of claim 8 wherein only the data representing the emotional state of the user is used to identify the data representing the at least one simulated emotion to be expressed by the avatar if the user is a passenger in the vehicle.