User interface/entertainment device that simulates personal interaction and responds to user's mental state and/or personality
First Claim
Patent Images
1. A conversation simulator for simulating conversational interaction with a user, comprising:
- a controller programmed to receive user inputs including natural language declarations and mental state data of the user;
said controller being programmed to classify at least one of a mood and a personality of said user based on the mental state data to produce class data; and
said controller being programmed to simulate a conversational interaction with the user by generating responses to said natural language declarations based on the natural language declarations and said class data.
2 Assignments
0 Petitions
Accused Products
Abstract
An interaction simulator uses computer vision, and inputs of other modalities, to analyze the user'"'"'s mental state and/or personality. The mental state and/or personality are classified and this information used to guide conversation and other interaction. In a chatterbot embodiment, the substance of the conversation may be altered in response to the mental state and/or personality class, for example, by changing the topic of conversation to a favorite subject when the user is sad or by telling a joke when the user is in a good mood.
402 Citations
19 Claims
-
1. A conversation simulator for simulating conversational interaction with a user, comprising:
-
a controller programmed to receive user inputs including natural language declarations and mental state data of the user;
said controller being programmed to classify at least one of a mood and a personality of said user based on the mental state data to produce class data; and
said controller being programmed to simulate a conversational interaction with the user by generating responses to said natural language declarations based on the natural language declarations and said class data. - View Dependent Claims (2, 3, 4, 5, 6)
the controller is programmed to determine a content of said responses based on said class data.
-
-
6. A conversation simulator as in claim 1, wherein:
the controller is programmed to determine a subject of said responses based on said class data.
-
7. A method of generating a dialogue response in a conversation simulator, comprising the steps of:
-
receiving a natural language declaration from a user;
determining a mental state of said user;
determining a subject for a response to said natural language declaration based on the determined mental state of said user; and
generating the response based on the natural language declaration and the determined subject. - View Dependent Claims (8, 9, 10, 11, 12, 13, 14, 15)
classifying image data from a camera;
classifying audio data from an audio transducer; and
determining the mental state based on the classified image data and classified audio data.
-
-
12. A method as in claim 11, wherein said step of receiving includes inputting speech through the audio transducer.
-
13. A method as in claim 7, further comprising:
-
classifying image data from a camera; and
determining a physical location of said user based on the classified image data;
wherein the mental state is determined based on the determined physical location.
-
-
14. A method as in claim 7, further comprising:
-
classifying image data from a camera; and
determining an activity of said user based on the classified image data;
wherein the mental state is determined based on the determined activity.
-
-
15. A method as in claim 14, wherein:
the activity includes at least one of sitting, lying prone, standing and walking.
-
16. A method of generating a dialogue response in a conversation simulator, comprising the steps of:
-
receiving input from a user;
determining a content of said input;
determining a mental state of said user; and
generating a conditional response to said input to simulate a conversational interaction with the user based on the determined mental state of said user, and based on the determined content of said input. - View Dependent Claims (17, 18, 19)
-
Specification