Emotion, mood and personality inference in real-time environments
First Claim
1. A method comprising:
- automatically monitoring communications using a specialized language processor, said communications comprising computerized text forming a conversation conducted between at least two conversation partners, said conversation partners comprising an agent using a specialized language processor and a user, said conversation comprising multiple turns of text utterances exchanged between said conversation partners relating to a specific issue;
automatically analyzing said communications using said specialized language processor to simultaneously determine, for said conversation, mental state variables of said user, said mental state variables comprising;
an emotion of said user;
a mood of said user; and
a personality of said user; and
automatically aggregating said emotion, said mood, and said personality using a hierarchical probabilistic graphical model that determines a highest probability path through a directed probabilistic graph to infer said mental state of said user, using said specialized language processor, said directed probabilistic graph comprising a single personality node that maintains a single unchanging state, multiple mood nodes, multiple emotion nodes, and multiple evidence nodes, and each of said mood nodes, said emotion nodes, and said evidence nodes being for a different time portion of said conversation;
automatically and constantly updating said mental state of said user output from said specialized language processor during said conversation by maintaining, in said directed probabilistic graph, a single unchanging state for said personality for all of said conversation, and maintaining multiple changing states for said emotion and said mood as said conversation progresses to track said mental state of said user during said conversation;
automatically and constantly updating said mental state of said user output from said specialized language processor as said specialized language processor tracks said mental state of said user during said conversation; and
automatically and constantly displaying said mental state to said agent through a graphic user interface as said mental state is constantly updated during said conversation.
6 Assignments
0 Petitions
Accused Products
Abstract
Methods and systems monitor communications between users and analyze the communications to simultaneously determine, for a current time period, mental state variables of one of the users. Such mental state variables include the emotion of the user, the mood of the user, and the personality of the user. Additionally, such methods aggregate the emotion, the mood, and the personality using a hierarchical probabilistic graphical model that determines the highest probability path through a directed probabilistic graph to infer the mental state of the user. The directed probabilistic graph maintains a single state for the personality for the time period, and maintains multiple states for the emotion and the mood for the time period. These methods and systems output the mental state of the user.
20 Citations
18 Claims
-
1. A method comprising:
-
automatically monitoring communications using a specialized language processor, said communications comprising computerized text forming a conversation conducted between at least two conversation partners, said conversation partners comprising an agent using a specialized language processor and a user, said conversation comprising multiple turns of text utterances exchanged between said conversation partners relating to a specific issue; automatically analyzing said communications using said specialized language processor to simultaneously determine, for said conversation, mental state variables of said user, said mental state variables comprising; an emotion of said user; a mood of said user; and a personality of said user; and automatically aggregating said emotion, said mood, and said personality using a hierarchical probabilistic graphical model that determines a highest probability path through a directed probabilistic graph to infer said mental state of said user, using said specialized language processor, said directed probabilistic graph comprising a single personality node that maintains a single unchanging state, multiple mood nodes, multiple emotion nodes, and multiple evidence nodes, and each of said mood nodes, said emotion nodes, and said evidence nodes being for a different time portion of said conversation; automatically and constantly updating said mental state of said user output from said specialized language processor during said conversation by maintaining, in said directed probabilistic graph, a single unchanging state for said personality for all of said conversation, and maintaining multiple changing states for said emotion and said mood as said conversation progresses to track said mental state of said user during said conversation; automatically and constantly updating said mental state of said user output from said specialized language processor as said specialized language processor tracks said mental state of said user during said conversation; and automatically and constantly displaying said mental state to said agent through a graphic user interface as said mental state is constantly updated during said conversation. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A method comprising:
-
automatically monitoring communications using a specialized language processor, said communications comprising computerized text forming a conversation conducted between at least two conversation partners, said conversation partners comprising an agent using a specialized language processor and a user, said conversation comprising multiple turns of text utterances exchanged between said conversation partners relating to a specific issue; automatically analyzing said text utterances using said specialized language processor to simultaneously determine, for said conversation, mental state variables of said user, said mental state variables comprising; an emotion of said user; a mood of said user; and a personality of said user; and automatically aggregating said emotion, said mood, and said personality using a hierarchical probabilistic graphical model that determines a highest probability path through a directed probabilistic graph to infer said mental state of said user, using said specialized language processor, said directed probabilistic graph comprising a single personality node that maintains a single unchanging state, multiple mood nodes, multiple emotion nodes, and multiple evidence nodes, and each of said mood nodes, said emotion nodes, and said evidence nodes being for a different time portion of said conversation; and automatically and constantly updating said mental state of said user output from said specialized language processor during said conversation by maintaining, in said directed probabilistic graph, a single unchanging state for said personality for all of said conversation, and maintaining multiple changing states for said emotion and said mood as said conversation progresses to track said mental state of said user during said conversation; and automatically and constantly updating said mental state of said user through said graphic user interface as said specialized language processor tracks said mental state of said user during said conversation; and automatically and constantly displaying said mental state to said agent through a graphic user interface as said mental state is constantly updated during said conversation by displaying said emotion, said mood, and said personality on said graphic user interface. - View Dependent Claims (8, 9, 10, 11, 12)
-
-
13. A system comprising:
-
a specialized language processor; and a graphic user interface operatively connected to said specialized language processor, said specialized language processor automatically monitoring communications, said communications comprising computerized text forming a conversation conducted between at least two conversation partners, said conversation partners comprising an agent using a specialized language processor and a user, said conversation comprising multiple turns of text utterances exchanged between said conversation partners relating to a specific issue; said specialized language processor automatically analyzing said communications to simultaneously determine, for said conversation, mental state variables of said user, said mental state variables comprising; an emotion of said user; a mood of said user; and a personality of said user; and said specialized language processor automatically aggregating said emotion, said mood, and said personality using a hierarchical probabilistic graphical model that determines a highest probability path through a directed probabilistic graph to infer said mental state of said user, said directed probabilistic graph comprising a single personality node that maintains a single unchanging state, multiple mood nodes, multiple emotion nodes, and multiple evidence nodes, each of said mood nodes, said emotion nodes, and said evidence nodes being for a different time portion of said conversation, said specialized language processor automatically and constantly updating said mental state of said user during said conversation by maintaining, in said directed probabilistic graph, a single unchanging state for said personality for all of said conversation, and maintaining multiple changing states for said emotion and said mood as said conversation progresses to track said mental state of said user during said conversation, said specialized language processor automatically and constantly updating said mental state of said user as said specialized language processor tracks said mental state of said user during said conversation, and said graphic user interface automatically and constantly displaying said mental state to said agent as said mental state is constantly updated during said conversation by displaying said emotion, said mood, and said personality. - View Dependent Claims (14, 15, 16, 17, 18)
-
Specification