VISUALIZING PREDICTED AFFECTIVE STATES OVER TIME
First Claim
Patent Images
1. A method, comprising:
- receiving a plurality of data streams from a plurality of respective sensors, the plurality of data streams being indicative of at least one condition of a user;
computing values that are indicative of valence, arousal, and engagement of the user, respectively, for a window of time based at least in part upon the plurality of data streams, valence being indicative of an intrinsic feeling of positiveness or negativeness of the user during the window of time, arousal being indicative of an intensity of the feeling of the user during the window of time, and engagement being indicative of cognitive engagement of the user during the window of time;
repeating acts of receiving and computing for a plurality of different windows of time to compute pluralities of values that are indicative of valence, arousal, and engagement of the user for the plurality of different windows of time, respectively; and
rendering graphical objects on a display screen of a computing device that are indicative of the respective valence, arousal, and engagement of the user for the plurality of different windows of time.
2 Assignments
0 Petitions
Accused Products
Abstract
Described herein are various technologies pertaining to estimating affective states of a user by way of monitoring data streams output by sensors and user activity on a computing device. Models of valence, arousal, and engagement can be learned during a training phase, and such models can be employed to compute values that are indicative of valence, arousal, and engagement of a user in near-real time. A visualization that represents estimated affective states of a user over time is generated to facilitate user reflection.
-
Citations
20 Claims
-
1. A method, comprising:
-
receiving a plurality of data streams from a plurality of respective sensors, the plurality of data streams being indicative of at least one condition of a user; computing values that are indicative of valence, arousal, and engagement of the user, respectively, for a window of time based at least in part upon the plurality of data streams, valence being indicative of an intrinsic feeling of positiveness or negativeness of the user during the window of time, arousal being indicative of an intensity of the feeling of the user during the window of time, and engagement being indicative of cognitive engagement of the user during the window of time; repeating acts of receiving and computing for a plurality of different windows of time to compute pluralities of values that are indicative of valence, arousal, and engagement of the user for the plurality of different windows of time, respectively; and rendering graphical objects on a display screen of a computing device that are indicative of the respective valence, arousal, and engagement of the user for the plurality of different windows of time. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A system, comprising:
-
a receiver component that receives a plurality of data streams from a plurality of respective sensors, the plurality of sensors configured to generate data that is indicative of at least one condition of a user; an affect computer component that computes a value that is indicative of at least one affective state of the user based at least in part upon the plurality of data streams from the plurality of respective sensors, the at least one affective state being at least one of valence of the user, arousal of the user, or engagement of the user, the affect computer component computing values that are indicative of the at least one affective state of the user over a respective plurality of windows of time; and a visualizer component that renders a time-series visualization on a display screen of a computing device, the visualization representing the at least one affective state of the user over the plurality of windows of time. - View Dependent Claims (14, 15, 16, 17, 18, 19)
-
-
20. A computer-readable medium comprising instructions that, when executed by a processor, cause the processor to perform acts comprising:
-
receiving data from a plurality of sensors that is indicative of at least one condition of a user, the plurality of sensors comprising a camera and a depth sensor; computing a first value that is indicative of valence of the user based at least in part upon the data received from the plurality of sensors; computing a second value that is indicative of arousal of the user based at least in part upon the data received from the plurality of sensors; computing a third value that is indicative of engagement of the user based at least in part upon the data received from the plurality of sensors; repeating acts of receiving, computing the first value, computing the second value, and computing the third value a plurality of times to generate first values that are indicative of valence of the user over time, second values that are indicative of arousal of the user over time, and third values that are indicative of engagement of the user over time; and generating a visualization that graphically depicts valence of the user, arousal of the user, and engagement of the user over a time window at a time granularity selected by the user to facilitate user reflection of emotional state over the time window;
wherein the visualization comprises graphical objects that represent documents interacted with by the user during the time window.
-
Specification