Wearable emotion detection and feedback system
First Claim
1. A see through head mounted display apparatus, comprising:
- a see-through, head mounted display;
a plurality of sensors cooperating with the display to detect audible and visual behaviors of a subject in a field of view of the apparatus; and
one or more processing devices in communication with display and the sensors, the one or more processing devices;
automatically monitor the audible and visual behaviors of the subject by receiving data from the sensors;
receive supplemental data relating to an emotional state of the subject from a second see-through, head mounted display also monitoring audible and visual behaviors of the subject;
compute an emotional state of the subject based on the audible and visual behaviors monitored by see-through, head mounted display device and the supplemental data received from the second see-through, head mounted display; and
provide feedback to the display indicating computed emotional states of the subject.
2 Assignments
0 Petitions
Accused Products
Abstract
A see-through, head mounted display and sensing devices cooperating with the display detect audible and visual behaviors of a subject in a field of view of the device. A processing device communicating with display and the sensors monitors audible and visual behaviors of the subject by receiving data from the sensors. Emotional states are computed based on the behaviors and feedback provided to the wearer indicating computed emotional states of the subject. During interactions, the device, recognizes emotional states in subjects by comparing detected sensor input against a database of human/primate gestures/expressions, posture, and speech. Feedback is provided to the wearer after interpretation of the sensor input.
-
Citations
18 Claims
-
1. A see through head mounted display apparatus, comprising:
-
a see-through, head mounted display; a plurality of sensors cooperating with the display to detect audible and visual behaviors of a subject in a field of view of the apparatus; and one or more processing devices in communication with display and the sensors, the one or more processing devices; automatically monitor the audible and visual behaviors of the subject by receiving data from the sensors; receive supplemental data relating to an emotional state of the subject from a second see-through, head mounted display also monitoring audible and visual behaviors of the subject; compute an emotional state of the subject based on the audible and visual behaviors monitored by see-through, head mounted display device and the supplemental data received from the second see-through, head mounted display; and provide feedback to the display indicating computed emotional states of the subject. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A computer storage device including instructions operable on a processing device to perform a method comprising the steps of:
-
receiving input from a plurality of sensors mounted on a see through head mounted display device, the sensors operable to detect audible and visual actions of one or more subjects in a field of view of the see through head mounted display device; computing an emotional state of the subject based on the audible and visual actions, the computing including determining for each of the one or more subjects whether the one or more subjects is a known subject having historical emotional state data and if so, computing the emotional state based on the historical emotional state data and if not, computing the emotional state data based on unknown subject data, wherein the historical emotional state data comprises emotional state data captured at an earlier time and stored for later use; and providing feedback to a wearer indicating computed emotional states of the subject. - View Dependent Claims (11, 12, 13, 14)
-
-
15. A method for providing emotional state feedback of subjects in a field of view of a see through head mounted display system, comprising:
-
determining an environment and orientation of the system, the system includes a plurality of sensors and a see-through display; identifying a crowd of subjects in the field of view; receiving input from the plurality of sensors mounted on the see through head mounted display device; recognizing actions of the crowd of subjects comprising any of two or more of a posture, expression, gesture, audible expression and word in the input for the subjects in the crowd of subject from the sensors and comparing recognized actions a set of emotional states determined based on recognized actions performed in combination with each other; computing an emotional state for the crowd of subjects as a whole based on the recognized actions; and providing feedback to the wearer indicating emotional state of the crowd of subjects. - View Dependent Claims (16, 17, 18)
-
Specification