VIDEO INDEXING BASED ON VIEWERS' BEHAVIOR AND EMOTION FEEDBACK
First Claim
1. A method for video indexing based on viewers'"'"' behavior and emotion feedback, comprising:
- monitoring one or more viewers during a multimedia sequence play back;
detecting the one or more viewers'"'"' behavior and emotion feedback;
categorizing the one or more viewers'"'"' behavior and emotion feedback as a plurality of categories of behavior and emotion segments; and
indexing the multimedia sequence using the plurality of categories of behavior and emotion segments, wherein a user can selectively view the multimedia sequence using the plurality of categories of behavior and emotion segments as video indices.
2 Assignments
0 Petitions
Accused Products
Abstract
A method and a corresponding apparatus for video indexing based on viewers'"'"' behavior and emotion feedback automatically index a multimedia sequence using viewers'"'"' casual feedback while watching the multimedia sequence. The method and apparatus use a system, such as an emotion detection system that includes one or more multimedia acquisition devices, such as video cameras, to detect viewers'"'"' behavior and emotion feedback, and to produce as video indices various categories of behavior and emotion segments. Each video camera may include one or more image sensors and/or audio sensors. The viewers or other users, i.e., user, may later selectively view the multimedia sequence by browsing through the video indices of various categories of emotion. The video indices are similar to chapters within digital video disc (DVD) movies that enable a user to jump directly to a particular chapter without having to fast forward.
-
Citations
20 Claims
-
1. A method for video indexing based on viewers'"'"' behavior and emotion feedback, comprising:
-
monitoring one or more viewers during a multimedia sequence play back;
detecting the one or more viewers'"'"' behavior and emotion feedback;
categorizing the one or more viewers'"'"' behavior and emotion feedback as a plurality of categories of behavior and emotion segments; and
indexing the multimedia sequence using the plurality of categories of behavior and emotion segments, wherein a user can selectively view the multimedia sequence using the plurality of categories of behavior and emotion segments as video indices. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. An apparatus for video indexing based on viewers'"'"' behavior and emotion feedback, comprising:
-
one or more multimedia acquisition devices capable of monitoring one or more viewers during a multimedia sequence play back, wherein each multimedia acquisition device includes one or more sensors for detecting the one or more viewers'"'"' behavior and emotion feedback; and
a computer capable of categorizing the one or more viewers'"'"' behavior and emotion feedback as a plurality of categories of behavior and emotion segments, and indexing the multimedia sequence using the plurality of categories of behavior and emotion segments, wherein a user can selectively view the multimedia sequence using the plurality of categories of behavior and emotion segments as video indices. - View Dependent Claims (13, 14, 15, 16)
-
-
17. A computer readable medium providing instructions for video indexing based on viewers'"'"' behavior and emotion feedback, the instructions comprising:
-
monitoring one or more viewers during a multimedia sequence play back;
detecting the one or more viewers'"'"' behavior and emotion feedback;
categorizing the one or more viewers'"'"' behavior and emotion feedback as a plurality of categories of behavior and emotion segments; and
indexing the multimedia sequence using the plurality of categories of behavior and emotion segments, wherein a user can selectively view the multimedia sequence using the plurality of categories of behavior and emotion segments as video indices. - View Dependent Claims (18, 19, 20)
-
Specification