CONTENT CATEGORIZATION USING FACIAL EXPRESSION RECOGNITION, WITH IMPROVED DETECTION OF MOMENTS OF INTEREST
First Claim
Patent Images
1. A method of content categorization comprising acts of:
- rendering content within graphical user interfaces to a plurality of viewers ;
receiving multiple signals related to feedbacks from the plurality of viewers relatively to the rendered content; and
tallying the multiple received signals from the plurality of viewers to categorize the content, wherein;
the content is fragmented into a plurality of fragments having a predetermined duration,each signal comprises data of a facial expression recognition of each viewer, to sense a mood expression of the viewer during the content rendering,a memory is provided for storing at least timestamps associated to fragments for which an intensity of the sensed mood expression of a viewer is above a first threshold, anda processing circuit is further provided for implementing tallying acts of;
For all the viewers and for each given timestamp, using the memory for counting a first number of viewers for which the intensity is above the first threshold during the fragment corresponding to the given timestamp, andWhen the first number is above a second threshold, labelling the fragment corresponding to the given timestamp as a moment of interest of the content.
1 Assignment
0 Petitions
Accused Products
Abstract
The invention relates to content categorization and a method to that end comprises acts of:
- rendering content within graphical user interfaces to a plurality of viewers;
- receiving multiple signals related to feedbacks from the plurality of viewers relatively to the rendered content; and
- tallying the multiple received signals from the plurality of viewers to categorize the content.
More particularly:
- the content is fragmented into a plurality of fragments having a predetermined duration,
- each signal comprises data of a facial expression recognition of each viewer, to sense a mood expression of the viewer during the content rendering,
- a memory is provided for storing at least timestamps associated to fragments for which an intensity of the sensed mood expression of a viewer is above a first threshold, and
- a processing circuit is further provided for implementing tallying acts of:
- For all the viewers and for each given timestamp, using the memory for counting a first number of viewers for which the intensity is above the first threshold during the fragment corresponding to the given timestamp, and
- When the first number is above a second threshold, labelling the fragment corresponding to the given timestamp as a moment of interest of the content.
-
Citations
13 Claims
-
1. A method of content categorization comprising acts of:
-
rendering content within graphical user interfaces to a plurality of viewers ; receiving multiple signals related to feedbacks from the plurality of viewers relatively to the rendered content; and tallying the multiple received signals from the plurality of viewers to categorize the content, wherein; the content is fragmented into a plurality of fragments having a predetermined duration, each signal comprises data of a facial expression recognition of each viewer, to sense a mood expression of the viewer during the content rendering, a memory is provided for storing at least timestamps associated to fragments for which an intensity of the sensed mood expression of a viewer is above a first threshold, and a processing circuit is further provided for implementing tallying acts of; For all the viewers and for each given timestamp, using the memory for counting a first number of viewers for which the intensity is above the first threshold during the fragment corresponding to the given timestamp, and When the first number is above a second threshold, labelling the fragment corresponding to the given timestamp as a moment of interest of the content. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 13)
-
-
11. A content categorization system, comprising:
-
a processing circuit, an input interface connected to the processing circuit so as to receive signals related to feedbacks from a plurality of viewers relatively to a rendered content, each signal comprising data of a facial expression recognition of each viewer, each signal resulting from sensing a mood expression of the viewer during the content rendering, a clock connected to the processing circuit for associating a timestamp to a fragment of the content for which an intensity of the sensed mood expression of a viewer is above a first threshold, and a memory connected to the processing circuit for storing at least the timestamp, an output interface for delivering content recommendation data, and wherein the processing circuit is arranged for performing, in cooperation with the input interface, the clock and the memory, tallying acts of; For all the viewers and for each given timestamp, using the memory for counting a first number of viewers for which the intensity is above the first threshold during the fragment corresponding to the given timestamp, and When the first number is above a second threshold, labelling the fragment corresponding to the given timestamp as a moment of interest of the content, so as to feed the output interface with content recommendation data derived at least from moments of interest of the content.
-
-
12. A content categorization device, comprising:
-
an input interface for receiving timestamps associated to fragments of the content for which an intensity of a sensed mood expression of one or several viewers during a rendering said fragments is above a first threshold, a memory for storing at least the received timestamps, an output interface for delivering content recommendation data, and a processing circuit arranged for performing, in cooperation with the input interface and the memory, tallying acts of; For all the viewers and for each given timestamp, using the memory for counting a first number of viewers for which the intensity is above the first threshold during the fragment corresponding to the given timestamp, and When the first number is above a second threshold, labelling the fragment corresponding to the given timestamp as a moment of interest of the content, so as to feed the output interface with content recommendation data derived at least from moments of interest of the content.
-
Specification