System and method for personalized media rating and related emotional profile analytics

• US 9,026,476 B2
• Filed: 11/07/2011
• Issued: 05/05/2015
• Est. Priority Date: 05/09/2011
• Status: Active Grant

• Current Assignee: Anurag Bist
• Original Assignee: Anurag Bist
• Inventors: Bist, Anurag
• Primary Examiner(s): Chaki, Kakali
• Assistant Examiner(s): SITIRICHE, LUIS A
• Application Number:
  US13/291,057
• Publication Number:
  US 20120290508A1
• Time in Patent Office: 1,275 Days
• Field of Search: None
• US Class Current: 706/10
• CPC Class Codes: G06F 16/437 Administration of user profiles, e.g. generation, initialisation, adaptation, distribution
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 5/04 Inference or reasoning models

Abstract

A system and a method for generating an emotional profile of the user and deriving inference from the analytics of generated emotional profile is provided. The method involves sharing media content or online event in a connected environment; capturing user'"'"'s reaction to the said content or event; generating an emotional score of the user to rate the media content or event; and sharing the emotional score within the connected environment.

Claims

1. A system for generating an emotional profile of a user while interacting with an online multimedia content or event, the system comprising:

a client device having a detector to detect and capture auditory, visual or sensory inputs of the user in response to online events or content in a network;

a processor configured to collect and process the auditory, visual or sensory inputs of the user to identify and generate emotional states of the user reflected from the user'"'"'s sensory inputs;

the processor configured to analyze emotional states of the user to determine an emotional state score of the user by calculating the intensity of each emotional component of the user at a given time stamp and normalizing the deviation of each generated emotional state score from an averaged or baseline emotional state score;

a first module configured to tag the emotional states and the corresponding emotional state scores to the online multimedia content or events;

generating the emotional profile for each of the user, where the emotional profile of the user contains the details of the online activities performed by the user, a list of online multimedia contents interacted by the user, the emotional state score of the user at different time stamps while interacting with the online multimedia content and the averaged or baseline emotional state score of the user, where the averaged or baseline emotional state score represents an average emotional behavior of the individual in reaction to all possible events that the user come across over a course of time.

2. The system of claim 1 wherein the client device is selected from a group consisting of a mobile phone, a Smartphone, a laptop, a camera with WiFi connectivity, a desktop, a tablet computer, or any other sensory device with connectivity.

3. The system of claim 1 wherein the detector captures the user'"'"'s input in form of auditory, visual, sensory, haptic, tactile or other stimulus based signals that designate the emotions, or reaction of the user.

4. The system of claim 1 wherein the detector comprises facial expression detector, smile detector, voice intonation, tactile sensors, breath analysis, pulse detection or voice analysis.

5. The system of claim 1, wherein the emotional profile of the user is shared in the network based on a predefined set of rules.

6. The system of claim 1 wherein the emotional profile of the user is stored in different versions or formats at a repository and can be communicated to a plurality of client devices in the network.

7. The system of claim 1 where emotional state comprises sad, happy, angry, disgusted, normal, fearful and surprised.

8. A method for rating an online multimedia content or event comprising:

distributing at least one online multimedia content or event to at least one client device using a web-based service over a connected network of client devices;

capturing a user'"'"'s auditory, visual or sensory input by a detector present in the client device, the user'"'"'s inputs are captured in the form of a change in the user'"'"'s reaction in response to the online multimedia content or event;

providing a processing module configured for analyzing the user'"'"'s auditory, visual or sensory input to identify emotional states of the user;

determining emotional state score by calculating the intensity of each emotional component of the user at a given time stamp and normalizing the deviation of each generated emotional state score from an averaged or baseline emotional state score;

generating an emotional profile of the user showing the user'"'"'s activity in relation to the multimedia content including the list of multimedia content that have been interacted with, rating given to the multimedia content and the insight derived about the user form the rated multimedia content;

wherein the online multimedia content are rated based on the generated emotional state score and tagged with the user'"'"'s metadata and the emotional state of the user along with the emotional state score; and

wherein the averaged or baseline emotional state score represents an average emotional behavior of the individual in reaction to all possible events that the user come across over a course of time.

9. The method of claim 8, wherein the online content or event is distributed among a plurality of the client devices configured with a server in the network through internet or Local Area Network.

10. The method of claim 8, wherein the user'"'"'s input are in form of facial expressions, smile, voice intonations, tactile, breath analysis, pulse detection or voice analysis signals.

11. The method of claim 8 wherein the metadata provides link to the user information, content being watched, time the content was watched, and any other associated data linking the user, the content watched and the emotional score generated.

12. The method of claim 8 wherein the content or multimedia event is recommended to the user by analyzing the emotional score of the user, the user'"'"'s networks, and the analytics associated with other similar content of a media repository.

13. The method of claim 8 wherein a user predicts the emotional score of other users in the network for a particular content and asks the other users to rate the content.

14. The method of claim 8 wherein a user invites other users or engages with other users in the network to get Emotional Scores of a specific content, to give Emotional Scores of specific content, or to gauge the performance of a particular content scored by a specific segment of the users.

15. The method of claim 8 wherein the emotional state comprises happy, sad, normal, disgusted, surprise, fearful and angry.

16. A method for deriving inferences from analytics of personalized emotional profile of a user in an interactive application comprising:

providing a web-based service on a client device that enables user to interact with other users using at least one online multimedia content or event in a connected on-line infrastructure;

capturing user'"'"'s sensory, auditory or visual input during the interaction by a detector present in the client device;

providing a processing module configured to process the user'"'"'s sensory, auditory or visual input to derive emotional states of the user during interaction with the multimedia content;

collecting the emotional states for a plurality of interactions with other users and with online multimedia content or event by a server and storing the emotional states in a database;

processing the collected emotional states for the plurality of user interactions to generate a baseline profile representing average emotional behavior of the user in reaction to all experienced multimedia events and storing the baseline profile in the database;

providing a mean to capture an instantaneous auditory, visual or sensory input of the user in a new interaction and deriving the instantaneous emotional states of the user during the entire interaction;

comparing the instantaneous emotional state of user during the new interaction with the baseline profile;

calculating the deviation of the user'"'"'s emotional state during the new interaction with the average behavior of the user in the baseline profile; and

determining the intensity of each emotional state component at a given time stamp and normalizing the deviation of the emotional state from the baseline profile to determine an emotional state score at the given time stamp.

17. The method of claim 16 wherein the web-based service comprises an on-line conversation service, web conferencing, online advertisements and online videos.

18. The method of claim 16 wherein the deviation of the user'"'"'s emotional state is measured by a metric that measure variation of voice, video, haptic, gesture, tactile or other sensory inputs with the baseline profile.

19. The method of claim 16 wherein the deviation of the user from the baseline profile is used in gaming, conferencing and other online applications to predict the reaction of the user.

20. The method of claim 16 wherein the emotional state comprises sad, happy, normal, angry, disgusted, fearful and surprise.