Method, apparatus and computer program product for gathering and presenting emotional response to an event

• US 9,681,186 B2
• Filed: 06/11/2013
• Issued: 06/13/2017
• Est. Priority Date: 06/11/2013
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Lehtiniemi, Arto Juhani, Eronen, Antti Johannes, Arrasvuori, Juha Henrik, Holm, Jukka Antero
• Primary Examiner(s): Bruckart, Benjamin R
• Assistant Examiner(s): TESFAYE, AKLIL M
• Application Number:
  US13/915,095
• Publication Number:
  US 20140366049A1
• Time in Patent Office: 1,463 Days
• Field of Search: 725 9- 21
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45

Abstract

Provided herein is a method, apparatus and computer program product for gathering and presenting emotional response to an event in the form of an emotional response timeline. In particular, the method may include generating a timeline of a collected emotional response of a user relative to an event, selecting, by a processor, a portion of the timeline of the emotional response that meets at least one predefined criterion, and generating an edited event based on the portion of the timeline of the emotional response that meets the at least one predetermined criterion. The emotional response may include one or more of a heart rate, a facial expression, a vocalization, or a facial flush. The at least one predetermined criterion may include an emotional response above a predefined threshold.

Claims

1. A method comprising:

generating a timeline of a collected emotional response of a user relative to an original media file, wherein the emotional response includes one or more of a heart rate, a facial expression, a vocalization, or a facial flush;

selecting, by a processor, a portion of the timeline of the emotional response that meets at least one predetermined criterion; and

generating an edited media file based on the portion of the timeline of the emotional response that meets the at least one predetermined criterion, wherein the edited media file comprises a media file including only portions of the original media file, wherein at least a portion of the edited media file comprises a portion of increased frame rate or reduced frame rate relative to an original frame rate of the original media file, and wherein the portions of the original media file include only those portions of the original media file where the emotional response was above a threshold and a predefined length of time immediately preceding those portions of the original media file where the emotional response was above a threshold.

2. The method of claim 1, wherein the at least one predetermined criterion includes at least one of a heart rate above a predefined threshold, a facial expression of at least one predefined type, a vocalization of at least one predetermined utterance, or a facial flush of a predefined hue.

3. The method of claim 2, wherein each of the at least one predetermined criterion is user adjustable.

4. The method of claim 1, further comprising calibrating a baseline emotional response for the event.

5. The method of claim 1, wherein the portions of the original medial file where the emotional response was above a threshold are included in the edited media file at a reduced frame rate relative to the original media file.

6. An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to:

generate a timeline of a collected emotional response of a user relative to an original media file, wherein the emotional response includes one or more of a heart rate, a facial expression, a vocalization, or a facial flush;

select a portion of the timeline of the emotional response that meets at least one predetermined criterion; and

generate an edited media file based on the portion of the timeline of the emotional response that meets the at least one predetermined criterion, wherein the edited media file comprises a media file including only portions of the original media file, wherein at least a portion of the edited media file comprises a portion of increased frame rate or reduced frame rate relative to an original frame rate of the original media file, and only those portions of the original media file where the emotional response was above a threshold and a predefined length of time immediately preceding those portions of the original media file where the emotional response was above a threshold.

7. The apparatus of claim 6, wherein the at least one predetermined criterion includes an emotional response above a predefined threshold.

8. The apparatus of claim 6, wherein the at least one predetermined criterion includes at least one of a heart rate above a predefined threshold, a facial expression of at least one predefined type, a vocalization of at least one predetermined utterance, or a facial flush of a predefined hue.

9. The apparatus of claim 8, wherein each of the at least one predetermined criterion is user adjustable.

10. The apparatus of claim 6, wherein the apparatus further caused to calibrate a baseline emotional response for the event.

11. The apparatus of claim 6, wherein the emotional response includes a vocalization of at least one predetermined utterance.

12. A computer program product comprising at least one non-transitory computer-readable storage medium having computer executable program code instructions stored therein, the computer executable program code instructions comprising:

program code instructions to generate a timeline of a collected emotional response of a user relative to an original media file, wherein the emotional response includes one or more of a heart rate, a facial expression, a vocalization, or a facial flush;

program code instructions to select a portion of the timeline of the emotional response that meets at least one predetermined criterion; and

program code instructions to generate an edited media file based on the portion of the timeline of the emotional response that meets the at least one predetermined criterion, wherein the edited media file comprises a media file including only portions of the original media file, wherein at least a portion of the edited media file comprises a portion of increased frame rate or reduced frame rate relative to an original frame rate of the original media file, and only those portions of the original media file where the emotional response was above a threshold and a predefined length of time immediately preceding those portions of the original media file where the emotional response was above a threshold.

13. The computer program product of claim 12, wherein the at least one predetermined criterion includes an emotional response above a predefined threshold.

14. The computer program product of claim 12, wherein the at least one predetermined criterion includes at least one of a heart rate above a predefined threshold, a facial expression of at least one predefined type, a vocalization of at least one predetermined utterance, or a facial flush of a predefined hue.

15. The computer program product of claim 14, wherein each of the at least one predetermined criterion is user adjustable.