MULTI-SENSORIAL EMOTIONAL EXPRESSION

• US 20130346920A1
• Filed: 11/28/2012
• Published: 12/26/2013
• Est. Priority Date: 06/20/2012
• Status: Abandoned Application

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Morris, Margaret E., Carmean, Douglas M.
• Application Number:
  US13/687,846
• Publication Number:
  US 20130346920A1
• Time in Patent Office: Days
• US Class Current: 715/835
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G10H 1/0025 Automatic or semi-automatic music composition, e.g. producing random music, applying rules from music theory or modifying a musical piece automatically producing a series of tones G10H1/26
• CPC Class Codes: G10H 1/368 displaying animated or moving pictures synchronized with the music or audio part
• CPC Class Codes: G10H 2210/101 Music Composition or musical creation; Tools or processes therefor
• CPC Class Codes: G10H 2240/085 Mood, i.e. generation, detection or selection of a particular emotional content or atmosphere in a musical piece

Abstract

Storage medium, method and apparatus associated with multi-sensorial expression of emotion to photos/pictures are disclosed herein. In embodiments, at least one storage medium may include a number of instructions configured to enable a computing device, in response to execution of the instructions by the computing device, to display a number of images having associated emotion classifications on a display device accessible to a number of users, and facilitate the number of users to individually and/or jointly modify the emotion classifications of the images in a multi-sensorial manner. Other embodiments may be disclosed or claimed.

Claims

1. At least one storage medium comprising a plurality of instructions configured to enable a computing device, in response to execution of the instructions by the computing device, to

display a plurality of images having associated emotion classifications on a display device accessible to a plurality of users;

and

facilitate the plurality of users to individually and/or jointly modify the associated emotion classifications in a multi-sensorial manner.

2. The at least one storage medium of claim 1, wherein display a plurality of images having associated emotion classifications comprises display the plurality of images having associated emotion classifications on a touch sensitive display screen accessible to the plurality of users.

3. The at least one storage medium of claim 1, wherein facilitate the plurality of users to individually and/or jointly modify the associated emotion classifications comprises facilitate a user in selecting an emotion classification for one of the images.

4. The at least one storage medium of claim 3, wherein facilitate a user in selecting an emotion classification for one of the images comprises facilitating a user in interacting with a mood map to select an emotion classification for one of the images.

5. The at least one storage medium of claim 4, wherein facilitate a user in interacting with a mood map comprises facilitate display of the mood map in a manner that is visually reflective of an initial or an aggregated emotion classification of the one image.

6. The at least one storage medium of claim 5, wherein facilitate a user in interacting with a mood map further comprises facilitate output of audio that is aurally reflective of the initial or aggregated emotion classification of the one image to accompany the display of the mood map.

7. The at least one storage medium of claim 4, wherein facilitate a user in interacting with a mood map comprises update an initial or aggregated emotion classification of the one image in response to the user'"'"'s selection of an emotion classification for the one image, including real time update of the display of the mood map, and companion audio, if provided, to reflect the updated aggregated emotion classification of the one image.

8. The at least one storage medium of claim 1, wherein display a plurality of images having associated emotion classifications comprises display a plurality of images having associated emotion classifications based on a determination of a user'"'"'s mood in accordance with a result of an analysis of the user'"'"'s facial expression.

9. The at least one storage medium of claim 1, wherein the instructions are further configured to enable the computing device, in response to execution of the instructions by the computing device, to analyze one of the images, and based at least in part on a result of the analysis, assign an initial emotion classification to the one image.

10. The at least one storage medium of claim 9, wherein analyze one of the image comprises analyze a caption of the one image.

11. The at least one storage medium of claim 9, wherein analyze one of the image comprises comparison of the one image against one or more other ones of the images with associated emotion classification, based on one or more visual or contextual properties of the images.

12. The at least one storage medium of claim 1, wherein display the plurality of images comprises sequentially display the plurality of images with visual attributes respectively reflective of aggregated emotion classification of the images to provide a mood wave.

13. The at least one storage medium of claim 12, wherein the instructions are further configured to enable the computing device, in response to execution of the instructions by the computing device, to output audio snippets that are respectively reflective of the aggregated emotion classifications of the images to accompany the sequential display of the images to provide the mood wave.

14. The at least one storage medium of claim 1, wherein the instructions are further configured to enable the computing device, in response to execution of the instructions by the computing device, to select the images from a collection of images, or a subset of the images, based at least in part on the emotion classifications of the images.

15. The at least one storage medium of claim 1, wherein the instructions are further configured to enable the computing device, in response to execution of the instructions by the computing device, to sort the images, based at least in part on the emotion classifications of the images.

16. A method for expressing emotion, comprising:

displaying a plurality of images having associated emotion classifications, by a computing device, on a display device accessible to a plurality of users; and

facilitating the plurality of users, by the computing device, to individually and/or jointly modify the emotion classifications of the images in a multi-sensorial manner, including facilitating a user in selecting an emotion classification for one of the images.

17. The method of claim 16, wherein facilitating a user in contributing in selecting an emotion classification for one of the images comprises facilitating the user, by the computing device, in interacting with a mood map to selecting an emotion classification for one of the images.

18. The method claim 17, wherein facilitating a user in interacting with a mood map comprises facilitating displaying of the mood map, by the computing device, in a manner that is visually reflective of an initial or an aggregated emotion classification of the one image;

and facilitating output of audio, by the computing device, that is aurally reflective of the initial or aggregated emotion classification of the one image to accompany the displaying of the mood map.

19. The method of claim 17, wherein facilitating a user in interacting with a mood map further comprises facilitating update, by the computing device, of an aggregated emotion classification of the one image to include the user'"'"'s selection of an emotion classification for the image, including real time updating of the mood map, and companion audio, if provided, by the computing device, to reflect the updated aggregated emotion classification of the one image.

20. The method of claim 17, wherein displaying a plurality of images having associated emotion classifications comprises displaying a plurality of images having associated emotion classifications based on a determination of a user'"'"'s mood in accordance with a result of an analysis of the user'"'"'s facial expression.

21. The method of claim 16, further comprising analyzing, by the computing device, one of the images, and based at least in part on a result of the analysis, assigning, by the computing device, an initial emotion classification to the one image, wherein analyzing includes comprises analyzing, by the computing device, a caption of the one image, or comparing, by the computing device, the one image against one or more other ones of the images with associated emotion classifications, based on one or more visual or contextual properties of the images.

22. The method of claim 16, wherein displaying the plurality of images comprises sequentially displaying, by the computing device, the plurality of images with visual attributes respectively reflective of aggregated emotion classifications of the images to provide a mood wave;

and outputting audio snippets that are respectively reflective of the aggregated emotion classifications of the images to accompany the sequential displaying of the images to provide the mood wave.

23. The method of claim 16, further comprising selecting, by the computing device, the images from a collection of images, or a subset of the images, based at least in part on the emotion classifications of the images.

24. An apparatus for expressing emotions, comprising:

a display device configured to be accessible to a plurality of users; and

a computing device coupled with the display device, and having instructions configured, in response to execution, to;

display on the display device a plurality of images having associated emotion classifications; and

facilitate the plurality of users to individually and jointly modify the emotion classifications of the images in a multi-sensorial manner, wherein facilitate includes facilitates a user in selection of an emotion classification for one of the images, using a mood map;

wherein using a mood map, includes display of the mood map, in a manner that is visually reflective of an initial or an aggregated emotion classification of the one image; and

output of audio that is aurally reflective of the initial or aggregated emotion classification of the one image to accompany the display of the mood map.

25. The apparatus of claim 24, wherein display the plurality of images comprises sequentially display the plurality of images with visual attributes respectively reflective of aggregated emotion classification of the images to provide a mood wave;

and output audio snippets that are respectively reflective of the aggregated emotion classification of the images to accompany the sequential display of the images to provide the mood wave.