SYSTEM AND METHOD FOR CAPTURING AN EMOTIONAL CHARACTERISTIC OF A USER

• US 20100086204A1
• Filed: 10/03/2008
• Published: 04/08/2010
• Est. Priority Date: 10/03/2008
• Status: Abandoned Application

• Current Assignee: Sony Ericsson Mobile Communications USA Incorporated (Sony Group Corp.)
• Original Assignee: Sony Ericsson Mobile Communications USA Incorporated (Sony Group Corp.)
• Inventors: Lessing, Simon
• Application Number:
  US12/244,852
• Publication Number:
  US 20100086204A1
• Time in Patent Office: Days
• US Class Current: 382/165
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually

Abstract

An apparatus and method for collecting viewer information associated with a user while the user is acquiring and/or viewing multimedia content. The viewer information is interpreted to determine an emotional characteristic. The emotional characteristic may be stored with the multimedia content. Interpretation of emotional characteristic can provide several gradations of user'"'"'s preference (e.g., the degree to which the user likes the content of the multimedia). It also can provide a relative degree of importance of the content to the user. Additionally, interpretation of the emotional characteristic can be made in terms of one or more specific emotions (e.g., happiness, sadness, fear, anger, etc.) evoked by the multimedia content. Emotional characteristics of other user may also be stored in the metadata of the multimedia content.

Claims

1. An electronic device, comprising:

a display for presenting multimedia content to an associated user, wherein the multimedia content includes a media component and a metadata component;

a first camera configured to obtain viewer information, wherein the viewer information includes at least one physical characteristic associated with the viewer of the multimedia content;

a controller coupled to the display and the first camera, wherein when the display presents multimedia content to the associated user, the controller causes the first camera to capture viewer information; and

an emotional categorization module coupled to the controller, wherein the module determines at least one emotional characteristic associated with the viewer based on the captured viewer information.

2. The electronic device of claim 1 further including an electronic storage device for storing the at least one emotional characteristic and an identification of the viewer in the metadata component of the multimedia content.

3. The electronic device of claim 2, wherein the metadata component also includes an identification of a subject in the multimedia content and at least one emotional characteristic associated with the subject.

4. The electronic device of claim 3, wherein the multimedia content is stored in a database.

5. The electronic device of claim 4, wherein the metadata component associated with multimedia content is searchable based on the at least one emotional characteristic associated with the viewer and/or a subject of multimedia content.

6. The electronic equipment of claim 5, wherein the media component is at least one selected from a group consisting of an image, a video, a song, or a web page.

7. The electronic equipment of claim 1, wherein the electronic equipment is a general purpose computer.

8. The electronic equipment of claim 1 further including a second camera coupled to the controller, wherein the second camera is configured to capture a scene that is in a field of view of the second camera.

9. The electronic equipment of claim 8, wherein the display is configured as a viewfinder to display a preview image representing at least a portion of the scene that is in the field of view of the second camera.

10. The electronic equipment of claim 9, wherein when the second camera captures an image of at least the portion of the scene, the controller causes the first camera to capture viewer information.

11. The electronic device of claim 10, wherein the electronic storage device stores the at least one emotional characteristic and an identification of the viewer in the metadata component of the multimedia content.

12. The electronic device of claim 11, wherein the metadata component includes an identification of a subject of the scene and the at least one emotional characteristic of the subject.

13. The electronic device of claim 12, wherein the electronic device is a mobile telephone.

14. A method of detecting an emotional characteristic of a viewer acquiring an image and/or video through an electronic device, the method comprising:

acquiring an image and/or video from a camera;

acquiring viewer information from a detector at a time substantially contemporaneous with the step of acquiring the image and/or video, wherein the viewer information includes least one of a physical characteristic associated with the viewer; and

processing the viewer information to determine at least one emotional characteristic associated with the viewer.

15. The method of claim 14 further including storing the image and/or video and the emotional characteristic of the viewer in a multimedia file, wherein the image and/or video is stored as a media component and the emotional characteristic is stored as metadata.

16. The method of claim 15 further including storing a plurality of multimedia files in a database, wherein the plurality of the multimedia files include at least one emotional characteristic associated with the viewer of the electronic device.

17. The method of claim 16, wherein the database is searchable based at least upon the emotional characteristic associated with the viewer and/or an emotional characteristic associated with a subject of the image and/or video.

18. The method of claim 16 further including acquiring viewer information from additional viewers of the image and/or video;

determining at least one emotional characteristic associated with at least one additional viewer and storing the emotional characteristic associated with the additional viewer in the metadata.

19. A method of detecting an emotional characteristic associated with a viewer of an electronic device while viewing multimedia content, the method comprising:

displaying multimedia content on a display of an electronic device to an associated viewer;

acquiring viewer information from a detector at a time substantially contemporaneous with the step of displaying multimedia content, wherein the viewer information includes at least one of a physical characteristic associated with the viewer;

processing the viewer information to determine an emotional characteristic of the user based upon the viewer information; and

storing the emotional characteristic associated with the user in metadata associated with the multimedia content in an electronic storage device.

20. The method of claim 19 further including determining an emotional characteristic of a subject in the multimedia content displayed on the display and also storing the emotional characteristic associated with the subject in electronic storage device.