Emotion controlled system for processing multimedia data

• US 7,698,238 B2
• Filed: 03/30/2005
• Issued: 04/13/2010
• Est. Priority Date: 04/01/2004
• Status: Active Grant

• Current Assignee: Sony Deutschland GmbH (Sony Group Corp.)
• Original Assignee: Sony Deutschland GmbH (Sony Group Corp.)
• Inventors: Mayer, Matthias, Moser, Boris, Barletta, Antonio
• Primary Examiner(s): Vincent; David R
• Assistant Examiner(s): Brown, Jr.; Nathan H
• Application Number:
  US11/093,495
• Publication Number:
  US 20050223237A1
• Time in Patent Office: 1,840 Days
• Field of Search: 706/16, 706/20, 706/21, 463/36
• US Class Current: 706/16
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: H04H 60/33 Arrangements for monitoring the users' behaviour or opinions
• CPC Class Codes: H04H 60/61 Arrangements for services using the result of monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
• CPC Class Codes: H04N 21/4131 home appliance, e.g. lighting, air conditioning system, metering devices home automation data switching networks exchanging configuration information on appliance services H04L12/2807
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 21/4402 involving reformatting operations of video signals for household redistribution, storage or real-time display details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739

Abstract

The present invention relates to an emotion controlled system for processing multimedia data comprising a multimedia system for presenting multimedia content to a user an emotion model means for determining the emotional state of the user during the presentation of the multimedia content and an editing unit for changing said multimedia content in accordance with the emotional state of the user in order to present the changed multimedia content by the multimedia system.

The present invention further relates to a method for executing the steps on this system.

Claims

1. A method for an emotion controlled system for processing multimedia data, comprising:

presenting multimedia content to a user using a multimedia system;

determining physical parameters of the user during the presentation of the multimedia content using an acquisition unit, said physical parameters including at least one of heart rate, blood pressure, and temperature;

changing the multimedia content relative the determined physical parameters using an editing unit, the changed multimedia content created in real time while the multimedia content is being presented;

presenting the changed multimedia content using the multimedia system, said changed multimedia content having a transmission bandwidth different than a transmission bandwidth of the multimedia content, and the transmission bandwidth of the changed multimedia content depending on a level of interest of the user; and

controlling an environmental device relative the determined physical parameters to intensify an emotional state of the user.

2. The method according to claim 1, wherein the changed multimedia content is a program different from the multimedia content.

3. The method according to claim 1, wherein the changed multimedia content is a digest of the multimedia content.

4. The method according to claim 1, wherein the determined physical parameters are embedded in the changed multimedia content.

5. The method according to claim 1, wherein the environmental device is a light unit.

6. The method according to claim 1, wherein the environmental device is a sound unit.

7. An emotion controlled system for processing multimedia data, comprising:

a multimedia system configured to present multimedia content to a user;

an acquisition unit configured to determine physical parameters of the user during presentation of the multimedia content, said physical parameters being at least one of heart rate, blood pressure, and temperature; and

an editing unit configured to change said multimedia content in accordance with the physical parameters of the user in order to present the changed multimedia content with the multimedia system, said changed multimedia content having a transmission bandwidth different than a transmission bandwidth of the multimedia content, and the transmission bandwidth of the changed multimedia content depending on a level of interest of the user, the editing unit configured to change said multimedia content in real time while said multimedia content is being presented by the multimedia system; and

an environmental control unit configured to control an environmental device relative the determined physical parameters to intensify an emotional state of the user.

8. The system according to claim 7, wherein the changed multimedia content is a program different from the multimedia content.

9. The system according to claim 7, wherein the changed multimedia content is a digest of the multimedia content.

10. The system according to claim 7, wherein the environmental device is a light unit.

11. The system according to claim 7, wherein the environmental device is a sound unit.

12. A computer readable medium including computer executable instructions, wherein the instructions, when executed by a processor, cause the processor to perform a method, comprising:

presenting multimedia content to a user;

determining physical parameters of the user during the presentation of the multimedia content, said physical parameters being at least one of heart rate, blood pressure, and temperature;

changing the multimedia content relative the physical parameters of the user, said changed multimedia content having a transmission bandwidth different than a transmission bandwidth of the multimedia content, and the transmission bandwidth of the changed multimedia content depending on a level of interest of the user, the changed multimedia content created in real time while the multimedia content is being presented;

presenting the changed multimedia content; and

controlling an environment device relative the determined physical parameters to intensify an emotional state of the user.

13. The computer readable medium according to claim 12, wherein the changed multimedia content is a program different from the multimedia content.

14. The computer readable medium according to claim 12, wherein the changed multimedia content is a digest of the multimedia content.

15. The computer readable medium according to claim 12, wherein the determined physical parameters are embedded in the changed multimedia content.

16. The computer readable medium according to claim 12, wherein the environmental device is a light unit.

17. The computer readable medium according to claim 12, wherein the environmental device is a sound unit.