SYSTEM AND METHOD FOR DYNAMIC CONTENT MODIFICATION BASED ON USER REACTIONS

• US 20130283162A1
• Filed: 06/20/2012
• Published: 10/24/2013
• Est. Priority Date: 04/23/2012
• Status: Abandoned Application

• Current Assignee: Sony Mobile Communications AB (Sony Group Corp.)
• Original Assignee: Sony Mobile Communications AB (Sony Group Corp.)
• Inventors: Aronsson, Pr-Anders, de Lon, David, Jonsson, Hkan, Klinghult, Gunnar, Thrn, Ola
• Application Number:
  US13/527,903
• Publication Number:
  US 20130283162A1
• Time in Patent Office: Days
• US Class Current: 715/719
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 21/42202 environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/454 Content or additional data filtering, e.g. blocking advertisements

Abstract

A dynamic content modification system dynamically modifies content playback based on a user reaction so as to provide an individualized entertainment experience. The system includes a sensor module configured to receive a plurality of sensor measurements of at least one user, and a user model database including a plurality of user models associated with content preferences. A controller is configured to receive the sensor measurements and apply the sensor measurements to at least one user model to determine a prediction of a user reaction to content. The controller further is configured to determine a content modification to a playback of to the content based on the prediction, and to a cause a content reproduction device to play back the content in a manner that incorporates the determined content modification.

Claims

1. A dynamic content modification system for dynamically modifying content playback based on a user reaction, the system comprising:

a sensor module configured to receive a plurality of sensor measurements of at least one user;

a user model database including a plurality of user models associated with content preferences; and

a controller, wherein;

the controller is configured to receive the sensor measurements and apply the sensor measurements to at least one user model to determine a prediction of a user reaction to content; and

the controller is configured to determine a content modification to a playback of the content based on the prediction.

2. The content modification system of claim 1, wherein the controller is further configured to a cause a content reproduction device to play back the content in a manner that incorporates the determined content modification.

3. The content modification system of claim 1, wherein the sensor module comprises a plurality of sensor devices.

4. The content modification system of claim 3, wherein the plurality of sensor devices includes at least one of a face detection camera, a motion sensor, and a photoplethysmography measuring system.

5. The content modification system of claim 3, wherein the plurality of sensor devices includes at least one of a headset worn by the user, a probe sensor worn by the user, and a remote control device operated by the user.

6. The content modification system of claim 5, wherein the probe sensor includes at least one of a photoplethysmography measuring system and a galvanic skin response measuring sensor.

7. The content modification system of claim 5, wherein the sensor module further comprises a wireless interface, and the controller receives the sensor measurements via the wireless interface.

8. The content modification system of claim 1, wherein:

the at least one user is a plurality of users;

the sensor module is configured to distinguish sensor measurements associated with each respective user;

the controller is configured to receive the sensor measurements for each respective user and apply the sensor measurements to a corresponding user model for each respective user to determine a prediction of a reaction to content for each respective user; and

the controller is configured to determine a content modification to a playback of the content based on one or more of the user predictions.

9. The content modification system of claim 1, wherein the user model data base contains at least one of an individual model that is specific to a corresponding individual user, and a default model that is not specific to a corresponding individual user.

10. The content modification system of claim 9, wherein the individual model includes a user profile for the corresponding individual user.

11. The content modification system of claim 9, wherein the individual model is generated automatically based on a learning process utilizing a usage history of a plurality default models.

12. The content modification system of claim 1, wherein the controller is configured to determine the content modification based on information contained in a media file associated with the content.

13. The content modification system of claim 12, wherein the controller is configured to determine the content modification based on information contained in metadata of the media file associated with the content.

14. The content modification system of claim 1, further comprising:

a wireless interface, and

a server storing the user model database;

wherein the controller is configured to apply the sensor measurements to the at least one user model by accessing the at least one user model from the server over the wireless interface.

15. The content modification system of claim 14, wherein:

the controller is configured to determine the content modification based on information contained in metadata of a media file associated with the content;

the server includes a metadata database containing the content modification information; and

the controller is configured to determine the content modification by accessing the metadata database from the server over the wireless interface.

16. The content modification system of claim 1, further comprising:

a wireless interface, and

a server storing the user model database and including a server controller;

wherein;

the server controller is configured to receive the sensor measurements over the wireless interface and apply the sensor measurements to at least one user model to determine the a prediction of a user reaction to content;

the server controller is configured to determine a content modification to a playback of the content based on the prediction and to transmit the determined content modification to the controller over the wireless interface; and

the controller is further configured to a cause a content playback device to play back the content in a manner that incorporates the determined content modification.

17. A content reproduction system comprising:

the content modification system of claim 1; and

a content reproduction device;

wherein the controller is further configured to a cause the content reproduction device to play back the content in a manner that incorporates the determined content modification.

18. A method of dynamically modifying content playback based on a user reaction comprising the steps of:

receiving a plurality of sensor measurements of at least one user;

applying the sensor measurements to at least one user model to determine a prediction of a user reaction to content; and

determining a content modification to a playback of the content based on the prediction.

19. The method of claim 18, further comprising causing a content reproduction device to play back the content in a manner that incorporates the determined content modification.

20. The method of claim 18, wherein the at least one user is a plurality of users, the method further comprising;

receiving the plurality of sensor measurements from the plurality of users;

distinguishing sensor measurements associated with each respective user;

applying the sensor measurements of each respective user to a corresponding user model for each respective user to determine a prediction of a reaction to content for each respective user; and

determining a content modification to a playback of the content based on one or more of the user predictions.