Aggregated stress monitoring to guide user interaction

• US 10,158,914 B2
• Filed: 03/30/2017
• Issued: 12/18/2018
• Est. Priority Date: 03/30/2017
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Durham, Lenitra M., Munafo, Tamir Damian, Wouhaybi, Rita H., Shaliv, Adi, Raffa, Giuseppe, Pogorelik, Oleg, Sharma, Sangita Ravi, Nayshtut, Alex
• Primary Examiner(s): Kumar, Pankaj
• Assistant Examiner(s): Hicks, Charles N
• Application Number:
  US15/474,599
• Publication Number:
  US 20180288478A1
• Time in Patent Office: 628 Days
• Field of Search: None
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/25883 being end-user demographical data, e.g. age, family status or address arrangements for identifying locations of users in broadcast systems H04H60/52
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4542 Blocking scenes or portions of the received content, e.g. censoring scenes
• CPC Class Codes: H04N 21/45455 applied to a region of the image

Abstract

A system and method for real-time alteration of media content based on stress monitoring is disclosed. A computer system present a single media content item in two distinct content streams to a first and second user. Using sensor generated data the computer system measures at least one user response indicator for the first and second user and estimates a stress level for the first and second users. The computer system determines whether the estimated stress level for the first user exceeds a first predetermined stress threshold. In accordance with a determination that the estimated stress level for the first user exceeds a first predetermined stress threshold the computer system alters the first stream of the presented media content item to modify the particular portion of the media content item associated with the estimated stress level for the first user.

Claims

1. A system for alteration of media content based on stress monitoring, the system comprising:

a memory including instructions; and

processing circuitry that, when in operation, is configured by the instructions to implement;

a presentation module to present a single media content item in two distinct content streams, the first content stream presented to at least a first user and a second content stream presented to at least a second user;

an accessing module to use sensor generated data to obtain at least one user response indicator for the first user and at least one user response indicator for the second user;

an estimation module to;

estimate a stress level for the first user based on at least one measured user response indicator for the first user; and

estimate a stress level for the second user based on at least one measured user response indicator for the second user;

a stress measurement module to;

determine whether the estimated stress level for the first user exceeds a first predetermined stress threshold; and

determine whether the estimated stress level for the second user exceeds a second predetermined stress threshold;

a content alteration module to, in accordance with a determination that the estimated stress level for the first user exceeds the first predetermined stress threshold and the estimated stress level for the second user does not exceed the second predetermined threshold;

associate the estimated stress level for the first user with a particular portion of the media content item; and

alter the first stream of the presented media content item to modify the particular portion of the media content item associated with the estimated stress level for the first user without altering the second stream of the presented media content; and

a display module to display a notification that an alteration has been made to the media content item.

2. The system of claim 1, wherein the sensor is one of a microphone, a camera, and a heartrate monitor.

3. The system of claim 1, wherein the user response indicator includes at least one of physical movement, heart rate, audio responses, skin temperature, or galvanic skin response.

4. The system of claim 1, wherein the content alteration module further uses the at least one processor to:

access eye tracking data for the first user;

based on the accessed eye tracking data for the first user, identify a particular displayed object associated with the estimated stress level; and

blur the particular displayed object in the media content item.

5. The system of claim 4, wherein the content alteration module further uses the at least one processor to:

identify a scene associated with the estimate stress level; and

remove at least a portion of the scene from the media content item.

6. The system of claim 5, wherein the instructions configure the processing circuitry to implement:

a selection module to select replacement content, wherein the duration of the replacement content is the approximately the same as the removed portion of the scene from the media content item; and

a presentation module, using at least one processor to present the replacement content.

7. A method for alteration of media content based on stress monitoring, the method comprising:

presenting a media item in two distinct streams, the first stream presented to a first user and a second stream presented to a second user;

using sensor generated data to estimate a stress level for the first user and the second user;

determining whether the estimated stress level for the first user exceeds a first predetermined stress threshold and whether the estimated stress level for the second user exceeds a second predetermined stress threshold;

in accordance with a determination that the estimated stress level for the first user exceeds a first predetermined stress threshold and the estimated stress level for the second user does not exceed a second predetermined threshold;

altering the first stream of the media item to modify a particular portion of the media item associated with the estimated stress level for the first user without altering the second stream of the media item; and

prior to presenting the media item;

receiving identification of at least one user to whom the media content item will be presented;

retrieving media item description data describing the content of the media item; and

identifying, based on information stored in a user profile associated with the at least one user to whom the media item will be presented, one or more portions of the media item that will exceed the stress threshold of the at least one user.

8. The method of claim 7, wherein the sensor is one of a microphone, a camera, and a heartrate monitor.

9. The method of claim 7, wherein the sensor generated data measures at least one user response indicator including at least one of physical movement, heart rate, audio responses, skin temperature, or galvanic skin response.

10. The method of claim 9, wherein the sensor is a camera and using sensor generated data to obtain at least one user response indicator for the first user further comprises:

detecting user motion of the first user based on received camera data; and

comparing detected user motion of the first user with reference motion data to identify the user motion.

11. The method of claim 10, wherein estimating a stress level for the first user further comprises:

determining a stress level associated with the identified user motion.

12. The method of claim 7, wherein determining whether the estimated stress level for the first user exceeds a first predetermined stress threshold further comprises:

accessing a user profile for the first user; and

based on user information in the user profile, identifying a threshold stress level for the user.

13. The method of claim 12, wherein the user information includes demographic information for the user.

14. The method of claim 12, wherein the user information includes past user reactions to stressful content.

15. The method of claim 7, further comprising:

displaying a notification that an alteration has been made to the media content item.

16. The method of claim 7, further comprising:

notifying a second user that the media content item presented to the first user has been altered.

17. The method of claim 7, wherein the first stream is altered such that it remains in sync with the second stream once the particular portion of the media content item has been presented.

18. At least one non-transitory computer-readable storage medium storing instructions that, when executed by the one or more processors of a machine, cause the machine to:

present a single media content item in two distinct content streams, the first content stream presented to at least a first user and a second content stream presented to at least a second user;

use sensor generated data to obtain at least one user response indicator for the first user and at least one user response indicator for the second user;

estimate a stress level for the first user based on at least one measured user response indicator for the first user;

estimate a stress level for the second user based on at least one measured user response indicator for the second user;

determine whether the estimated stress level for the first user exceeds a first predetermined stress threshold;

determine whether the estimated stress level for the second user exceeds a second predetermined stress threshold;

in accordance with a determination that the estimated stress level for the first user exceeds a first predetermined stress threshold and the estimated stress level for the second user does not exceed a second predetermined threshold;

associate the estimated stress level for the first user with a particular portion of the media content item; and

alter the first stream of the presented media content item to modify the particular portion of the media content item associated with the estimated stress level for the first user without altering the second stream of the presented media content; and

notify a second user that the media content item presented to the first user has been altered.

19. The non-transitory computer-readable storage medium of claim 18, wherein the sensor is one of a microphone, a camera, and a heartrate monitor.

20. The non-transitory computer-readable storage medium of claim 18, wherein the stress level indicators include at least one of physical movement, heart rate, audio responses, skin temperature, or galvanic skin response.

21. The non-transitory computer-readable storage medium of claim 18, wherein the sensor is a camera and using sensor generated data to obtain at least one user response indicator for the first user further comprises:

detecting user motion of the first user based on received camera data; and

comparing detected user motion of the first user with reference motion data to identify the user motion.

22. The non-transitory computer-readable storage medium of claim 21, wherein the instructions that cause the machine to estimate a stress level for the first user based on at least one measured user response indicator for the first user further comprise instructions to:

determine a stress level associated with the identified user motion.

23. The non-transitory computer-readable storage medium of claim 18, wherein the instructions that cause the machine to determine whether the estimated stress level for the first user exceeds a first predetermined stress threshold further comprise instructions to:

access a user profile for the first user; and

based on user information in the user profile, identify a threshold stress level for the user.

24. The non-transitory computer-readable storage medium of claim 23, wherein the user information includes demographic information for the user.