Attentiveness-based video presentation management

• US 10,110,950 B2
• Filed: 09/14/2016
• Issued: 10/23/2018
• Est. Priority Date: 09/14/2016
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Abou Mahmoud, Alaa, Bastide, Paul R., Lu, Fang
• Primary Examiner(s): Kumar, Pankaj
• Assistant Examiner(s): Newlin, Timothy R
• Application Number:
  US15/265,839
• Publication Number:
  US 20180077455A1
• Time in Patent Office: 769 Days
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 51/52 for supporting social networking services
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04N 21/25891 being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/44213 Monitoring of end-user related data arrangements for monitoring the users' behaviour or opinions in broadcast systems H04H60/33
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4668 for recommending content, e.g. movies
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8455 involving pointers to the content, e.g. pointers to the I-frames of the video stream

Abstract

Disclosed aspects relate to attentiveness-based video presentation management. Using a set of computer-based sensors, an attentiveness of a user related to a first set of video presentation contents is monitored. Based on the monitoring, an attentiveness factor of the user related to the first set of video presentation contents is detected. Based on the attentiveness factor of the user related to the first set of video presentation contents, a second set of video presentation contents for presentation to the user is determined. The second set of video presentation contents is presented to the user.

Claims

1. A computer-implemented method for attentiveness-based video presentation management, the method comprising:

monitoring, using a set of computer-based sensors, an attentiveness of a user related to a first set of video presentation contents;

detecting, based on the monitoring, an attentiveness factor of the user related to the first set of video presentation contents;

determining, based on the attentiveness factor of the user related to the first set of video presentation contents, a second set of video presentation contents for presentation to the user, wherein the second set of video presentation contents is an advertisement comprising audio and visual content; and

presenting, to the user, the second set of video presentation contents concurrently with the first set of video presentation contents, wherein concurrent presentation comprises playing the second set of video presentation contents within a presentation of the first set of video presentation contents, and wherein concurrent presentation comprises integrating aspects of the second set of video presentation contents to appear as part of the first set of video presentation contents, wherein integrating aspects comprises blending the audio of the second set of video presentation contents with the first set of video presentation contents based on a volume of an audio of the first set of video presentation contents and the attentiveness factor.

2. The method of claim 1, wherein the attentiveness factor is based on an eye gaze activity factor.

3. The method of claim 1, wherein the attentiveness factor is selected from the group consisting of:

an eye gaze focus factor;

an eye gaze duration factor;

a mouse focus factor;

a typing speed factor;

a number of open applications factor;

a running application factor;

a set of social media activity by the user; and

an external noise factor.

4. The method of claim 1, wherein the second set of video presentation contents includes a set of key frames of an advertisement video.

5. The method of claim 1, further comprising:

analyzing, with respect to the second set of video presentation contents for presentation to the user, a set of advertisement message data;

analyzing, with respect to a third set of video presentation contents for presentation to the user, a set of background environment data; and

determining, based on the analyzing of both the set of advertisement message data and the set of background environment data, a video content relationship for the second and third sets of video presentation contents.

6. The method of claim 5, further comprising:

examining a set of scene busyness factors related to a movement frequency, a set of colors, a set of characters, and a narrative.

7. The method of claim 6, wherein the video content relationship is based on a similarity factor of the set of scene busyness factors for the second and third sets of video presentation contents.

8. The method of claim 5, further comprising:

determining, based on both the attentiveness factor and the video content relationship, a presentation integration action to integrate the second set of video presentation contents with the third set of video presentation contents.

9. The method of claim 5, further comprising:

integrating, by blending one or more images of the second set of video presentation contents with one or more images of the third set of video presentation contents, the second set of video presentation contents with the third set of video presentation contents.

10. The method of claim 5, further comprising:

integrating, by mixing one or more audio components of the second set of video presentation contents with one or more audio components of the third set of video presentation contents, the second set of video presentation contents with the third set of video presentation contents.

11. The method of claim 8, wherein presenting, to the user, the second set of video presentation contents includes:

presenting, to the user based on the presentation integration action, the second set of video presentation contents integrated-with the third set of video presentation contents.

12. The method of claim 1, further comprising:

comparing the attentiveness factor of the user related to the first set of video presentation contents with a threshold attentiveness factor;

resolving that the threshold attentiveness factor exceeds the attentiveness factor of the user related to the first set of video presentation contents; and

modifying, using a set of advertisement message data, the second set of video presentation contents.

13. The method of claim 12, wherein modifying the second set of video presentation contents includes:

filtering the second set of video presentation contents to include a set of key frames of an advertisement video.

14. The method of claim 12, wherein modifying the second set of video presentation contents includes:

adjusting one or more audio components of the second set of video presentation contents; and

adjusting one or more image components of the second set of video presentation contents.

15. The method of claim 12, wherein the modifying occurs in a dynamic fashion to streamline attentiveness-based video presentation management.

16. The method of claim 2, further comprising:

adjusting, based on the eye gaze activity factor, one or more audio components of the second set of video presentation contents.

17. The method of claim 1, wherein the monitoring, the detecting, the determining, and the presenting each occur in an automated fashion without user intervention.

18. A system for attentiveness-based video presentation management, the system comprising:

a memory having a set of computer readable computer instructions;

a processor for executing the set of computer readable instructions, the set of computer readable instructions including;

monitoring, using a set of computer-based sensors, an attentiveness of a user related to a first set of video presentation contents;

detecting, based on the monitoring, an attentiveness factor of the user related to the first set of video presentation contents;

determining, based on the attentiveness factor of the user related to the first set of video presentation contents, a second set of video presentation contents for presentation to the user, wherein the second set of video presentation contents is an advertisement comprising audio and visual content; and

presenting, to the user, the second set of video presentation contents concurrently with the first set of video presentation contents, wherein concurrent presentation comprises playing the second set of video presentation contents within a presentation of the first set of video presentation contents, and wherein concurrent presentation comprises integrating aspects of the second set of video presentation contents to appear as part of the first set of video presentation contents, wherein integrating aspects comprises blending the audio of the second set of video presentation contents with the first set of video presentation contents based on a volume of an audio of the first set of video presentation contents and the attentiveness factor.

19. A computer program product for attentiveness-based video presentation management, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, wherein the computer readable storage medium is not a transitory signal per se, the program instructions executable by a processor to cause the processor to perform a method comprising:

monitoring, using a set of computer-based sensors, an attentiveness of a user related to a first set of video presentation contents;

detecting, based on the monitoring, an attentiveness factor of the user related to the first set of video presentation contents;

determining, based on the attentiveness factor of the user related to the first set of video presentation contents, a second set of video presentation contents for presentation to the user, wherein the second set of video presentation contents is an advertisement comprising audio and visual content; and

presenting, to the user, the second set of video presentation contents concurrently with the first set of video presentation contents, wherein concurrent presentation comprises playing the second set of video presentation contents within a presentation of the first set of video presentation contents, and wherein concurrent presentation comprises integrating aspects of the second set of video presentation contents to appear as part of the first set of video presentation contents, wherein integrating aspects comprises blending the audio of the second set of video presentation contents with the first set of video presentation contents based on a volume of an audio of the first set of video presentation contents and the attentiveness factor.

20. The computer program product of claim 19, wherein at least one of:

the program instructions are stored in the computer readable storage medium in a data processing system, and wherein the program instructions were downloaded over a network from a remote data processing system;

or

the program instructions are stored in the computer readable storage medium in a server data processing system, and wherein the program instructions are downloaded over a network to the remote data processing system for use in a second computer readable storage medium with the remote data processing system.