Determining a future portion of a currently presented media program

• US 9,788,032 B2
• Filed: 01/13/2015
• Issued: 10/10/2017
• Est. Priority Date: 05/04/2012
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Conrad, Michael J., Hulten, Geoffrey J., Krum, Kyle J., Mendhro, Umaimah A., Remington, Darren B.
• Primary Examiner(s): Flynn, Nathan
• Assistant Examiner(s): Huerta, Alexander Q
• Application Number:
  US14/596,074
• Publication Number:
  US 20150128161A1
• Time in Patent Office: 1,001 Days
• CPC Class Codes: G06Q 90/00 Systems or methods specially adapted for administrative, commercial, financial, managerial or supervisory purposes, not involving significant data processing
• CPC Class Codes: H04N 21/252 Processing of multiple end-users' preferences to derive collaborative data
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 21/44213 Monitoring of end-user related data arrangements for monitoring the users' behaviour or opinions in broadcast systems H04H60/33
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/458 Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations arrangements for replacing or switching information during the broadcast or during the distribution H04H20/10
• CPC Class Codes: H04N 21/4667 Processing of monitored end-user data, e.g. trend analysis based on the log file of viewer selections
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02

Abstract

This document describes techniques and apparatuses for determining a future portion of a currently presented media program. The techniques and apparatuses can receive current media reactions of one or many people to a currently presented media program and determine later portions to present in the media program based on the media reactions. In some embodiments, for example, a program can be presented live, reactions can be received during the live presentation, and the program altered on-the-fly and in real time based on those reactions. Further, the alterations can be general or tailored to a group or a particular person.

Claims

1. A method implemented by a computing device comprising:

receiving, by the computing device and during a presentation of a first portion of a currently presented media program, passively sensed sensor data for a user during the first portion of the currently presented media program;

determining, by the computing device, a probability of a state of the user and an engagement level of the user during the first portion of the currently presented media program based on the sensor data, the probability of the state of the user and the engagement level of the user during the first portion of the currently presented media program being normalized by historical sensor data for the user such that the determination of the probability of the state of the user and determination of the engagement level of the user are specific to the user;

determining, by the computing device, an interest level of the user during the first portion of the currently presented media program based on the probability of the state of the user during the first portion of the currently presented media program, the engagement level of the user during the first portion of the currently presented media program, and a context for the first portion of the currently presented media program, the interest level of the user being normalized by the historical sensor data for the user such that the determination of the interest level of the user is specific to the user;

determining, by the computing device, based on the first portion of the currently presented media program and the interest level determined to be high for the user during the first portion of the currently presented media program, a future portion of the currently presented media program, the future portion of the currently presented media program;

occurring during a later portion of the currently presented media program;

during a current presentation of the currently presented media program; and

selected from a set of future portions of the currently presented media program based on a similarity to the first portion of the currently presented media program; and

causing, by the computing device, the future portion of the currently presented media program to be presented during the later portion of the currently presented media program and during the current presentation of the currently presented media program.

2. A method as described in claim 1, wherein the currently presented media program includes a previously-scheduled future portion of the currently presented media program and causing the future portion of the currently presented media program is effective to replace the previously-scheduled future portion of the currently presented media program with the future portion of the currently presented media program.

3. A method as described in claim 1, wherein receiving the sensor data is from a media presentation device on which the currently presented media program is presented and causing the future portion of the currently presented media program to be presented is performed by the computing device through a communications network.

4. A method as described in claim 1, further comprising receiving other sensor data, the other sensor data sensed during the first portion of the currently presented media program and associated with a different user than the user associated with the first-mentioned sensor data, the different user physically local to the user, and wherein determining the future portion of the currently presented media program is further based on the other sensor data.

5. A method as described in claim 1, wherein the sensor data is received from an entity local to a media presentation device on which the currently presented media program is presented and the set of future portions of the currently presented media program is previously stored local to the media presentation device and associated with a time-range in the currently presented media program at which to present the future portion of the currently presented media program.

6. A method as described in claim 1, wherein the first portion of the currently presented media program is an advertisement and determining the future portion of the currently presented media program determines the future portion of the currently presented media program based on the future portion of the currently presented media program determined to have the user have a higher interest level than one or more other previously prepared future portion of the currently presented media programs of the set of future portions of the currently presented media program.

7. A method as described in claim 1, wherein the determining the future portion of the currently presented media program is further based on sensor data actively sensed during the first portion of the currently presented media program.

8. A method as described in claim 1, wherein the method further comprises determining, by the computing device, based on the first portion of the currently presented media program and the interest level being determined to be low for the user during the first portion of the currently presented media program, another future portion of the currently presented media program, the other future portion of the currently presented media program:

occurring during a later portion of the currently presented media program;

during a current presentation of the currently presented media program; and

selected from the set of future portions of the currently presented media program based on a dissimilarity to the first portion of the currently presented media program.

9. A method as described in claim 1, wherein the interest level for the user is further based on one or more of a demographic of the user, weather information at the user'"'"'s location, the user'"'"'s schedule, a time of day, or sensor data received from other users remote to the user.

10. An apparatus comprising:

one or more computer processors; and

one or more computer-readable storage media having instructions stored thereon that, responsive to execution by the one or more computer processors, perform operations comprising;

receiving, during a presentation of a first portion of a currently presented media program, passively sensed sensor data for a user during the first portion of the currently presented media program for a user;

determining a probability of a state of the user and an engagement level of the user during the first portion of the currently presented media program based on the sensor data, the probability of the state of the user and the engagement level of the user during the first portion of the currently presented media program being normalized by historical sensor data received for the user;

determining an interest level of the user during the first portion of the currently presented media program based on the probability of the state of the user during the first portion of the currently presented media program, the engagement level of the user during the first portion of the currently presented media program, and a context for the first portion of the currently presented media program, the interest level of the user being normalized by the historical sensor data received for the user;

determining, based on the first portion of the currently presented media program and the interest level determined to be high for the user during the first portion of the currently presented media program, a future portion of the currently presented media program, the future portion of the currently presented media program;

to occur during a later portion of the currently presented media program;

during a current presentation of the currently presented media program; and

selected from a set of future portions of the currently presented media program based on a similarity to the first portion of the currently presented media program; and

causing the future portion of the currently presented media program to be presented during the later portion of the currently presented media program and during the current presentation of the currently presented media program.

11. An apparatus as described in claim 10, wherein the currently presented media program includes a previously-scheduled future portion of the currently presented media program and causing the future portion of the currently presented media program is effective to replace the previously-scheduled future portion of the currently presented media program with the future portion of the currently presented media program.

12. An apparatus as described in claim 10, wherein receiving the sensor data is from a media presentation device on which the currently presented media program is presented and that is remote from the apparatus.

13. An apparatus as described in claim 10, wherein the operations further comprise receiving other sensor data, the other sensor data sensed during the first portion of the currently presented media program and associated with a different user than a user associated with the first-mentioned sensor data, the different user physically local to the user, and wherein determining the future portion of the currently presented media program is further based on the other sensor data.

14. An apparatus as described in claim 10, wherein the operations further comprise presenting, by the apparatus, the currently presented media program and receiving, from the user and by the apparatus, the sensor data, and wherein determining the future portion of the currently presented media program determines the future portion of the currently presented media program from the set of future portions of the currently presented media program previously stored on the one or more computer-readable storage media, the set of future portions of the currently presented media program associated with a time-range in the currently presented media program at which to present the future portion of the currently presented media program.

15. An apparatus as described in claim 10, wherein the first portion of the currently presented media program is an advertisement and determining the future portion of the currently presented media program determines the future portion of the currently presented media program based on the future portion of the currently presented media program determined to have the user have a higher interest level than one or more other previously prepared future portions of the currently presented media program of the set of future portions of the media currently presented program.

16. An apparatus as described in claim 10, wherein the determining the future portion of the currently presented media program is further based on sensor data actively sensed during the first portion of the currently presented media program.

17. An apparatus as described in claim 10, wherein the interest level for the user is further based on one or more of a demographic of the user, weather information at the user'"'"'s location, the user'"'"'s schedule, a time of day, or sensor data received from other users remote to the user.

18. A method implemented by a computing device comprising:

receiving, by the computing device and during a presentation of a first portion of a currently presented media program, passively sensed sensor data for a user during the first portion of the currently presented media program for a user;

determining, by the computing device, a probability of a state of the user and an engagement level of the user during the first portion of the currently presented media program based on the sensor data, the probability of the state of the user and the engagement level of the user during the first portion of the currently presented media program being normalized by historical sensor data received for the user;

determining, by the computing device, an interest level of the user during the first portion of the currently presented media program based on the probability of the state of the user during the first portion of the currently presented media program, the engagement level of the user during the first portion of the currently presented media program, and a context for the first portion of the currently presented media program, the interest level of the user being normalized by the historical sensor data received for the user;

determining, by the computing device, based on the first portion of the currently presented media program and the interest level being determined to be low for the user during the first portion of the currently presented media program, a future portion of the currently presented media program, the future portion of the currently presented media program;

occurring during a later portion of the currently presented media program;

during a current presentation of the currently presented media program; and

selected from a set of future portions of the currently presented media program based on a dissimilarity to the first portion of the currently presented media program; and

causing, by the computing device, the future portion of the currently presented media program to be presented during the later portion of the currently presented media program and during the current presentation of the currently presented media program.

19. A method as described in claim 18, wherein the method further comprises determining, by the computing device, based on the first portion of the currently presented media program and the interest level being determined to be high for the user during the first portion of the currently presented media program, another future portion of the currently presented media program, the other future portion of the currently presented media program:

occurring during a later portion of the currently presented media program;

during a current presentation of the currently presented media program; and

selected from the set of future portions of the currently presented media program based on a similarity to the first portion of the currently presented media program.

20. A method as described in claim 18, wherein the interest level for the user is further based on one or more of a demographic of the user, weather information at the user'"'"'s location, the user'"'"'s schedule, a time of day, or sensor data received from other users remote to the user.