Determining streaming content user consumption

• US 11,062,331 B2
• Filed: 04/10/2019
• Issued: 07/13/2021
• Est. Priority Date: 08/08/2016
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Greenberger, Jeremy A., Greenberger, Zachary M.
• Primary Examiner(s): Mansfield, Thomas L
• Application Number:
  US16/380,139
• Publication Number:
  US 20190311381A1
• Time in Patent Office: 825 Days
• Field of Search: None
• CPC Class Codes: G06Q 30/0201 Market modelling; Market analysis; Collecting market data
• CPC Class Codes: H04L 63/107 wherein the security policies are location-dependent, e.g. entities privileges depend on current location or allowing specific operations only from locally connected terminals
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/029 Location-based management or tracking services

Abstract

Confidence of attentiveness of a consumer of a media object on a media playback device is estimated by detecting a user action performed on a mobile computing device while or soon after the media objects are presented; responsive to the user action detection, retrieving descriptors for the media object; correlating the detected user action and the descriptors; if sufficiently correlated, determining a degree of confidence that the user is attentive to the media object; and recording the one user action, the media object descriptors, and the degree of confidence into digital results into computer memory.

Claims

1. A method comprising:

detecting, by a computer, a user action on a user device, wherein the detected user action is independent of one or more media objects transmitted via a computer network to the user device;

retrieving, by a computer, from a media object server, one or more media object descriptors for the one or more media objects;

determining, by a computer, a correlation of the detected user action to the one or more retrieved media descriptors;

responsive to the correlation of the detected user action to the one or more retrieved media descriptors meeting a first threshold, determining, by a computer, a degree of confidence that the user is paying attention to at least one of the one or more media objects, wherein the degree of confidence that the user is paying attention is determined by performing analytic analysis on one or more available metrics, and further wherein the one or more available metrics include at least one of an amount of time elapsed between the reception of the media object on the media device and the user action, and a number of times the user action has been performed; and

responsive to the degree of confidence that the user is paying attention to at least one of the one or more media objects meeting a second threshold, recording, by a computer, the user action, the one or more correlated media object descriptors, and the degree of confidence into one or more digital results in computer memory.

2. The method as set forth in claim 1 wherein the one or more media objects are transmitted to the user device by one or more transmission modes selected from the group consisting of currently streaming, currently broadcasting, recently streamed, and recently broadcasted.

3. The method as set forth in claim 1 wherein the media object server comprises one or more servers selected from the group consisting of a streaming media server and a broadcast server.

4. The method of claim 1 further comprising:

repeating, by a computer, the steps of detecting, retrieving, correlating, determining and recording for a plurality of users; and

wherein the determining of the degree of confidence comprises determining, by a computer, a degree of confidence that the plurality of users are attentive to at least one or more media objects.

5. The method as set forth in claim 1 wherein the detected user action comprises one or more user actions selected from the group consisting of launching a local application program on the mobile computing device, submitting search criteria to search engine website, submitting search criteria to search engine via a search engine application program, creating an event in a locally-stored electronic calendar, modifying an event in a locally-stored electronic calendar, accepting an event in a locally-stored electronic calendar, creating an event in a remotely-stored electronic calendar, modifying an event in a remotely-stored electronic calendar, accepting an event in a remotely-stored electronic calendar, authoring an electronic message, reading an electronic message, forwarding an electronic message, replying to an electronic message, initiating a streaming message, receiving a streaming message, joining a streaming message, forwarding a streaming message, responding to a streaming message, creating a social media post on a social media account, responding to a social media post on a social media account, reposting a social media post on a social media account, setting a reaction indication to a social media post on a social media account, deleting a social media post on a social media account, casting an electronic vote, visiting a website, visiting Uniform Resource Locator (URL), selecting a hyperlink, accessing an additional media object, and initiating a telephone call.

6. The method as set forth in claim 1 wherein the one or more transmitted media objects comprise at least one media object selected from the group consisting of a streaming video object, a streaming audio object, an online presentation, a broadcast television program, an electronic advertisement, and a broadcast audio program.

19. The method of claim 1, wherein the one or more available metrics includes a strength of the correlation of the detected user action to the one or more retrieved media descriptors.

20. The method of claim 1, wherein the one or more available metrics includes a number of known associates of the user that are concurrently performing relevant actions to the media object.

7. A computer program product comprising:

a tangible, computer-readable memory device which is not a propagating signal per se, accessible by a processor;

program instructions embodied by the memory device to cause the processor to, when executed, perform steps comprising;

detect a user action on a user device, wherein the detected user action is independent of one or more media objects transmitted via a computer network to the user device;

retrieve from a media object server, one or more media object descriptors for the one or more media objects;

determine a correlation of the detected user action to the one or more retrieved media descriptors;

responsive to the correlation of the detected user action to the one or more retrieved media descriptors meeting a first threshold, determine a degree of confidence that the user is paying attention to at least one of the one or more media objects, wherein the degree of confidence that the user is paying attention is determined by performing analytic analysis on one or more available metrics, and further wherein the one or more available metrics include at least one of an amount of time elapsed between the reception of the media object on the media device and the user action, a strength of the correlation of the detected user action to the one or more retrieved media descriptors, a number of times the user action has been performed, and a number of known associates of the user that are concurrently performing relevant actions to the media object; and

responsive to the degree of confidence that the user is paying attention to at least one of the one or more media objects meeting a second threshold, record the user action, the one or more correlated media object descriptors, and the degree of confidence into one or more digital results in computer memory.

8. The computer program product as set forth in claim 7 wherein the one or more media objects are transmitted to the user device by one or more transmission modes selected from the group consisting of currently streaming, currently broadcasting, recently streamed, and recently broadcasted.

9. The computer program product as set forth in claim 7 wherein the media object server comprises one or more servers selected from the group consisting of a streaming media server and a broadcast server.

10. The computer program product of claim 7 wherein the program instructions further comprise program instructions for causing a processor to:

repeat the detecting, retrieving, correlating, determining and recording for a plurality of users; and

wherein the determining of the degree of confidence comprises determining, by a computer, a degree of confidence that the plurality of users are attentive to at least one or more media objects.

11. The computer program product of claim 7 wherein the detected user action comprises one or more user actions selected from the group consisting of launching a local application program on the mobile computing device, submitting search criteria to search engine website, submitting search criteria to search engine via a search engine application program, creating an event in a locally-stored electronic calendar, modifying an event in a locally-stored electronic calendar, accepting an event in a locally-stored electronic calendar, creating an event in a remotely-stored electronic calendar, modifying an event in a remotely-stored electronic calendar, accepting an event in a remotely-stored electronic calendar, authoring an electronic message, reading an electronic message, forwarding an electronic message, replying to an electronic message, initiating a streaming message, receiving a streaming message, joining a streaming message, forwarding a streaming message, responding to a streaming message, creating a social media post on a social media account, responding to a social media post on a social media account, reposting a social media post on a social media account, setting a reaction indication to a social media post on a social media account, deleting a social media post on a social media account, casting an electronic vote, visiting a website, visiting Uniform Resource Locator (URL), selecting a hyperlink, accessing an additional media object, and initiating a telephone call.

12. The computer program product of claim 7 wherein the media object comprises at least one media object selected from the group consisting of a streaming video object, a streaming audio object, an online presentation, a broadcast television program, an electronic advertisement, and a broadcast audio program.

13. A system comprising:

a computer processor for executing program instructions;

a tangible, computer-readable memory device which is not a propagating signal per se, accessible by the processor;

program instructions embodied by the memory device to cause the processor to, when executed, perform steps comprising;

detect a user action on a user device, wherein the detected user action is independent of one or more media objects transmitted via a computer network to the user device;

retrieve from a media object server, one or more media object descriptors for the one or more media objects;

determine a correlation of the detected user action to the one or more retrieved media descriptors;

responsive to the correlation of the detected user action to the one or more retrieved media descriptors meeting a first threshold, determine a degree of confidence that the user is paying attention to at least one of the one or more media objects, wherein the degree of confidence that the user is paying attention is determined by performing analytic analysis on one or more available metrics, and further wherein the one or more available metrics include at least one of an amount of time elapsed between the reception of the media object on the media device and the user action, a strength of the correlation of the detected user action to the one or more retrieved media descriptors, a number of times the user action has been performed, and a number of known associates of the user that are concurrently performing relevant actions to the media object; and

responsive to the degree of confidence that the user is paying attention to at least one of the one or more media objects meeting a second threshold, record the user action, the one or more correlated media object descriptors, and the degree of confidence into one or more digital results in computer memory.

14. The system as set forth in claim 13 wherein the one or more media objects are transmitted to the user device by one or more transmission modes selected from the group consisting of currently streaming, currently broadcasting, recently streamed, and recently broadcasted.

15. The system as set forth in claim 13 wherein the media object server comprises one or more servers selected from the group consisting of a streaming media server and a broadcast server.

16. The system as set forth in claim 13 wherein the program instructions further comprise program instructions for causing a processor to:

repeat the detecting, retrieving, correlating, determining and recording for a plurality of users; and

wherein the determining of the degree of confidence comprises determining, by a computer, a degree of confidence that the plurality of users are attentive to at least one or more media objects.

17. The system as set forth in claim 13 wherein the detected user action comprises one or more user actions selected from the group consisting of launching a local application program on the mobile computing device, submitting search criteria to search engine website, submitting search criteria to search engine via a search engine application program, creating an event in a locally-stored electronic calendar, modifying an event in a locally-stored electronic calendar, accepting an event in a locally-stored electronic calendar, creating an event in a remotely-stored electronic calendar, modifying an event in a remotely-stored electronic calendar, accepting an event in a remotely-stored electronic calendar, authoring an electronic message, reading an electronic message, forwarding an electronic message, replying to an electronic message, initiating a streaming message, receiving a streaming message, joining a streaming message, forwarding a streaming message, responding to a streaming message, creating a social media post on a social media account, responding to a social media post on a social media account, reposting a social media post on a social media account, setting a reaction indication to a social media post on a social media account, deleting a social media post on a social media account, casting an electronic vote, visiting a website, visiting Uniform Resource Locator (URL), selecting a hyperlink, accessing an additional media object, and initiating a telephone call.

18. The system as set forth in claim 13 wherein the media object comprises at least one media object selected from the group consisting of a streaming video object, a streaming audio object, an online presentation, a broadcast television program, an electronic advertisement, and a broadcast audio program.