Data processing system for managing activities linked to multimedia content

• US 10,152,758 B2
• Filed: 05/24/2018
• Issued: 12/11/2018
• Est. Priority Date: 06/10/2016
• Status: Active Grant

• Current Assignee: RALI Solutions LLC
• Original Assignee: Understory, LLC
• Inventors: Benfield, Steve, Aslami, Ahmad, Jones, Taylor, Cutrell, Jonathan, Dolan, Taylor, Kimball, Andrew, Mills, Chad
• Primary Examiner(s): Nguyen, Cam Linh T
• Application Number:
  US15/988,882
• Publication Number:
  US 20180268502A1
• Time in Patent Office: 201 Days
• Field of Search: 707743
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/43 Querying
• CPC Class Codes: G06F 16/44 Browsing; Visualisation therefor
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/783 using metadata automatically derived from the content
• CPC Class Codes: G06F 40/00 Handling natural language data speech analysis or synthesis, speech recognition G10L
• CPC Class Codes: G06Q 30/0201 Market modelling; Market analysis; Collecting market data
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: H05K 999/00 dummy group
• CPC Class Codes: H05K 999/99 dummy group

Abstract

An activity management system is configured to allow users to access multimedia content where the multimedia content is divided in to segments. While a user is viewing or interacting with the multimedia content, the user can submit one or more activities (e.g., comments, questions, replies, or reactions) using a graphical user interface. The system is operable to electronically link the activity provided by the user with the particular segment of multimedia content in which the activity was captured by the system. The system is also configured to determine a sentiment score for particular multimedia content, one or more segments of the particular multimedia content, a user, a group of users, or an organization. The sentiment score may be related to a general mood (e.g., confused, happy, bored) of the user when viewing one or more segments of particular multimedia content.

Claims

1. A computer-implemented data processing method of providing one or more activities to subsequent viewers of a piece of multimedia in a time-shifted manner according to an activity map and determining a viewer influence score for a first viewer, comprising:

identifying, by one or more activity management servers, a plurality of segments that make up a piece of multimedia;

receiving, by the one or more activity management servers, a plurality of activities from one or more users prior to a first time, each particular activity of the plurality of activities being associated with a respective particular segment of the plurality of segments;

generating, by the one or more activity management servers, an activity map for the piece of multimedia based at least in part on the plurality of segments, the activity map indicating;

the association between each particular activity of the plurality of activities and the respective particular segment of the plurality of segments; and

one or more associations between one or more particular activities of the plurality of activities and one or more other activities of the plurality of activities;

receiving, by the one or more activity management servers, from a client device, a first request to display one or more activities associated with the piece of multimedia;

in response to the first request, generating a graphical display of the one or more activities associated with the piece multimedia based at least in part on the activity map;

causing the client device to display the graphical display;

identifying a first user of the one or more users;

calculating a viewer influence score for the first user based at least in part on a total number of the plurality of activities submitted by the first user; and

storing the viewer influence score in memory.

2. The computer-implemented data processing method of claim 1, wherein:

the plurality of activities submitted by the first user comprise one or more comments regarding the associated respective particular segment;

the plurality of activities comprise one or more responses to the one or more comments by the one or more subsequent viewers of the piece of multimedia; and

calculating the viewer influence score for the first user is further based at least in part on a total number of the one or more responses.

3. The computer-implemented data processing method of claim 1, wherein:

the method further comprises;

selecting one or more processed activities from the plurality of activities submitted by the first user;

generating a sentiment value for each one of the one or more processed activities selected from the plurality of activities submitted by the first user; and

transforming the sentiment values for the one or more processed activities into at least one sentiment score; and

calculating the viewer influence score for the first user is further based at least in part on the at least one sentiment score.

4. The computer-implemented data processing method of claim 3, wherein the step of generating a sentiment value for each one of the one or more processed activities further comprises:

a. evaluating each particular one of the one or more processed activities to determine the type of activity contained therein, wherein the type of activity is selected from a group consisting of;

i. a predefined text activity that the particular viewer can select via the first graphical user interface;

ii. a plurality of reactions that the particular viewer can select from via a graphical user interface when viewing the multimedia content, and

iii. a custom text entry that is entered by the particular viewer via the graphical user interface in response to the content of the multimedia content or to an activity submitted by another viewer; and

b. calculating a sentiment value for each activity type, wherein;

i. each predefined text activity is assigned a corresponding predefined sentiment value;

ii. each type of reaction from the plurality of reactions has a corresponding predefined sentiment value, and

iii. each custom text activity is passed through a sentiment filter that determines a sentiment value based on the contents of the custom text.

5. The computer-implemented data processing method of claim 3, wherein the step of transforming the sentiment values for the one or more processed activities into at least one sentiment score further comprises generating a sentiment score for each segment of the multimedia content based on each of the one or more processed activities linked to each respective segment of the multimedia content.

6. The computer-implemented data processing method of claim 1, wherein:

the method further comprises;

measuring a total number of words in each of the plurality of activities submitted by the first user; and

calculating the viewer influence score for the first user is further based at least in part on the total number of words in each of the plurality of activities submitted by the first user.

7. The computer-implemented data processing method of claim 1, wherein:

the plurality of activities comprise one or more responses to the plurality of activities submitted by the first user;

the method further comprises determining, from the one or more responses to the plurality of activities submitted by the first user, a total number of reactions and/or type of reactions that were elicited from other viewers in response to the plurality of activities submitted by the first user; and

calculating the viewer influence score for the first user further comprises calculating the viewer influence score based at least in part on the total number of reactions and/or type of reactions that were elicited from other viewers in response to the plurality of activities submitted by the first user.

8. The computer-implemented data processing method of claim 1, wherein:

the plurality of activities comprise one or more responses to the plurality of activities submitted by the first user;

the method further comprises;

selecting at least one of the one or more responses to the plurality of activities submitted by the first user;

generating a sentiment value for each at least one of the one or more responses to the plurality of activities submitted by the first user; and

transforming the sentiment values for each at least one of the one or more responses into at least one sentiment score; and

calculating the viewer influence score for the first user is further based at least in part on the at least one sentiment score.

9. The computer-implemented data processing method of claim 8, wherein the step of generating a sentiment value for each at least one of the one or more responses to the plurality of activities submitted by the first user further comprises:

a. evaluating each at least one of the one or more responses to determine the type of activity contained therein, wherein the type of activity is selected from a group consisting of;

iv. a predefined text activity that the particular viewer can select via the first graphical user interface;

v. a plurality of reactions that the particular viewer can select from via a graphical user interface when viewing the multimedia content, and

vi. a custom text entry that is entered by the particular viewer via the graphical user interface in response to the content of the multimedia content or to an activity submitted by another viewer; and

b. calculating a sentiment value for each activity type, wherein;

vii. each predefined text activity is assigned a corresponding predefined sentiment value;

viii. each type of reaction from the plurality of reactions has a corresponding predefined sentiment value, and

ix. each custom text activity is passed through a sentiment filter that determines a sentiment value based on the contents of the custom text.

10. The computer-implemented data processing method of claim 1, wherein calculating the viewer influence score for the first user further comprises calculating the viewer influence score based at least in part on one or more factors selected from the group consisting of:

i. a total number of activities submitted by the first user for each type of content that is contained in the particular multimedia content;

ii. a total number of activities submitted by the first user that elicited a conversation with one or more other users;

iii. a total number of activities submitted by the first user that were questions that elicited a response from one or more subsequent viewers; and

iv. a role of the first user within an organization.

11. An electronic data processing system for electronically managing a conversation that is linked to one or more segments of multimedia content that is divided into a plurality of segments, and for analyzing activities that make up the conversation, comprising:

a. one or more processors;

b. one or more databases coupled to the one or more processors;

c. a plurality of electronic data records stored in the one or more databases, each one of the plurality of electronic data records corresponding to an activity submitted by a viewer and comprising an identifier for the multimedia content, an identifier for the viewer who submitted the activity, and one or more data fields selected from a group consisting of;

i. text contained in the activity;

ii. a length of the activity;

iii. a number of words contained in the activity;

iv. a reaction type;

v. a reply count;

vi. an activity count;

vii. a question flag;

viii. an answer flag;

ix. an activity type; and

x. an identifier for a related activity that is linked to the activity;

wherein the one or more processors are configured for;

selecting one or more of the plurality of electronic data records for the particular multimedia content;

determining the type of activity contained in each one of the one or more selected electronic data records, wherein the type of activity is selected from a group consisting of;

a predefined text activity that the viewer selected while viewing the particular multimedia content;

a reaction that the viewer selected while viewing the particular multimedia content, and

a custom text entry that is entered by the viewer in response to the subject matter of the particular multimedia content or to an activity submitted by another viewer,

at least partially in response to determining the type of activity contained in each one of the one or more selected electronic data records, calculating a scoring value for each determined activity type, wherein;

each predefined text activity is assigned a corresponding predefined scoring value;

each type of reaction from the plurality of reactions has a corresponding predefined scoring value, and

each custom text entry is passed through a sentiment filter to determine a scoring value at least partially based on the contents of the custom text; and

calculating a viewer influence score for the viewer based at least in part on the scoring value.

12. The electronic data processing system of claim 11, wherein:

the plurality of electronic data records comprise a first electronic data record that corresponds to a custom text entry comment entered by the viewer in response to the subject matter of the particular multimedia content;

the one or more data fields corresponding to the first electronic data record comprise a length of the custom text entry comment; and

calculating the viewer influence score for the viewer is further based at least in part on the length of the custom text entry comment.

13. The electronic data processing system of claim 11, wherein:

the plurality of electronic data records comprise a second electronic data record that corresponds to a second activity submitted by the viewer;

the one or more data fields corresponding to the second electronic data record comprise an identifier for each of a plurality of activities submitted by one or more or viewers in response to the second activity and a reply count for the second activity; and

calculating the viewer influence score for the viewer is further based at least in part on the reply count.

14. The electronic data processing system of claim 11, wherein:

the plurality of electronic data records comprise a third electronic data record that corresponds to a third activity submitted by the viewer;

the one or more data fields corresponding to the third electronic data record comprise an identifier for each of a plurality of reactions submitted by one or more or viewers in response to the third activity and a reaction type for each of the plurality of reactions; and

calculating the viewer influence score for the viewer is further based at least in part on the reaction type for each of the plurality of reactions.

15. The electronic data processing system of claim 11, wherein:

the plurality of electronic data records comprise a fourth electronic data record that corresponds to a fourth activity submitted by the viewer;

the one or more data fields corresponding to the fourth electronic data record comprise an identifier for each of a plurality of activities submitted by one or more or viewers in response to the fourth activity, wherein each of the plurality of activities submitted by the one or more viewers in response to the fourth activities correspond to a respective electronic data record that comprises a data field indicating a length of the respective activity submitted in response to the fourth activity; and

calculating the viewer influence score for the viewer is further based at least in part on the length of each respective activity submitted in response to the fourth activity.

16. The electronic data processing system of claim 11, wherein:

the plurality of electronic data records comprise a fifth electronic data record that corresponds to a fifth activity submitted by the viewer;

the one or more data fields corresponding to the fifth electronic data record comprise an identifier for each of a plurality of responses submitted by one or more or viewers in response to the fifth activity;

the one or more processors are further configured for;

selecting at least one of the plurality of responses submitted by one or more or viewers in response to the fifth activity;

generating a sentiment value for each at least one of the plurality of responses; and

transforming the sentiment values for each at least one of the plurality of responses into at least one sentiment score; and

calculating the viewer influence score for the viewer is further based at least in part on the at least one sentiment score.

17. The electronic data processing system of claim 16, wherein generating the sentiment value for each at least one of the plurality of responses comprises generating the sentiment value based at least in part on the scoring value for each at least one of the plurality of responses.

18. The electronic data processing system of claim 11, wherein calculating the viewer influence score for the viewer further comprises calculating the viewer influence score based at least in part on one or more of the one or more data fields.

19. The electronic data processing system of claim 18, wherein:

the one or more data fields comprise the activity count; and

calculating the viewer influence score for the viewer further comprises calculating the viewer influence score based at least in part on the activity count.

20. The electronic data processing system of claim 18, wherein:

the one or more data fields comprise the number of words contained in the activity; and

calculating the viewer influence score for the viewer further comprises calculating the viewer influence score based at least in part on the number of words contained in the activity.