Data processing system for managing activities linked to multimedia content

• US 10,157,431 B2
• Filed: 05/24/2018
• Issued: 12/18/2018
• Est. Priority Date: 06/10/2016
• Status: Active Grant

• Current Assignee: RALI Solutions LLC
• Original Assignee: Understory, LLC
• Inventors: Benfield, Steve, Aslami, Ahmad, Jones, Taylor, Cutrell, Jonathan, Dolan, Taylor, Kimball, Andrew, Mills, Chad
• Primary Examiner(s): Jacob, Ajith
• Application Number:
  US15/988,859
• Publication Number:
  US 20180268498A1
• Time in Patent Office: 208 Days
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/43 Querying
• CPC Class Codes: G06F 16/44 Browsing; Visualisation therefor
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/783 using metadata automatically derived from the content
• CPC Class Codes: G06F 40/00 Handling natural language data speech analysis or synthesis, speech recognition G10L
• CPC Class Codes: G06Q 30/0201 Market modelling; Market analysis; Collecting market data
• CPC Class Codes: G06Q 50/01 Social networking

Abstract

An activity management system is configured to allow users to access multimedia content where the multimedia content is divided in to segments. While a user is viewing or interacting with the multimedia content, the user can submit one or more activities (e.g., comments, questions, replies, or reactions) using a graphical user interface. The system is operable to electronically link the activity provided by the user with the particular segment of multimedia content in which the activity was captured by the system. The system is also configured to determine a sentiment score for particular multimedia content, one or more segments of the particular multimedia content, a user, a group of users, or an organization. The sentiment score may be related to a general mood (e.g., confused, happy, bored) of the user when viewing one or more segments of particular multimedia content.

Claims

1. A computer-implemented data processing method for electronically linking one or more activities to a respective segment of multimedia content so that at least two users can create an asynchronous conversation that is linked to the segments of the multimedia content, comprising:

providing, by an activity management system, a first graphical user interface comprising a first segment display, wherein each segment on the first segment display is associated with a respective segment of multimedia content being viewed by a first viewer;

presenting, at a first time, on the first graphical user interface, a representation of one or more activities received from a facilitator of the multimedia content, wherein each of the one or more activities is linked to a respective segment of the multimedia content;

receiving at a second time subsequent to the first time, via the first graphical user interface, a first activity from the first viewer of the multimedia content;

electronically linking, by the activity management system, the received first activity to a first segment of the multimedia content;

creating a first electronic record that comprises one or more of the first activity, a multimedia identifier for the multimedia content, a first viewer identifier, and a first segment identifier for the first segment, and digitally storing the first electronic record; and

presenting, on the first graphical user interface, a first representation of the first activity on the first segment display in association with a point on the first segment display corresponding to the first segment of the multimedia.

2. The computer-implemented data processing method of claim 1, wherein the first activity is selected from a group consisting of:

a reply to a particular one of the one or more activities; and

a question entered via the first user interface in free form text.

3. The computer-implemented data processing method of claim 2, wherein:

the first activity is a reply to the particular one of the one or more activities; and

the particular one of the one or more activities is selected from a group consisting of;

a pre-seeded survey;

a pre-seeded question that is presented to elicit a response from the first viewer; and

a discussion point pre-seeded by the multimedia content owner.

4. The computer-implemented data processing method of claim 2, wherein;

the first activity is a first question entered via the first user interface in free form text; and

the method further comprises;

providing, by the activity management system, a facilitator graphical user interface that displays one or more user submitted questions associated with the multimedia content, the one or more user submitted questions comprising the first question.

5. The computer-implemented data processing method of claim 4, further comprising the steps of:

generating, by the activity management system, a plurality of segment displays, each one of the plurality of segment displays being presented on a respective one of a plurality of graphical user interfaces, wherein each segment on each of the plurality of segment displays is associated with a corresponding segment of the multimedia content being viewed by a plurality of viewers;

presenting on each one of the plurality of graphical user interfaces the representation of the one or more activities received from the facilitator at a point on each one of the plurality of segment displays that corresponds to the segment of the multimedia content that is associated with the one or more activities;

receiving at a plurality of times that are each after the first time, via each respective one of the plurality of graphical user interfaces, one or more second activities from each one of the plurality of viewers of the multimedia content;

electronically linking, by the activity management system, each received one or more second activities to a respective segment of the multimedia content;

creating a corresponding electronic record for each received one or more second activities from the plurality of viewers, each corresponding electronic record comprising a respective activity from the one or more second activities, the multimedia identifier for the multimedia content, an identifier of the viewer from the plurality of viewers, and a segment identifier for the respective segment linked to the respective activity, and digitally storing each corresponding electronic record; and

presenting, on each one of the plurality of graphical user interfaces, a representation of each one of the one or more second activities at a point on the plurality of segment displays that corresponds to the respective segment of the multimedia content that is linked with each respective activity.

6. The computer-implemented data processing method of claim 5, the method further comprising:

tracking, for each of the plurality of viewers, a respective progression through the piece of multimedia content;

digitally storing the respective progression in association with each respective viewer of the plurality of viewers; and

presenting, via the facilitator graphical user interface, each respective progression in association with the respective viewer.

7. The computer-implemented data processing method of claim 5, the method further comprising:

presenting, via the facilitator graphical user interface, a volume of the one or more second activities received from each one of the plurality of viewers.

8. A computer-implemented data processing method of providing one or more activities to subsequent viewers of a piece of multimedia in a time-shifted manner according to an activity map, wherein:

the one or more activities comprise at least one pre-seeded activity received from a facilitator of the piece of multimedia; and

the method comprises;

identifying, by one or more activity management servers, a plurality of segments that make up a piece of multimedia,

receiving, by the one or more activity management servers, a plurality of activities from one or more users prior to a first time, wherein;

each particular activity of the plurality of activities is associated with a respective particular segment of the plurality of segments; and

the plurality of activities comprise the at least one pre-seeded activity received from the facilitator of the piece of multimedia;

generating, by the one or more activity management servers, an activity map for the piece of multimedia based at least in part on the plurality of segments, the activity map indicating;

the association between each particular activity of the plurality of activities and the respective particular segment of the plurality of segments; and

one or more associations between one or more particular activities of the plurality of activities and one or more other activities of the plurality of activities;

receiving, by the one or more activity management servers, from a client device, a first request to display one or more activities associated with the piece of multimedia;

in response to the first request, generating a graphical display of the one or more activities associated with the piece multimedia based at least in part on the activity map; and

causing the client device to display the graphical display.

9. The computer-implemented data processing method of claim 8, wherein:

the at least one pre-seeded activity comprises a discussion point pre-seeded by the facilitator;

the discussion point pre-seeded by the facilitator is associated with a first particular segment of the plurality of segments;

the plurality of activities comprise a first response to the discussion point submitted by a first user; and

the activity map further indicates an association between the first response and the discussion point.

10. The computer-implemented data processing method of claim 8, the method further comprising:

tracking, for each of the one or more users, a respective progression through the piece of multimedia;

digitally storing the respective progression in association with each respective user of the one or more users;

receiving, by the one or more activity management servers, from the client device, a second request to display a progression of at least one user;

in response to the second request, generating a second graphical display of the respective progression of the at least one user; and

causing the client device to display the second graphical display.

11. The computer-implemented data processing method of claim 8, the method further comprising:

generating a graphic display based at least in part on the plurality of activities and the activity map;

providing the graphic display for display on the client device.

12. The computer-implemented data processing method of claim 11, wherein:

the graphic display comprises an activity graph; and

the method comprises generating the activity graph based on an activity density for each of the plurality of segments of the piece of multimedia.

13. The computer-implemented data processing method of claim 11, wherein the method further comprises generating the graphic display based on a type of each of the plurality of activities associated with each of the plurality of segments.

14. The computer-implemented data processing method of claim 13, wherein each of the plurality of activities comprise an activity selected from the group consisting of:

one or more free-form text comments;

one or more video comments;

one or more text comments; and

one or more predefined comments.

15. A computer-implemented data processing method for electronically managing a conversation that is linked to one or more segments of multimedia content divided into a plurality of segments, and for electronically analyzing activities that make up the conversation and providing the analysis to a facilitator of the multimedia content, the method comprising:

electronically receiving, from the facilitator, a pre-seeded activity associated with a first segment of the plurality of segments;

processing the pre-seeded activity by;

digitally storing the pre-seeded activity in memory;

mapping the pre-seeded activity to the first segment of the plurality of segments based at least in part on the pre-seeded activity; and

electronically associating the pre-seeded activity, the first segment, the facilitator, and the multimedia content in memory;

providing a user interface for submitting one or more viewer activities regarding the multimedia content, the one or more viewer activities comprising a first viewer activity and a second viewer activity;

identifying a plurality of segments that make up the multimedia content;

electronically receiving, via the user interface, the first viewer activity at a first time;

processing the first viewer activity by;

digitally storing the first viewer activity in memory;

mapping the first viewer activity to a first segment of the plurality of segments based at least in part on the first viewer activity; and

electronically associating the first viewer activity, the first segment, a first viewer associated with the first activity, and the multimedia content in memory;

electronically receiving, via the user interface, the second viewer activity at a second time, wherein the second time is subsequent to the first time;

processing the second viewer activity by;

digitally storing the second viewer activity in memory;

mapping the second viewer activity to a second segment of the plurality of segments based at least in part on the second viewer activity;

electronically associating the second viewer activity, the second segment, a second viewer associated with the second viewer activity, and the multimedia content in memory;

providing a facilitator interface for displaying data associated with the multimedia content; and

displaying, via the facilitator interface, at least one of the first viewer activity and the second viewer activity.

16. The computer-implemented data processing method of claim 15, wherein:

the pre-seeded activity is a pre-seeded question that is presented to elicit a response from the first viewer and the second viewer;

the first viewer activity is a response to the pre-seeded question; and

the second viewer activity is a response to the pre-seeded question.

17. The computer-implemented data processing method of claim 15, wherein the method further comprises:

generating an activity graph based on an activity density for each of the plurality of segments of the piece of multimedia; and

presenting the activity graph on the facilitator interface.

18. The computer-implemented data processing method of claim 15, wherein:

the pre-seeded activity is a pre-seeded survey; and

the first viewer activity comprises a selected answer to the pre-seeded survey.

19. The computer-implemented data processing method of claim 15, wherein:

the first viewer activity comprises a question in free form text; and

the method further comprises displaying the question via the facilitator interface, wherein displaying the question via the facilitator interface comprises displaying the question without displaying the piece of multimedia.

20. The computer-implemented data processing method of claim 19, wherein:

the second viewer activity is a response to the first viewer activity; and

the method further comprises electronically associating the second viewer activity with the first viewer activity in memory.