Data processing system for managing activities linked to multimedia content

• US 10,152,757 B2
• Filed: 05/24/2018
• Issued: 12/11/2018
• Est. Priority Date: 06/10/2016
• Status: Active Grant

• Current Assignee: RALI Solutions LLC
• Original Assignee: Understory, LLC
• Inventors: Benfield, Steve, Aslami, Ahmad, Jones, Taylor, Cutrell, Jonathan, Dolan, Taylor, Kimball, Andrew, Mills, Chad
• Primary Examiner(s): Le, Hung D
• Application Number:
  US15/988,868
• Publication Number:
  US 20180268499A1
• Time in Patent Office: 201 Days
• Field of Search: None
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/43 Querying
• CPC Class Codes: G06F 16/44 Browsing; Visualisation therefor
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/783 using metadata automatically derived from the content
• CPC Class Codes: G06F 40/00 Handling natural language data speech analysis or synthesis, speech recognition G10L
• CPC Class Codes: G06Q 30/0201 Market modelling; Market analysis; Collecting market data
• CPC Class Codes: G06Q 50/01 Social networking

Abstract

An activity management system is configured to allow users to access multimedia content where the multimedia content is divided in to segments. While a user is viewing or interacting with the multimedia content, the user can submit one or more activities (e.g., comments, questions, replies, or reactions) using a graphical user interface. The system is operable to electronically link the activity provided by the user with the particular segment of multimedia content in which the activity was captured by the system. The system is also configured to determine a sentiment score for particular multimedia content, one or more segments of the particular multimedia content, a user, a group of users, or an organization. The sentiment score may be related to a general mood (e.g., confused, happy, bored) of the user when viewing one or more segments of particular multimedia content.

Claims

1. A computer-implemented data processing method for electronically mapping one or more user activities to a respective segment of a piece of media content and electronically displaying the one or more activities in association with the respective segment of the piece of media content, the method comprising:

providing a user interface for submitting the one or more user activities regarding the piece of media content, the one or more user activities comprising a first activity and a second activity;

identifying a plurality of segments that make up the piece of media content;

electronically receiving, via the user interface, the first activity at a first time;

processing the first activity by;

digitally storing the first activity in memory;

mapping the first activity to a first segment of the plurality of segments based at least in part on the first activity; and

electronically associating the first activity, the first segment, and the piece of media content in memory;

displaying, at a second time subsequent to the first time the first activity in association with the first segment of the piece of media content;

electronically receiving, via the user interface, the second activity at a third time, wherein the third time is subsequent to the first time;

processing the second activity by;

digitally storing the second activity in memory;

mapping the second activity to a second segment of the plurality of segments based at least in part on the first activity; and

electronically associating the second activity, the second segment, and the piece of media content in memory; and

displaying, at a fourth time subsequent to the second time and the third time;

the first activity in association with the first segment of the piece of media content;

the second activity in association with the second segment of the piece of media content; and

a word cloud that indicates a visual display of a graphic density of one or more particular words that appear in the first activity and the second activity.

2. The computer-implemented data processing method of claim 1, further comprising:

generating the word cloud based at least in part on a frequency of the one or more particular words that appear in the first activity and the second activity.

3. The computer-implemented data processing method of claim 2, wherein displaying the word cloud comprises displaying more frequently used words of the one or more particular words in a larger font than less frequently used words of the one or more particular words.

4. The computer-implemented data processing method of claim 1, further comprising:

receiving a request to filter the one or more user activities based on a particular activity term;

in response to receiving the request, identifying one or more of the first activity and the second activity that comprise the particular activity term; and

displaying each of the identified activities that comprise the particular activity term in association with an associated particular segment.

5. The computer-implemented data processing method of claim 4, wherein receiving the request to filter the one or more activities based on a particular activity term comprises receiving the request in response to selection of a particular word of the one or more particular words in the word cloud.

6. The computer-implemented data processing method of claim 1, further comprising:

receiving a request to view one or more user activities associated with a particular respective segment; and

in response to the request, displaying the one or more user activities associated with the particular respective segment.

7. The computer-implemented data processing method of claim 6, further comprising:

receiving a request to filter the one or more activities based on a particular activity term;

in response to receiving the request, identifying one or more of the one or more user activities that comprise the particular activity term; and

displaying each of the one or more of the one or more user activities that comprise the particular activity term in association with the particular respective segment.

8. A computer-implemented data processing method of providing one or more activities to subsequent viewers of a piece of multimedia in a time-shifted manner according to an activity map, comprising:

identifying, by one or more activity management servers, a plurality of segments that make up a piece of multimedia;

receiving, by the one or more activity management servers, a plurality of activities from one or more users prior to a first time, each particular activity of the plurality of activities being associated with a respective particular segment of the plurality of segments;

generating, by the one or more activity management servers, an activity map for the piece of multimedia based at least in part on the plurality of segments, the activity map indicating;

the association between each particular activity of the plurality of activities and the respective particular segment of the plurality of segments; and

one or more associations between one or more particular activities of the plurality of activities and one or more other activities of the plurality of activities;

receiving, by the one or more activity management servers, from a client device, a first request to display one or more activities associated with the piece of multimedia;

in response to the first request, generating a graphical display of the one or more activities associated with the piece multimedia based at least in part on the activity map, the graphical display comprising a word cloud generated based at least in part on a graphic density of one or more particular words that appear in the one or more activities; and

causing the client device to display the graphical display.

9. The computer-implemented data processing method of claim 8, the method further comprising:

receiving, by the one or more activity management servers, one or more additional activities, each particular one of the one or more additional activities being associated with a respective particular segment of the plurality of segments; and

as the system receives each particular one of the one or more additional activities, substantially continuously updating, by the one or more activity management servers, the activity map to indicate;

the association between each particular one of the one or more additional activities and the respective particular segment; and

one or more associations between the one or more additional activities and the plurality of activities.

10. The computer-implemented data processing method of claim 9, the method further comprising:

receiving a request to filter the graphical display based at least in part on an activity term;

in response to the request, identifying one or more of the one or more activities that comprise the activity term, and

displaying, adjacent the graphical display, each of the identified activities that comprise the activity term in association with an associated particular segment.

11. The computer-implemented data processing method of claim 10, where receiving the request to filter the one or more activities based on the activity term comprises receiving the request in response to selection of a particular word of the one or more particular words in the word cloud.

12. The computer-implemented data processing method of claim 11, further comprising generating the word cloud based at least in part on a frequency of the one or more particular words that appear in the one or more activities.

13. The computer-implemented data processing method of claim 8, wherein generating the graphical display comprises determining which of the one or more activities to display based at least in part on one or more factors selected from the group consisting of:

an activity density for each of the plurality of segments, and

a type of activity that makes up the activity density for each of the plurality of segments.

14. The computer-implemented data processing method of claim 8, further comprising generating the word cloud based on the one or more words that appear in the one or more activities.

15. A computer-implemented data processing method for electronically linking one or more activities to a respective segment of a plurality of segments that make up a piece of multimedia content so that at least two users can create an asynchronous conversation that is linked to the respective segment of the multimedia content, comprising:

providing, by an activity management system, a first graphical user interface comprising a first segment display, wherein each segment on the first segment display is associated with a respective segment of the plurality of segments that make up the piece of multimedia content being viewed by a first viewer;

receiving at a first time, via the first graphical user interface, a first activity from the first viewer of the multimedia content;

electronically linking, by the activity management system, the received first activity to a first segment of the multimedia content;

creating a first electronic record that comprises one or more of the first activity, a multimedia identifier for the multimedia content, a first viewer identifier, and a first segment identifier for the first segment, and digitally storing the first electronic record; and

presenting, on the first graphical user interface;

a first representation of the first activity on the first segment display in association with a point on the first segment display corresponding to the first segment of the multimedia; and

a word cloud that indicates a visual display of a graphic density of one or more particular words that appear in the first activity and the one or more activities.

16. The computer-implemented data processing method of claim 15, the method further comprising:

receiving a request to filter the one or more activities based at least in part on an activity term;

in response to the request, identifying one or more of the one or more activities that comprise the activity term, and

displaying, adjacent the word cloud, the one or more of the one or more activities that comprise the activity term in association with an associated particular segment.

17. The computer-implemented data processing method of claim 16, where receiving the request to filter the one or more activities based on the activity term comprises receiving the request in response to selection of a particular word of the one or more particular words in the word cloud by the first viewer.

18. The computer-implemented data processing method of claim 15, further comprising:

generating, by the activity management system, a plurality of segment displays, each one of the plurality of segment displays being presented on a respective one of a plurality of graphical user interfaces, wherein each segment on each of the plurality of segment displays is associated with a corresponding segment of the multimedia content being viewed by a plurality of viewers;

presenting on each one of the plurality of graphical user interfaces the first representation of the first activity at a point on each one of the plurality of segment displays that corresponds to the segment of the multimedia content that is associated with the first activity;

receiving at a plurality of times, via each respective one of the plurality of graphical user interfaces, one or more activities from each one of the plurality of viewers of the multimedia content;

electronically linking, by the activity management system, each received one or more activities to a respective segment of the multimedia content;

creating a corresponding electronic record for each received one or more activities from the plurality of viewers, each corresponding electronic record comprising a respective activity from the one or more activities, the multimedia identifier for the multimedia content, an identifier of the viewer from the plurality of viewers, and a segment identifier for the respective segment linked to the respective activity, and digitally storing each corresponding electronic record; and

modifying the word cloud based at least in part on a frequency of the one or more particular words in the one or more activities as the system receives the one or more activities at the plurality of times.

19. The computer-implemented data processing method of claim 15, further comprising:

receiving selection of a particular viewer of the plurality of viewers;

in response to the request, identifying one or more of the one or more activities made by the particular viewer; and

displaying only those one or more of the one or more activities made by the particular viewer in conjunction with the word cloud.

20. The computer-implemented data processing method of claim 15, wherein presenting the word cloud comprises displaying more frequently used words of the one or more particular words in a bolder font than less frequently used words of the one or more particular words.