Automated rich presentation of a semantic topic
First Claim
1. A computer-implemented method comprising:
- determining a semantic topic;
evaluating respective portions of multimodal information corresponding to the semantic topic to identify events, each event being associated with one or more of person, time, location, and keyword;
for each document in the respective portion, calculating probability that the document belongs to an event of the events based on a generative model and document distribution along a timeline associated with the event;
for each event in least a subset of the events;
objectively identifying one or more representative documents that are of greater relevance to the event as compared to other documents;
extracting other media corresponding to the representative documents from the multimodal information, the representative documents and the other media being objectively most representative of the semantic topic; and
wherein the one or more representative documents and the other media are for presentation to a user in a storyboard.
2 Assignments
0 Petitions
Accused Products
Abstract
Automated rich presentation of a semantic topic is described. In one aspect, respective portions of multimodal information corresponding to a semantic topic are evaluated to locate events associated with the semantic topic. The probability that a document belongs to an event is determined based on document inclusion of one or more of persons, times, locations, and keywords, and document distribution along a timeline associated with the event. For each event, one or more documents objectively determined to be substantially representative of the event are identified. One or more other types of media (e.g., video, images, etc.) related to the event are then extracted from the multimodal information. The representative documents and the other media are for presentation to a user in a storyboard.
-
Citations
17 Claims
-
1. A computer-implemented method comprising:
-
determining a semantic topic; evaluating respective portions of multimodal information corresponding to the semantic topic to identify events, each event being associated with one or more of person, time, location, and keyword; for each document in the respective portion, calculating probability that the document belongs to an event of the events based on a generative model and document distribution along a timeline associated with the event; for each event in least a subset of the events; objectively identifying one or more representative documents that are of greater relevance to the event as compared to other documents; extracting other media corresponding to the representative documents from the multimodal information, the representative documents and the other media being objectively most representative of the semantic topic; and wherein the one or more representative documents and the other media are for presentation to a user in a storyboard. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A computer implemented method comprising:
-
determining a semantic topic; extracting, from multimedia data, multimodal information relevant to the semantic topic; evaluating respective portions of the multimodal information to identify events, each event being associated with one or more of person, time, location, and keyword; for each document in the respective portion, calculating probability that the document belongs to an event of the events based on a generative model and document distribution along a timeline associated with the event; generating an event summary summarizing the events; for each event in the event summary; objectively identifying one or more representative documents that are of greater relevance to the event as compared to other documents; and extracting other media corresponding to the representative documents from the multimodal information, the representative documents and the other media being representative content; integrating the representative content into a storyboard layout for presentation to a user, the storyboard layout providing a concise overview of salient event(s) and associated multimodal information regarding the semantic topic. - View Dependent Claims (14, 15, 16, 17)
-
Specification