MEDIA FILE SUMMARIZER

• US 20170337273A1
• Filed: 05/17/2016
• Published: 11/23/2017
• Est. Priority Date: 05/17/2016
• Status: Abandoned Application

• Current Assignee: OpenTV, Inc. (Kudelski SA)
• Original Assignee: OpenTV, Inc. (Kudelski SA)
• Inventors: Iyer, Nandini, Lundell, Gregory James
• Application Number:
  US15/157,034
• Publication Number:
  US 20170337273A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/148 File search processing
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/7834 using audio features
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: G06F 16/787 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 16/9536 Search customisation based on social or collaborative filtering

Abstract

A summarizer machine can be configured provide a summary file of at least one episode of a media series. The summary file may be generated or otherwise provided based on one or more social media messages. The summarizer machine detects a request that the summary file be generated for a user, and the request may specify the episodes to be summarized. The machine accesses a media database that stores the episodes and also accesses a communication database that records communications among social connections of the requesting user. The communications all identify a same media scene in a same episode, and some of the communications all reference a same media frame in that media scene. The machine determines an excerpt of a media file for the episode and incorporates the excerpt into the generated summary file. The machine causes the summary file to be provided in response to the request.

Claims

1. A method comprising:

detecting, using one or more processors, a request that a summary file be generated for a user, the request specifying a set of episodes of media content to be summarized by the summary file;

accessing, using the one or more processors, a media database that stores one or more media files that each store a different episode among the set of episodes to be summarized, each media file including media frames that each have a different timecode in the media file;

accessing, using the one or more processors, a communication database that stores records of communications among a group of users whose social relationships to the user are modeled by a social relationships database, the records each identifying a same media scene in a same episode among the set of episodes, a portion of the records each referencing a same media frame in the media scene in the episode;

determining, using the one or more processors, an excerpt of the media file that stores the episode, the excerpt including the referenced media frame and being defined by a start timecode and a stop timecode that surround a timecode of the referenced media frame in the media file;

generating, using the one or more processors, the summary file for the user, the summary file including the excerpt that includes the media frame referenced by each record in the portion of the records; and

causing, using the one or more processors, the generated summary file to be provided to a device of the user in response to the request.

2. The method of claim 1, wherein:

the request that the summary file be generated specifies a target playback duration of the summary file; and

the determining of the excerpt includes determining the start timecode and the stop timecode based on the target playback duration specified by the request.

3. The method of claim 1, wherein:

a record in the portion of the records indicates a communication by a sender among the group of users;

the method further comprises accessing an indicator from the social relationships database, the indicator quantifying a degree of closeness between the sender and the user; and

the determining of the excerpt includes selecting the referenced media frame for inclusion in the summary file based on the degree of closeness quantified by the indicator.

4. The method of claim 3, wherein:

the indicator indicates a closest degree of closeness between the sender and the user; and

the selecting of the referenced media frame is based on the indicator indicating the closest degree of closeness.

5. The method of claim 1, wherein:

the determining of the excerpt of the media file includes identifying the timecode of the referenced media frame by reading the timecode of the referenced media frame from a record in the portion of the records.

6. The method of claim 1, wherein:

the determining of the excerpt of the media file includes identifying the timecode of the referenced media frame by;

detecting a first clock time at which the referenced media frame was provided to the group of users, the first clock time being detected by reading the first clock time from a record in the portion of the records;

accessing a broadcast schedule from a schedule database, the broadcast schedule indicating a second clock time at which a beginning of the episode was provided to the group of users; and

calculating the timecode of the referenced media frame within the media file based on a time difference between the first and second clock times.

7. The method of claim 1, wherein:

the determining of the excerpt of the media file includes identifying the timecode of the referenced media frame by;

detecting a first episode time at which the referenced media frame appeared in the episode, the first episode time being detected by reading the first episode time from a record in the portion of the records;

accessing a broadcast schedule from a schedule database, the broadcast schedule mapping a second episode time of the episode to a clock time at which a beginning of the episode was provided to the group of users; and

calculating the timecode of the referenced media frame within the media file based on a combination of the clock time, the first episode time, and the second episode time.

8. The method of claim 1, wherein:

the determining of the excerpt of the media file includes determining the stop timecode of the excerpt, the determining of the stop timecode including detecting a timecode of an ending keyframe that ends the media scene, the timecode of the ending keyframe immediately preceding a timecode of a beginning keyframe that begins a subsequent media scene in the episode, the determining of the stop timecode being based on the detected timecode of the ending keyframe that ends the media scene.

9. The method of claim 1, wherein:

the determining of the excerpt of the media file includes determining the start timecode of the excerpt, the determining of the start timecode including detecting a timecode of a beginning keyframe that begins the media scene, the timecode of the beginning keyframe immediately following a timecode of an ending keyframe that ends a preceding media scene in the episode, the determining of the start timecode being based on the detected timecode of the beginning keyframe that begins the media scene.

10. The method of claim 1, wherein:

the determining of the excerpt of the media file includes determining the stop timecode of the excerpt, the determining of the stop timecode including detecting a timecode of an audio peak subsequent to the timecode of the referenced media frame in the media file, the determining of the stop timecode being based on the detected timecode of the audio peak.

11. The method of claim 10, wherein:

the detecting of the timecode of the audio peak includes;

normalizing amplitudes of audio peaks in the media file; and

detecting the audio peak among the normalized amplitudes of the audio peaks based on a threshold audio level.

12. The method of claim 10, wherein:

the determining of the excerpt of the media file includes identifying the timecode of the referenced media frame, the identifying of the timecode of the referenced media frame including accessing a reference audio latency, the identifying of the timecode of the referenced media frame being based on the stop timecode of the excerpt and the reference audio latency.

13. The method of claim 10, wherein:

the determining of the excerpt of the media file includes determining the start timecode of the excerpt, the determining of the start timecode including accessing a reference scene duration, the determining of the start timecode being based on the reference scene duration and at least one of the stop timecode of the excerpt or the timecode of the referenced media frame.

14. The method of claim 1, wherein:

the determining of the excerpt of the media file includes determining the stop timecode of the excerpt, the determining of the stop timecode including detecting a timecode of a messaging peak in the records, the determining of the stop timecode being based on the detected timecode of the messaging peak.

15. The method of claim 14, wherein:

the detecting of the timecode of the messaging peak includes;

normalizing amplitudes of messaging peaks in the records; and

detecting the messaging peak among the normalized amplitudes of the messaging peaks based on a threshold messaging level.

16. The method of claim 14, wherein:

the determining of the excerpt of the media file includes identifying the timecode of the referenced media frame, the identifying of the timecode of the referenced media frame including accessing a reference messaging latency, the identifying of the timecode of the referenced media frame being based on the stop timecode of the excerpt and the reference messaging latency.

17. The method of claim 14, wherein:

the determining of the excerpt of the media file includes determining the start timecode of the excerpt, the determining of the start timecode including accessing a reference scene duration, the determining of the start timecode being based on the reference scene duration and at least one of the stop timecode of the excerpt or the timecode of the referenced media frame.

18. The method of claim 1, wherein:

the generating of the summary file includes;

accessing and analyzing multiple versions of the referenced media frame;

selecting a highest-quality version of the referenced media frame based on a set of image quality criteria; and

incorporating the highest-quality version of the referenced media frame into the summary file.

19. The method of claim 1, wherein:

the generating of the summary file generates a single-page document that includes the referenced media frame.

20. A non-transitory machine-readable storage medium comprising instructions that, when executed by processors of a machine, cause the machine to perform operations comprising:

detecting a request that a summary file be generated for a user, the request specifying a set of episodes of media content to be summarized by the summary file;

accessing a media database that stores one or more media files that each store a different episode among the set of episodes to be summarized, each media file including media frames that each have a different timecode in the media file;

accessing a communication database that stores records of communications among a group of users whose social relationships to the user are modeled by a social relationships database, the records each identifying a same media scene in a same episode among the set of episodes, a portion of the records each referencing a same media frame in the media scene in the episode;

determining an excerpt of the media file that stores the episode, the excerpt including the referenced media frame and being defined by a start timecode and a stop timecode that surround a timecode of the referenced media frame in the media file;

generating the summary file for the user, the summary file including the excerpt that includes the media frame referenced by each record in the portion of the records; and

causing the generated summary file to be provided to a device of the user in response to the request.

21. The non-transitory machine-readable storage medium of claim 20, wherein:

the determining of the excerpt of the media file includes selecting the referenced media frame for inclusion in the summary file based on a count of records in the portion of the records.

22. The non-transitory machine-readable storage medium of claim 20, wherein:

a record in the portion of the records references the media frame by indicating that a link to the referenced media frame was included in a communication by a sender among the group of users; and

the determining of the excerpt of the media file includes selecting the referenced media frame for inclusion in the summary file based on the record indicating that the link to the referenced media frame was included in the communication.

23. The non-transitory machine-readable storage medium of claim 20, wherein:

the media frames in the media file include video frames; and

the causing of the generated summary file to be provided to the device of the user in response to the request causes the device to present the video frames to the user via a display screen of the device.

24. A system comprising:

one or more processors; and

a memory storing instructions that, when executed by the one or more processors of a machine, cause the one or more processors to perform operations comprising;

detecting a request that a summary file be generated for a user, the request specifying a set of episodes of media content to be summarized by the summary file;

accessing a media database that stores one or more media files that each store a different episode among the set of episodes to be summarized, each media file including media frames that each have a different timecode in the media file;

accessing a communication database that stores records of communications among a group of users whose social relationships to the user are modeled by a social relationships database, the records each identifying a same media scene in a same episode among the set of episodes, a portion of the records each referencing a same media frame in the media scene in the episode;

determining an excerpt of the media file that stores the episode, the excerpt including the referenced media frame and being defined by a start timecode and a stop timecode that surround a timecode of the referenced media frame in the media file;

generating the summary file for the user, the summary file including the excerpt that includes the media frame referenced by each record in the portion of the records; and

causing the generated summary file to be provided to a device of the user in response to the request.

25. The system of claim 24, wherein:

the media frames in the media file include audio frames; and

the causing of the generated summary file to be provided to the device of the user in response to the request causes the device to present the audio frames to the user via an audio speaker of the device.