Aiding discovery of program content by providing deeplinks into most interesting moments via social media

• US 9,237,386 B2
• Filed: 08/31/2012
• Issued: 01/12/2016
• Est. Priority Date: 08/31/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Oztaskent, Ant, Zafirovski, Gjokica
• Primary Examiner(s): Ortiz Ditren, Belix M
• Application Number:
  US13/601,722
• Publication Number:
  US 20140067825A1
• Time in Patent Office: 1,229 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/5846 using extracted text
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 16/9536 Search customisation based on social or collaborative filtering
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/64322 IP
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02

Abstract

A computerized method, system for, and computer-readable medium operable to: retrieve program details data about at least one media program. Retrieve social media posts involving the at least one media program. Match the retrieved program details data with the retrieved social media posts to find matching locations. Store time offset data corresponding to the matched locations within the at least one media program into at least one micropost. Rank the at least one media program by the number of microposts corresponding to the at least one media program. Present the at least one media program, each of the at least one media program with at least one micropost, wherein the at least one micropost comprises a link to the original social media page hosting the social media post and a video deeplink that plays a time off-set video, the time off-set video starting from the stored time offset data.

Claims

1. A computerized method, comprising:

retrieving, via a computing device, program details data about at least one media program, wherein the program details data comprises subtitle data for the at least one media program;

retrieving, via the computing device, social media posts involving the at least one media program, wherein each social media post includes text data;

comparing, via the computing device, the subtitle data with the text data from each of the retrieved social media posts;

identifying, via the computing device, based on the comparison, social media posts that include text data that matches a portion of the subtitle data

identifying, via the computing device, how many different locations within the subtitle data are matched by text data from at least one of the retrieved social media posts

identifying, via the computing device, for each identified social media post that includes text data that matches a portion of the subtitle data, timestamp data associated with the subtitle data that matches the text data;

identifying, via the computing device, time offset data corresponding to the subtitle data that matches the text data based on the identified timestamp data;

storing, via the computing device, the time offset data corresponding to the subtitle data that matches the text data within the at least one media program into at least one micropost;

ranking, via the computing device, the at least one media program based on the number of different locations within the subtitle data that are matched by text data from at least one of the retrieved social media posts; and

presenting, via the computing device, the at least one media program based on the ranking, including presenting each of the at least one media program with the at least one micropost, wherein the at least one micropost comprises a link to a social media page hosting at least one of the social media posts and a video deeplink that plays a time-offset video, the time-offset video comprising video from the at least one media program corresponding to the stored time offset data.

2. The method of claim 1, wherein the at least one media program comprises a television program, a web-based program viewable online, a podcast and a broadcast media program.

3. The method of claim 1, wherein the program details data comprises, from the at least one media program:

program name, episode names, airing times, links to websites or videos where episodes can be watched online, character names, cast lists, official hashtags, social media service usernames or identifiers and other metadata, wherein the subtitle data comprises hearing-impaired caption data and script data.

4. The method of claim 1, wherein retrieving, via the computer device, social media posts involving the at least one media program comprises:

focusing the search of all social media posts into a subset of social media posts that occur during the airing time from the program details data of the at least one media program as well as a preselected amount of time before and after the airing time;

determining if any of the subset of social media posts reference any data from the program details data; and

storing any social media posts that reference any data from the program details data into the retrieved social media posts.

5. The method of claim 1, further comprising:

matching a first predetermined number of consecutive word matches, wherein the predetermined number is higher for word sequences that include stop-words and lower for word sequences of uncommon words;

matching every other word according to a second predetermined number of consecutive word matches;

matching if there is a low Hamming distance between a retrieved social media post and selected subtitle data; and

matching based on colors or formatting of subtitles.

6. The method of claim 3, wherein matching, via the computing device, the retrieved program details data with the retrieved social media posts to find matching locations comprises:

determining if the retrieved social media posts summarize any portions of the at least one media program by keyword searches or comparing the social media posts with any information from the program details data; and

storing such summary data if found into the matching locations.

7. The method of claim 1, wherein storing, via the computing device, the time offset data corresponding to the matched locations within the at least one media program into at least one micropost comprises:

finding the a time offset value in an episode of the at least one media program where the matched data from the matching location begins, wherein the time offset value comprises a time offset value where the matched data exactly begins and a time offset value starting from the beginning of the sentence where the matched data exactly begins and a time offset value starting from the beginning of the scene where the matched data exactly begins; and

storing the time offset value as the time offset data.

8. The method of claim 1, wherein ranking, via the computing device, the at least one media program by the number of the matched locations within the at least one media program comprises:

ascertaining how many microposts refer to the same matched locations;

grouping and totaling those microposts that refer to those matched locations; and

using the total number of microposts in the ranking of the at least one media program in comparison to other media programs.

9. The method of claim 1, wherein presenting, via the computing device, the at least one media program based on the ranking, including presenting each of the at least one media program with at least one micropost comprises:

presenting each of the at least one media program in a program panel on a user interface, wherein the user interface loads a predetermined number of program panels on a screen at one time, and further wherein the program panel comprises the title of the at least one media program, at least one program link, at least one social media affirmation button, the at least one micropost, at least one program summary news byte, and at least one loading area; and

executing a clicked item on the user interface either directly on the user interface itself or on a separate user interface.

10. The method of claim 9, wherein the program link may be a media item that plays an episode or clip from the at least one media program directly on the user interface, or directs the user interface to the separate user interface of another website where the episode or clip from the at least one media program may be played,

further wherein the social media affirmation button allows the confirmation and sharing of the at least one media program and the at least one media program with at least one social media service;

further wherein the at least one program summary news byte provides a news item that can be opened up and read directly from the user interface or links to the separate user interface of another news website where the news item may be read; and

further wherein the at least one loading area may be clicked on to load more program panels.

11. The method of claim 9, wherein the video deeplink may play the time-offset video directly on the user interface or links to the separate user interface of another website where the time-offset video may be played, and further wherein the time-offset video may be played until an ending point, the ending point comprising the end of the scene discussed in the micropost and the end of the entire episode.

12. A system comprising a processing circuit operable to:

retrieve program details data about at least one media program, wherein the program details data comprises subtitle data for the at least one media program;

retrieve social media posts involving the at least one media program, wherein each social media post includes text data;

compare the subtitle data with the text data from each of the retrieved social media posts;

identify, based on the comparison, social media posts that include text data that matches a portion of the subtitle data;

identify how many different locations within the subtitle data are matched by text data from at least one of the retrieved social media posts;

identify, for each identified social media post that includes text data that matches a portion of the subtitle data, timestamp data associated with the subtitle data that matches the text data;

identify time offset data corresponding to the subtitle data that matches the text data based on the identified timestamp data;

store the time offset data corresponding to the subtitle data that matches the text data within the at least one media program into at least one micropost;

rank the at least one media program based on the number of different locations within the subtitle data that are matched by text data from at least one of the retrieved social media posts; and

present the at least one media program based on the rank, including presenting each of the at least one media program with the at least one micropost, wherein the at least one micropost comprises a link to a social media page hosting at least one of the social media posts and a video deeplink that plays a time-offset video, the time-offset video comprising video from the at least one media program corresponding to the stored time offset data.

13. The system of claim 12, wherein the program details data comprises, from the at least one media program:

program name, episode names, airing times, links to websites or videos where episodes can be watched online, character names, cast lists, official hashtags, social media service usernames or identifiers and other metadata, wherein the subtitle data comprises hearing-impaired caption data and script data, and

further wherein the at least one media program comprises a television program, a web-based program viewable online, a podcast and a broadcast media program.

14. The system of claim 12, wherein to retrieve social media posts involving the at least one media program comprises:

focusing the search of all social media posts into a subset of social media posts that occur during the airing time from the program details data of the at least one media program as well as a preselected amount of time before and after the airing time;

determining if any of the subset of social media posts reference any data from the program details data; and

storing any social media posts that reference any data from the program details data into the retrieved social media posts.

15. The system of claim 12, further comprising:

matching a first predetermined number of consecutive word matches, wherein the predetermined number is higher for word sequences that include stop-words and lower for word sequences of uncommon words;

matching every other word according to a second predetermined number of consecutive word matches;

matching if there is a low Hamming distance between a retrieved social media post and selected subtitle data; and

matching based on colors or formatting of subtitles.

16. The system of claim 12, wherein to store the time offset data corresponding to the matched locations within the at least one media program into at least one micropost comprises:

finding the a time offset value in an episode of the at least one media program where the matched data from the matching location begins, wherein the time offset value comprises a time offset value where the matched data exactly begins and a time offset value starting from the beginning of the sentence where the matched data exactly begins and a time offset value starting from the beginning of the scene where the matched data exactly begins; and

storing the time offset value as the time offset data.

17. The system of claim 12, wherein to rank the at least one media program by the number of the matched locations within the at least one media program comprises:

ascertaining how many microposts refer to the same matched locations;

grouping and totaling those microposts that refer to those matched locations; and

using the total number of microposts in the ranking of the at least one media program in comparison to other media programs.

18. The system of claim 12, wherein to present the at least one media program based on the ranking, including presenting each of the at least one media program with at least one micropost comprises:

presenting each of the at least one media program in a program panel on a user interface, wherein the user interface loads a predetermined number of program panels on a screen at one time, and further wherein the program panel comprises the title of the at least one media program, at least one program link, at least one social media affirmation button, the at least one micropost, at least one program summary news byte, and at least one loading area; and

executing a clicked item on the user interface either directly on the user interface itself or on a separate user interface.

19. The system of claim 18, wherein the program link may be a media item that plays an episode or clip from the at least one media program directly on the user interface, or directs the user interface to the separate user interface of another website where the episode or clip from the at least one media program may be played,

further wherein the social media affirmation button allows the confirmation and sharing of the at least one media program and the at least one media program with at least one social media service;

further wherein the at least one program summary news byte provides a news item that can be opened up and read directly from the user interface or links to the separate user interface of another news website where the news item may be read; and

further wherein the at least one loading area may be clicked on to load more program panels.

20. The system of claim 18, wherein the video deeplink may play the time-offset video directly on the user interface or links to the separate user interface of another website where the time-offset video may be played, and further wherein the time-offset video may be played until an ending point, the ending point comprising the end of the scene discussed in the micropost and the end of the entire episode.

21. A non-transitory computer-readable storage medium having instructions thereon that cause one or more processors to perform operations, the operations comprising:

retrieving program details data about at least one media program, wherein the program details data comprises subtitle data for the at least one media program;

retrieving social media posts involving the at least one media program, wherein each social media post includes text data;

comparing the subtitle data with the text data from each of the retrieved social media posts;

identifying based on the comparison, social media posts that include text data that matches a portion of the subtitle data;

identifying how many different locations within the subtitle data are matched by text data from at least one of the retrieved social media posts;

identifying, for each identified social media post that includes text data that matches a portion of the subtitle data, timestamp data associated with the subtitle data that matches the text data;

identifying time offset data corresponding to the subtitle data that matches the text data based on the identified timestamp data;

storing the time offset data corresponding to the subtitle data that matches the text data within the at least one media program into at least one micropost;

ranking the at least one media program based on the number of different locations within the subtitle data that are matched by text data from at least one of the retrieved social media posts; and

presenting the at least one media program based on the ranking, including presenting each of the at least one media program with the at least one micropost, wherein the at least one micropost comprises a link to a social media page hosting at least one of the social media posts and a video deeplink that plays a time-offset video, the time-offset video comprising video from the at least one media program corresponding to the stored time offset data.

22. The non-transitory computer-readable storage medium of claim 21, wherein the program details data comprises, from the at least one media program:

program name, episode names, airing times, links to websites or videos where episodes can be watched online, character names, cast lists, official hashtags, social media service usernames or identifiers and other metadata, wherein the subtitle data comprises hearing-impaired caption data and script data, and

further wherein the at least one media program comprises a television program, a web-based program viewable online, a podcast and a broadcast media program.

23. The non-transitory computer-readable storage medium of claim 21, wherein retrieving social media posts involving the at least one media program comprises:

focusing the search of all social media posts into a subset of social media posts that occur during the airing time from the program details data of the at least one media program as well as a preselected amount of time before and after the airing time;

determining if any of the subset of social media posts reference any data from the program details data; and

storing any social media posts that reference any data from the program details data into the retrieved social media posts.

24. The non-transitory computer-readable medium of claim 21, wherein storing the time offset data corresponding to the matched locations within the at least one media program into at least one micropost comprises:

finding the a time offset value in an episode of the at least one media program where the matched data from the matching location begins, wherein the time offset value comprises a time offset value where the matched data exactly begins and a time offset value starting from the beginning of the sentence where the matched data exactly begins and a time offset value starting from the beginning of the scene where the matched data exactly begins; and

storing the time offset value as the time offset data.

25. The non-transitory computer-readable medium of claim 21, wherein ranking the at least one media program by the number of matched locations within the at least one media program comprises:

ascertaining how many microposts refer to the same matched locations;

grouping and totaling those microposts that refer to those matched locations; and

using the total number of microposts in the ranking of the at least one media program in comparison to other media programs.

26. The non-transitory computer-readable medium of claim 21, wherein presenting the at least one media program based on the ranking, including presenting each of the at least one media program with at least one micropost comprises:

presenting each of the at least one media program in a program panel on a user interface, wherein the user interface loads a predetermined number of program panels on a screen at one time, and further wherein the program panel comprises the title of the at least one media program, at least one program link, at least one social media affirmation button, the at least one micropost, at least one program summary news byte, and at least one loading area; and

executing a clicked item on the user interface either directly on the user interface itself or on a separate user interface.

27. A computerized method, comprising:

retrieving, via a computing device, subtitle data for a plurality of media programs;

retrieving, via the computing device, social media posts related to each of the plurality of media programs, wherein each social media post includes text data;

comparing, via the computing device, the subtitle data for the plurality of media programs with the text data from each of the retrieved social media posts related to that media program;

identifying, via the computing device, based on the comparison, social media posts that include text data that matches a portion of the subtitle data for a first media program of the plurality of media programs;

determining, via the computing device, for each social media post that includes text data that matches a portion of the subtitle data for the first media program, a portion of the first media program that corresponds to the portion of the subtitle data;

determining, via the computing device, a number of portions of the first media program that correspond to at least one social media post;

ranking, via the computing device, the first media program and other media programs of the plurality of media programs based at least in part on the number of portions of the first media program that correspond to the at least one social media post;

causing, via the computing device, a selectable representation of the first media program to be presented in a list of media programs in an order that is based on the ranking; and

causing, via the computing device, at least a subset of the identified social media posts to be presented in an area adjacent to the selectable representation of the first media program, wherein each social media post of the subset is associated with a video deeplink that causes the portion of the media program corresponding to the portion of the subtitle data that matches the text data to be presented upon selection of the video deeplink.