Systems and methods for generating video program extracts based on search queries

• US 9,535,990 B2
• Filed: 07/18/2014
• Issued: 01/03/2017
• Est. Priority Date: 05/20/2014
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Skolicki, Zbigniew
• Primary Examiner(s): Woo, Isaac M
• Application Number:
  US14/335,851
• Publication Number:
  US 20150339382A1
• Time in Patent Office: 900 Days
• Field of Search: 707600-899
• US Class Current: 1/1
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739

Abstract

A process builds extracts for video programs based on search query spikes during transmission of the video programs. The process is performed at a server system with one or more processors and memory storing programs configured for execution by the one or more processors. The process identifies a plurality of search query spikes from search queries submitted by a plurality of users, and correlates a subset of the search query spikes to a broadcast video program. Each correlated search query spike corresponds to a respective location in the video program. The process constructs a snippet of the video program by stitching together portions of the video program that contain the locations corresponding to the correlated search query spikes. In some implementations, the portions extend to video scene boundaries before and after each location. In some implementations, video program subtitles are used to match search query spikes to video program locations.

Claims

1. A method of building a video program extract, comprising:

at a server system with one or more processors and memory storing programs configured for execution by the one or more processors;

identifying a plurality of search query spikes from search queries submitted by a plurality of users;

wherein each search query spike corresponds to a respective set of one or more search queries identified as equivalent; and

wherein a frequency for submitting queries from the respective set during a corresponding spike period exceeds a frequency for submitting queries from the respective set during an average span of time by a predefined threshold amount;

correlating a subset of the search query spikes to a broadcast video program, wherein each correlated search query spike corresponds to a respective location in the video program; and

constructing a snippet of the video program by stitching together portions of the video program that contain the locations corresponding to the correlated search query spikes.

2. The method of claim 1, further comprising:

in response to a search query from a user for information about the video program, providing the user with the constructed snippet.

3. The method of claim 1, wherein a first and a second search query are identified as equivalent when an ordered sequence of search terms from the first search query is substantially identical to an ordered sequence of search terms from the second search query.

4. The method of claim 1, wherein a first and a second search query are identified as equivalent when a linguistic concept expressed using search terms from the first search query is substantially the same linguistic concept expressed using search terms from the second search query.

5. The method of claim 1, wherein the video program is a televised television program.

6. The method of claim 1, wherein correlating a search query spike to a broadcast video program comprises matching search terms from the corresponding search queries to subtitles of the video program at a corresponding respective location in the video program.

7. The method of claim 1, wherein the portions of the video program are arranged in order in the constructed snippet according to the order of the portions within the video program.

8. The method of claim 1, wherein the portions of the video program that contain the locations corresponding to the correlated search query spikes extend to video scene boundaries before and after each location.

9. The method of claim 1, further comprising constructing respective snippets for a plurality of respective broadcast video programs, wherein each respective snippet is based on correlating a respective plurality of the search query spikes to the respective video program, and wherein the plurality of broadcast video programs were all broadcast during a predefined span of time;

and

stitching together the snippets for the plurality of broadcast programs to form a single video summary for the predefined span of time.

10. The method of claim 1, wherein for each respective correlated search query spike a time difference between a time of the respective search query spike and when the respective location of the video program was broadcast is less than a predefined delay.

11. A server system for building a video program extract, comprising:

one or more processors;

memory; and

one or more programs stored in the memory configured for execution by the one or more processors, the one or more programs comprising instructions for;

identifying a plurality of search query spikes from search queries submitted by a plurality of users;

wherein each search query spike corresponds to a respective set of one or more search queries identified as equivalent; and

wherein a frequency for submitting queries from the respective set during a corresponding spike period exceeds a frequency for submitting queries from the respective set during an average span of time by a predefined threshold amount;

correlating a subset of the search query spikes to a broadcast video program, wherein each correlated search query spike corresponds to a respective location in the video program; and

constructing a snippet of the video program by stitching together portions of the video program that contain the locations corresponding to the correlated search query spikes.

12. The server system of claim 11, wherein the one or more programs further comprise instructions for:

in response to a search query from a user for information about the video program, providing the user with the constructed snippet.

13. The server system of claim 11, wherein the instructions for correlating a search query spike to a broadcast video program comprise instructions for matching search terms from the corresponding search queries to subtitles of the video program at a corresponding respective location in the video program.

14. The server system of claim 11, wherein the portions of the video program are arranged in order in the constructed snippet according to the order of the portions within the video program.

15. The server system of claim 11, wherein the portions of the video program that contain the locations corresponding to the correlated search query spikes extend to video scene boundaries before and after each location.

16. The server system of claim 11, wherein the one or more programs further comprise instructions for:

constructing respective snippets for a plurality of respective broadcast video programs, wherein each respective snippet is based on correlating a respective plurality of the search query spikes to the respective video program, and wherein the plurality of broadcast video programs were all broadcast during a predefined span of time; and

stitching together the snippets for the plurality of broadcast programs to form a single video summary for the predefined span of time.

17. The server system of claim 11, wherein for each respective correlated search query spike a time difference between a time of the respective search query spike and when the respective location of the video program was broadcast is less than a predefined delay.

18. A non-transitory computer readable storage medium storing one or more programs configured for execution by a server system having one or more processors and memory storing one or more programs configured for execution by the one or more processors, the one or more programs comprising instructions for:

identifying a plurality of search query spikes from search queries submitted by a plurality of users;

wherein each search query spike corresponds to a respective set of one or more search queries identified as equivalent; and

wherein a frequency for submitting queries from the respective set during a corresponding spike period exceeds a frequency for submitting queries from the respective set during an average span of time by a predefined threshold amount;

correlating a subset of the search query spikes to a broadcast video program, wherein each correlated search query spike corresponds to a respective location in the video program; and

constructing a snippet of the video program by stitching together portions of the video program that contain the locations corresponding to the correlated search query spikes.

19. The non-transitory computer readable storage medium of claim 18, wherein the one or more programs further comprise instructions for, in response to a search query from a user for information about the video program, providing the user with the constructed snippet.

20. The non-transitory computer readable storage medium of claim 18, wherein the one or more programs further comprise instructions for:

constructing respective snippets for a plurality of respective broadcast video programs, wherein each respective snippet is based on correlating a respective plurality of the search query spikes to the respective video program, and wherein the plurality of broadcast video programs were all broadcast during a predefined span of time; and

stitching together the snippets for the plurality of broadcast programs to form a single video summary for the predefined span of time.