Audio and/or video scene detection and retrieval

• US 9,378,209 B2
• Filed: 02/20/2014
• Issued: 06/28/2016
• Est. Priority Date: 11/29/2005
• Status: Active Grant

• Current Assignee: Mercury Kingdom Assets Limited
• Original Assignee: Mercury Kingdom Assets Limited
• Inventors: Chowdhury, Abdur R., Vandermolen, Harmannus
• Primary Examiner(s): Augustine, Nicholas
• Application Number:
  US14/185,826
• Publication Number:
  US 20140172836A1
• Time in Patent Office: 859 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/7834 using audio features
• CPC Class Codes: G11B 27/002 Programmed access in sequence to a plurality of record carriers or indexed parts, e.g. tracks, thereof, e.g. for editing; transfer of record carriers from magazine G11B15/68, G11B17/10; G11B17/22
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739

Abstract

Video trailers for a video quote may be created and provided to a user. The Internet may be searched to identify documents that likely include references to a video. A reference to the video within an identified document may be detected and determined to be a video quote. The video quote and related information may be extracted from the identified document. A location of the video quote within the video may be determined. A video trailer that includes the video quote may be created based on the location of the video quote. A request for a video trailer that includes a video quote or a partial video quote, specified by the user, may be received from the user. A video trailer that includes the video quote or the partial video quote may be identified and provided to the user.

Claims

1. A method performed by one or more processors configured with executable instructions to perform acts comprising:

receiving, from a user, a query comprising a quote from a television show;

identifying the television show associated with the quote;

determining a location of the quote within the television show based on a television quote index database; and

providing a video segment in response to the query, the video segment comprising at least a portion of the television show that includes the quote.

2. The method of claim 1, wherein providing the video segment comprises:

identifying a first location within the television show that is prior to the quote;

identifying a second location within the television show that is after the quote; and

creating the video segment based on a portion of the television show that is between the first location and the second location.

3. The method of claim 2, wherein:

the first location is associated with a beginning of a scene in the television show; and

the second location is associated with an end of the scene in the television show.

4. The method of claim 1, further comprising:

storing the video segment in a database; and

providing the video segment in response to receiving a subsequent query that includes the quote from the television show.

5. The method of claim 1, wherein the video segment is created in real-time in response to receiving the query comprising the quote from the television show.

6. The method of claim 1, wherein determining, based on the transcript of the television show, the location of the quote within the television show comprises:

performing speech-to-text processing on an audio track of the television show to create the transcript; and

searching the transcript based on the query.

7. The method of claim 1, wherein identifying the television show associated with the quote comprises:

identifying a plurality of television shows associated with the quote;

determining a number of references to the quote associated with each of the plurality of television shows; and

identifying the television show from among the plurality of television shows based on the number of references to the quote in the television show.

8. The method of claim 7, further comprising:

providing, in response to the query, one or more additional video segments that include the quote, the one or more additional video segments based on one or more of the plurality of television shows that include the quote.

9. The method of claim 8, further comprising:

for each of the one or more additional video segments, providing a value that indicates a popularity of each of the one or more additional video segments.

10. The method of claim 1, wherein the television quote index database includes information associated with at least one of:

a television show title, an episode title, a channel on which the show airs, a day on which the show airs, a time at which the show airs, and an indication of whether the actor who played the character who spoke the quote is a permanent character on the show or a guest star.

11. A system comprising:

at least one processor; and

a non-transitory computer-readable storage medium to store a plurality of instructions that are executable by the at least one processor to perform acts comprising;

receiving, from a user, a query comprising a quote from a television show;

identifying the television show associated with the quote;

determining a location of the quote within the television show based on one or more of a television quote index database, a transcribed television episode database, a full video television episode database, or a television trailer database; and

providing a video segment in response to the query, the video segment comprising at least a portion of the television show that includes the quote.

12. The system of claim 11, wherein providing the video segment comprises:

identifying a first location within the television show that is prior to the quote;

identifying a second location within the television show that is after the quote; and

creating the video segment based on a portion of the television show that is between the first location and the second location.

13. The system of claim 12, wherein:

the first location is associated with a beginning of a first scene in the television show; and

the second location is associated with an end of a second scene in the television show.

14. The system of claim 11, wherein the acts further comprise:

storing the video segment in a database; and

providing the video segment in response to receiving a subsequent query that includes the quote from the television show.

15. The system of claim 11, wherein the video segment is created in real-time in response to receiving the query comprising the quote from the television show.

16. The system of claim 11, wherein determining, based on the transcript of the television show, the location of the quote within the television show comprises:

performing speech-to-text processing on an audio track of the television show to create the transcript; and

searching the transcript based on the query.

17. The system of claim 11, wherein identifying the television show associated with the quote comprises:

identifying a plurality of television shows associated with the quote;

determining a number of references to the quote associated with each of the plurality of television shows; and

identifying the television show from among the plurality of television shows based on the number of references to the quote in the television show.

18. The system of claim 17, the acts further comprising:

providing, in response to the query, one or more additional video segments that include the quote, the one or more additional video segments based on one or more of the plurality of television shows that include the quote.

19. The system of claim 18, the acts further comprising:

for each of the one or more additional video segments, providing a value that indicates a popularity of each of the one or more additional video segments.

20. The system of claim 11, wherein providing the video segment in response to the query comprises:

sending a multimedia file comprising the video segment to the user that provided the query.