Audio and/or video scene detection and retrieval

• US 8,132,103 B1
• Filed: 09/06/2006
• Issued: 03/06/2012
• Est. Priority Date: 07/19/2006
• Status: Active Grant

• Current Assignee: Mercury Kingdom Assets Limited
• Original Assignee: AOL Inc. (Apollo Global Management, Inc.)
• Inventors: Chowdhury, Abdur R., Vandermolen, Harmannus
• Primary Examiner(s): Augustine, Nicholas
• Application Number:
  US11/470,575
• Time in Patent Office: 2,008 Days
• Field of Search: 715/714, 715/717, 715/738, 715/745, 715/762, 715/763, 715/810, 715/811, 715/825, 715719-726
• US Class Current: 715/723
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/7834 using audio features
• CPC Class Codes: G11B 27/002 Programmed access in sequence to a plurality of record carriers or indexed parts, e.g. tracks, thereof, e.g. for editing; transfer of record carriers from magazine G11B15/68, G11B17/10; G11B17/22
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739

Abstract

Movie video trailers for a particular movie quote may be created and provided to a user. The Internet may be searched to identify documents that likely include references to a movie. A reference to the movie within an identified document may be detected and determined to be a movie quote. The movie quote and related information may be extracted from the identified document. A location of the movie quote within the movie may be determined. A movie video trailer that includes the movie quote may be created based on the location of the movie quote. A request for a movie video trailer that includes a movie quote or a partial movie quote, specified by the user, may be received from the user. A movie video trailer that includes the movie quote or the partial movie quote may be identified and provided to the user.

Claims

1. A computer-implemented method comprising:

searching the Internet, using at least one processor, to identify documents that are likely to include references to a movie;

accessing a plurality of identified documents;

detecting one or more references to the movie within the plurality of identified documents;

determining that the plurality of identified documents comprise a movie quote, wherein determining that the plurality of identified documents comprise the movie quote comprises using text analysis to determine that a detected reference to the movie is a movie quote;

extracting the movie quote and related information from the plurality of identified documents;

determining the popularity of the plurality of identified documents;

selecting one of the plurality of identified documents based on its popularity;

determining a location of the movie quote from the selected document within the movie; and

creating a movie video trailer that includes the movie quote from the selected document based on the determined location of the movie quote.

2. The method of claim 1 wherein determining that the plurality of identified documents comprise the movie quote further comprises using key words from a transcript of the movie to determine that a detected reference to the movie is a movie quote.

3. The method of claim 1 wherein determining that the plurality of identified documents comprise the movie quote further comprises using an identified set of key phrases to determine that a detected reference to the movie is a movie quote.

4. The method of claim 1 wherein the movie video trailer excludes at least a portion of content included in the movie.

5. The method of claim 4 wherein creating the movie video trailer includes:

tuning to the location in the movie that includes the movie quote;

rewinding the movie from the location of the movie quote until a beginning of a scene that includes the movie quote is reached;

rewinding the movie past the beginning of the scene by a predetermined amount of time;

marking a first time stamp of the movie at the rewound location as a scene start time;

returning to the location in the movie of the movie quote;

forwarding the movie from the location of the movie quote until an end of the scene that includes the movie quote is reached;

forwarding the movie past the end of the scene by a predetermined amount of time;

marking a second time stamp of the movie at the forwarded location as a scene end time;

removing at least a portion of the content of the movie located before the first time stamp; and

removing at least a portion of the content of the movie located after the second time stamp.

6. The method of claim 1 wherein the movie video trailer includes a pointer to a portion of the movie that includes the movie quote, wherein the portion of the movie is made perceivable to a user without requiring the user to view the entire movie.

7. The method of claim 1 wherein determining a location of the movie quote from the selected document within the movie includes:

accessing a transcript of the movie;

determining a location of the movie quote from the selected document within the transcript; and

identifying a timestamp associated with the location of the movie quote.

8. A computer-implemented method for providing movie video trailers to a user, the method comprising:

receiving, from a user, a request for a movie video trailer that includes a movie quote or a partial movie quote specified by the user;

identifying, using at least one processor, a plurality of movie video trailers responsive to the request, the plurality of movie video trailers including the movie quote or the partial movie quote specified by the user, wherein identifying the plurality of movie video trailers responsive to the request comprises using text analysis to determine that a detected reference to the movie is a movie quote or partial movie quote;

determining the popularity of the plurality of movie video trailers;

selecting one of the plurality of movie video trailers based on its popularity; and

providing the user with the selected movie video trailer.

9. The method of claim 8 wherein receiving the request includes receiving a search query inputted by the user for a movie video trailer, the search query including the movie quote or the partial movie quote.

10. The method of claim 8 wherein identifying a plurality of movie video trailers responsive to the request includes identifying an existing movie video trailer that is responsive to the request.

11. The method of claim 10 wherein identifying a plurality of movie video trailers responsive to the request includes:

determining that a movie video trailer that is responsive to the request does not exist; and

generating a movie video trailer that is responsive to the request on-the-fly.

12. The method of claim 8 wherein:

the request for the movie video trailer includes the partial movie quote; and

identifying a plurality of movie video trailers responsive to the request includes;

identifying a first movie video trailer associated with a first movie, the first movie video trailer including a first movie quote that contains the partial movie quote; and

identifying a second movie video trailer associated with a second movie, the second movie video trailer including a second movie quote that is distinct from the first movie quote and contains the partial movie quote.

13. The method of claim 12 wherein providing the user with the selected movie video trailer comprises:

determining a popularity of the first movie quote;

determining a popularity of the second movie quote; and

presenting the first movie video trailer and the second movie video trailer to the user based on the determined popularity of the first movie quote and the second movie quote.

14. The method of claim 13 wherein determining a popularity of the first movie quote includes determining a value of a reference counter associated with the first movie quote, wherein the reference counter indicates a number of references to the first movie quote on the Internet.

15. The method of claim 14 wherein determining a value of the reference counter associated with the first movie quote includes:

searching the Internet to identify documents that likely include references to movies;

accessing an identified document;

identifying a reference to the first movie quote within the identified document; and

increasing a value of the reference counter associated with the first movie quote in response to identification of the reference to the first movie quote within the identified document.

16. The method of claim 14 wherein the reference counter indicates a combination of the number of references to the first movie quote on the Internet and the number of references to the first movie on the Internet.

17. The method of claim 13 wherein determining a popularity of the first movie quote includes determining a value of a reference counter associated with the first movie, wherein the reference counter indicates a number of references to the first movie on the Internet.

18. The method of claim 13 wherein providing the first movie video trailer and the second movie video trailer to the user comprises presenting the first movie video trailer and the second movie video trailer in a grouping that is ordered based on the determined popularity of the first movie quote and the second movie quote.

19. The method of claim 18 wherein the grouping is a list that presents the first movie video trailer and the second movie video trailer in a ranked order based on the determined popularity of the first movie quote and the second movie quote.

20. The method of claim 8 wherein:

the request for the movie video trailer includes the movie quote; and

identifying at least one movie video trailer responsive to the request includes;

identifying a first movie video trailer associated with a first movie, the first movie video trailer including the movie quote; and

identifying a second movie video trailer associated with a second movie, the second movie video trailer including a second movie quote that is distinct from the first movie quote and contains the movie quote.

21. The method of claim 20 wherein providing the user with the identified at least one movie video trailer comprises:

determining a popularity of the first movie;

determining a popularity of the second movie; and

presenting the first movie video trailer and the second movie video trailer to the user based on the determined popularity of the first movie and the second movie.

22. The method of claim 21 wherein determining a popularity of the first movie includes determining a value of a reference counter associated with the first movie, wherein the reference counter indicates a number of references to the first movie on the Internet.

23. The method of claim 22 wherein determining a value of the reference counter associated with the first movie includes:

searching the Internet to identify documents that likely include references to movies;

accessing an identified document;

identifying a reference to the first movie within the identified document; and

increasing a value of the reference counter associated with the first movie in response to identification of the reference to the first movie within the identified document.

24. The method of claim 21 wherein presenting the first movie video trailer and the second movie video trailer to the user comprises presenting the first movie video trailer and the second video trailer in a grouping that is ordered based on the determined popularity of the first movie and the second movie.

25. The method of claim 24 wherein the grouping is a list that presents the first movie trailer and the second movie trailer in a ranked order based on the determined popularity of the first movie and the second movie.

26. A computer program product including instructions that, when executed by a processor, cause the processor to:

search the Internet to identify documents that are likely to include references to a movie;

access a plurality of identified documents;

detect one or more references to the movie within the plurality of identified documents;

determine that the plurality of identified documents comprise a movie quote, wherein determining that the plurality of identified documents comprise the movie quote comprises using text analysis to determine that a detected reference to the movie is a movie quote;

extract the movie quote and related information from the plurality of identified documents;

determine the popularity of the plurality of identified documents;

select one of the plurality of identified documents based on its popularity;

determine a location of the movie quote from the selected document within the movie; and

create a movie video trailer that includes the movie quote from the selected document based on the determined location of the movie quote.

27. The computer program product of claim 26 wherein the movie video trailer excludes at least a portion of content included in the movie.

28. The computer program product of claim 26 wherein the instructions that cause the processor to create the movie video trailer are configured to further cause the processor to:

tune to the location in the movie that includes the movie quote;

rewind the movie from the location of the movie quote until a beginning of a scene that includes the movie quote is reached;

rewind the movie past the beginning of the scene by a predetermined amount of time;

mark a first time stamp of the movie at the rewound location as a scene start time;

return to the location in the movie of the movie quote;

forward the movie from the location of the movie quote until an end of the scene that includes the movie quote is reached;

forward the movie past the end of the scene by a predetermined amount of time;

mark a second time stamp of the movie at the forwarded location as a scene end time;

removing at least a portion of the content of the movie located before the first time stamp; and

remove at least a portion of the content of the movie located after the second time stamp.

29. The computer program product of claim 26 wherein the movie video trailer includes a pointer to a portion of the movie that includes the movie quote, wherein the portion of the movie is made perceivable to a user without requiring the user to view the entire movie.

30. The computer program product of claim 26 wherein the instructions that cause the processor to determine a location of the movie quote within the movie are configured to further cause the processor to:

access a transcript of the movie;

determine a location of the movie quote within the transcript; and

identify a timestamp associated with the location of the movie quote.

31. A computer program product including instructions that, when executed by a processor, cause the processor to:

receive, from a user, a request for a movie video trailer that includes a movie quote or a partial movie quote specified by the user;

identify a plurality of movie video trailers responsive to the request, the plurality of movie video trailers including the movie quote or the partial movie quote specified by the user, wherein identifying the plurality of movie video trailers responsive to the request comprises using text analysis to determine that a detected reference to the movie is a movie quote or partial movie quote;

determine the popularity of the plurality of movie video trailers;

select one of the plurality of movie video trailers based on its popularity; and

provide the user with the selected movie video trailer.

32. The computer program product of claim 31 wherein the instructions that cause the processor to identify a plurality of movie video trailers responsive to the request are configured to further cause the processor to identify an existing movie video trailer that is responsive to the request.

33. The computer program product of claim 32 wherein the instructions that cause the processor to identify a plurality of movie video trailers responsive to the request are configured to further cause the processor to:

determine that a movie video trailer that is responsive to the request does not exist; and

generate a movie video trailer that is responsive to the request on-the-fly.

34. The computer program product of claim 31 wherein:

the request for the movie video trailer includes the partial movie quote; and

the instructions for causing the processor to identify at least one movie video trailer responsive to the request are further configured to cause the processor to;

identify a first movie video trailer associated with a first movie, the first movie video trailer including a first movie quote that contains the partial movie quote; and

identify a second movie video trailer associated with a second movie, the second movie video trailer including a second movie quote that is distinct from the first movie quote and contains the partial movie quote.

35. The computer program product of claim 31 wherein the instructions for causing the processor to provide the user with the selected movie video trailer are further configured to cause the processor to:

determine a popularity of the first movie quote;

determine a popularity of the second movie quote; and

present the first movie video trailer and the second movie video trailer to the user based on the determined popularity of the first movie quote and the second movie quote.

36. The computer program product of claim 35 wherein the instructions for causing the processor to determine a popularity of the first movie quote are further configured to cause the processor to determine a value of a reference counter associated with the first movie quote, wherein the reference counter indicates a number of references to the first movie quote on the Internet.

37. The computer program product of claim 35 wherein the instructions that cause the processor to provide the first movie video trailer and the second movie video trailer to the user are further configured to cause the processor to present the first movie video trailer and the second movie video trailer in a grouping that is ordered based on the determined popularity of the first movie quote and the second movie quote.

38. The computer program product of claim 31 wherein:

the request for the movie video trailer includes the movie quote; and

the instructions for causing the processor to identify a plurality of movie video trailers responsive to the request are further configured to cause the processor to;

identify a first movie video trailer associated with a first movie, the first movie video trailer including the movie quote; and

identify a second movie video trailer associated with a second movie, the second movie video trailer including a second movie quote that is distinct from the first movie quote and contains the movie quote.

39. The computer program product of claim 38 wherein the instructions for causing the processor to provide the user with the selected movie video trailer are further configured to cause the processor to:

determine a popularity of the first movie;

determine a popularity of the second movie; and

present the first movie video trailer and the second movie video trailer to the user based on the determined popularity of the first movie and the second movie.

40. The computer program product of claim 39 wherein the instructions for causing the processor to determine a popularity of the first movie are further configured to cause the processor to determine a value of a reference counter associated with the first movie, wherein the reference counter indicates a number of references to the first movie on the Internet.

41. A computer-implemented system comprising:

means for searching the Internet to identify documents that are likely to include references to a movie, wherein the searching means comprises at least one processor;

means for accessing a plurality of identified documents;

means for detecting one or more references to the movie within the plurality of identified documents wherein determining that the plurality of identified documents comprise the movie quote includes using text analysis to determine that a detected reference to the movie is a movie quote;

means for determining that the plurality of identified documents comprise a movie quote, wherein determining that the plurality of identified documents comprise the movie quote comprises using text analysis to determine that a detected reference to the movie is a movie quote;

means for extracting the movie quote and related information from the plurality of identified documents;

means for determining the popularity of the plurality of identified documents;

means for selecting one of the plurality of identified documents based on its popularity;

means for determining a location of the movie quote within the movie; and

means for creating a movie video trailer from the movie that includes the movie quote based on the determined location of the movie quote.

42. A computer-implemented system comprising:

means for receiving, from a user, a request for a movie video trailer that includes a movie quote or a partial movie quote specified by the user;

means for identifying a plurality of movie video trailers responsive to the request, the plurality of movie video trailers including the movie quote or the partial movie quote specified by the user, wherein the identifying means comprises at least one processor, wherein identifying the plurality of movie video trailers responsive to the request comprises using text analysis to determine that a detected reference to the movie is a movie quote or partial movie quote;

means for determining the popularity of the plurality of movie video trailers;

means for selecting one of the plurality of movie video trailers based on its popularity; and

means for providing the user with the identified at least one movie video trailer.