Annotating video intervals

• US 8,112,702 B2
• Filed: 02/19/2008
• Issued: 02/07/2012
• Est. Priority Date: 02/19/2008
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Badoiu, Mihai, Muthukrishnan, Shanmugavelayutham
• Primary Examiner(s): Tran, Quoc A
• Application Number:
  US12/033,817
• Publication Number:
  US 20090210779A1
• Time in Patent Office: 1,449 Days
• Field of Search: 715/230, 715/723, 715/726, 715/732, 715/201, 386/52, 725/37, 725/109
• US Class Current: 715/230
• CPC Class Codes: G06F 16/244 Grouping and aggregation
• CPC Class Codes: G06F 16/24573 using data annotations, e.g. user-defined metadata
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/70 of video data
• CPC Class Codes: G06F 16/73 Querying
• CPC Class Codes: G06F 16/738 Presentation of query results
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 30/00 Computer-aided design [CAD]
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

A system and method is provided for managing and displaying annotations in online hosted videos. To determine related annotations associated with a video, a plurality of annotations for one or more intervals of the video are collected and organized into a plurality of groups. Each group includes annotations for intervals of the video that are similar to each other. A group having related annotations is identified, and an annotated clip of the video is formed based upon the intervals in the group. This process can be used to determine any number of groups in a given video having related annotations, forming the respective annotated intervals within a single video, and can also identify and organize annotated intervals within a large number of different videos.

Claims

1. The method for managing annotations associated with a first video, the method comprising:

receiving a plurality of annotations for one or more intervals of the first video, each annotation having a reputation score associated with a user providing the annotation;

assigning a weight to each annotation based on the reputation score;

forming a plurality of groups, each group including annotations for intervals of the first video that are similar to each other;

determining a first group having related annotations based on the assigned weights of the annotations; and

forming a first annotated clip of the first video based upon the intervals in the first group.

2. The method of claim 1, further comprising:

forming a first synoptic annotation for the first annotated clip of the first video based on the related annotations in the first group.

3. The method of claim 2, wherein the first synoptic annotation contains a summary of content of the related annotations in the first group.

4. The method of claim 2, wherein the first synoptic annotation contains excerpts of content of the related annotations in the first group.

5. The method of claim 1, wherein the first group of related annotations is determined based at least in part on a comparison of content within each annotation.

6. The method of claim 1, further comprising:

responsive to receiving a search query term, identifying one or more annotations containing the term.

7. The method of claim 1, wherein forming the plurality of groups comprises clustering the annotations based on a timestamp associated with each annotation.

8. The method of claim 1, wherein each interval has a start time and an end time, and forming the plurality of groups comprises clustering the annotations based on the start times and the end times of the intervals.

9. The method of claim 1, wherein forming the plurality of groups comprises:

identifying a plurality of scenes in the first video; and

associating each group with one or more scenes.

10. The method of claim 1, wherein forming the plurality of groups comprises:

identifying a plurality of features in the first video; and

associating each group with a set of one or more features in the first video.

11. The method of claim 1, further comprising:

assigning a weight to each annotation based on whether the annotation was provided by a unique user; and

determining the first group having related annotations based on the assigned weights of the annotations.

12. The method of claim 1, wherein forming the plurality of groups comprises determining a predetermined number of annotated clips permitted based on a number of indications of annotated clips that can be visually distinguished on a timeline corresponding to the first video.

13. The method of claim 1, wherein forming the plurality of groups comprises determining an amount of time between the intervals with which the annotations are associated.

14. The method of claim 1, further comprising:

displaying an indication of the first annotated clip on a timeline associated with the first video.

15. The method of claim 1, further comprising:

determining a second group having related annotations; and

forming a second annotated clip based on the intervals in the second group; and

ranking the first annotated clip and the second annotated clip based on the annotations in each group.

16. The method of claim 15, further comprising:

displaying an indication of the first annotated clip and an indication of the second annotated clip of the first video on a timeline associated with the first video.

17. The method of claim 15, further comprising:

forming an annotated excerpt of the first video comprising the first annotated clip and the second annotated clip; and

displaying the annotated excerpt.

18. The method of claim 1, further comprising:

receiving a plurality of annotations associated with one or more intervals of a second video;

forming a plurality of groups for the second video, each group including annotations for intervals of the second video that are similar to each other;

determining a first group for the second video having related annotations for a similar interval in the second video; and

forming a first annotated clip of the second video based upon the intervals in the first group for the second video; and

ranking the first video and the second video based on a number of annotations associated with each annotated clip of the first video and of the second video.

19. The method of claim 18, further comprising:

responsive to receiving a search query term, identifying one or more annotations from the first video and the second video containing the term.

20. The method of claim 18, further comprising:

identifying annotations from the second video that have content in common with annotations from the first video.

21. A system for managing annotations associated with a video comprising:

a computer processor; and

a non-transitory computer-readable storage medium storing computer program modules configured to execute on the computer processor, the computer program modules comprising;

an extraction module, adapted to extract a plurality of annotations associated with one or more intervals of the video, each annotation having a reputation score associated with a user providing the annotation;

a grouping module, adapted to form a plurality of groups, each group including annotations for intervals of the video that are similar to each other;

an annotation determination module, adapted to;

assign a weight to each annotation based on the reputation score; and

determine a group having related annotations based on the assigned weights of the annotations; and

a clip generation module, adapted to form an annotated clip of the video based upon the intervals in the group.

22. The system of claim 21, further comprising:

a display module, adapted to display an indication of the annotated clip on a timeline associated with the video.

23. A computer program product having a non-transitory computer readable storage medium and including computer executable code for managing annotations associated with a first video, the code adapted to perform steps comprising:

receiving a plurality of annotations for one or more intervals of the first video, each annotation having a reputation score associated with a user providing the annotation;

assigning a weight to each annotation based on the reputation score;

forming a plurality of groups, each group including annotations for intervals of the first video that are similar to each other;

determining a first group having related annotations based on the assigned weights of the annotations; and

forming a first annotated clip of the first video based upon the intervals in the first group.