Annotation framework for video

• US 9,805,012 B2
• Filed: 12/31/2013
• Issued: 10/31/2017
• Est. Priority Date: 12/22/2006
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Datar, Mayur, Garg, Ashutosh, Mittal, Vibhu
• Primary Examiner(s): Ries, Laurie
• Application Number:
  US14/145,641
• Publication Number:
  US 20140115440A1
• Time in Patent Office: 1,400 Days
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier

Abstract

A system and method for transferring annotations associated with a media file. An annotation associated with a media file is indexed to a first instance of that media file. By comparing features of the two instances, a mapping is created between the first instance of the media file and a second instance of the media file. The annotation can be indexed to the second instance using the mapping between the first and second instances. The annotation can be processed (displayed, stored, or modified) based on the index to the second instance.

Claims

1. A method for providing annotations at a client device in conjunction with a video, the method comprising:

presenting the video at the client device, presenting the video including presenting a frame on a display;

during the presenting of the frame, visually distinguishing a subset of the frame on the display with an annotation definition, the subset being less than all of the frame;

determining whether the annotation definition of the subset of the frame being presented on the display is associated with an annotation having properties that match user-defined criteria describing one or more annotation properties; and

in response to the determination, presenting the annotation corresponding to the annotation definition of the subset of the frame contemporaneously with the presentation of the frame.

2. The method of claim 1, wherein distinguishing the subset of the frame comprises displaying a visual border around the subset of the frame.

3. The method of claim 1, wherein the subset of the frame depicts an entity, the method further comprising:

distinguishing a second subset of a second frame of the video, the second subset depicting the entity; and

providing the annotation in conjunction with the second frame.

4. The method of claim 1, wherein the method further comprises:

obtaining an indication of the subset of the frame, the obtaining including a user selecting a corresponding portion of the visual representation; and

editing the annotation in response to user input.

5. The method of claim 1, further comprising:

distinguishing a second subset of frame during the presenting; and

providing a second annotation corresponding to the second subset of the frame in conjunction with the frame.

6. The method of claim 1, wherein the annotation includes audio content.

7. The method of claim 1, further comprising presenting a list of annotations that correspond to the frame in conjunction with the frame.

8. A computer system for adding an annotation to a video, the system comprising:

a computer processor; and

a computer-readable storage medium storing computer program instructions, the computer program instructions to configure the processor to perform operations comprising;

presenting the video to a user, presenting the video including presenting a frame on a display;

during the presenting of the frame, obtaining, from user input, an indication of a subset of a frame of the video, the subset being less than all of the frame; and

presenting a user interface configured to enable the user to provide annotation content to be associated with the subset of the frame, the annotation configured for contemporaneous display with frame along with a visual indication distinguishing the subset of the frame.

9. The computer system of claim 8, wherein presenting the video to the user comprises displaying a visual representation of the video to the user, and obtaining the indication of the subset of the frame comprises the user selecting a corresponding portion of the visual representation.

10. The computer system of claim 8, wherein the operations further comprise:

distinguishing the subset of the frame during presentation of the video to indicate that the annotation is associated with the subset of the frame; and

providing the annotation in conjunction with the frame.

11. The computer system of claim 10, wherein distinguishing the subset of the frame comprises displaying a visual border around the subset of the frame.

12. The computer system of claim 8, wherein the subset of the frame depicts an entity, the operations further comprising:

distinguishing a second subset of a second frame of the video, the second subset depicting the entity; and

providing the annotation in conjunction with the second frame.

13. The computer system of claim 8, wherein the operations the processor is configured to perform by the computer program instructions further comprise:

distinguishing a second subset of the frame during the presenting; and

providing a second annotation corresponding to the second subset of the frame in conjunction with the frame.

14. The computer system of claim 8, wherein the operations further comprise presenting a list of annotations that correspond to the frame in conjunction with the frame.

15. A computer program product, comprising a computer-readable storage medium storing computer program instructions for adding an annotation to a video, the computer program instructions to configure a computer processor to perform operations comprising:

presenting the video to a user, presenting the video including presenting a frame on a display;

during the presenting of the frame, obtaining, from user input, an indication of a subset of a frame of the video, the subset being less than all of the frame; and

presenting a user interface configured to enable the user to provide annotation content to be associated with the subset of the frame, the annotation configured for contemporaneous display with frame along with a visual indication distinguishing the subset of the frame.

16. The computer program product of claim 15, wherein presenting the video to the user comprises displaying a visual representation of the video to the user, and obtaining the indication of the subset of the frame comprises the user selecting a corresponding portion of the visual representation.

17. The computer program product of claim 15, wherein the operations further comprise:

distinguishing the subset of the frame during presentation of the video to indicate that the annotation is associated with the subset of the frame; and

providing the annotation in conjunction with the frame.

18. The computer program product of claim 17, wherein distinguishing the subset of the frame comprises displaying a visual border around the subset of the frame.

19. The computer program product of claim 15, wherein the subset of the frame depicts an entity, the operations further comprising:

distinguishing a second subset of a second frame of the video, the second subset depicting the entity; and

providing the annotation in conjunction with the second frame.

20. The computer program product of claim 15, wherein the operations further comprise presenting a list of annotations that correspond to the frame in conjunction with the frame.