Annotation framework for video

• US 10,261,986 B2
• Filed: 10/27/2017
• Issued: 04/16/2019
• Est. Priority Date: 12/22/2006
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Datar, Mayur, Garg, Ashutosh, Mittal, Vibhu
• Primary Examiner(s): Ries, Laurie A
• Application Number:
  US15/795,635
• Publication Number:
  US 20180052812A1
• Time in Patent Office: 536 Days
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier

Abstract

A system and method for transferring annotations associated with a media file. An annotation associated with a media file is indexed to a first instance of that media file. By comparing features of the two instances, a mapping is created between the first instance of the media file and a second instance of the media file. The annotation can be indexed to the second instance using the mapping between the first and second instances. The annotation can be processed (displayed, stored, or modified) based on the index to the second instance.

Claims

1. A method for annotating video content items, the method comprising:

receiving a frame selection from a plurality of frames of a first video associated with a content creator;

in response to receiving the frame selection, presenting an interface element for controlling a user interface that is contemporaneously presented with at least one frame of the first video;

generating the user interface in response to instructions received via the interface element;

generating a user interface definition based on received user interface criteria, wherein the user interface definition is associated with the user interface and wherein the user interface definition delineates a subset of frames from the plurality of frames with which the user interface is associated;

determining that a second video having the subset of frames is associated with the content creator; and

mapping the user interface and the associated user interface definition to the subset of frames in the second video.

2. The method of claim 1, wherein the user interface includes a border around a portion of the at least one frame of the first video that visually distinguishes the portion of the at least one frame of the first video.

3. The method of claim 1, wherein the user interface includes an annotation that is contemporaneously presented with the at least one frame of the first video.

4. The method of claim 3, wherein user interface is generated by receiving a selection of the interface element, obtaining an indication of a portion of the at least one frame of the first video, and editing the annotation in response to user input.

5. The method of claim 1, further comprising determining whether the user interface definition of the subset of the frame being presented has properties that match user-defined criteria describing one or more interface properties.

6. The method of claim 5, wherein the user interface and the associated user interface definition are mapped to the subset of frames in the second videos in response to the determination that the user interface definition matches the user-defined criteria.

7. The method of claim 1, further comprising presenting a list of user interfaces that correspond to the at least one frame of the first video in response to receiving a selection of the interface element.

8. A system for annotating video content items, the system comprising:

a memory; and

a hardware processor that, when executing computer executable instructions stored in the memory, is configured to;

receive a frame selection from a plurality of frames of a first video associated with a content creator;

in response to receiving the frame selection, present an interface element for controlling a user interface that is contemporaneously presented with at least one frame of the first video;

generate the user interface in response to instructions received via the interface element;

generate a user interface definition based on received user interface criteria, wherein the user interface definition is associated with the user interface and wherein the user interface definition delineates a subset of frames from the plurality of frames with which the user interface is associated;

determine that a second video having the subset of frames is associated with the content creator; and

map the user interface and the associated user interface definition to the subset of frames in the second video.

9. The system of claim 8, wherein the user interface includes a border around a portion of the at least one frame of the first video that visually distinguishes the portion of the at least one frame of the first video.

10. The system of claim 8, wherein the user interface includes an annotation that is contemporaneously presented with the at least one frame of the first video.

11. The system of claim 10, wherein user interface is generated by receiving a selection of the interface element, obtaining an indication of a portion of the at least one frame of the first video, and editing the annotation in response to user input.

12. The system of claim 8, wherein the hardware processor is further configured to determine whether the user interface definition of the subset of the frame being presented has properties that match user-defined criteria describing one or more interface properties.

13. The system of claim 12, wherein the user interface and the associated user interface definition are mapped to the subset of frames in the second videos in response to the determination that the user interface definition matches the user-defined criteria.

14. The system of claim 8, wherein the hardware processor is further configured to present a list of user interfaces that correspond to the at least one frame of the first video in response to receiving a selection of the interface element.

15. A non-transitory computer-readable medium containing computer executable instructions that, when executed by a processor, cause the processor to perform a method for annotating video content items, the method comprising:

receiving a frame selection from a plurality of frames of a first video associated with a content creator;

in response to receiving the frame selection, presenting an interface element for controlling a user interface that is contemporaneously presented with at least one frame of the first video;

generating the user interface in response to instructions received via the interface element;

generating a user interface definition based on received user interface criteria, wherein the user interface definition is associated with the user interface and wherein the user interface definition delineates a subset of frames from the plurality of frames with which the user interface is associated;

determining that a second video having the subset of frames is associated with the content creator; and

mapping the user interface and the associated user interface definition to the subset of frames in the second video.

16. The non-transitory computer-readable medium of claim 15, wherein the user interface includes a border around a portion of the at least one frame of the first video that visually distinguishes the portion of the at least one frame of the first video.

17. The non-transitory computer-readable medium of claim 15, wherein the user interface includes an annotation that is contemporaneously presented with the at least one frame of the first video.

18. The non-transitory computer-readable medium of claim 17, wherein user interface is generated by receiving a selection of the interface element, obtaining an indication of a portion of the at least one frame of the first video, and editing the annotation in response to user input.

19. The non-transitory computer-readable medium of claim 15, wherein the method further comprises determining whether the user interface definition of the subset of the frame being presented has properties that match user-defined criteria describing one or more interface properties.

20. The non-transitory computer-readable medium of claim 19, wherein the user interface and the associated user interface definition are mapped to the subset of frames in the second videos in response to the determination that the user interface definition matches the user-defined criteria.

21. The non-transitory computer-readable medium of claim 15, wherein the method further comprises presenting a list of user interfaces that correspond to the at least one frame of the first video in response to receiving a selection of the interface element.