Web-based system for collaborative generation of interactive videos

• US 8,566,353 B2
• Filed: 02/18/2009
• Issued: 10/22/2013
• Est. Priority Date: 06/03/2008
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Fink, Michael, Junee, Ryan, Barzilai, Aviad, Elias, Isaac, Frumar, Julian, Ho, Herbert, Ratner, Simon, Schrock, Jasson Arthur, Tavory, Ran, Wang, Virginia, Badoiu, Mihai, Bhargava, Ankur, Kofman, Igor, Bar, Sigalit, Kerem, Nir, Wiseman, Leora, Muthukrishnan, Shanmugavelayutham
• Primary Examiner(s): Badawi, Sherief
• Application Number:
  US12/388,365
• Publication Number:
  US 20090300475A1
• Time in Patent Office: 1,707 Days
• Field of Search: 707/742, 707/784, 707/748, 707/782, 707/781, 715/202, 715/230
• US Class Current: 707/782
• CPC Class Codes: A63F 2300/6018 where the game content is authored by the player, e.g. level editor or by game device at runtime, e.g. level is created from music data on CD
• CPC Class Codes: A63F 2300/632 by branching, e.g. choosing one of several possible story developments at a given point in time
• CPC Class Codes: A63F 2300/69 Involving elements of the real world in the game world, e.g. measurement in live races, real video
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: H04N 21/252 Processing of multiple end-users' preferences to derive collaborative data
• CPC Class Codes: H04N 21/25875 involving end-user authentication restricting access to computer systems by authenticating users using a predetermined code G06F21/33; arrangements for secret or secure communication including means for verifying the identity or authority of a user of the system H04L9/32; networks authentication protocols H04L63/08; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/2743 Video hosting of uploaded data from client
• CPC Class Codes: H04N 21/454 Content or additional data filtering, e.g. blocking advertisements
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/4781 Games
• CPC Class Codes: H04N 21/8541 involving branching, e.g. to different story endings
• CPC Class Codes: H04N 21/8583 by creating hot-spots
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

Systems and methods are provided for adding and displaying interactive annotations for existing online hosted videos. A graphical annotation interface allows the creation of annotations and association of the annotations with a video. Annotations may be of different types and have different functionality, such as altering the appearance and/or behavior of an existing video, e.g. by supplementing it with text, allowing linking to other videos or web pages, or pausing playback of the video. Authentication of a user desiring to perform annotation of a video may be performed in various manners, such as by checking a uniform resource locator (URL) against an existing list, checking a user identifier against an access list, and the like. As a result of authentication, a user is accorded the appropriate annotation abilities, such as full annotation, no annotation, or annotation restricted to a particular temporal or spatial portion of the video.

Claims

1. A computer-implemented method for annotating a digital video stored in a video repository, the method comprising:

identifying a visual object displayed within the video using visual object recognition;

determining whether a user, who did not contribute the digital video to the video repository, is authorized to annotate the digital video;

responsive to the user being authorized to annotate the digital video, providing to the user a first web-based user interface portion for annotating the digital video, the first web-based user interface portion comprising visual representations of a plurality of different annotation types and a visual suggestion to annotate the visual object;

responsive to receiving a user selection of one of the annotation types and approval of the suggestion of annotating the visual object, providing to the user a second web-based user interface portion comprising at least one input area for specifying a URL for a new annotation for the visual object, the URL separately encoding both an identifier of a target video and a time stamp of a moment within the target video;

receiving a request from the user via the second user interface portion to add an annotation of the selected annotation type to the visual object, the request comprising a designation of the URL for the annotation;

tracking a spatial position of the visual object across frames of the video to identify a plurality of spatial positions of the visual object as the visual object moves within the video; and

adding the annotation to the digital video such that the annotation is displayed during playback of the digital video and moves responsive to the tracked plurality of spatial positions of the visual object, and such that selection of the annotation causes playback of the target video at the moment in the target video specified by the time stamp, the target video being different than the digital video.

2. The computer-implemented method of claim 1, wherein determining whether the user is authorized to annotate the digital video comprises comparing a URL associated with the user to a URL associated with the digital video.

3. The computer-implemented method of claim 1, wherein determining whether the user is authorized to annotate the digital video comprises determining whether the user is on a list of users authorized to annotate the digital video.

4. The computer-implemented method of claim 1, wherein determining whether the user is authorized to annotate the digital video comprises monitoring actions of a contributor of the digital video with respect to the user.

5. The computer-implemented method of claim 1, wherein determining whether the user is authorized to annotate the digital video comprises monitoring actions of other users with respect to the user.

6. The computer-implemented method of claim 1, further comprising determining whether the user is authorized to annotate a particular temporal or spatial portion of the digital video.

7. The computer-implemented method of claim 1, wherein determining whether the user is authorized to annotate the digital video comprises determining whether an owner of the digital video has disabled annotation for the digital video.

8. The computer-implemented method of claim 1, wherein the annotation is associated with a time range of the digital video and has a visual appearance.

9. The computer-implemented method of claim 1, further comprising receiving a request to add a pause annotation for a time within the digital video, the pause annotation causing playback of the digital video to halt when the time is reached.

10. The computer-implemented method of claim 1, wherein the annotation has a graphical appearance that when selected displays information associated with the visual object.

11. The computer-implemented method of claim 1, further comprising:

responsive to receiving a request for the digital video from a client;

providing annotations that are associated with the digital video and that can be displayed by the client.

12. The computer-implemented method of claim 1, further comprising:

responsive to receiving a request for the digital video from a client;

altering annotations that are associated with the digital video to be displayed in a different locale from a locale in which they were created.

13. The computer-implemented method of claim 1, further comprising:

responsive to receiving a request for the digital video from a viewer;

identifying annotations associated with the digital video;

filtering the identified annotations by the identity of the viewer, thereby producing a modified set of annotations; and

providing the modified set of annotations to the viewer.

14. The computer-implemented method of claim 1, further comprising:

responsive to receiving a request for the digital video from a viewer;

identifying annotations associated with the digital video;

filtering the identified annotations by the identity of a group of which the viewer is a member, thereby producing a modified set of annotations;

providing the modified set of annotations to the viewer.

15. The computer-implemented method of claim 1, wherein the request to add the annotation incorporates annotation data derived from optical character recognition.

18. The computer-implemented method of claim 1, wherein adding the annotation to the digital video comprises storing the annotation within an annotation database on an annotation server that is physically separate from a video server that stores the digital video.

19. The computer-implemented method of claim 1, further comprising providing, to a second user, a user interface comprising:

a representation of the digital video; and

a visual timeline representing the duration of the digital video and time locations of a plurality of annotations associated with the digital video.

20. The computer-implemented method of claim 19, further comprising a user interface element for selectively displaying time locations of the plurality of associated annotations based on identities of users who added the annotations.

16. A computer non-transitory readable storage medium storing a computer program executable by a processor for annotating a digital video stored in a video repository, the actions of the computer program comprising:

identifying a visual object displayed within the video using visual object recognition;

determining whether a user, who did not contribute the digital video to the video repository, is authorized to annotate the digital video;

responsive to the user being authorized to annotate the digital video, providing to the user a first web-based user interface portion for annotating the digital video, the first web-based user interface portion comprising visual representations of a plurality of different annotation types and a visual suggestion to annotate the visual object;

responsive to receiving a user selection of one of the annotation types and approval of the suggestion of annotating the visual object, providing to the user a second web-based user interface portion comprising at least one input area for specifying a URL for a new annotation for the visual object, the URL separately encoding both an identifier of a target video and a time stamp of a moment within the target video;

receiving, from the user via the provided second user interface portion, a request to add an annotation of the selected annotation type to the visual object, the request comprising a designation of the URL for the annotation;

tracking a spatial position of the visual object across frames of the video to identify a plurality of spatial positions of the visual object as the visual object moves within the video; and

adding the annotation to the digital video such that the annotation is displayed during playback of the digital video and moves responsive to the tracked plurality of spatial positions of the visual object, and such that selection of the annotation causes playback of the target video at the moment in the target video specified by the time stamp, the target video being different than the digital video.

17. A computer system for annotating a digital video stored in a video repository, comprising:

a computer processor;

an annotation database storing annotation data; and

annotation logic comprising instructions that when executed by the computer processor perform actions comprising;

identifying a visual object displayed within the video using visual object recognition;

determining whether a user, who did not contribute the digital video to the video repository, is authorized to annotate the digital video;

responsive to the user being authorized to annotate the digital video, providing to the user a first web-based user interface portion for annotating the digital video, the first web-based user interface portion comprising visual representations of a plurality of different annotation types and a visual suggestion to annotate the identified visual object;

responsive to receiving a user selection of one of the annotation types and approval of the suggestion of annotating the visual object, providing to the user a second web-based user interface portion comprising at least one input area for specifying a URL for a new annotation for the visual object, the URL separately encoding both an identifier of a target video and a time stamp of a moment within the target video;

receiving, from the user via the provided second user interface portion, a request to add an annotation of the selected annotation type to the visual object, the request comprising a designation of the URL for the annotation;

tracking a spatial position of the visual object across frames of the video to identify a plurality of spatial positions of the visual object as the visual object moves within the video; and

adding the annotation to the digital video such that the annotation is displayed during playback of the digital video and moves responsive to the tracked plurality of spatial positions of the visual object, and such that selection of the annotation causes playback of the target video at the moment in the target video specified by the time stamp, the target video being different than the digital video.