Web-based system for collaborative generation of interactive videos

• US 9,684,432 B2
• Filed: 09/10/2013
• Issued: 06/20/2017
• Est. Priority Date: 06/03/2008
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Fink, Michael, Junee, Ryan, Elias, Isaac, Frumar, Julian, Ratner, Simon, Schrock, Jasson Arthur, Tavory, Ran, Wang, Virginia, Badoiu, Mihai, Bhargava, Ankur, Kofman, Igor, Bar, Sigalit, Ho, Herbert, Kerem, Nir, Wiseman, Leora, Muthukrishnan, Shanmugavelayutham, Barzilai, Aviad
• Primary Examiner(s): LIAO, JASON G
• Application Number:
  US14/023,404
• Publication Number:
  US 20140019862A1
• Time in Patent Office: 1,379 Days
• CPC Class Codes: A63F 2300/6018 where the game content is authored by the player, e.g. level editor or by game device at runtime, e.g. level is created from music data on CD
• CPC Class Codes: A63F 2300/632 by branching, e.g. choosing one of several possible story developments at a given point in time
• CPC Class Codes: A63F 2300/69 Involving elements of the real world in the game world, e.g. measurement in live races, real video
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: H04N 21/252 Processing of multiple end-users' preferences to derive collaborative data
• CPC Class Codes: H04N 21/25875 involving end-user authentication restricting access to computer systems by authenticating users using a predetermined code G06F21/33; arrangements for secret or secure communication including means for verifying the identity or authority of a user of the system H04L9/32; networks authentication protocols H04L63/08; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/2743 Video hosting of uploaded data from client
• CPC Class Codes: H04N 21/454 Content or additional data filtering, e.g. blocking advertisements
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/4781 Games
• CPC Class Codes: H04N 21/8541 involving branching, e.g. to different story endings
• CPC Class Codes: H04N 21/8583 by creating hot-spots
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

Systems and methods are provided for adding and displaying interactive annotations for existing online hosted videos. A graphical annotation interface allows the creation of annotations and association of the annotations with a video. Annotations may be of different types and have different functionality, such as altering the appearance and/or behavior of an existing video, e.g. by supplementing it with text, allowing linking to other videos or web pages, or pausing playback of the video. Authentication of a user desiring to perform annotation of a video may be performed in various manners, such as by checking a uniform resource locator (URL) against an existing list, checking a user identifier against an access list, and the like. As a result of authentication, a user is accorded the appropriate annotation abilities, such as full annotation, no annotation, or annotation restricted to a particular temporal or spatial portion of the video.

Claims

1. A computer-implemented method comprising:

identifying, by a computer, a visual object displayed within a digital video;

providing to a user a first web-based user interface portion for annotating the digital video, the first web-based user interface portion comprising visual representations of a plurality of different annotation types;

receiving a selection from the user of one of the annotation types;

providing to the user a second web-based user interface portion comprising at least one input area for specifying a link for a new annotation for the visual object;

receiving a request from the user to add an annotation of the selected annotation type to the visual object, the request comprising a designation of the link for the annotation;

determining, by the computer, a plurality of spatial and temporal positions of the visual object across a corresponding plurality of frames of the digital video;

adding the annotation to an annotation database in association with the digital video such that the annotation is displayed during playback of the digital video and moves along with the determined plurality of spatial and temporal positions of the visual object, and such that selection of the annotation redirects to a target of the link; and

responsive to receiving a request for the digital video from a client device;

detecting that the client device is in a locale with a language different from a language of text of the annotation; and

responsive to the detecting, altering the annotation to be displayed, wherein altering the annotation comprises translating the text of the annotation according to the language of the locale.

2. The computer-implemented method of claim 1, further comprising determining, by the computer, whether the user is authorized to annotate the digital video.

3. The computer-implemented method of claim 2, wherein determining, by the computer, whether the user is authorized to annotate the digital video comprises comparing a URL associated with the user to a URL associated with the digital video.

4. The computer-implemented method of claim 2, wherein determining, by the computer, whether the user is authorized to annotate the digital video comprises determining whether the user is on a list of users authorized to perform annotation for the digital video.

5. The computer-implemented method of claim 2, wherein determining, by the computer, whether the user is authorized to annotate the digital video comprises monitoring actions of a contributor of the digital video with respect to the user.

6. The computer-implemented method of claim 2, wherein determining, by the computer, whether the user is authorized to annotate the digital video comprises monitoring actions of other users with respect to the user.

7. The computer-implemented method of claim 2, further comprising determining, by the computer, whether the user is authorized to annotate a particular temporal or spatial portion of the digital video.

8. The computer-implemented method of claim 2, wherein determining, by the computer, whether the user is authorized to annotate the digital video comprises determining whether an owner of the digital video has disabled annotation for the digital video.

9. The computer-implemented method of claim 1, further comprising adding a pause annotation at a specified time within the digital video, the pause annotation causing playback of the digital video to halt when the specified time is reached.

10. The computer-implemented method of claim 1, wherein the annotation has a graphical appearance that when selected displays information associated with the identified visual object.

11. The computer-implemented method of claim 1, further comprising:

responsive to receiving a request for the digital video from a viewer;

identifying annotations associated with the digital video;

filtering the identified annotations by the identity of a viewer, thereby producing a modified set of annotations;

providing the modified set of annotations to the viewer.

12. The computer-implemented method of claim 1, wherein the target of the link is a target video and the link separately encodes both an identifier of the target video and a time stamp of a moment within the target video, and wherein selection of the annotation causes playback of the target video at the moment in the target video specified by the time stamp.

13. The computer-implemented method of claim 1, wherein the target of the link is a web page for a video channel of a contributing user, the video channel comprising a set of videos contributed by the contributing user.

14. A non-transitory computer-readable storage medium having executable computer program instructions embodied therein, the instructions when executed by a processor performing actions comprising:

identifying, by a computer, a visual object displayed within a digital video;

providing to a user a web-based user interface for annotating the digital video;

receiving a request from the user to add an annotation to the visual object;

determining, by the computer, a plurality of spatial and temporal positions of the visual object across a corresponding plurality of frames of the digital video; and

adding the annotation to an annotation database in association with the digital video such that the annotation is displayed during playback of the digital video and moves along with the determined plurality of spatial and temporal positions of the visual object; and

responsive to receiving a request for the digital video from a client device;

detecting that the client device is in a locale with a language different from a language of text of the annotation; and

responsive to the detecting, altering the annotation to be displayed, wherein altering the annotation comprises translating the text of the annotation according to the language of the locale.

15. The non-transitory computer-readable storage medium of claim 14, wherein the request to add the annotation comprises a designation of a link for the annotation, wherein the target of the link is a target video, the link separately encoding both an identifier of the target video and a time stamp of a moment within the target video, and wherein selection of the annotation causes playback of the target video at the moment in the target video specified by the time stamp.

16. The non-transitory computer-readable storage medium of claim 14, the instructions when executed by the processor performing actions comprising adding a pause annotation at a specified time within the digital video, the pause annotation causing playback of the digital video to halt when the specified time is reached.

17. The non-transitory computer-readable storage medium of claim 14, wherein the annotation has a graphical appearance that when selected displays information associated with the identified visual object.

18. A computer system comprising:

a computer processor;

an annotation database storing annotation data; and

a non-transitory computer-readable storage medium having executable computer program instructions embodied therein, the instructions when executed by the computer processor performing actions comprising;

identifying, by a computer, a visual object displayed within a digital video;

providing to a user a first web-based user interface portion for annotating the digital video, the first web-based user interface portion comprising visual representations of a plurality of different annotation types;

receiving a selection from the user of one of the annotation types;

providing to the user a second web-based user interface portion comprising at least one input area for specifying a link for a new annotation for the visual object;

receiving a request from the user to add an annotation of the selected annotation type to the visual object, the request comprising a designation of the link for the annotation;

determining, by the computer, a plurality of spatial and temporal positions of the visual object across a corresponding plurality of frames of the digital video; and

associating the annotation with the digital video in the annotation database, such that the annotation is displayed during playback of the digital video and moves along with the determined plurality of spatial and temporal positions of the visual object, and such that selection of the annotation redirects to a target video of the link; and

responsive to receiving a request for the digital video from a client device;

detecting that the client device is in a locale with a language different from a language of text of the annotation; and

responsive to the detecting, altering the annotation to be displayed, wherein altering the annotation comprises translating the text of the annotation according to the language of the locale.

19. The computer system of claim 18, wherein the target of the link is a target video, wherein the link separately encodes both an identifier of the target video and a time stamp of a moment within the target video, and wherein selection of the annotation causes playback of the target video at the moment in the target video specified by the time stamp.