Playing and editing linked and annotated audiovisual works

• US 9,170,700 B2
• Filed: 05/13/2010
• Issued: 10/27/2015
• Est. Priority Date: 05/13/2009
• Status: Active Grant

• Current Assignee: Coincident TV Incorporated
• Original Assignee: Carl Rosenberg
• Inventors: Kaiser, David H., Schwartz, Bruce, Rosenberg, Carl, Reyes, Luis
• Primary Examiner(s): MORRISON, JAY A
• Application Number:
  US12/779,262
• Publication Number:
  US 20100293190A1
• Time in Patent Office: 1,993 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/748 Hypervideo linking data to content, e.g. by linking an URL to a video object in the context of video distribution systems H04N21/858
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/854 Content authoring

Abstract

In one embodiment, a method includes obtaining metadata that relates to a video program and that defines, for one or more specified time points in the video program, one or more web services to be invoked at those time points; generating and displaying, on a computer, a video window that is configured to play the video program; during playing the video program on a computer, detecting that the video program is playing at one of the time points and determining an identifier of a particular web service associated with that one of the time points; in response to the detecting, causing the computer to invoke the particular web service.

Claims

1. A non-transitory computer-readable data storage medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform:

obtaining a link to a stored video program;

obtaining metadata that relates to the video program and that defines, for a specified time point in the video program, one or more annotations to be invoked at the specified time point, wherein each of the annotations comprises an association of a graphic image and a reference to a video program segment within the same video program or an online electronic document from among a plurality of video segments in the video program;

wherein the metadata is in a metadata file separate from the streaming video program, and wherein the metadata file comprises XML tags specifying a reference to the streaming video program, a plurality of cue point types for each of the one or more specified time points, and attributes for the cue point types and the specified time points in the streaming video program, the attributes including at least the one or more annotations, locations of the graphic image and the reference;

causing the computer to play the video program from the link;

during playing the video program on a computer, detecting that the video program is playing at the specified time point;

in response to the detecting, obtaining the one or more annotations for the specified time point and causing the computer to display one or more graphic images associated with the one or more annotations for the specified time point, obtain input selecting one of the graphic images, and initiate playing the video program segment of the same video program segment and that is associated with the selected one of the graphic images;

wherein the metadata file defines at least two segments in the video program and wherein a first segment comprises a start cue point and a jump cue point, wherein the jump cue point references a second segment, and wherein the second segment comprises a return-end cue point;

during playing the video program, initiating playing at the start cue point of the first segment, detecting that the video program is at the jump cue point of the first segment, and in response, initiating playing the second segment of the video program, then detecting that the video program is at the return-end cue point, and in response, initiating playing the video program at a point just after the jump cue point.

2. The computer-readable data storage medium of claim 1, further comprising instructions which when executed cause the computer, in response to the detecting, to display one or more graphic images associated with the one or more annotations for the specified time point, obtain input selecting one of the graphic images, obtain a copy of the online electronic document that is associated with the selected one of the graphic images, display the video program in a reduced size video window logically layered above a browser window, and to display the copy of the online electronic document in the browser window concurrently.

3. The computer-readable data storage medium of claim 1, wherein the video program segment is in the video program.

4. The computer-readable data storage medium of claim 1, wherein the reference to the video program segment is a particular time point in the video program.

5. The computer-readable data storage medium of claim 1, wherein the video program segment is a second video program that is obtainable over a network.

6. The computer-readable data storage medium of claim 1, further comprising instructions which when executed cause displaying the one or more graphic images in a border rectangle that is adjacent to a video rectangle, wherein both the border rectangle and video rectangle are within a video window of a player window, and wherein the video program plays within the video rectangle.

7. The computer-readable data storage medium of claim 6, comprising instructions which when executed cause displaying the one or more graphic images in the border rectangle in a position laterally adjacent to the video rectangle.

8. The computer-readable data storage medium of claim 1, further comprising instructions which when executed cause obtaining the video program from any of local storage on the computer, or a first networked server computer that is separate from the computer, and obtaining the metadata from a different second networked server computer.

9. A non-transitory computer-readable data storage medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform:

obtaining first data identifying a stored video file having one or more video segments;

displaying at least a frame of the stored video file in a video window of a screen display that is generated using a video editor;

using a metadata panel that is displayed using the video editor in the screen display adjacent to the video window, obtaining second data specifying one or more cue points for the video file, wherein each of the cue points comprises an association of a playback time value, a cue point type, and one or more values of attributes that are associated with a particular cue point type, wherein the cue point type and attribute values define an action to perform among a plurality of different actions at the cue point during playing of the video file, wherein the action includes invoking an external web service;

storing the first data and second data in association with one another in a metadatae file;

wherein the metadata file defines at least two segments in the video program and wherein a first segment comprises a start cue point and a jump cue point, wherein the jump cue point references a second segment, and wherein the second segment comprises a return-end cue point;

causing the one or more processors to play the stored video file;

during playing the stored video file, initiating playing at the start cue point of the first segment, detecting that the stored video file is at the jump cue point of the first segment, and in response, initiating playing the second segment of the stored video file, then detecting that the stored video file is at the return-end cue point, and in response, initiating playing the stored video file at a point just after the jump cue point.

10. The storage medium of claim 9, further comprising instructions which when executed cause:

obtaining annotation data defining an annotation for one or more cue points, wherein the annotation data comprises an annotation name, annotation type, annotation position, and one or more of text, a graphical image, and a graphical image to display at the time of a user mouse over operation, and wherein the annotation defines information for a video player to display over a video program when the video program is at a particular one of the cue points;

obtaining association data defining an association of the annotation to the particular one of the cue points;

storing the annotation data and the association data in the metadata file.

11. The storage medium of claim 9, further comprising instructions which when executed cause:

obtaining web reference data defining an online electronic document for association with one or more cue points, wherein the web reference data comprises at least a network resource identifier of an electronic document to display in a browser window of a video player at the time of that the one or more cue points is reached in playing the video program;

obtaining association data defining an association of the web reference data to at least one of the cue points;

storing the annotation data and the association data in the metadata file.

12. The storage medium of claim 11, further comprising instructions which when executed cause obtaining, as part of the web reference data, a query string for submitting to an internet search engine for generating search results in which a viewer may have interest.

13. The storage medium of claim 11, further comprising instructions which when executed cause obtaining, as part of the web reference data, an interest URL to which a viewer may be directed at playback time in response to receiving input at a player indicating interest in other information relating to the video program.

14. The storage medium of claim 11, further comprising instructions which when executed cause obtaining, as part of the web reference data, a target at which processing should continue in response to receiving user input indicating closing the electronic document or completing viewing the electronic document.

15. The storage medium of claim 11, further comprising instructions which when executed cause obtaining, as part of the web reference data, web view layout data that defines a visual layout of a browser window and a video window within a player window for use at playback time to concurrently display both the electronic document and the video program.

16. The storage medium of claim 11, further comprising instructions which when executed cause obtaining player layout data that defines a visual layout of a player window for use at playback time to concurrently display both the electronic document and the video program, wherein the player layout data defines a size and position of a browser window and a video window within the player window.

17. The storage medium of claim 11, further comprising instructions which when executed cause obtaining player layout data that defines a visual layout of a player window for use at playback time to concurrently display both the electronic document and the video program, wherein the player layout data defines a size and position of a browser window, a video window, and a background within the player window.

18. The storage medium of claim 17 comprising instructions which when executed cause obtaining player layout data that defines the video window as reduced size and logically over the browser window.

19. The storage medium of claim 17 comprising instructions which when executed cause obtaining player layout data that defines the video window and the browser window as adjacent and both surrounded by the background.

20. The storage medium of claim 9, further comprising instructions which when executed cause storing the metadata file in a first location that is different than a second location of the stored video file.