Playing and editing linked and annotated audiovisual works

• US 9,462,309 B2
• Filed: 10/26/2015
• Issued: 10/04/2016
• Est. Priority Date: 05/13/2009
• Status: Active Grant

• Current Assignee: Coincident TV Incorporated
• Original Assignee: Coincident TV Incorporated
• Inventors: Kaiser, David H., Schwartz, Bruce, Rosenberg, Carl, Reyes, Luis
• Primary Examiner(s): MORRISON, JAY A
• Application Number:
  US14/922,287
• Publication Number:
  US 20160057458A1
• Time in Patent Office: 344 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/748 Hypervideo linking data to content, e.g. by linking an URL to a video object in the context of video distribution systems H04N21/858
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/854 Content authoring

Abstract

In one embodiment, a method includes obtaining metadata that relates to a video program and that defines, for one or more specified time points in the video program, one or more web services to be invoked at those time points; generating and displaying, on a computer, a video window that is configured to play the video program; during playing the video program on a computer, detecting that the video program is playing at one of the time points and determining an identifier of a particular web service associated with that one of the time points; in response to the detecting, causing the computer to invoke the particular web service.

Claims

1. A non-transitory computer-readable data storage medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform:

obtaining metadata that relates to a video program and that defines, for one or more specified time points in the video program, one or more web services to be invoked at those time points;

wherein the metadata is in a metadata file separate from the video program, and wherein the metadata file comprises tags specifying a reference to the video program, a plurality of cue point types for each of the one or more specified time points, and attributes for the cue point types and the specified time points in the streaming video program, the attributes including at least identifiers of the one or more web services;

generating and displaying, on a computer, a video window that is configured to play the video program;

obtaining and playing the video program on the computer;

during playing the video program, detecting that the video program is at one of the time points and determining an identifier of a particular web service associated with that one of the time points;

obtaining metadata that further defines a database query;

in response to the detecting, causing the computer to invoke the particular web service by submitting the database query to the web service, including invoking the particular web service that is configured to execute the database query, determine a result set, and return the result set in a response to the computer;

based on the result set that is received in response to the database query via the web service, selecting a target piece of media from among a plurality of target pieces of media and playing the target piece of media.

2. The computer-readable data storage medium of claim 1, further comprising instructions which when executed cause invoking a particular web service that is configured to obtain a cellular radiotelephone number and to dispatch a text message to the number.

3. The computer-readable data storage medium of claim 1, further comprising instructions which when executed cause invoking a particular web service that is configured to submit information about the video program over a network to a social networking service.

4. The computer-readable data storage medium of claim 1, further comprising instructions which when executed cause obtaining the video program from any of local storage on the computer, or a first networked server computer that is separate from the computer.

5. The computer-readable data storage medium of claim 1, further comprising instructions which when executed cause obtaining the video program from any of local storage on the computer, or a first networked server computer that is separate from the computer, and obtaining the metadata from a different second networked server computer.

6. The computer-readable data storage medium of claim 1, further comprising instructions which when executed cause the one or more processors to perform:

identifying a particular cue point at an end of playing the target piece of media, wherein the particular cue point has a value of one of a return value, a goto value, or a program end value;

in response to the value of the particular cue point, performing;

when the particular cue point has the return value, returning to playing the video program at a point just after the one of the time points at which an identifier of a particular web service was determined;

when the particular cue point has the goto value, playing the video program starting at a new time point that is specified with the particular cue point;

when the particular cue point has the program end value, stopping playing the video program without a rewind option.

7. A computer-implemented data processing method comprising:

obtaining metadata that relates to a video program and that defines, for one or more specified time points in the video program, one or more web services to be invoked at those time points;

wherein the metadata is in a metadata file separate from the video program, and wherein the metadata file comprises XML tags specifying a reference to the video program, a plurality of cue point types for each of the one or more specified time points, and attributes for the cue point types and the specified time points in the streaming video program, the attributes including at least identifiers of the one or more web services;

generating and displaying, on a computer, a video window that is configured to play the video program;

obtaining and playing the video program on the computer;

during playing the video program, detecting that the video program is at one of the time points and determining an identifier of a particular web service associated with that one of the time points;

obtaining metadata that further defines a database query;

in response to the detecting, causing the computer to invoke the particular web service by submitting the database query to the web service, including invoking the particular web service that is configured to execute the database query, determine a result set, and return the result set in a response to the computer;

based on the result set that is received in response to the database query via the web service, selecting a target piece of media from among a plurality of target pieces of media and playing the target piece of media.

8. The method of claim 7, further comprising invoking a particular web service that is configured to obtain a cellular radiotelephone number and to dispatch a text message to the number.

9. The method of claim 7, further comprising invoking a particular web service that is configured to submit information about the video program over a network to a social networking service.

10. The method of claim 7, further comprising obtaining the video program from any of local storage on the computer, or a first networked server computer that is separate from the computer.

11. The method of claim 7, further comprising obtaining the video program from any of local storage on the computer, or a first networked server computer that is separate from the computer, and obtaining the metadata from a different second networked server computer.

12. The method of claim 7, further comprising:

identifying a particular cue point at an end of playing the target piece of media, wherein the particular cue point has a value of one of a return value, a goto value, or a program end value;

in response to the value of the particular cue point, performing;

when the particular cue point has the return value, returning to playing the video program at a point just after the one of the time points at which an identifier of a particular web service was determined;

when the particular cue point has the goto value, playing the video program starting at a new time point that is specified with the particular cue point;

when the particular cue point has the program end value, stopping playing the video program without a rewind option.