Method and apparatus for interactive programming using captioning

• US 7,937,740 B2
• Filed: 09/16/2008
• Issued: 05/03/2011
• Est. Priority Date: 08/16/2002
• Status: Expired due to Term

• Current Assignee: Mediaip LLC
• Original Assignee: Mediaip Incorporated
• Inventors: Shusman, Chad W.
• Primary Examiner(s): Pendleton; Brian T
• Assistant Examiner(s): IDOWU, OLUGBENGA O
• Application Number:
  US12/211,714
• Publication Number:
  US 20090089840A1
• Time in Patent Office: 959 Days
• Field of Search: 725/13, 725/24, 725/25, 725/45, 725/46, 725/136, 725/50
• US Class Current: 725/135
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/236 Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream multiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/262 Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists scheduling strategies for dispatcher in multiprogramming arrangements G06F9/4881; arrangements for scheduling broadcast services or broadcast-related services H04H60/06; flow control in packet networks H04L47/10; establishing a time schedule or organising the servicing of application requests H04L67/62
• CPC Class Codes: H04N 21/26603 for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques
• CPC Class Codes: H04N 21/433 Content storage operation, e.g. storage operation in response to a pause request, caching operations
• CPC Class Codes: H04N 21/434 Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/458 Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations arrangements for replacing or switching information during the broadcast or during the distribution H04H20/10
• CPC Class Codes: H04N 21/4758 for providing answers, e.g. voting
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/8126 involving additional data, e.g. news, sports, stocks, weather forecasts
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/854 Content authoring
• CPC Class Codes: H04N 21/8545 for generating interactive applications
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

A method and system for the creation of interactive programming using captions. A caption and program information extractor monitors a broadcast media signal having captions and program information encoded in the broadcast media signal. The captions and program information are extracted and stored in a content database. A moderator accesses the content database to retrieve captions and for a program specified by the program information. The moderator uses the services of a moderator server to generate interactive programming from the captions and the moderator'"'"'s own comments. The interactive programming is transmitted to a plurality of viewers who interact with the interactive programming by entering viewer comments. The viewer comments are received by the moderator along with additional captions and new interactive programming is generated using the viewer comments, additional captions, and additional moderator commentary.

Claims

1. A method for generating a user-generated interactive program hosted by a moderator for transmission over a communications network to a plurality of viewers, comprising:

dynamically extracting captions and program information from a broadcast media content by an intelligent caption and program information extractor;

dynamically organizing, semantic tagging, time coding and putting the captions and program information in a media content database by the intelligent caption and program information extractor;

coupling a moderator server to the communications network and the media content database;

coupling a moderator client for use by the moderator and a plurality of viewer clients for use by the plurality of viewers to the moderator server through the communications network;

dynamically getting the organized, semantic tagged and time coded captions and program information by the moderator using the moderator client to retrieve the organized, semantic tagged and time coded captions and program information from the media content database via the moderator server;

dynamically editing the captions by the moderator using the moderator client;

dynamically generating moderator comments by the moderator using the moderator client;

dynamically receiving viewer comments at the moderator server from the viewers using the viewer clients and transmitting the viewer comments from the moderator server to the moderator client;

dynamically editing the viewer comments for viewing by the plurality of viewers by the moderator using the moderator client;

dynamically transmitting the organized, semantic tagged and time coded edited captions and program information, moderator comments, and edited viewer comments from the moderator client to the moderator server;

dynamically generating the user-generated interactive program by the moderator server utilizing the received moderator comments, the received, edited viewer comments, the organized, semantic tagged and time coded edited captions and program information, and the media content, wherein the dynamically generating the user-generated interactive program comprises;

processing the received moderator comments, the received, edited viewer comments, the organized, semantic tagged and time coded edited captions and program information;

generating viewer response and caption content based on a collaboration and interaction of the processed moderator comments, the processed viewer comments, the processed program information and the processed captions; and

merging the viewer response and caption content based on the collaboration and interaction of the processed moderator comments, the processed viewer comments, the processed program information and the processed captions with the media content; and

transmitting the user-generated interactive program by the moderator server to the viewer clients through the communications network, wherein the media content is a digital video signal, and the generating of the user-generated interactive program further comprises;

encapsulating an interactive component in a first elementary stream of a digital video broadcast stream, and

adding the media content to a second elementary stream of the video broadcast stream.

2. The method of claim 1, further comprising:

receiving viewer comments by the moderator server from the viewer clients through the communications network; and

transmitting the viewer comments by the moderator server to the moderator client through the communications network.

3. The method of claim 1 wherein the communications network is a virtual private network.

4. The method of claim 1 wherein the edited viewer comments further include an interactive program rating signal.

5. The method of claim 1, further comprising:

receiving a viewer exclusion signal specifying a viewer client of the plurality of viewer clients by the moderator server from the moderator client through the communications network; and

generating by the moderator server the user-generated interactive program utilizing the viewer exclusion signal to exclude viewer comments received from the specified viewer client.

6. The method of claim 1, further comprising:

receiving a viewer invitation signal corresponding to a specific viewer client of the plurality of viewer clients by the moderator server from the moderator client through the communications network; and

generating by the moderator server the user-generated interactive program utilizing the viewer invitation signal to include viewer comments from the specific viewer client in a virtual stage.

7. A method for generating a user-generated interactive program hosted by a moderator for transmission over a television broadcast network to a plurality of viewers, comprising:

dynamically extracting captions and program information from a broadcast media content by an intelligent caption and program information extractor;

dynamically organizing, semantic tagging, time coding, and putting the captions and program information in a media content database by the intelligent caption and program information extractor;

coupling a moderator server to a communications network, a telephony network, the television broadcast network, and the media content database;

coupling a moderator client for use by the moderator to the moderator server through the communications network;

dynamically getting the organized, semantic tagged, and time coded captions and program information by the moderator using the moderator client to retrieve the organized, semantic tagged and time coded captions and program information from the media content database via the moderator server;

dynamically editing the captions by the moderator using the moderator client;

dynamically generating moderator comments by the moderator using the moderator client;

dynamically receiving viewer comments at the moderator server from the viewers and transmitting the viewer comments from the moderator server to the moderator client;

dynamically editing the viewer comments for viewing by the plurality of viewers by the moderator using the moderator client;

dynamically transmitting the organized, semantic tagged and time coded edited captions and program information, moderator comments, and edited viewer comments from the moderator client to the moderator server;

dynamically generating the user-generated interactive program by the moderator server utilizing the received moderator comments, the received, edited viewer comments, the organized, semantic tagged, and time coded edited captions and program information, and the media content, wherein the dynamically generating the user-generated interactive program comprises;

processing the received moderator comments, the received, edited viewer comments, the organized, semantic tagged, and time coded edited captions and program information;

generating viewer response and caption content based on a collaboration and interaction of the processed moderator comments, the processed viewer comments, the processed program information and the processed captions; and

merging the viewer response and caption content based on the collaboration and interaction of the processed moderator comments, the processed viewer comments, the processed program information and the processed captions with the media content; and

transmitting the user-generated interactive program by the moderator server to viewer televisions through the television broadcast network, wherein the media content is a digital video signal, and the generating of the user-generated interactive program further comprises;

encapsulating an interactive component in a first elementary stream of a digital video broadcast stream, and

adding the media content to a second elementary stream of the video broadcast stream.

8. The method of claim 7, wherein viewers communicate with a moderator through the telephony network, the method further comprising:

coupling the moderator server to the telephony network;

receiving viewer comments by the moderator server from the viewers through the telephony network; and

transmitting the viewer comments by the moderator server to the moderator client through the communications network.

9. An apparatus for creating, editing, and distributing a user-generated interactive program hosted by a moderator for transmission over a communications network to a plurality of viewers, comprising:

a media content database;

a caption and program information extractor coupled to a broadcast media signal source and the media content database for extracting captions and program information from a broadcast media content and dynamically organizing, semantic tagging, time coding, and putting the extracted captions and program information in the media content database;

a moderator server coupled to the media content database, the moderator server for coupling through the communications network to a plurality of viewer clients for use by the plurality of viewers and a moderator client for use by the moderator, the moderator server including;

a processor; and

a memory operably coupled to the processor and having program instructions stored therein, the processor being operable to execute the program instructions, the program instructions including;

dynamically extracting the organized, semantic tagged, and time coded captions and program information from the media content database in response to requests by the moderator using the moderator client and transmitting the captions and program information to the moderator client;

dynamically receiving viewer comments from the viewers using the viewer clients and transmitting the viewer comments to the moderator client;

dynamically receiving the organized, semantic tagged and time coded captions and program information after editing by the moderator using the moderator client;

dynamically receiving moderator comments by the moderator using the moderator client;

dynamically receiving the viewer comments after editing for viewing by the plurality of viewers by the moderator using the moderator client;

dynamically generating the user-generated interactive program utilizing the received moderator comments, the received, edited viewer comments, the received organized, semantic tagged, and time coded edited captions and program information, and the media content, wherein the dynamically generating the user-generated interactive program comprises;

processing the received moderator comments, the received, edited viewer comments, the organized, semantic tagged, and time coded edited captions and program information;

generating viewer response and caption content based on a collaboration and interaction of the processed moderator comments, the processed viewer comments, the processed program information and the processed captions; and

merging the viewer response and caption content based on the collaboration and interaction of the processed moderator comments, the processed viewer comments, the processed program information and the processed captions with the media content; and

transmitting the user-generated interactive program to the viewer clients through the communications network, wherein the media content is a digital video signal, and the generating of the user-generated interactive program further comprises;

encapsulating an interactive component in a first elementary stream of a digital video broadcast stream, and

adding the media content to a second elementary stream of the video broadcast stream.

10. The apparatus of claim 9, the program instructions further including:

receiving viewer comments from the viewer clients through the communications network; and

transmitting the viewer comments to the moderator client through the communications network.

11. The apparatus of claim 9, wherein the communications network is a virtual private network.

12. The apparatus of claim 9, wherein the edited viewer comments further include an interactive program rating signal.

13. The apparatus of claim 9, the program instructions further including:

receiving a viewer exclusion signal specifying a viewer client of the plurality of viewer clients from the moderator client through the communications network; and

generating the interactive program utilizing the viewer exclusion signal to exclude viewer comments received from the specified viewer client.

14. The apparatus of claim 9, the program instructions further including:

receiving a viewer invitation signal corresponding to a specific viewer client of the plurality of viewer clients from the moderator client through the communications network; and

generating the interactive program utilizing the viewer invitation signal to include viewer comments from the specific viewer client in a virtual stage.