System for presenting synchronized HTML documents in digital television receivers

• US 7,188,353 B1
• Filed: 04/06/1999
• Issued: 03/06/2007
• Est. Priority Date: 04/06/1999
• Status: Expired due to Fees

• Current Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Laboratories of America Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Crinon, Regis J.
• Primary Examiner(s): TRAN, HAI V
• Application Number:
  US09/287,402
• Time in Patent Office: 2,891 Days
• Field of Search: 725/32, 725/110, 725/136, 725/116, 725/139, 725/86, 725/82, 725135-137, 725/500.1, 725/501.1, 375/240.26, 348/425.1, 348/425.3, 348/460, 348/500, 348512-513, 370534-538, 345715-717, 709235-237, 709/219
• US Class Current: 725/32
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/2355 involving reformatting operations of additional data, e.g. HTML pages optimising the visualization of content for information retrieval from the Internet G06F16/9577; tracking of instant messages H04L51/234; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/23608 Remultiplexing multiplex streams, e.g. involving modifying time stamps or remapping the packet identifiers
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/4305 Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets arrangements for synchronising receiver with transmitter by comparing receiver clock with transmitter clock H04L7/0012; arrangements for synchronising receiver with transmitter wherein the receiver takes measures against momentary loss of synchronisation H04L7/0083
• CPC Class Codes: H04N 21/43074 of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV program
• CPC Class Codes: H04N 21/434 Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/4344 Remultiplexing of multiplex streams, e.g. by modifying time stamps or remapping the packet identifiers
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/858 Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
• CPC Class Codes: H04N 7/163 by receiver means only

Abstract

A method and apparatus is provided for synchronizing display of HTML documents to the audio/video content of a digital television program. Documents are authored with a structure for receiving a presentation time stamp value. After the packetized data representing the document is received at the television receiver, the document is reconstructed, and the value of the presentation time stamp is inserted in the structure in the document. The broadcast HTML formatted document, including the time stamp value, can be read by a broadcast HTML cognizant browser which notifies the program viewer or displays the document at the time specified by the time stamp.

Claims

1. A method of displaying a document together with a first time stamp specified display of a video element comprising the steps of:

(a) a transmitter providing said document wherein said document includes a structure for receiving a first time stamp value associated with said video element in a packetized elementary stream, wherein the combination of said document and said structure for receiving said first time stamp value is provided in a packetized elementary stream together with an associated presentation time stamp value;

(b) a receiver inserting said presentation time stamp value into said structure;

(c) reading said presentation time stamp value in said document; and

(d) at least one of providing and signaling the availability of said document to a viewer in accordance with said presentation time stamp value.

2. The method of claim 1 wherein said availability of said document is signaled by displaying said document.

3. The method of claim 1 wherein said availability of said document is signaled by displaying to said viewer a notice of said availability to which said viewer may respond by causing said display of said document.

4. The method of claim 1 wherein said presentation time stamp value is encoded in a data packet with said document before said data packet is transmitted.

5. The method of claim 1 wherein said presentation time stamp value is inserted into said structure after said document is transmitted.

6. A method of displaying a document together with at least one of a video element and an audio element of a video comprising:

(a) providing said document wherein said document includes a structure for receiving a first time stamp value specifying a display time for said document;

(b) encoding in a packetized elementary stream a first data packet comprising a payload containing said document together with an associated presentation time stamp value located apart from said structure;

(c) encoding in a packetized elementary stream a second data packet comprising said first time stamp value and a target datum in said at least one of said video element and said audio element;

(d) reconstructing said document from said first data packet;

(e) capturing said presentation time stamp value from said first data packet;

(f) inserting said presentation time stamp value into said structure for receiving said first time stamp value;

(g) reading said presentation time stamp value in said document; and

(h) at least one of providing and signaling the availability of said document to a viewer and displaying said target datum of said at least one of said video element and said audio element at said display time specified by said presentation time stamp value.

7. The method of claim 6 wherein the presence of said document is signaled by displaying said document.

8. The method of claim 7 further comprising the steps of:

(a) including in said document a display time interval; and

(b) terminating said display of said document at a time specified by said display time interval and said time stamp value.

9. The method of claim 6 wherein the presence of said document is signaled by displaying a command by which said viewer can cause said document to be displayed.

10. The method of claim 6 further comprising transmitting said first and second data packets to a receiver.

11. An apparatus for displaying a document together with at least one of a video and an audio element of a video comprising:

(a) a document server for delivering said document wherein said document includes a structure for receiving a first time stamp value as a first data stream to a packet assembler said delivery being coordinated with the arrival of a target datum in a second data stream representing said at least one of a video element and an audio element;

(b) said packet assembler for encoding in a packetized elementary stream a first data packet having, together with an associated presentation time stamp value not within said structure, a payload comprising a data unit representing said document and said first time stamp value specifying a time for displaying said document and a second data packet comprising said target datum and said first time stamp value;

(c) a packet disassembler for separating said data unit and said first time stamp value from said first data packet;

(d) a parser to reconstruct said document from said data unit;

(e) a time stamp loader to insert said presentation time stamp value into said structure for receiving said first time stamp value; and

(f) a data presentation engine to read said document and signal a viewer of the availability of said document at said time specified by said first time stamp value.

12. The apparatus of claim 11 wherein the availability of said document is signaled by displaying said document on a display.

13. The apparatus of claim 11 further comprising:

(a) a storage device to store said reconstructed document; and

(b) a command device enabling said viewer to cause the display of said document.

14. The apparatus of claim 11 further comprising a transmission and receiving system for transferring data packets to a receiver.