SYNCHRONIZATION OF VIDEO WITH TELEMETRY SIGNALS METHOD AND APPARATUS

• US 20100067553A1
• Filed: 05/01/2009
• Published: 03/18/2010
• Est. Priority Date: 09/12/2008
• Status: Abandoned Application

• Current Assignee: Carefusion 202 Inc. (Becton, Dickinson & Co)
• Original Assignee: Viasys Healthcare Incorporated (Cardinal Health, Inc.)
• Inventors: Hein, James S., McKINNEY, Michael
• Application Number:
  US12/433,922
• Publication Number:
  US 20100067553A1
• Time in Patent Office: Days
• US Class Current: 370/503
• CPC Class Codes: H04J 3/0664 unidirectional timestamps
• CPC Class Codes: H04J 3/067 Details of the timestamp structure
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/23892 involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/4341 Demultiplexing of audio and video streams

Abstract

An Ethernet-compatible synchronization process between isolated digital data streams assures synchronization by embedding an available time code from a first stream into data locations in a second stream that are known a priori to be unneeded. Successive bits of time code values, generated as a step in acquiring and digitizing analog sensor data, are inserted into least-significant-bit locations in a digitized audio stream generated along with digitized image data by a digital video process. The overwritten LSB locations are shown to have no discernable effect on audio reconstructed from the Ethernet packets. Telemetry recovery is the reverse of the embedment process, and the data streams are readily synchronized by numerical methods.

Claims

1. An Ethernet-compatible apparatus for synchronization of first and second packetized digital data streams, comprising:

a telemetry synchronization (SYNC) word generator, wherein the SYNC word generator produces a sequential series of SYNC words, and wherein the respective SYNC words consist of successions of symbols;

a first packetized digital data stream, wherein data timing of the first stream is associated with timing of the SYNC word generator;

a data packet capture function configured to capture packets in a second stream of digital data packets;

a SYNC embedment function, wherein captured digital data packets are modified by substitution of symbols from SYNC words for portions of data contained within the captured packets; and

a digital packet transmission function for the first and modified second data packet streams.

2. The synchronization apparatus of claim 1, wherein the first packetized, transmitted digital data stream comprises at least in part successive SYNC words created by the SYNC word generator, wherein successive SYNC words correspond to successive time values and are nonrepeating over a selected interval.

3. The synchronization apparatus of claim 1, wherein each symbol consists of a single bit.

4. The synchronization apparatus of claim 3, wherein the symbols are embedded in least-significant-bit locations within sequential second-stream digital data packets.

5. The synchronization apparatus of claim 1, wherein each symbol consists of a plurality of bits.

6. The synchronization apparatus of claim 5, wherein the symbols are embedded within second-stream digital data packets in locations comprising a plurality of least-significant-bits not less than the number of bits of the symbol.

7. The synchronization apparatus of claim 1, wherein the symbols are embedded within second-stream digital data packets by displacing higher-order bits to other bit locations within the packets and inserting the symbols at least in part in bit locations wherefrom the higher-order bits are displaced.

8. The synchronization apparatus of claim 1, wherein the digital packet transmission function for the first and modified second data packet streams directs the streams to separate receiving addresses.

9. The synchronization apparatus of claim 1, further comprising:

a first telemetry receiving function for the first data packet stream;

a second telemetry receiving function for the modified second data packet stream;

a first extraction function, configured to extract SYNC words from the first data packet stream, further configured to distribute data from remaining first-stream packets into at least one first presentation stream;

a second extraction synchronization function, configured to extract SYNC words from modified packets within the second data packet stream, further configured to distribute data from remaining second-stream packets into at least one second presentation stream;

a synchronization function, configured to adjust presentation timing to establish simultaneous presentation of the first and second streams within a selected time offset range.

10. A method for establishing synchronization between packetized, digitized audio/video signals and packetized telemetry, comprising:

generating a succession of digitized time values;

capturing a succession of Ethernet audio/video (AV) signal data packets, wherein data items representing a succession of values of digitized AV signals are contained within the Ethernet AV packets;

embedding the succession of time values into the succession of AV signal value data items, wherein a subset of the digital content of successive digitized audio data values is replaced by a subset of a digitized time value; and

retransmitting Ethernet AV data packets wherein digitized audio data values include embedded time value subsets.

11. The method for establishing synchronization of claim 10, wherein the acquired time values are nonrepeating over a predetermined interval, are synchronized to a succession of data acquisition values, and are digitized and packetized as telemetry.

12. The method for establishing synchronization of claim 10, further comprising capturing a succession of data acquisition elements, wherein the AV signal values correlate chronologically with the data acquisition elements within predetermined embedment timing parameters.

13. The method for establishing synchronization of claim 12, further comprising:

forming a succession of Ethernet telemetry packets, wherein each packet contains at least a valid destination address and at least one of an acquired data element or a plurality of subsets of a time value that correlates chronologically with the data acquisition element within predetermined embedment timing parameters; and

transmitting the Ethernet telemetry packets.

14. The method for establishing synchronization of claim 10, wherein successive Ethernet AV packets comprise at least valid destination addresses and successive audio signal data values.

15. The method for establishing synchronization of claim 10, further comprising replacing least-significant bits in successive digitized audio signal values by successive bits of a time value that correlates chronologically with the successive audio signal values within predetermined embedment timing parameters.

16. The method for establishing synchronization of claim 13, further comprising:

receiving the AV and telemetry Ethernet packets;

stripping out the audio data from the AV packets;

extracting the digitized time value subsets from the audio data; and

reconstructing the time values from the subsets extracted from the audio data.

17. The method for establishing synchronization of claim 16, further comprising:

stripping out the time values from the telemetry packets; and

reconstructing the time values from the time value symbols extracted from the telemetry packets.

18. The method for establishing synchronization of claim 17, further comprising:

forming presentation streams from the respective AV and telemetry packets;

adjusting presentation stream timing so that AV and telemetry have time values synchronized within predetermined embedment timing parameters; and

presenting the AV and telemetry streams.

19. A method for establishing synchronization between packetized, digitized audio/video signals and packetized telemetry, comprising:

generating a succession of digitized time values, nonrepeating over a predetermined interval, synchronized to a succession of digitized data acquisition values, wherein each time value comprises a plurality of symbols;

accessing a succession of digitized audio/video data values, wherein chronological occurrence and sequencing of the audio/video data values correlate to chronological occurrence and sequencing of the data acquisition values within selected embedment timing parameters;

embedding successive symbols from a time value into successive digitized audio/video data values, wherein a subset of the content of successive digitized audio data elements is replaced by successive time value symbols;

forming a succession of Ethernet audio/video data packets comprising successive audio data elements wherein successive symbols from the time value are embedded;

forming a succession of Ethernet telemetry packets, wherein each telemetry packet comprises at least one datum, and wherein the at least one datum is a data acquisition element or a plurality of symbols of a time value associated with the data element; and

transmitting the Ethernet packets.

20. An Ethernet-compatible apparatus for synchronization of first and second packetized digital data streams, comprising:

means for generating a succession of telemetry synchronization (SYNC) words, wherein the respective SYNC words consist of successions of symbols;

means for acquiring data items representing a succession of values of digitized audio/video (AV) signals, wherein digitized audio data items are a subset of the AV data items;

means for embedding the succession of SYNC words into the succession of digitized audio data items, wherein symbols within the digital content of successive digitized audio data values are replaced by successive symbols from digitized time values; and

means for transmitting Ethernet AV data packets wherein a digitized audio data value subset thereof includes embedded time value symbols.

21. The synchronization apparatus of claim 20, further comprising:

means for generating time values that are nonrepeating over a predetermined interval;

means for acquiring data values including at least the time values, wherein the data values are distinct from the AV signals, wherein the data values are digitized and packetized as Ethernet telemetry; and

means for transmitting the data values.

22. The synchronization apparatus of claim 20, further comprising:

means for receiving the AV and telemetry Ethernet packet streams;

means for stripping out the audio data from the AV packets;

means for extracting the digitized time value symbols from the audio data;

means for reconstructing the time values from the symbols extracted from the audio data;

means for stripping out the time values from the telemetry packets; and

means for synchronizing presentation of AV and telemetry from the reconstructed time values from the respective Ethernet packet streams.