System and method for in-band A/V timing measurement of serial digital video signals

• US 8,531,603 B2
• Filed: 12/17/2010
• Issued: 09/10/2013
• Est. Priority Date: 06/02/2010
• Status: Active Grant

• Current Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Original Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Inventors: Strein, Michael J., Stefanidis, Efthimis, Jackson, James L.
• Primary Examiner(s): Tran, Trang U
• Application Number:
  US12/972,183
• Publication Number:
  US 20120033134A1
• Time in Patent Office: 998 Days
• Field of Search: 348515-516, 348/512, 348/180, 348/464, 348/500, 348/518, 348/423.1, 348/425.1, 348/425.4, 348/462
• US Class Current: 348/512
• CPC Class Codes: H04N 17/004 for digital television systems
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/8106 involving special audio data, e.g. different tracks for different languages
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content
• CPC Class Codes: H04N 5/04 Synchronising for television systems using pulse code modulation H04N7/56

Abstract

A system and method for characterizing the relative offset in time between audio and video signals and enables the receiver of the audio and video signals to resynchronize the audio and video signals. Signal characterization data is dynamically captured and encoded into frames of video and audio data that is output by a television origination facility. The signal characterization data is extracted by the receiver and signal characterization data is recomputed for the received frames. The extracted signal characterization data is compared with the recomputed signal characterization data to compute the relative offset in time between the video and one or more audio signals for a frame. The receiver may then resynchronize the video and audio signals using the computed relative offset.

Claims

1. A computer-implemented method for characterizing a relative offset in time between audio and video signals, the method comprising:

generating in-band characterization data for synchronized audio and video signals associated with each frame in a sequence of frames, wherein the in-band characterization data represents a fingerprint of a portion of the synchronized audio and video signals, and wherein a portion of the synchronized audio and video signals comprises each scanline of video data and audio data for each frame in the sequence of frames;

inserting the characterization data for the synchronized audio and video signals into a vertical ancillary (VANC) space of a signal that includes video and audio signals for each frame in the sequence of frames; and

transmitting the signal to a receiver that is configured to reproduce the synchronized audio and video signals associated with each frame in the sequence of frames.

2. The method of claim 1, wherein the step of generating the in-band characterization data comprises:

for each frame in the sequence of frames, computing a first value for the video signals associated with at least a first scanline for the frame based on a first mathematical function; and

for each frame in the sequence of frames, computing second values for the audio signals associated with the at least a first scanline for each the frame based on a second mathematical function.

3. The method of claim 2, wherein the audio signals include a plurality of audio channels, wherein each audio channel is represented by an audio channel pair, and the step of computing the second values for the audio signals associated with the at least first scanline comprises computing a separate value for each audio channel pair associated with the plurality of audio channels.

4. The method of claim 2, wherein the step of generating the in-band characterization data comprises:

for each frame in the sequence of frames, computing a third value for the video signals associated with a second scanline for the frame based on the first mathematical function; and

for each frame in the sequence of frames, computing fourth values for the audio signals associated with the second scanline for the frame based on the second mathematical function.

5. The method of claim 1, wherein the in-band characterization data alone cannot be used to reproduce the audio and the video signals used to generate the characterization data.

6. The method of claim 1, wherein the step of transmitting the signal comprises transmitting the signal through a communication satellite.

7. A computer-implemented method for characterizing a relative offset in time between audio and video signals, the method comprising:

receiving, from a television origination facility, a sequence of frames including video and audio signals as well as in-band characterization data associated with each scanline of video data and audio data for each frame in the sequence of frames that is transmitted using in-band signals;

extracting the in-band characterization data from the sequence of frames;

recomputing characterization data for each scanline of video data and audio data for each frame in the sequence of frames based on the video and audio signals to produce recomputed characterization data; and

comparing the recomputed characterization data for each scanline of video data and audio data for each frame with the extracted in-band characterization data to determine the relative offset in time between the audio and video signals for the sequence of frames.

8. The method of claim 7, wherein the step of recomputing characterization data comprises:

for each frame in the sequence of frames, computing a first value for the video signals associated with at least a first scanline for the frame based on a first mathematical function; and

for each frame in the sequence of frames, computing a second value for the audio signals associated with at least a first scanline for the frame based on a second mathematical function.

9. The method of claim 8, wherein the audio signals include a plurality of audio channels, wherein each audio channel is represented by an audio channel pair, and the step of computing the first value for the audio signals associated with the at least first scanline comprises computing a separate value for each audio channel pair associated with the plurality of audio channels.

10. The method of claim 7, further comprising aligning the video and audio signals based on the relative offset in time to produce a synchronized sequence of frames.

11. The method of claim 7, wherein the step of comparing comprises comparing the extracted in-band characterization data for a particular frame in the sequence of frames with the recomputed characterization data associated with one or more frames both before and after the particular frame.

12. The method of claim 7, wherein the extracted in-band characterization data alone cannot be used to reproduce the audio and the video signals used to generate the extracted in-band characterization data.

13. The method of claim 7, wherein the step of receiving the sequence of frames comprises receiving the sequence of frames through a communication satellite.

14. The method of claim 7, wherein the extracted in-band characterization data represents a fingerprint of a portion of the audio and the video signals for the sequence of frames.

15. A system for characterizing a relative offset in time between audio and video signals, the system comprising:

a frame storage configured to;

receive, from a television origination facility, a sequence of frames including video and audio signals as well as in-band characterization data associated with each scanline of video data and audio data for each frame in the sequence of frames; and

store at least a portion of the frames in the sequence of frames;

a receiver coupled to the frame storage and configured to;

extract the in-band characterization data from the sequence of frames;

recompute characterization data for each scanline of video data and audio data for each frame in the sequence of frames based on the video and audio signals; and

compare the recomputed characterization data for each scanline of video data and audio data for each frame in the sequence of frames with the extracted in-band characterization data to determine the relative offset in time between the audio and video signals for the sequence of frames.

16. The system of claim 15, further comprising an audio/video alignment unit that is coupled to the receiver and configured to align the video and audio signals based on the relative offset in time to produce a synchronized sequence of frames.

17. The system of claim 15, wherein the extracted in-band characterization data represents a fingerprint of a portion of the audio and the video signals for the sequence of frames.

18. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause a computer system to characterize a relative offset in time between audio and video signals, by performing the steps of:

receiving, from a television origination facility, a sequence of frames including video and audio signals as well as in-band characterization data associated with each scanline of video data and audio data for each frame in the sequence of frames that is transmitted using in-band signals;

extracting the characterization data from the sequence of frames;

recomputing characterization data for each scanline of video data and audio data for each frame in the sequence of frames based on the video and audio signals to produce recomputed characterization data; and

comparing the recomputed characterization data for each scanline of video data and audio data for each frame in the sequence of frames with the extracted characterization data to determine the relative offset in time between the audio and video signals for the sequence of frames.

19. The non-transitory computer-readable storage medium of claim 18, further comprising aligning the video and audio signals based on the relative offset in time to produce a synchronized sequence of frames.

20. The non-transitory computer-readable storage medium of claim 18, wherein the extracted in-band characterization data represents a fingerprint of a portion of the audio and the video signals for the sequence of frames.