Automatic Video Glitch Detection and Audio-Video Synchronization Assessment

• US 20080037954A1
• Filed: 05/15/2006
• Published: 02/14/2008
• Est. Priority Date: 05/15/2006
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Lee, Mingtzong, Yildiz, Huseyin S.
• Granted Patent: US 8,379,735 B2
• Time in Patent Office: Days
• US Class Current: 386/96
• CPC Class Codes: H04N 19/467 characterised by the embedded information being invisible, e.g. watermarking
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/23892 involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/4305 Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets arrangements for synchronising receiver with transmitter by comparing receiver clock with transmitter clock H04L7/0012; arrangements for synchronising receiver with transmitter wherein the receiver takes measures against momentary loss of synchronisation H04L7/0083
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/8358 involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content
• CPC Class Codes: H04N 5/85 on discs or drums
• CPC Class Codes: H04N 9/8042 involving data reduction

Abstract

A process to detect video glitches and audio-video synchronization errors arising during playback or capture. The process encodes an external time stamp into video and audio streams directly at the output of a digital media playback device. The process captures the stamped video and audio streams and analyzes the external stamp by comparing it with a presentation time stamp and a capture time stamp.

Claims

1. A computer implemented method, comprising:

adding a first time stamp to a first area of a video frame, to a second area of the video frame, and to a first portion of an audio signal corresponding to the video frame;

adding a first time code to a third area of the video frame and to a second portion of the audio signal; and

recognizing the first time stamp and the first time code.

2. The computer implemented method of claim 1, further comprising determining a time-based offset using the first time stamp and the first time code.

3. The computer implemented method of claim 1, wherein the first time stamp includes a bar code representing a time value.

4. The computer implemented method of claim 1, wherein the second time stamp includes a bar code representing a time value.

5. The computer implemented method of claim 1, wherein the adding a first time stamp is performed before the video frame is converted to an analog form.

6. The computer implemented method of claim 1, wherein the adding a first time stamp is performed before the audio signal is converted to an analog form.

7. The computer implemented method of claim 1, wherein the first time code is added after the video frame has been converted to an analog form.

8. The computer implemented method of claim 1, wherein the first time code is added after the audio frame has been converted to an analog form.

9. The computer implemented method of claim 1 wherein the recognizing is performed by an optical character recognition.

10. The computer implemented method of claim 1 wherein the first area and second area of the video frame are non-visible.

11. The computer implemented method of claim 1 wherein the first portion of the audio signal is represented with an audio signal encoding scheme which is not perceivable by human beings.

12. The computer implemented method of claim 1, further comprising analyzing at least one difference between the first time stamp and first time code.

13. A computerized system, comprising:

a video rendering component for rendering a first time stamp to a first area and to a second area of a frame of video;

an audio rendering component for rendering the first time stamp to a first portion of audio information corresponding to the frame of video;

a time code generator for adding a first time code to a third area of the frame of video and to a second portion of the audio information; and

an analysis component for determining the first time stamp and the first time code.

14. The computerized system of claim 13, wherein the first time stamp was added to the first area and the second area of the frame of video before the frame of video is received by the system.

15. The computerized system of claim 13, wherein the first time stamped was added to the first portion of audio information corresponding to the frame of video before the first portion of audio is received by the system.

16. The computerized system of claim 13, wherein the first area is left of a vertical center point of the frame of video and is above a horizontal center point of the frame of video.

17. The computerized system of claim 13, wherein the second area is right of a vertical center point of the frame of video and is below a horizontal center point of the frame of video.

18. A frame of video, comprising:

a first time stamp corresponding to a presentation time of the frame of video;

a second time stamp corresponding to the presentation time of the frame of video; and

a first time code corresponding to a display time of the frame of video.

19. The frame of video of claim 18, wherein the first time stamp is an undetectable watermark and the second time stamp is an undetectable watermark.

20. The frame of video of claim 18, wherein the first time code is a Society of Motion Picture Television Engineers (SMPTE) signal.