Method and apparatus for synchronizing video data

• US 20110122315A1
• Filed: 11/12/2010
• Published: 05/26/2011
• Est. Priority Date: 11/13/2009
• Status: Abandoned Application

• Current Assignee: NTT Docomo Incorporated (Nippon Telegraph and Telephone Corporation)
• Original Assignee: NTT Docomo Incorporated (Nippon Telegraph and Telephone Corporation)
• Inventors: Eichhorn, Michael, Kellerer, Wolfgang, Fahrmair, Michael, Steinbach, Eckehard, Schroth, Georg, Schweiger, Florian
• Application Number:
  US12/926,383
• Publication Number:
  US 20110122315A1
• Time in Patent Office: Days
• US Class Current: 348/500
• CPC Class Codes: H04N 21/2365 Multiplexing of several video streams
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content

Abstract

A method determining the temporal relationship between a first video sequence and a second video sequence, said method comprising:

• obtaining from said first video sequence a first parameter such that the evolvement of said first parameter over time corresponds to the change of the entropy of said first video sequence over time;
• obtaining from said second video sequence a second parameter such that the evolvement of said second parameter over time corresponds to the change of the entropy of said second video over time;
• matching the evolvement of said first parameter over time to the evolvement of said second parameter over time to thereby determine the temporal relationship between the two video sequences.

Claims

1. A method for determining the temporal relationship between a first video sequence and a second video sequence, said method comprising:

obtaining from said first video sequence a first parameter such that the evolvement of said first parameter over time corresponds to the change of the entropy of said first video sequence over time;

obtaining from said second video sequence a second parameter such that the evolvement of said second parameter over time corresponds to the change of the entropy of said second video over time,

matching the evolvement of said first parameter over time to the evolvement of said second parameter over time, wherein

said matching of said evolvement of said first and said second parameter over time is performed by calculating a correlation function between the evolvement of said first parameter over time with the evolvement of said second parameter over time to thereby determine the temporal relationship between the two video sequences.

2. The method of claim 1, wherein said first and said second parameters respectively are one of the following:

the entropy or the conditional entropy or the block entropy or any entropy related or entropy based parameter as derived from said first or said second video sequence for the individual frames or a group of frames of said first and second video sequences;

the bit rate or the frame size as obtained from a video codec which encodes or decodes the first or second video sequence.

3. The method of claim 1, wherein a preprocessing is performed which comprises one or more of the following:

obtaining a differential value of said parameter which is used to represent the entropy change of said first and second video sequences over time;

applying a function which gives more weight to lower intensity values and less weight to higher intensity values;

applying a filter function to perform a smoothing.

4. The method of claim 1, further comprising:

performing a dynamic time warping to carry out a non-linear match between said first and said second video sequence.

5. The method of claim 1, further comprising:

subtracting the contribution of a subset of blocks or pixels of the individual frames to the parameter being indicative evolvement of the entropy change of said first or second video sequence over time.

6. The method of claim 1, further comprising:

performing said match of said evolvement of said first and said second parameter by calculating a cross correlation.

7. The method of claim 1, further comprising:

iterate the correlation of the first parameter of said first video sequence over all possible selections of a certain length of said second video sequence and use the median or the average of the correlation maxima as the result.

14. A computer program comprising computer program code which when being executed on a computer enables said computer to carry out a method according to claim 1.

8. An apparatus for determining the temporal relationship between a first video sequence and a second video sequence, said apparatus comprising:

a module for obtaining from said first video sequence a first parameter such that the evolvement of said first parameter over time corresponds to the change of the entropy of said first video sequence over time;

a module for obtaining from said second video sequence a second parameter such that the evolvement of said second parameter over time corresponds to the change of the entropy of said second video over time;

a module for matching the evolvement of said first parameter over time to the evolvement of said second parameter over time, wherein

said matching of said evolvement of said first and said second parameter over time is performed by calculating a correlation function between the evolvement of said first parameter over time with the evolvement of said second parameter over time to thereby determine the temporal relationship between the two video sequences.

9. The apparatus of claim 8, wherein said first and said second parameter respectively are one of the following:

the entropy or the conditional entropy or the block entropy or any entropy related or entropy based parameter as derived from said first or said second video sequence for the individual frames or a group of frames of said first and second video sequences;

the bit rate or the frame size as obtained from a video codec which encodes or decodes the first or second video sequence.

10. The apparatus of claim 8, wherein a preprocessing is performed which comprises one or more of the following:

obtaining a differential value of said parameter which is used to represent the entropy change of said first and second video sequences over time;

applying a function which gives more weight to lower intensity values and less weight to higher intensity values;

applying a filter function to perform a smoothing.

11. The apparatus of claim 8, further comprising:

a module for performing a dynamic time warping to carry out a non-linear match between said first and said second video sequence.

12. The apparatus of claim 8, further comprising:

a module for subtracting the contribution of a subset of blocks or pixels of the individual frames to the parameter being indicative evolvement of the entropy change of said first or second video sequence over time.

13. The apparatus of claim 8, further comprising:

a module for iterating the correlation of the first parameter of said first video sequence over all possible selections of a certain length of said second video sequence and use the median of the correlation maxima as the result.