Delay detector apparatus and method for plural image sequences

• US 5,530,483 A
• Filed: 10/11/1994
• Issued: 06/25/1996
• Est. Priority Date: 10/11/1994
• Status: Expired due to Term

• Current Assignee: Cascades AV LLC (Cascades Ventures, Inc.)
• Original Assignee: Pixel Instruments Corporation
• Inventors: Cooper, James C., Anderson, Steven J.
• Primary Examiner(s): Metjahic, Safet
• Assistant Examiner(s): Murrell, Jeffrey S.
• Application Number:
  US08/321,280
• Time in Patent Office: 623 Days
• Field of Search: 348/512, 348/518, 348/615, 348/422, 348/192, 348/97, 348/129, 348/914, 382/209, 382/217, 382/218, 382/107, 382/236, 382/278
• US Class Current: 348/518
• CPC Class Codes: H04N 17/00 Diagnosis, testing or measuring for television systems or their details
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 5/04 Synchronising for television systems using pulse code modulation H04N7/56
• CPC Class Codes: H04N 5/222 Studio circuitry; Studio devices; Studio equipment cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00
• CPC Class Codes: H04N 5/602 for digital sound signals
• CPC Class Codes: Y10S 348/914 Delay for equalization

Abstract

The apparatus and method described herein shows a system of determining the delay of a delayed version of a sequence of images with respect to a relatively undelayed version. The system operates to take multiple samples of the delayed and undelayed versions at approximately the same sample position on the image and to correlate these samples over multiple image frames to determine which of a plurality of delayed images most closely match a given undelayed image. By knowing which delayed image frame most closely matches a given undelayed image frame it is shown to arrive at a coarse number of frames of delay. A fine delay measurement is achieved by adding a measure of the instantaneous frame to frame delay with respect to a known corresponding feature of the respective video type signals. The invention is also useful for comparing a given image to other images to determine the closest match.

Claims

1. An apparatus for determining the best match between a first image and a plurality of other images, the system comprising in combination:

an element for selecting known image locations,

an element for taking a first set of samples of said first image at said image locations,

an element for taking at least a second set of samples from one of said plurality of other images at said known image locations,

an element for taking at least a third set of samples from another of said plurality of other images at said known image locations,

an element for comparing said first set of samples to said second set of samples and to said third set of samples,

an element for determining which of said second and said third set of samples most closely matches said first set.

2. An apparatus as claimed in claim 1 wherein said image is rectangular, and all said locations are located in a circle contained within said rectangular image.

3. An apparatus as claimed in claim 2 wherein said circle has a diameter which is between 10% and 50% less than the length of the smallest side of said rectangle which circle is centered within said rectangle.

4. An apparatus as claimed in claim 1 wherein said samples are taken on only the luminance portion of said images.

5. An apparatus as claimed in claim 1 wherein said samples are taken on one or more color components of said images.

6. An apparatus as claimed in claim 1 wherein said element for determining which of said second and said third set of samples most closely matches requires that a given set match within a known threshold.

7. An apparatus as claimed in claim 1 wherein said element for determining which of said second and said third set of samples most closely matches requires that a given set match within a known offset amount better than any other set.

8. An apparatus as claimed in claim 6 or 7 wherein said threshold or said offset may be adjusted in response to image quality.

9. An apparatus for determining the delay of a delayed version of a sequence of images with respect to a relatively undelayed version, the system comprising in combination:

a) an element for taking a first set of samples of one of images from one of said delayed or undelayed sequences of images at a plurality of known sample positions,

b) an element for taking other sets of samples for each of a plurality of images of the other of said delayed or undelayed sequences at said plurality of known sample positions,

c) an element for comparing said first set of samples to said other sets of samples,

d) an element for determining which of said other sets of samples most closely matches said first set.

10. An apparatus as claimed in claim 9 wherein said image is rectangular, and said locations are located in a circle contained within said rectangular image.

11. An apparatus as claimed in claim 10 wherein said circle has a diameter which is between 10% and 50% less than the length of the smallest side of said rectangle and centered within said rectangle.

12. An apparatus as claimed in claim 9 wherein said samples are taken on only the luminance portion of said images.

13. An apparatus as claimed in claim 9 wherein said samples are taken on one or more color components of said images.

14. An apparatus as claimed in claim 9 wherein said element a) takes samples of one of the images from said undelayed sequence.

15. An apparatus as claimed in claim 9 wherein said element a) takes samples of one of the images from said delayed sequence.

16. An apparatus as claimed in claim 9 wherein said sequence of images is a video signal in raster scanned format.

17. An apparatus as claimed in claim 9 wherein said sequence of images is a video signal in bit mapped format.

18. An apparatus as claimed in claim 9 wherein said sequence of images is a video signal in compressed data format.

19. An apparatus as claimed in claim 9 wherein said element for determining which of said other sets of samples most closely matches requires that a given other set match within a known threshold.

20. An apparatus as claimed in claim 9 wherein said element for determining which of said other sets of samples most closely matches requires that a given other set match within a known offset amount better than any other set.

21. An apparatus as claimed in claim 19 or 20 wherein said threshold or said offset may be adjusted in response to image quality.

22. A method for determining the best match between a first image and a plurality of other images, the system comprising the steps of:

selecting known image locations,

taking a first set of samples of said first images at said image locations,

taking at least a second set of samples from one of said plurality of other images at said known image locations,

taking at least a third set of samples from another of said plurality of other images at said known image locations,

comparing said first set of samples to said second set of samples and to said third set of samples,

determining which of said second and said third set of samples most closely matches said first set.

23. A method as claimed in claim 22 wherein said image is rectangular, and said locations are located in a circle contained within said rectangular image.

24. A method as claimed in claim 23 wherein said circle has a diameter which is between 10% and 50% less than the length of the smallest side of said rectangle which circle is centered within said rectangle.

25. A method as claimed in claim 22 wherein said samples are taken on only the luminance portion of said images.

26. A method as claimed in claim 22 wherein said samples are taken on one or more color components of said images.

27. A method as claimed in claim 22 wherein said step for determining which of said second and said third set of samples most closely matches said first set requires that a given set match within a known threshold.

28. A method as claimed in claim 22 wherein said step for determining which of said second and said third set of samples most closely matches requires that a given set match within a known offset amount better than any other set.

29. A method as claimed in claim 27 or 28 wherein said threshold or said offset may be adjusted in response to image quality.

30. A method for determining the delay of a delayed version of a sequence of images with respect to a relatively undelayed version, the method including the steps of:

a) taking a first set of samples of one of images from one of said delayed or undelayed sequences of images at a plurality of known sample positions,

b) taking a plurality of other sets of samples at said plurality of known sample positions for a plurality of images of the other of said delayed or undelayed sequences,

c) comparing said first set of samples to each of said other sets of samples to determine the difference thereof,

d) determining which of said other sets of samples most closely matches said first set.

31. A method as claimed in claim 30 wherein said image is rectangular, and said locations are located in a circle contained within said rectangular image.

32. A method as claimed in claim 31 wherein said circle has a diameter which is between 10% and 50% less than the length of the smallest side of said rectangle and centered within said rectangle.

33. A method as claimed in claim 30 wherein said samples are taken on only the luminance portion of said images.

34. A method as claimed in claim 30 wherein said samples are taken on one or more color components of said images.

35. A method as claimed in claim 30 wherein said step a) takes samples of one of the images from said undelayed sequence.

36. A method as claimed in claim 30 wherein said step a) takes samples of one of the images from said delayed sequence.

37. A method as claimed in claim 30 wherein said sequence of images is a video signal in raster scanned format.

38. A method as claimed in claim 30 wherein said sequence of images is a video signal in bit mapped format.

39. A method as claimed in claim 30 wherein said sequence of images is a video signal in compressed data format.

40. A method as claimed in claim 30 wherein said step for determining which of said second and said third set of samples most closely matches said first set requires that a given set match within a known threshold.

41. A method as claimed in claim 30 wherein said step for determining which of said second and said third set of samples most closely matches requires that a given set match by a known offset amount better than any other set.

42. A method as claimed in claim 40 or 41 wherein said threshold or said offset may be adjusted in response to image quality.

43. An apparatus for determining the delay of a delayed version of an image carrying signal with respect to a relatively undelayed version thereof, the system comprising in combination:

a) an element for taking a first set of samples of at least a first frame from one of said delayed or undelayed signals at a plurality of known sample positions,

b) an element for taking other sets of samples for each of a plurality of frames of the other of said delayed or undelayed signal,

c) an element for comparing said first set of samples to said other sets of samples,

d) an element for determining which of said other sets of samples matches said first set within a known threshold value,

e) an element for outputting said delay in response to the matching of said first and other sets of samples.

45. An apparatus as claimed in claim 43 or 44 wherein said image carrying signal is a video signal having vertical sync portions and said value of element d) is adjusted in response to coincidence of the vertical sync portion of said delayed and undelayed video signals.

46. An apparatus as claimed in claim 43 or 44 wherein said value of element d) is adjusted in response to the noise on said delayed or undelayed signal.

47. An apparatus as claimed in claim 43 or 44 wherein said value of element d) is adjusted in response to the motion on said delayed or undelayed signal.

48. An apparatus as claimed in claim 43 or 44 wherein element e) includes restricting the time between changing of said delay which is output.

49. An apparatus as claimed in claim 43 or 44 wherein said value of element d) is changed in response to the time from the last finding of a match in element d).

44. An apparatus for determining the delay of a delayed version of an image carrying signal with respect to a relatively undelayed version thereof, the system comprising in combination:

a) an element for taking a first set of samples of at least a first frame from one of said delayed or undelayed signals at a plurality of known sample positions,

b) an element for taking other sets of samples for each of a plurality of frames of the other of said delayed or undelayed signal,

c) an element for comparing said first set of samples to said other sets of samples,

d) an element for determining which of said other sets of samples matches said first set by a known offset value better than any other set,

e) an element for outputting said delay in response to the matching of said first and other sets of samples.

50. A method for determining the delay of a delayed version of an image sequence with respect to a relatively undelayed version thereof, said method comprising the steps of:

a) taking a first set of samples of at least a first image from one of said delayed or undelayed image sequences at a plurality of known sample locations,

b) taking other sets of samples for each of a plurality of images of the other of said delayed or undelayed image sequences,

c) comparing said first set of samples to said other sets of samples,

d) determining which of said other sets of samples matches said first set of samples,

e) outputting said delay in response to the matching of said first and other sets of samples.

51. A method as claimed in claim 50 wherein said value of step d) is changed in response to a restarting of said method.

52. A method as claimed in claim 50 wherein said value of step d) is changed in response to the removal of an alarm indicating an abnormal operation of step a) or b).

53. A method as claimed in claim 50 wherein said delay which is output in step e) is held in response to an alarm indicating an abnormal operation of step a) or b).

54. A method as claimed in claim 50 wherein said delay which is output in step e) is limited to a maximum amount.

55. A method as claimed in claim 50 wherein said delay which is output in step e) is limited to a maximum amount, and upon determination of a predetermined number of delay measurements which exceed said maximum amount a warning condition is generated.

56. A method as claimed in claim 50 wherein said delay which is output in step e) is limited to a maximum amount, which amount is responsive to a device which results in the creation of the delay of said delayed version.