Method and apparatus for identifying and eliminating specific material from video signals

• US 5,151,788 A
• Filed: 01/26/1989
• Issued: 09/29/1992
• Est. Priority Date: 01/26/1988
• Status: Expired due to Fees

• Current Assignee: Integrated Circuit Technologies Limited Pannell KERR Forster BLDG
• Original Assignee: Integrated Circuit Technologies Limited Pannell KERR Forster BLDG
• Inventors: Blum, Dieter W.
• Primary Examiner(s): Groody, James J.
• Assistant Examiner(s): Harvey, David E.
• Application Number:
  US07/301,769
• Time in Patent Office: 1,342 Days
• Field of Search: 358/142, 358/146, 358/188, 358/908, 358/139, 358/310, 358/311, 358/335
• US Class Current: 348/725
• CPC Class Codes: G11B 2220/90 Tape-like record carriers
• CPC Class Codes: G11B 27/024 on tapes G11B27/028, G11B27/029 take precedence
• CPC Class Codes: G11B 27/028 with computer assistance
• CPC Class Codes: H04N 21/4334 Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 5/44 Receiver circuitry for the reception of television signals according to analogue transmission standards H04N5/14 takes precedence
• CPC Class Codes: H04N 5/782 on tape
• CPC Class Codes: Y10S 358/908 Pause control, i.e. "commercial killers"

Abstract

In a content control system for identifying and eliminating commercials from a recording or presentation of a video signal there is shown a content control unit, a VCR and a TV.

The content control unit has an identification and a communication section. The identification section includes a blank frame detector, an activity detector and a timer for detecting the commercials. The communication section communicates by infra-red signals to control the functioning of the VCR and TV. The blank frame detector has a black level extractor being compensated for by a peak level extractor, and a frame luminance level extractor. A blank frame comparator compares the levels of the compensated black level and the frame luminance level. The activity detector determines the rate of change of frame luminance after the blank frame has been detected and the timer is set. The activity timer has an integrator and a differentiator.

Claims

1. A method for detecting a blank frame in a video signal, the method comprising:

extracting the black level from the video signal to produce a black level signal;

gating undesired portions from the video signal to produce a gated signal;

continuously extracting the luminance level from the gated signal to produce an average luminance level signal representative of the average luminance level of a frame; and

comparing the black level signal and the average luminance signal to determine when the average luminance level signal is within a given threshold of the black level signal.

2. A method according to claim 1, wherein extracting the black level comprises;

extracting the black level from each line of the video signal to produce a series of black level pulses and smoothing the black level pulses to produce the black level signal.

3. A method according to claim 2, wherein extracting the luminance level comprises;

extracting the luminance level from each line of the gated signal to produce a series of luminance level pulses and smoothing the luminance level pulses to produce the average luminance level signal.

4. A method according to claim 3, wherein extracting the black level produces an uncompensated black level signal and further comprising;

extracting the peak luminance level from each line of the gated signal, to produce a series of peak luminance level pulses and smoothing the peak luminance level pulses to produce the peak luminance level signal and compensating the uncompensated black level signal to produce the black level signal.

5. A method according to claim 1, wherein the threshold is approximately 5% of the black level signal.

6. A method according to claim 1 wherein extracting the black level produces an uncompensated black level signal and further comprising;

extracting the peak luminance level of the gated signal to produce a peak luminance level signal and compensating the uncompensated black level signal with the peak luminance level signal to produce the black level signal.

7. A method for detecting a blank frame in a video signal comprising:

extracting the black level from the video signal to produce an extracted black level signal;

extracting the peak luminance level of the composite signal to produce an extracted peak luminance level signal;

compensating the extracted black level signal with the extracted peak luminance signal level to produce a compensated black level signal;

extracting the average luminance level for each frame of the video signal to produce an extracted average luminance level signal; and

comparing the extended average luminance level signal to the compensated black level signal to determine whether the extracted average luminance level signal is within a threshold of the compensated black level signal.

8. A method for detecting a commercial advertisement on a video signal, the method comprising;

detecting a blank frame on the video signal, setting a timer for a given period after the detection of a blank frame, and testing for activity on the video signal during that period representative of a commercial advertisement.

9. A method according to claim 8, the video signal being a video signal, wherein detecting a blank frame comprises:

extracting the black level from the video signal to produce a black level signal;

gating undesired portions from the video signal to produce a gated signal;

continuously extracting the luminance level from the gated signal to produce an average luminance level signal representative of the average luminance level of a frame; and

comparing the black level signal and the average luminance signal to determine when the average luminance level signal is within a given threshold of the black signal.

10. A method according to claim 9, wherein extracting the black level comprises;

extracting the black level from each line of the video signal to produce a series of black level pulses and smoothing the black level pulses to produce the black level signal.

11. A method according to claim 10, wherein extracting the luminance level comprises;

extracting the luminance level from each line of the gated video signal to produce a series of luminance level pulses and smoothing the luminance level pulses to produce the average luminance level signal.

12. A method according to claim 11, wherein extracting the black level produces an uncompensated black level signal and further comprising;

extracting the peak luminance level from each line of the gated signal, to produce a series of peak luminance level pulses and smoothing the peak luminance level pulses to produce the peak luminance level signal and compensating the uncompensated black level signal to produce the black level signal.

13. A method according to claim 9, wherein the threshold is approximately 5% of the black level signal.

14. A method according to claim 9, wherein extracting the black level produces an uncompensated black level and further comprising;

extracting the peak luminance level of the gated signal to produce a peak luminance level signal and compensating the uncompensated black level signal with the peak luminance level signal to produce the black level signal.

15. A method according to claim 14, wherein testing for activity comprises;

continuously integrating the luminance level from the video signal over a number of frames to produce an integrated luminance level signal, differentiating the integrated luminance level signal to determine its rate of change.

16. A method according to claim 8, for detecting a blank frame in a video signal comprising:

extracting the black level from the video signal to produce an extracted black level signal;

extracting the peak luminance level of the composite signal to produce an extracted peak luminance level signal;

compensating the extracted black level signal with the extracted peak luminance signal level to produce a compensated black level signal;

extracting the average luminance level for each frame of the video signal to produce an extracted average luminance level signal; and

comparing to determine whether the extracted average luminance level signal is within a threshold of the compensated black level signal.

17. A method according to claim 9, wherein testing for activity comprises;

continuously integrating the average luminance level signal from the video signal over a number of frames to produce an integrated luminance level signal;

differentiating the integrated luminance level signal to determine its rate of change.

18. A method according to claim 17, wherein extracting the black level comprises;

extracting the black level from each line of the video signal to produce a series of black level pulses and smoothing the black level pulses to produce the black level signal; and

wherein extracting the luminance level comprises;

extracting the luminance level from each line of the gated video signal to produce a series of luminance level pulses and smoothing the luminance level pulses to produce the average luminance level signal.

19. A method according to claim 18, wherein extracting the black level produces an uncompensated black level signal and further comprising;

extracting the peak luminance level from each line of the gated signal, to produce a series of peak luminance level pulses and smoothing the peak luminance level pulses to produce the peak luminance level signal and compensating the uncompensated black level signal to produce the black level signal.

20. A method according to claim 19, wherein the given period is approximately 8 seconds.

21. A method according to claim 17, wherein extracting the black level produces an uncompensated black level and further comprising;

extracting the peak luminance level of the gated signal to produce a peak luminance level signal and compensating the uncompensated black level signal with the peak luminance level signal to produce the black level signal.

22. A method according to claim 21, wherein the given period is approximately 8 seconds.

23. A method according to claim 8, wherein the given period is approximately 8 seconds.

24. A method according to claim 8, wherein testing for activity comprises;

continuously integrating the luminance level from the video signal over a number of frames to produce an integrated luminance level signal;

differentiating the integrated luminance level signal to determine its rate of change.

25. A method for producing a content control signal having set and clear states representing a commercial and no commercial present in a video signal respectively, the method comprising:

detecting a blank frame on the video signal;

after the detection of a blank frame setting an activity timer for a given period and the content control signal;

testing for activity on the video signal during the period representative of a commercial advertisement; and

clearing the content control signal when such activity is not detected during the period.

26. A method according to claim 25, wherein detecting a blank frame comprises:

extracting the black level from the video signal to produce a black level signal;

gating undesired portions from the video signal to produce a gated signal;

continuously extracting the luminance level from the gated signal to produce an average luminance level signal representative of the average luminance level of a frame; and

comparing the black level signal and the average luminance level signal to determine when the black level signal is within a given threshold of the average luminance signal.

27. A method according to claim 26, wherein extracting the black level comprises;

extracting the black level from each line of the video signal to produce a series of black level pulses and smoothing the black level pulses to produce the black level signal.

28. A method according to claim 27, wherein extracting the luminance level comprises;

extracting the luminance level from each line of the gated video signal to produce a series of luminance level pulses and smoothing the luminance level pulses to produce the average luminance level signal.

29. A method according to claim 28, wherein extracting the black level produces an uncompensated black level signal and further comprising;

extracting the peak luminance level from each line of the gated signal, to produce a series of peak luminance level pulses and smoothing the peak luminance level pulses to produce the peak luminance level signal and compensating the uncompensated black level signal to produce the black level signal.

30. A method according to claim 26, wherein the threshold is approximately 5% of the black level signal.

31. A method according to claim 26, wherein extracting the black level produces an uncompensated black level and further comprising;

extracting the peak luminance level of the gated signal to produce a peak luminance level signal and compensating the uncompensated black level signal with the peak luminance level signal to produce the black level signal.

32. A method according to claim 31, wherein testing for activity comprises;

continuously integrating the luminance level from the video signal over a number of frames to produce an integrated luminance level signal, differentiating the integrated luminance level signal to determine its rate of change.

33. A method according to claim 25, for detecting a blank frame in a video signal comprising:

extracting the black level from the video signal to produce an extracted black level signal;

extracting the peak luminance level of the video signal to produce an extracted peak luminance level signal;

compensating the extracted black level signal with the extracted peak luminance signal level to produce a compensated black level signal;

extracting the average luminance level for each frame of the video signal to produce an extracted average luminance level signal; and

comparing to determine whether the extracted average luminance level signal is within a threshold of the compensated black level signal.

34. A method according to claim 26, wherein testing for activity comprises;

continuously integrating the average luminance level signal from the video signal over a number of frames to produce an integrated luminance level signal;

differentiating the integrated luminance level signal to determine its rate of change.

35. A method according to claim 34, wherein extracting the black level comprises;

extracting the black level from each line of the video signal to produce a series of black level pulses and smoothing the black level pulses to produce the black level signal; and

wherein extracting the luminance level comprises;

extracting the luminance level from each line of the gated video signal to produce a series of luminance level pulses and smoothing the luminance level pulses to produce the average luminance level signal.

36. A method according to claim 35, wherein extracting the black level produces an uncompensated black level signal and further comprising;

extracting the peak luminance level from each line of the gated signal, to produce a series of peak luminance level pulses and smoothing the peak luminance level pulses to produce the peak luminance level signal and compensating the uncompensated black level signal to produce the black level signal.

37. A method according to claim 36, wherein the given period is approximately 8 seconds.

38. A method according to claim 34, wherein extracting the black level produces an uncompensated black level and further comprising;

extracting the peak luminance level of the gated signal to produce a peak luminance level signal and compensating the uncompensated black level signal with the peak luminance level signal to produce the black level signal.

39. A method according to claim 38, wherein the given period is approximately 8 seconds.

40. A method according to claim 25, wherein the given period is approximately 8 seconds.

41. A method according to claim 25, wherein testing for activity comprises;

continuously integrating the luminance level from the video signal over a number of frames to produce an integrated luminance level signal;

differentiating the integrated luminance level signal to determine its rate of change.

42. A blank frame detector for operation on a video signal, the detector comprising:

a primary black level extractor for extracting the black level of the video signal;

line gating means gating undesired portions of the video signal;

a frame average luminance level extractor being connected to the line gating means and for extracting the average luminance of a frame of the video signal;

a blank frame comparator being connected to the black level extractor and the frame average luminance level extractor for determining when the extracted average luminance level of the field is within a given threshold of the extracted black level of the frame.

43. A detector according to claim 42, further comprising;

a sync pulse extractor being connected to the primary black level extractor for extracting the back porch of the video signal, and wherein the primary black level extractor comprises a secondary black level extractor for extracting the black level of the video signal during the back porch to produce extracted black level pulses.

44. A detector according to claim 43, wherein the sync pulse extractor is further connected to the line gating means and further extracts the horizontal sync pulse of the video signal and the line gating means gates the horizontal sync pulses of undesired lines to produce the gated signal.

45. A detector according to claim 44, wherein the primary black level extractor further comprises a first smoother connected to the secondary black level extractor for smoothing the extracted black level pulses.

46. A detector according to claim 45, wherein the frame average luminance level extractor comprises;

a secondary luminance level extractor for extracting the luminance level of the gated signal.

47. A detector according to claim 46, wherein the frame average luminance level extractor further comprises a second smoother connected to the secondary luminance level extractor for smoothing the extracted luminance level to produce the average luminance level.

48. A detector according to claim 47, wherein the primary black level extractor extracts an uncompensated black level and the detector further comprises;

a secondary peak luminance level extractor for extracting the peak luminance level of the gated signal to produce peak luminance level pulses;

a third smoother connected to the secondary peak luminance level extractor for smoothing the peak luminance level pulses to produce a peak luminance level signal, and a black level offset means connected to the first smoother and the third smoother and the blank frame comparator for compensating the uncompensated black level with the peak luminance level signal to produce the black level.

49. A device according to claim 42, wherein the threshold is approximately 5%.

50. A device according to claim 42, wherein the primary black level extractor extracts an uncompensated black level, and the blank frame detector further comprises;

a primary peak luminance level extractor being connected to the line gating means for extracting the peak luminance level of the gated signal, and a black level offset means being connected to the primary black level extractor, the primary peak luminance level extractor and the blank frame comparator for compensating the uncompensated black level with the peak luminance level to produce the black level.

51. A blank frame detector for operation on a video signal, the detector comprising:

a primary black level extractor for extracting the black level of the video signal;

a primary peak luminance extractor for extracting the peak luminance level of the video signal;

black level offset means connected to the primary black level extractor and to the primary peak luminance level extractor for compensating the extracted black level with a desired portion of the extracted peak luminance level;

a frame average luminance level extractor for extracting the average luminance level of the frame; and

a blank frame comparator connected to the black level offset means and the frame average luminance level extractor for determining whether the extracted average luminance level is within a threshold of the compensated black level.

52. An identification unit for detecting a commercial advertisement on a video signal, the unit comprising:

a blank frame detector for detecting blank frames on the video signal;

an activity timer being connected to the blank frame detector and being set upon the detection of a blank frame in the signal; and

an activity detector being connected to the blank frame detector and the activity timer for testing for activity representative of a commercial advertisement in the signal during the time the activity timer is set.

53. A device according to claim 52, wherein the video signal is a video signal and the blank frame detector comprises:

a primary black level extractor for extracting the black level of the video signal;

line gating means gating undesired portions of the video signal;

a frame average luminance level extractor being connected to the line gating means and for extracting the average luminance of a frame of the video signal;

a blank frame comparator being connected to the black level extractor and the frame average luminance level extractor for determining when the extracted black level of the field is within a given threshold of the extracted average luminance level of the frame.

54. A device according to claim 53, wherein the blank frame detector further comprises;

a sync pulse extractor being connected to the primary black level extractor for extracting the back porch of the video signal, and wherein the primary black level extractor comprises a secondary black level extractor for extracting the black level of the video signal during the back porch to produce extracted black level pulses.

55. A device according to claim 54, wherein the sync pulse extractor is further connected to the line gating means and further extracts the horizontal sync pulse of the video signal and the line gating means gates the horizontal sync pulses of undesired lines and to produce the gated signal.

56. A device according to claim 55, wherein the primary black level extractor further comprises;

a first smoother connected to the secondary black level extractor for smoothing the extracted black level pulses.

57. A device according to claim 56, wherein the frame average luminance level extractor comprises;

a secondary luminance level extractor for extracting the luminance level of the gated signal.

58. A device according to claim 57, wherein the frame average luminance level extractor further comprises a second smoother connected to the secondary luminance level extractor for smoothing the extracted luminance level to produce the average luminance level.

59. A device according to 58, wherein the primary black level extractor extracts an uncompensated black level and the detector further comprises;

a secondary peak luminance level extractor for extracting the peak luminance level of the gated signal to produce peak luminance level pulses;

a third smoother connected to the secondary peak luminance level extractor for smoothing the peak luminance level pulses to produce a peak luminance level signal, and a black level offset means connected to the first smoother and the third smoother and the blank frame comparator for compensating the uncompensated black level with the peak luminance level signal to produce the black level.

60. A device according to claim 53, wherein the threshold is approximately 5%.

61. A device according to claim 53, wherein the primary black level extractor extracts an uncompensated black level, and the blank frame detector further comprises;

a primary peak luminance level extractor being connected to the line gating means for extracting the peak luminance level of the gated signal, and a black level offset means being connected to the primary black level extractor, the primary peak luminance level extractor and the blank frame comparator for compensating the uncompensated black level with the peak luminance level to produce the black level.

62. A device according to claim 52, wherein the primary black level extractor extracts an uncompensated black level, and the blank frame detector further comprises;

a primary peak luminance level extractor being connected to the line gating means for extracting the peak luminance level of the gated signal, and a black level offset means being connected to the primary black level extractor, the primary peak luminance level extractor and the blank frame comparator for compensating the uncompensated black level with the peak luminance level to produce the black level.

63. A device according to claim 53, wherein the activity detector comprises the average frame luminance level extractor, an integrator being connected to the average frame luminance level extractor for integrating the average frame luminance level over a number of frames, and a differentiator being connected to the timer and the integrator determining the rate of change of the integrated average force luminance level.

64. A device according to claim 63, wherein the blank frame detector comprises;

a blank frame detector for operation on a video signal, the detector comprising;

a primary black level extractor for extracting the black level of the video signal;

line gating means gating undesired portions of the video signal;

a frame average luminance level extractor being connected to the line gating means and for extracting the average luminance of a frame of the video signal;

a blank frame comparator being connected to the black level extractor and the frame average luminance level extractor for determining when the extracted black level of the field is within a given threshold of the extracted average luminance level of the frame.

65. A device according to claim 64, wherein the blank frame detector further comprises;

a sync pulse extractor being connected to the primary black level extractor for extracting the back porch of the video signal, and wherein the primary black level extractor comprises a secondary black level extractor for extracting the black level of the video signal during the back porch to produce extracted black level pulses.

66. A device according to claim 65, wherein the sync pulse extractor is further connected to the line gating means and further extracts the horizontal sync pulse of the video signal and the line gating means gates the horizontal sync pulses of undesired lines and to produce the gated signal.

67. A device according to claim 66, wherein the primary black level extractor further comprises a first smoother connected to the secondary black level extractor for smoothing the extracted black level pulses.

68. A device according to claim 67, wherein the frame average luminance level extractor comprises;

a secondary luminance level extractor for extracting the luminance level of the gated signal.

69. A device according to claim 68, wherein the frame average luminance level extractor further comprises a second smoother connected to the secondary luminance level extractor for smoothing the extracted luminance level to produce the average luminance level.

70. A device according to claim 69, wherein the primary black level extractor extracts an uncompensated black level and the detector further comprises;

a secondary peak luminance level extractor for extracting the peak luminance level of the gated signal to produce peak luminance level pulses;

a third smoother connected to the secondary peak luminance level extractor for smoothing the peak luminance level pulses to produce a peak luminance level signal, and a black level offset means connected to the first smoother and the third smoother and the blank frame comparator for compensating the uncompensated black level with the peak luminance level signal to produce the black level.

71. A device according to claim 52, wherein the threshold is approximately 5%.

72. A device according to claim 52, wherein the video signal is a video signal and the activity detector comprises an integrator integrating the luminance level of the composite video signal over a number of frames and a differentiator connected to the integrator determining the rate of change of the integrated signal.

73. A content control unit for controlling a storage device recording a video signal to limit the recording of commercial material contained thereon, the unit comprising:

an identification section comprising;

a blank frame detector for detecting blank frames in the video signal;

an activity timer being connected to the blank frame detector and being set upon the detection of a blank frame in the video signal; and

an activity detector being connected to the blank frame detector and the activity timer for testing for activity representative of a commercial advertisement in the video signal during the time the activity timer is set; and

a communication section being connected to the content control unit and adapted to be coupled to the storage device for communicating instructions based upon the detection of blank frames and the detection of such activity by the identification section.

74. A content control system operating on a video signal containing commercial material, the system comprising:

a storage device for recording the video signal;

a content control unit being connected to the storage device and comprising;

an identification section comprising;

a blank frame detector for detecting blank frames in the video signal;

an activity timer being connected to the blank frame detector and being set upon the detection of a blank frame in the video signal; and

an activity detector being connected to the blank frame detector and the activity timer for testing for activity representative of a commercial advertisement in the video signal during the time the activity timer is set; and

a communication section being connected to the content control unit and coupled to the storage device for communicating instructions based upon the detection of blank frames and the detection of such activity by the identification section.