Methods and apparatus for automatically identifying programs viewed or recorded

• US 4,697,209 A
• Filed: 04/26/1984
• Issued: 09/29/1987
• Est. Priority Date: 04/26/1984
• Status: Expired due to Term

• Current Assignee: Nielsen Media Research, Inc. (Nielsen Holdings plc)
• Original Assignee: A. C. Nielsen Company, LLC (MOOD Media Corporation)
• Inventors: Lu, Daozheng, Kiewit, David A.
• Primary Examiner(s): NOT, DEFINED
• Application Number:
  US06/604,367
• Time in Patent Office: 1,251 Days
• Field of Search: 179/2 AS, 358/84, 358/139, 358/908, 455/2, 455/67, 379/92
• US Class Current: 725/19
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: G11B 2220/90 Tape-like record carriers
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04H 60/37 for identifying segments of broadcast information, e.g. scenes or extracting programme ID
• CPC Class Codes: H04H 60/59 of video recognising characters or patterns in general G06F18/00, G06V20/00

Abstract

A method and apparatus for identifying programs such as television programs received from various sources detects the occurrence of predetermined events such as scene changes in a video signal and extracts a signature from the video signal. The signatures and the times of occurrence of the signatures are stored and subsequently compared with reference signatures to identify the program. The signatures may be compared in pairs to increase resolution, and the time interval between events or signatures may also be used to identify the program, either by themselves or in conjunction with the signatures.

Claims

1. A method of identifying a signal received by an audience member'"'"'s television receiver for determining audience ratings comprising the steps of:

detecting the occurence of a first event in the functional operations of he audience namber'"'"'s televison receiver;

detecting the occurence of a second event after the detected first event in the signal to be identified;

extracting a signature from a single frame of the video signal to be identified after the occurrence of the second event;

storing the signature and the time of occurence thereof; and

comparing the stored signature with reference signatures that occurred at approximately the same time as the stored signature.

2. The method recited in claim 1 wherein said signal is a television video signal and said second event is a scene change from one video scene to another video scene.

3. The method recited in claim 1 wherein said signal is a color television video signal and said second event is a change in the color of at least a portion of successive frames.

4. The method recited in claim 1 wherein said signal is a television video signal and said second event is a still picture.

5. The method recited in claim 1 wherein said signal is an audio signal said second event is a predetermined change in the magnitude in the audio signal.

6. The method recited in claim 1 wherein said signal is a television signal received by a television signal receiver and wherein said first event is the turn-on of the televison receiver.

7. The method recited in claim 1 wherein said signal is a television signal received by a televsion signal receiver receiver and wherein said first event is a change in the channnel to which the television signal receiver is tuned.

8. The method recited in claim 1 wherein said first event is the elapse of a predetermined length of time after the occurrence of the previous first event.

9. The method recited in claim 8 wherein said predetermined length of time is approximately 5 to 10 minutes.

10. The method recited in claim 1 wherein said signal is a television signal and said step of extracting said signature includes the step of low pass filtering a video signal of the televison signal to provide a video envelope signal, periodically sampling said video envelope signal to provide a series of video samples, and digitizing said video samples to provide said signature.

11. The method recited in claim 10 wherein said step of low pass filtering said video signal includes the step of passing the video signal through a low pass filter having a cut-off frequency of approximately 2 to 6 kHz.

12. The method recited in claim 11 wherein the step of sampling said video envelope signal includes the step of taking eightly samples of said video envelope signal and taking the average of every eight consecutive samples to generate ten features that comprise the feature string.

13. The method recited in claim 10 wherein the step of sampling said video envelope signal includes the step of taking a predetermined number of samples of said video envelope signal and taking the averages of predetermined consecutive samples to generate a plurality of average signals, each average signal defining one of the features that comprises the feature string.

14. A system for identifying program material received by an audience member'"'"'s televison receiver for determining audience ratings comprising:

15. means for detecting a first predetermined event in the functional operations of the audience member'"'"'s television receiver;

25. The system recited in claim 15 wherein said signal is a television video signal and said second event detecting means includes means for detecting a scene change from one video scene to another video scene.

27. A system as recited in claim 15 wherein said signal is a television signal received by a television signal receiver, and wherein said first event detecting means includes means for detecting a change in the channel to which the television signal receiver is tuned.

28. A system as recited in claim 15 wherein said first event detecting means includes means for detecting the elapse of a predetermined length of time after the occurrence of the previous first event.

30. A system as recited in claim 15 wherein said signal is a television signal and said means for extracting said signature includes means for low pass filtering a video signal of the television signal to provide a video envelope signal, means for periodically sampling said video envelope signal to provide a series of video samples, and means for digitizing said video samples to provide said signature.

35. The system recited in claim 25 wherein said system further includes a central unit, means for transmitting the recorded predetermined characteristics and times to the central unit, wherein the central unit includes means for comparing the recorded predetermined characteristics and their times of occurrence with reference predetermined characteristics that occurred at substantially the same times to identify the program.

38. The method recited in claim 28 wherein the signal to be identified includes an audio signal, and wherein the step of extracting the feature string includes the step of monitoring the amplitude of the audio signal and determining the time intervals that the amplitude of the audio signal departs from a predetermined level of amplitude.

40. The method recited in claim 28 wherein the signal to be identified includes a video signal, and wherein the step of extracting the feature string includes the steps of detecting predetermined events in the video signal and determining the time intervals between detected predetermined events to generate the feature string.

45. The method recited in claim 35 wherein the step of monitoring the video envelope of two frames includes the step of comparing the envelopes of at least one field of two consecutive frames.

46. The method recited in claim 35 wherein the step of monitoring the video envelope of two frames includes the step of comparing the envelopes of at least one field of two non-consecutive frames.

48. The method recited in claim 38 wherein the step of comparing the video envelope of two frames includes the step of sampling said video envelope and comparing counterpart samples.

50. The method recited in claim 40 wherein the step of comparing and taking the difference of counterpart samples includes the step of taking the difference of the absolute values of the counterpart samples.

51. The method recited in claim 40 wherein said predetermined number of samples is eighty.

52. The method recited in claim 40 further including the step of obtaining a signature including the step of monitoring the video envelope of a predetermined frame, obtaining a predetermined number of samples from said envelope, obtaining the average of a predetermined number of consecutive samples to define said signature.

54. The method recited in claim 28 wherein said signal to be identified includes a video signal said video signal includes a color signal, wherein the step of extracting the feature string includes the step of determining the time interval between predetermined changes in the color signals.

55. The method recited in claim 45 wherein the step of determining changes in the color signal includes the step of comparing a function of the color signal with the average of the color signal and determining the time intervals when the function of the color signal exceeds the average of the color signal and the time intervals when the function of the color signal is less than the average of the color signal to extract the feature string.

56. The method recited in claim 46 wherein the function of the color signal and the average of the color signal is determined for only a single line of the frame.

60. The improvement recited in claim 50 wherein the predetermined level amplitude is a level that corresponds substantially to silence, and said time interval corresponds to the time interval between successive periods of silence in the audio signal.

62. The improvement recited in claim 52 wherein predetermined events detecting means includes means for monitoring the light emanating from the display on which the video signal is displayed and indicating a scene change predetermined event when the amount of light emanating from the display changes by a predetermined amount.

64. The improvement recited in claim 52 wherein the predetermined event detecting means includes means for determining the average amplitude of the video signal and indicating a detected predetermined event when the average amplitude of the video signal changes by a predetermined amount.

65. The improvement recited in claim 52 wherein the predetermined event detecting means includes means for comparing the video envelopes of two frames.

66. The improvement recited in claim 56 wherein the video envelope monitoring means includes means for comparing the envelopes of at least one field of two consecutive frames.

67. The improvement recited in claim 56 wherein the video envelope monitoring means includes means for comparing the envelopes of at least one field of two non-consecutive frames.

69. The improvement recited in claim 56 wherein the video envelope comparing means includes means for sampling said video envelope and comparing counterpart samples.

70. The improvement recited in claim 52 wherein said predetermined event detecting means includes means for monitoring the video envelopes of two frames, means for obtaining a predetermined number of samples from each envelope, means for comparing the magnitudes of counterpart samples to obtain a difference in counterpart samples, and means for taking the average of the differences and for indicating a detected predetermined event whenever the average exceeds a predetermined level.

74. The improvement recited in claim 52 wherein the step of determining Event 2s includes means for determining the average level of the video signal, means for determining the amplitudes of predetermined portions of the video signal, means for comparing the amplitudes of the predetermined portions of the video signal with the average amplitude of the video signal and assigning one of a first and a second designation to each portion depending on whether the amplitude of the predetermined portion exceeds or is less than the average amplitude, means for utilizing the designations so obtained to obtain a frame code, means for comparing the frame code with the frame code of a previous frame and indicating a change if the current frame code differs from the previous frame code by a predetermined amount.

75. The improvement recited in claim 50 wherein said signal to be identified includes a video signal and said video signal includes a color signal, wherein the feature string extracting means includes means for determining the time interval between predetermined changes in the color signals.

76. The improvement recited in claim 66 wherein the color signal change determining means includes means for comparing a function of the color signal with the average of the color signal and determining the time intervals when the function of the color signal exceeds the average of the color signal and the time intervals when the function of the color signal is less than the average of the color signal to extract the feature string.

77. The improvement recited in claim 67 wherein the function of the color signal and the average of the color signal is determined for only a single line of the frame.

80. The system recited in claim 70 further including means for comparing the feature string with reference feature strings representative of known signals and for identifying said signal when said feature string correlates with one of said reference feature strings within a predetermined coefficient of correlation.

84. The method recited in claim 74 wherein the step of comparing includes the step of comparing the extracted signature with reference signatures that occurred at approximately the same time as the extracted signature.

94. The method recited in claim 84 wherein said step of low pass filtering said video signal includes the step of passing the video signal through a low pass filter having a cut-off frequency of approximately 2 to 6 kHz.

104. A system as recited in claim 94 wherein said comparing means includes means for comparing an extracted signature with reference signatures that occurred at approximately the same time.

16. means for detecting a second predetermined event in the program material;

26. A system as recited in claim 16 wherein said television signal is received by a television signal receiver, and wherein said means for detecting said first event includes means for detecting the turn-on of the television receiver.

36. The system recited in claim 26 further including means for generating said reference predetermined characteristics, wherein said reference predetermined characteristic generating means includes means for receiving signals representative of various programs gram to be monitored and means for continuously extracting and storing said predetermined characteristics of the programs being monitored to generate said reference predetermined characteristics.

17. means for extracting at least one predetermined characteristic of the program material from a single frame of a video signal;

18. means for storing the predetermined characteristic and the time that the predetermined characteristic is extracted;

and

19. means for comparing the recorded predtermined characteristic and its time of occurrence with reference predetermined characteristics that occured at substantially the same time to identify the program.

29. A system as recited in claim 19 wherein said detecting means includes means for setting the predetermined length of time to approximately 5 to 10 minutes.

39. The method recited in claim 29 wherein the predetermined level amplitude is a level that corresponds substantially to silence, and said time interval corresponds to the time interval between successive periods of silence in the audio signal.

20. A system for identifying a signal received by an audience member'"'"'s television receiver for determining audience ratings comprising:

21. means for detecting the occurrence of a first event in the functional operations of the audience member'"'"'s television receiver;

31. A system as recited in claim 21 wherein said low pass filtering means has a cut-off on the order frequency of approximately 2 to 6 kHz.

33. A system as recited in claim 21 wherein said video envelope signal sampling means includes means for taking a predetermined number of samples of video envelope signal and means for taking the averages of predetermined consecutive samples to generate a plurality of average signals, each average signal defining one of the features that comprises the feature string.

41. The method recited in claim 31 wherein the step of detecting predetermined events includes the step of monitoring the light emanating from a display on which the video signal is displayed, and indicating a detected predetermined event when the amount of light emanating from the display changes by a predetermined amount.

43. The method recited in claim 31 wherein the step of detecting predetermined events includes the step of determining the average amplitude of the video signal and indicating a detected predetermined event when the average amplitude of the video signal changes by a predetermined amount.

44. The method recited in claim 31 wherein the step of detecting predetermined events includes the step of monitoring the video envelopes of at least one field of two frames.

49. The method recited in claim 31 wherein the step of detecting predetermined events includes the steps of monitoring the video envelopes of two frames, obtaining a predetermined number of samples from each envelope and comparing the magnitudes of counterpart samples to obtain a difference in counterpart samples, taking the average of the differences, and indicating a detected predetermined event whenever the average exceeds a predetermined level.

53. The method recited in claim 31 wherein the step of detecting predetermined events includes the steps of determining the average level of the video signal, determining the amplitudes of predetermined portions of the video signal, comparing the amplitudes of the predetermined portions of the video signal with the average amplitude of the video signal and assigning one of a first and a second designation to each portion depending on whether the amplitude of the predetermined portion exceeds or is less than the average amplitude, utilizing the designations so obtained to obtain a frame code, comparing the frame code with the frame code of a previous frame, and indicating a change if the current frame code differs from the previous frame code by a predetermined amount.

59. The improvement recited in claim 49 wherein the signal to be identified includes an audio signal, and wherein said feature string extracting means includes means for monitoring the amplitude of the audio signal and determining the time intervals that the amplitude of the audio signal departs from a predetermined level of amplitude.

61. The improvement recited in claim 49 wherein the signal to be identified includes a video signal, and wherein said feature string extracting means includes means for detecting predetermined events in the video signal and determining the time intervals between detected predetermined events to generate the feature string.

63. The improvement recited in claim 53 wherein the display light monitoring means includes means for monitoring the light with a photoelectric device, and indicating a detected predetermined event when the output of the photoelectric device changes by a predetermined amount.

71. The improvement recited in claim 61 wherein the comparing and counterpart samples difference taking means includes means for taking the differences of the absolute values of the counterpart samples.

72. The improvement recited in claim 61 wherein said predetermined number of samples is eighty.

73. The improvement recited in claim 61 further including means for obtaining a signature including means for monitoring the video envelope of a predetermined frame and obtaining a predetermined number of samples from said envelope, and means for obtaining the average of a predetermined number of consecutive samples to define said signature.

82. The method recited in claim 72 further including the step of comparing the extracted signature with reference signatures.

83. The method recited in claim 73 wherein said reference signatures are extracted by the steps of:

monitoring a known signal;

detecting the occurrence of said second event in the known signal;

extracting a reference signature from the known signal after the occurence of a second event; and

storing the reference signature and the time of occurence thereof.

85. The method recited in claim 72 wherein said second event is a scene change from one video scene to another video scene.

86. The method recited in claim 72 whrein said televison signal is a color television video signal and said second event is a change in the color of at least a portion of successive frames.

87. The method recited in claim 72 wherein said second event is a still picture.

88. The method recited in claim 72 wherein said second event is a predetermined change in the magnitude in an audio signal of the television signal.

89. The method recited in claim 72 wherein said first event is the turn-on of the television receiver.

90. The method recited in claim 72 wherein said first event is a change in the channel to which the television signal receiver is tuned.

91. The method recited in claim 72 wherein said first event is the elapse of a predetermined length of time after the occurence of the previous first event.

92. The method recited in claim 82 wherein said predetermined length of time is approximately 5 to 10 minutes.

93. The method recited in claim 72 wherein said step of extracting said signature includes the step of low pass filtering a video signal of the television signal to provide a video envelop signal, periodically sampling said video envelope signal to provide a series of video samples, and digitizing said video samples to provide said signature.

95. The method recited in claim 85 wherein the step of sampling said video envelope signal includes the step of taking eighty samples of said video envelope signal and taking the average of every eight consecutive samples to generate ten features that comprise the feature string.

96. The method recited in claim 85 wherein the step of sampling said video envelope signal includes the step of taking a predetermined number of samples of said video envelope signal and taking the averages of predetermined consecutive samples to generate a plurality of average signals, each average signal defining one of the features that comprises the feature string.

98. A system as recited in claim 88 wherein said extracting means includes means for extracting said predetermined characteristic upon the second occurence of the second predetermined event following the occurence of said first event.

99. A system as recited in claim 89 wherein said extracting means includes means responsive to a detected recording operational mode for extracting said predetermined characeristic upon each occurrence of the second predetermined event, and wherein the predetermined characteristic further includes the time interval between the second event and the immediately preceding second event.

100. A system as recited in claim 88 further including means for comparing the extracted predetermined characteristics with stored reference predetermined characteristics to identify the program material.

102. A system as recited in claim 92 further including means for comparing said stored signatures with reference signatures obtained from known signals to identify the signal.

103. A system as recited in claim 93 further including means for obtaining the reference signatures, said reference signal obtaining means including means for monitoring known signals, means for detecting the occurrence of second events in said known signals, and means responsive to the detection of the second events for extracting reference signatures from the known signals because real time data is not necessary to make the identification.

105. The system reicted in claim 92 wherein said second event detecting means includes means for detecting a scene change from one video scene to another video scene.

106. A system as recited in claim 93 wherein said means for detecting said first event includes means for detecting the turn-on of the television receiver.

107. A system as recited in claim 92 wherein said first event detecting means includes means for detecting a change in the channel to which the television signal receiver is tuned.

108. A system as recited in claim 92 wherein said first event detecting means includes means for detecting the elapse of a predetermined length of time after the occurrence of the previous first event.

109. A system as recited in claim 99 wherein said detecting means includes means for setting the predetermined length of time to approximately 5 to 10 minutes.

110. A system as recited in claim 92 wherein said means for extracting said signature includes means for low pass filtering a video signal of the television signal to provide a video envelope signal, means for periodically sampling said video envelope signal to provide a series of video samples, and means for digitizing said video samples to provide said signature.

112. A system as recited in claim 102 wherein said video envelope signal sampling means includes means for taking approximately eighty samples of said video envelope signal and means for taking the average of every eight consecutive samples to generate ten features that comprise the feature string.

115. The improvement recited in claim 105 further including means responsive to said video recorder condition responsive means for storing data representative of the program being viewed in two different manners depending on whether or not the program being viewed is being recorded.

22. means responsive to the detected first event for detecting the occurrence of a second event in the signal to be identified;

means for extracting a signature from a single frame of the video signal to be identified after the occurence of the second event;

32. A system as recited in claim 22 wherein said video envelope signal sampling means includes means for taking approximately eighty samples of said video envelope signal and means for taking the average of every eight consecutive samples to generate ten features that comprise the feature string.

42. The method recited in claim 32 wherein the step of monitoring the light emanating from the display includes the step of monitoring the light with a photoelectric device, and indicating a detected predetermined event when the output of the photoelectric device changes by a predetermined amount.

23. means for storing the signature and the time of occurence thereof;

and

24. means for comparing the stored signature with reference signatures that occur at approximately the same time as the stored signature.

34. A system for identifying program material received by an audience member'"'"'s television receiver for determining audience ratings comprising:

means for detecting a first predetermined event in the functional operations of the audience member'"'"'s television receiver;

means responsive to the detected first predetermined event for detecting at least one second predetermined event in the programmed material;

means for extracting at least one predetermined characteristic of the program material from a single frame of a video signal after the occurrence of a predetermined number of said first and second events; and

means for recording the predetermined characteristic and the time of occurrence of the predetermined characteristic.

37. A method for identifying signals for determining audience ratings comprising the steps of operating on the signal to be identified in order to extract a feature string, comparing the feature string with various feature strings corresponding to known signals and identifying the signal when the feature string of the signal to be identified correlates with one of the feature strings corresponding to a known signal within a predetermined tolerence, wherein the step of extracting the feature string from the signal to be identified comprises the steps of:

monitoring predetermined changes in a predetermined parameter of the signal to be identified;

determining the time intervals between the predetermined changes in the predetermined parameter; and

utilizing the time intervals between successive predetermined changes to generate the feature string, the feature string being a digital representation of a predefined number of said time intervals.

47. The method recited in claim 37 wherein the step of comparing the video envelope of two non-consecutive frames includes the step of comparing the video envelopes of two frames spaced at approximately a twenty to forty frame interval.

57. The method recited in claim 47 wherein the single line is near the top of the image.

58. In a system for identifying signals for determining audience ratings having means for operating on the signal to be identified in order to extract a feature string, means for comparing the feature string with various feature strings corresponding to known signals and for identifying the signal when the feature string of the signal to be identified correlates with one of the feature strings corresponding to a known signal within a predetermined tolerance, the improvement wherein the feature string extracting means comprises:

means for monitoring predetermined changes in a predetermined parameter of the signal to be identified;

means for determining the time intervals between the predetermined changes in the predetermined parameter; and

means for utilizing the time intervals between successive predetermined changes to generate the feature string, the feature string being a digital representation of a predetermined number of said time intervals.

68. The improvement recited in claim 58 wherein the video envelope comparing means includes means for comparing the video envelopes of two frames spaced at approximately twenty to forty frame intervals.

78. The improvement recited in claim 68 wherein the single line is near the top of the image.

79. A system for identifying signals for determining audience ratings comprising:

means for detecting the occurence of predetermined events in the signal;

means responsive to said detecting means for determining the time intervals between successive occurences of said predetermined events; and

means responsive to said time intervals for generating a signal identifying feature string in response to said time intervals, said signal identifying feature string being a digital representation of a predefined number of said time intervals.

81. A method of identifying a television signal received from either a television receiver or a video recorder for determining audience viewing habits comprising the steps of:

detecting predetermined operational modes of the audience member'"'"'s television receiver and the video recorder;

detecting the occurence of a first event in one of the operational modes;

detecting the occurence of a second event in the signal to be identified;

extracting a signature from a single frame of the video signal to be identified after the occurence of the second event; and

storing the extracted signature, the time of the signature extraction and the detected operational mode.

97. A system for identifiying program material viewed on a television receiver or recorded by a video recorder for determining audience viewing habits comprising:

means for detecting predetermined operational modes of the television receiver and the video recorder;

means for detecting a first predetermined event in one of the operational modes;

means for detecting a second predetermined event in the program material;

means responsive to the detected predetermined operational modes for extracting a predetermined characteristic of the program material from a single frame of a video signal after the occurrence of said second predetermined event; and

means for storing the predetermined characteristic, the time the predetermined characteristic is extracted and the detected predetermined operational mode.

101. A system for identifying a television signal received from both a television receiver and a video recorder for determining audience viewing habits comprising:

means for detecting predetermined changes in the operational modes of the television receiver and the video recorder;

means for detecting the occurence of a first event in one of the operational modes;

means responsive to both the detection of a first event and a detected viewing operational mode for detecting the occurrence of a second event in the signal to be identified;

means responsive to a detected recording operational mode for detecting the occurence of a second event in the signal to be identified;

means responsive to the detection of a second event for extracting a signature from a single frame of the video signal to be identified after the occurence of the second event; and

means for storing the extracted signature and the detected operational mode.

111. A system as recited in claim 101 wherein said low pass filtering means has a cut-off on the order frequency of approximately 2 to 6 kHz.

113. A system as recited in claim 101 wherein said video envelope signal sampling means includes means for taking a predetermined number of samples of said video envelope signal and means for taking the averages of predetermined consecutive samples to generate a plurality of average signals, each average signal defining one of the features that comprises the feature string.

114. In a system for identifying programs viewed on a television receiver, wherein the programs are obtained from a video recorder and from an external program source, the improvement comprising:

means responsive to the on/off condition of the television;

means responsive to the on/off condition and the play/record condition of the video recorder;

logic means responsive to the television condition responsive means and the video recorder condition responsive means for providing an indication if the program being viewed is being obtained from the video recorder or from the external program source;

means for identifying the program being viewed, said identifying means being responsive to said logic means and operative to identify said program according to two different criteria depending on whether the program being viewed is obtained from the external program source or form the video recorder.

116. In a system for determining the viewing habits of a household having a video recorder capable of recording programs obtained from an external program source and playing video programs, and a television receiver for viewing programs obtained from the external program source and from the video recorder, said system having a home unit and a central unit, the improvement comprising:

means responsive to predetermined operating conditions of said television receiver and said video recorder to provide signals representative of television viewing, recording, and playback;

means for detecting during viewing a first predetermined event in the program material;

means responsive to the detection of said first predetermined event for detecting during viewing a second predetermined event in the program material;

means responsive to the detection of said second predetermined event for extracting during viewing at least one predetermined characteristic of the program material;

means for storing at the home unit the predetermined characteristic of the viewed program material and the time that the predetermined characteristic is extracted;

means for continuously detecting during recording the second predetermined events in the program material;

means responsive to the detection of said second predetermined events for extracting during recording at least one predetermined characteristic of the program material;

means for storing during recording the predetermined characteristics and the times that the predetermined characteristics are extracted;

means for comparing the predetermined characteristics stored during viewing and recording and their times of occurrence with reference predetermined characteristics stored in the central unit that occurred at substantially the same time to identify the programs viewed and recorded;

means for detecting during playback the first predetermined event in the program material;

means responsive to the detection of said first predetermined event for detecting during playback the second predetermined event in the program material;

means responsive to the detection of said second predetermined event for extracting during playback at least one predetermined characteristic of the program material;

means for recording during playback the predetermined characteristic; and

means for comparing the predetermined characteristic recorded during playback with reference predetermined characteristics stored at the central unit at the time of recording to identify the program.

117. In a system for determining the viewing habits of a household having a video recorder and a television receiver, said system having a home unit and a central unit, the improvement comprising:

means responsive to predetermined parameters of said television receiver and said video recorder to provide signals representative of television viewing, playback and recording;

means for detecting during viewing a first predetermined event in the program material;

means responsive to the detection of said first predetermined event for detecting during viewing a second predetermined event in the program material;

means responsive to the detection of said second predtermined event for extracting during viewing at least one predetermined characteristic of the program material;

means at the home unit for storing during viewing the predetermined characteristic and the time that the predetemined characteristic is extracted;

means for continuously detecting during recording the second predetermined events in the program material;

means responsive to the detection of said second predetermined events for extracting during recording at least one predetermined characteristic of the program material;

means at the home unit for storing during recording the predetermined characteristics and the times of occurrence thereof;

means at the home unit for determining time intervals between the detached predetermined second events during recording;

means for detecting during playback the second predetermined events in the program material;

means responsive to the detection of said second predetermined events for extracting during playback at least one predetermined characteristic of the program material;

means at the home unit for determining time intervals between the detected predetermined second events during playback;

means at the home unit for comparing the time intervals between the detected events during playback and the time intervals between the events stored during recording; and

means responsive to a match provided by the comparing means for comparing the predetermined characteristics extracted during recording with reference characteristics stored in the central unit to identify the program.