Audio data receipt/exposure measurement with code monitoring and signature extraction

• US 7,222,071 B2
• Filed: 09/27/2002
• Issued: 05/22/2007
• Est. Priority Date: 09/27/2002
• Status: Expired due to Term

• Current Assignee: The Nielsen Company LLC (MOOD Media Corporation)
• Original Assignee: Arbitron Inc. (MOOD Media Corporation)
• Inventors: Neuhauser, Alan R., White, Thomas W.
• Primary Examiner(s): Knepper; David D.
• Application Number:
  US10/256,834
• Publication Number:
  US 20040064319A1
• Time in Patent Office: 1,698 Days
• Field of Search: 704/207, 704/231, 704/237, 725 18- 22, 455/2.01, 455/2, 375/130, 380/3
• US Class Current: 704/231
• CPC Class Codes: G10L 15/00 Speech recognition G10L17/00 takes precedence
• CPC Class Codes: G10L 19/018 Audio watermarking, i.e. embedding inaudible data in the audio signal
• CPC Class Codes: H04H 2201/90 characterised by the use of signatures
• CPC Class Codes: H04H 60/31 Arrangements for monitoring the use made of the broadcast services
• CPC Class Codes: H04H 60/37 for identifying segments of broadcast information, e.g. scenes or extracting programme ID
• CPC Class Codes: H04H 60/58 of audio determination or detection of speech characteristics in general G10L25/00; speech recognition in general G10L15/00
• CPC Class Codes: H04H 60/65 for using the result on users' side

Abstract

Systems and methods are provided for gathering audience measurement data relating to receipt of and/or exposure to audio data by an audience member. Audio data is monitored to detect a monitoring code. Based on detection of the monitoring code, a signature characterizing the audio data is extracted.

Claims

1. A method of gathering data reflecting receipt of and/or exposure to audio data, comprising:

receiving audio data to be monitored in a monitoring device, the audio data having a monitoring code indicating that the audio data is to be monitored;

detecting the monitoring code; and

in response to detection of the monitoring code, producing signature data characterizing the audio data using at least a portion of the audio data containing the monitoring code.

2. The method of claim 1, wherein forming the signature data comprises forming a signature data set reflecting time-domain variations of the received audio data.

3. The method of claim 2, wherein forming the signature data further comprises forming a signature data set reflecting time-domain variations of the received audio data in a plurality of frequency sub-bands of the received audio data.

4. The method of claim 1, wherein forming the signature data comprises forming a signature data set reflecting frequency-domain variations in the received audio data.

5. The method of claim 1, wherein the monitoring code comprises a plurality of substantially single-frequency code components.

6. The method of claim 5, further comprising processing the received audio data to produce signal-to-noise ratios for the plurality of components.

7. The method of claim 1, wherein forming the signature data comprises forming a signature data set comprising signal-to-noise ratios for frequency components of the audio data and/or data representing characteristics of the audio data.

8. The method of claim 7, wherein forming the signature data comprises combining selected ones of the signal-to-noise ratios.

9. The method of claim 7, wherein forming the signature data comprises forming a signature data set reflecting time-domain variations of the signal-to-noise ratios.

10. The method of claim 9, wherein forming the signature data further comprises forming a signature data set reflecting time-domain variations of the signal-to-noise ratios in a plurality of frequency sub-bands of the received audio data.

11. The method of claim 10, wherein the sub-bands are substantially single-frequency sub-bands.

12. The method of claim 7, wherein forming the signature data comprises forming a signature data set reflecting frequency-domain variations of the signal-to-noise ratios.

13. The method of claim 12, wherein the signal-to-noise ratios reflect the ratios of the magnitudes of substantially single-frequency components data to noise levels.

14. The method of claim 1, wherein the audio data comprises a first data set and a second data set, the first data set includes the monitoring code, the signature data characterizes the first data set, and the second data set includes a second monitoring code, further comprising:

detecting the second monitoring code; and

in response to detection of the second monitoring code, producing signature data characterizing the second data set using at least a portion of the audio data containing the second monitoring code.

15. The method of claim 1, wherein the produced signature data comprises data obtained from the monitoring code and/or a source identification code included in the audio data.

16. The method of claim 15, wherein the monitoring code and the source identification code occur simultaneously in the audio data.

17. The method of claim 15, wherein the monitoring code and the source identification code occur in different time segments of the audio data.

18. The method of claim 1, further comprising comparing the signature data to reference signature data of identified audio data to identify the received audio data.

19. The method of claim 18, wherein:

producing the signature data occurs at the location where the audio data is received; and

comparing the signature data to the reference signature data occurs at a location remote from the location where the audio data is received.

20. The method of claim 18, wherein producing the signature data and comparing the signature data to the reference signature data both occur at the location where the audio data is received.

21. A system for gathering data reflecting receipt of and/or exposure to audio data, comprising:

an input device to receive, in a monitoring device, audio data having a monitoring code indicating that the audio data is to be monitored;

a detector to detect the monitoring code; and

a first processor to produce, in response to detection of the monitoring code, signature data characterizing the audio data using at least a portion of the audio data containing the monitoring code.

22. The system of claim 21, wherein the processor is operative to form the signature data by forming a signature data set reflecting time-domain variations of the received audio data.

23. The system of claim 22, wherein the processor is further operative to form the signature data by forming a signature data set reflecting time-domain variations of the received audio data in a plurality of frequency sub-bands of the received audio data.

24. The system of claim 21, wherein the processor is operative to form the signature data by forming a signature data set reflecting frequency-domain variations in the received audio data.

25. The system of claim 21, wherein the monitoring code comprises a plurality of substantially single-frequency code components.

26. The system of claim 25, further comprising a second processor to process the received audio data to produce signal-to-noise ratios for the plurality of components.

27. The system of claim 21, wherein the first processor is operative to form the signature data by forming a signature data set comprising signal-to-noise ratios for frequency components of the audio data and/or data representing characteristics of the audio data.

28. The system of claim 27, wherein the first processor is operative to form the audio data signature by combining selected ones of the signal-to-noise ratios.

29. The system of claim 27, wherein the first processor is operative to form the signature data by forming a signature data set reflecting time-domain variations of the signal-to-noise ratios.

30. The system of claim 29, wherein the first processor is further operative to form the signature data by forming a signature data set reflecting time-domain variations of the signal-to-noise ratios in a plurality of frequency sub-bands of the received audio data.

31. The system of claim 30, wherein the sub-bands are substantially single-frequency sub-bands.

32. The system of claim 27, wherein the first processor is further operative to form the signature data by forming a signature data set reflecting frequency-domain variations of the signal-to-noise ratios.

33. The system of claim 32, wherein the signal-to-noise ratios reflect the ratios of the magnitudes of substantially single-frequency audio data components to noise levels.

34. The system of claim 21, wherein the audio data comprises a first data set and a second data set, the first data set includes the monitoring code, the signature data characterizes the first data set, and the second data set includes a second monitoring code, and wherein:

the detector is operative to detect the second monitoring code; and

the processor is operative to produce, in response to detection of the second monitoring code, signature data characterizing the second data set using at least a portion of the audio data containing the second monitoring code.

35. The system of claim 21, wherein the produced signature data comprises data obtained from the monitoring code and/or a source identification code included in the audio data.

36. The system of claim 35, wherein the monitoring code and the source identification code occur simultaneously in the audio data.

37. The system of claim 35, wherein the monitoring code and the source identification code occur in different time segments of the audio data.

38. The system of claim 21, further comprising a second processor to compare the signature data to reference signature data of identified audio data to identify the received audio data.

39. The system of claim 38, wherein:

the first processor is located at the same location as the receiver; and

the second processor is located remotely from the receiver.

40. The system of claim 38, wherein the first processor and the second processor are both located at the same location as the input device.

41. A method of gathering data reflecting receipt of and/or exposure to audio data comprising;

receiving audio data to be monitored in a monitoring device, the audio data having a monitoring code occurring continuously throughout a time base of the audio data;

detecting the monitoring code; and

in response to detection of the monitoring code, producing signature data characterizing the audio data.

42. The method of claim 41, wherein forming the signature data comprises forming signature data set reflecting time-domain variations of the received audio data.

43. The method of claim 42, wherein forming the signature data further comprises forming a signature data set reflecting time-domain variations of the received audio data in a plurality of frequency sub-bands of the received audio data.

44. The method of claim 41, wherein forming the signature data comprises forming a signature data set reflecting frequency-domain variations in the received audio data.

45. The method of claim 41, wherein the monitoring code comprises a plurality of substantially single-frequency code components.

46. The method of claim 45, further comprising processing the received audio data to produce signal-to-noise ratios for the plurality of components.

47. The method of claim 41, wherein forming the signature data comprises forming a signature data set comprising signal-to-noise ratios for frequency components of the audio data and/or data representing characteristics of the audio data.

48. The method of claim 47, wherein forming the signature data comprises combining selected ones of the signal-to-noise ratios.

49. The method of claim 47, wherein forming the signature data comprises forming a signature data set reflecting time-domain variations of the signal-to-noise ratios.

50. The method of claim 49, wherein forming the signature data further comprises forming a signature data set reflecting time-domain variations of the signal-to-noise ratios in a plurality of frequency sub-bands of the received audio data.

51. The method of claim 50, wherein the sub-bands are substantially single-frequency sub-bands.

52. The method of claim 47, wherein forming the signature data comprises forming a signature data set reflecting frequency-domain variations of the signal-to-noise ratios.

53. The method of claim 52, wherein the signal-to-noise ratios reflect the ratios of the magnitudes of substantially single-frequency audio data components to noise levels.

54. The method of claim 41, wherein the audio data comprises a first data set and a second data set, the first data set includes the monitoring code, which code occurs continuously throughout a time base of the first data set, the signature data characterizes the first data set, and the second data set includes a second monitoring code, which second monitoring code occurs continuously throughout a time base of the second data set, further comprising:

detecting the second monitoring code; and

in response to detection of the second monitoring code, producing signature data characterizing the second data set.

55. The method of claim 41, wherein the produced signature data comprises data obtained from the monitoring code and/or a source identification code included in the audio data.

56. The method of claim 55, wherein the monitoring code and the source identification code occur simultaneously in the audio data.

57. The method of claim 55, wherein the monitoring code and the source identification code occur in different time segments of the audio data.

58. The method of claim 41, wherein the monitoring code occurs continuously throughout a first portion of the time base of the audio data and provides an indication that it occurs in the first portion, and the audio data includes a second monitoring code, which code occurs continuously throughout a second portion of the time base of the audio data and provides an indication that it occurs in the second portion, further comprising:

detecting the second monitoring code; and

in response to detection of the second monitoring code, producing signature data characterizing the audio data.

59. The method of claim 41, further comprising comparing the signature data to reference signature data of identified audio data to identify the received audio data.

60. The method of claim 59, wherein:

producing the signature data occurs at the location where the audio data is received; and

comparing the signature data to the reference signature data occurs at a location remote from the location where the audio data is received.

61. The method of claim 59, wherein producing the signature data and comparing the signature data to the reference signature data both occur at the location where the audio data is received.

62. A system for gathering data reflecting receipt of and/or exposure to audio data comprising:

an input device to receive, in a monitoring device, audio data to be monitored having a monitoring code occurring continuously throughout a time base of the audio data;

a detector to detect the monitoring code; and

a first processor to produce, in response to detection of the monitoring code, signature data characterizing the audio data.

63. The system of claim 62, wherein the processor is operative to form the signature data by forming a signature data set reflecting time-domain variations of the received audio data.

64. The system of claim 63, wherein the processor is further operative to form the signature data by forming a signature data set reflecting time-domain variations of the received audio data in a plurality of frequency sub-bands of the received audio data.

65. The system of claim 62, wherein the processor is operative to form the signature data by forming a signature data set reflecting frequency-domain variations in the received audio data.

66. The system of claim 62, wherein the monitoring code comprises a plurality of substantially single-frequency code components.

67. The system of claim 66, further comprising a second processor to process the received audio data to produce signal-to-noise ratios for the plurality of components.

68. The system of claim 62, wherein the first processor is operative to form the signature data by forming a signature data set comprising signal-to-noise ratios for frequency components of the audio data and/or data representing characteristics of the audio data.

69. The system of claim 68, wherein the first processor is operative to form the signature data by combining selected ones of the signal-to-noise ratios.

70. The system of claim 68, wherein the first processor is operative to form the signature data by forming a signature data set reflecting time-domain variations of the signal-to-noise ratios.

71. The system of claim 70, wherein the first processor is further operative to form the signature data by forming a signature data set reflecting time-domain variations of the signal-to-noise ratios in a plurality of frequency sub-bands of the received audio data.

72. The system of claim 71, wherein the sub-bands are substantially single-frequency sub-bands.

73. The system of claim 68, wherein the first processor is further operative to form the signature data by forming a signature data set reflecting frequency-domain variations of the signal-to-noise ratios.

74. The system of claim 73, wherein the signal-to-noise ratios reflect the ratios of the magnitudes of substantially single-frequency audio data components to noise levels.

75. The system of claim 62, wherein the audio data comprises a first data set and a second data set, the first data set includes the monitoring code, which code occurs continuously throughout a time base of the first data set, the signature data set includes a second monitoring code, which second monitoring code occurs continuously throughout a time base of the second data set, and wherein:

the detector is operative to detect the second monitoring code; and

the processor is operative to produce, in response to detection of the second monitoring code, signature data characterizing the second data set.

76. The system of claim 62, wherein the produced signature data comprises data obtained from the monitoring code and/or a source identification code included in the audio data.

77. The system of claim 76, wherein the monitoring code and the source identification code occur simultaneously in the audio data.

78. The system of claim 76, wherein the monitoring code and the source identification code occur in different time segments of the audio data.

79. The system of claim 62, wherein the monitoring code occurs continuously throughout a first portion of the time base of the audio data and provides and indication that it occurs in the first portion, and the audio data includes a second monitoring code, which code occurs continuously throughout a second portion of the time base of the audio data and provides an indication that it occurs in the second portion, and wherein:

the detector is operative to detect the second monitoring code; and

the processor is operative to produce, in response to detection of the second monitoring code, signature data characterizing the audio data.

80. The system of claim 62, further comprising a second processor to compare the signature data to reference signature data of identified audio data to identify the received audio data.

81. The system of claim 80, wherein:

the first processor is located at the same location as the receiver; and

the second processor is located remotely from the receiver.

82. The system of claim 80, wherein the first processor and the second processor are both located at the same location as the receiver.

83. A method of gathering data reflecting receipt of and/or exposure to audio data, comprising;

receiving audio data to be monitored in a monitoring device, the audio data having a monitoring code occurring repeatedly therein;

detecting the monitoring code; and

in response to detection of the monitoring code, producing signature data characterizing the audio data.

84. The method of claim 83, wherein forming the signature data comprises forming a signature data set reflecting time-domain variations of the received audio data.

85. The method of claim 84, wherein forming the signature data further comprises forming a signature data set reflecting time-domain variations of the received audio data in a plurality of frequency sub-bands of the received audio data.

86. The method of claim 83, wherein forming the signature data comprises forming a signature data set reflecting frequency-domain variations in the received audio data.

87. The method of claim 83, wherein the monitoring code comprises a plurality of substantially single-frequency code components.

88. The method of claim 87, further comprising processing the received audio data to produce signal-to-noise ratios for the plurality of components.

89. The method of claim 83, wherein forming the signature data comprises forming a signature data set comprising signal-to-noise ratios for frequency components of the audio data and/or data representing characteristics of the audio data.

90. The method of claim 89, wherein forming the signature data comprises combining selected ones of the signal-to-noise ratios.

91. The method of claim 89, wherein forming the signature data comprises forming a signature data set reflecting time-domain variations of the signal-to-noise ratios.

92. The method of claim 91, wherein forming the signature data further comprises forming a signature data set reflecting time-domain variations of the signal-to-noise ratios in a plurality of frequency sub-bands of the received audio data.

93. The method of claim 92, wherein the sub-bands are substantially single-frequency sub-bands.

94. The method of claim 89, wherein forming the signature data comprises forming a signature data set reflecting frequency-domain variations of the signal-to-noise ratios.

95. The method of claim 94, wherein the signal-to-noise ratios reflect the ratios of the magnitudes of substantially single-frequency audio data components to noise levels.

96. The method of claim 83, wherein the audio data comprises a first data set and a second data set, the first data set includes the monitoring code, which code occurs repeatedly throughout the first data set, the signature data characterizes the first data set, and the second data set includes a second monitoring code, which second monitoring code occurs repeatedly throughout the second data set, further comprising:

detecting the second monitoring code; and

in response to detection of the second monitoring code, producing signature data characterizing the second data set.

97. The method of claim 83, wherein the produced signature data comprises data obtained from the monitoring code and/or a source identification code included in the audio data.

98. The method of claim 97, wherein the monitoring code and the source identification code occur simultaneously in the audio data.

99. The method of claim 97, wherein the monitoring code and the source identification code occur in different time segments of the audio data.

100. The method of claim 83, wherein the monitoring code occurs repeatedly in a first portion of the audio data and provides an indication that it occurs in the first portion, and the audio data includes a second monitoring code, which code occurs repeatedly in a second portion of the audio data and provides an indication that it occurs in the second portion, further comprising:

detecting the second monitoring code; and

in response to detection of the second monitoring code, producing signature data characterizing the audio data.

101. The method of claim 83, further comprising comparing the signature data to reference signature data of identified audio data to identify the received audio data.

102. The method of claim 101, wherein:

producing the signature data occurs at the location where the audio data is received; and

comparing the signature data to the reference signature data occurs at a location remote from the location where the audio data is received.

103. The method of claim 101, wherein producing the signature data and comparing the signature data to the reference signature data both occur at the location where the audio data is received.

104. The method of claim 83, wherein the monitoring code repeats at a predetermined interval.

105. The method of claim 83, wherein the monitoring code repeats at one or more variable intervals.

106. A system for gathering data reflecting receipt of and/or exposure to audio data, comprising:

an input device to receive, in a monitoring device, audio data to be monitored having a monitoring code occurring repeatedly therein;

a detector to detect the monitoring code; and

a first processor to produce, in response to detection of the monitoring code, signature data characterizing the audio data.

107. The system of claim 106, wherein the processor is operative to form the signature data by forming a signature data set reflecting time-domain variations of the received audio data.

108. The system of claim 107, wherein the processor is further operative to form the signature data by forming a signature data set reflecting time-domain variations of the received audio data in a plurality of frequency sub-bands of the received audio data.

109. The system of claim 106, wherein the processor is operative to form the signature data by forming a signature data set reflecting frequency-domain variations in the received audio data.

110. The system of claim 106, wherein the monitoring code comprises a plurality of substantially single-frequency code components.

111. The system of claim 110, further comprising a second processor to process the received audio data to produce signal-to-noise ratios for the plurality of components.

112. The system of claim 106, wherein the first processor is operative to form the signature data by forming a signature data set comprising signal-to-noise ratios for frequency components of the audio data and/or data representing characteristics of the audio data.

113. The system of claim 112, wherein the first processor is operative to form the signature data by combining selected ones of the signal-to-noise ratios.

114. The system of claim 112, wherein the first processor is operative to form the signature data by forming a signature data set reflecting time-domain variations of the signal-to-noise ratios.

115. The system of claim 114, wherein the first processor is further operative to form the signature data by forming a signature data set reflecting time-domain variations of the signal-to-noise ratios in a plurality of frequency sub-bands of the received audio data.

116. The system of claim 115, wherein the sub-bands are substantially single-frequency sub-bands.

117. The system of claim 112, wherein the first processor is further operative to form the signature data by forming a signature data set reflecting frequency-domain variations of the signal-to-noise ratios.

118. The system of claim 117, wherein the signal-to-noise ratios reflect the ratios of the magnitudes of substantially single-frequency audio data components to noise levels.

119. The system of claim 106, wherein the audio data comprises a first data set and a second data set, the first data set includes the monitoring code, which code occurs repeatedly throughout the first data set, the signature data set includes a second monitoring code, which second monitoring code occurs repeatedly throughout the second data set, and wherein:

the detector is operative to detect the second monitoring code; and

the processor is operative to produce, in response to detection of the second monitoring code, signature data characterizing the second data set.

120. The system of claim 106, wherein the produced signature data comprises data obtained from the monitoring code and/or a source identification code included in the audio data.

121. The system of claim 120, wherein the monitoring code and the source identification code occur simultaneously in the audio data.

122. The system of claim 120, wherein the monitoring code and the source identification code occur in different time segments of the audio data.

123. The system of claim 106, wherein the monitoring code occurs repeatedly in a first portion of the audio data and provides an indication that it occurs in the first portion, and the audio data includes a second monitoring code, which code occurs repeatedly in a second portion of the audio data and provides and indication that it occurs in the second portion, and wherein:

the detector is operative to detect the second monitoring code; and

the processor is operative to produce, in response to detection of the second monitoring code, signature data characterizing the audio data.

124. The system of claim 106, further comprising a second processor to compare the signature data to reference signature data of identified audio data to identify the received audio data.

125. The system of claim 124, wherein:

the first processor is located at the same location as the input device; and

the second processor is located remotely from the input device.

126. The system of claim 124, wherein the first processor and the second processor are both located at the same location as the receiver.

127. The system of claim 106, wherein the monitoring code repeats at a predetermined interval.

128. The system of claim 106, wherein the monitoring code repeats at one or more variable intervals.