Media monitoring, management and information system

• US 9,648,282 B2
• Filed: 10/12/2011
• Issued: 05/09/2017
• Est. Priority Date: 10/15/2002
• Status: Expired due to Fees

• Current Assignee: IP Acquisitions, LLC
• Original Assignee: Verance Corporation
• Inventors: Petrovic, Rade, Tehranchi, Babak, Jemili, Kanaan, Winograd, Joseph M., Angelico, Dean
• Primary Examiner(s): Harold, Jefferey
• Assistant Examiner(s): KARWAN, SIHAR A
• Application Number:
  US13/272,061
• Publication Number:
  US 20120026393A1
• Time in Patent Office: 2,036 Days
• Field of Search: 713176, 382100, 348462
• CPC Class Codes: H04H 20/14 for monitoring programmes
• CPC Class Codes: H04H 20/31 using in-band signals, e.g. subsonic or cue signal
• CPC Class Codes: H04H 2201/50 characterised by the use of watermarks
• CPC Class Codes: H04N 21/258 Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data arrangements for services using the result on the distributing side of broadcast systems H04H60/66; profiles in network data switching protocols H04L67/30
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8352 involving content or source identification data, e.g. Unique Material Identifier [UMID]
• CPC Class Codes: H04N 21/8358 involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

Systems and methods are provided for monitoring transmissions of media content (such as audio and audiovisual content) in order to obtain independent and objective data regarding the use of specific media content recordings or works within the transmissions. Processing and reporting of such data is provided in various ways to serve a variety of business needs. Methods for employing content identification technology to efficiently and automatically obtain reliable, accurate, and precise monitoring data are also disclosed. Various information products and services based on such monitoring systems are proposed.

Claims

1. A method for embedding of watermarks comprising identification information into a multimedia content, comprising:

separating at least one audio component from other components of the multimedia content that is being received in real-time;

embedding the separated audio component(s) imperceptibly and repeatedly with the watermarks comprising the identification information; and

combining the other components of the multimedia content with the embedded audio component(s), while using a video delay unit configured to store a video component in a buffer as the separated audio component(s) are being embedded so as to accommodate delays caused at least in-part by embedding of the audio component, so that synchronization between segments of the other components of the multimedia content and corresponding segments of the embedded audio component(s) is preserved, wherein upon an indication that the at least one audio component is in analog form, converting the at least one audio component into digital form prior to the embedding and converting the at least one audio component back into analog form after the embedding.

2. The method of claim 1, wherein the multimedia content includes audio and video portions.

3. The method of claim 1, wherein the multimedia content is in compressed digital form.

4. The method of claim 3, further comprising:

decompressing the at least one audio component of the compressed multimedia content prior to the embedding; and

compressing the embedded audio component(s) prior to combination with the other components of the multimedia content.

5. The method of claim 1, wherein the multimedia content includes a metadata stream.

6. The method of claim 5, wherein the combining comprises combining the other components of the multimedia content with the embedded audio component(s) so that synchronization between the metadata stream and the corresponding segments of the embedded audio component(s) is preserved.

7. The method of claim 5, wherein the metadata includes a time code.

8. The method of claim 1, further comprising enabling batch processing by providing an embedding list of time instances that indicate when a new clip of the multimedia content begins and ends.

9. The method of claim 1, wherein:

the multimedia content includes at least three streams of data prior to the separating, the three streams including an audio stream corresponding to the audio component(s), a video stream corresponding to the video component, and a meta data stream comprising time codes; and

the combining is carried out so that synchronization between segments of the video and meta data streams and the corresponding segments of the embedded audio component(s) is preserved.

10. An apparatus, comprising:

an audio-video separator circuitry configured to separate audio and video components of a multimedia content that is being received in real-time;

an audio watermark embedder circuitry configured to embed at least one audio component imperceptibly and repeatedly with identification information;

an audio-video combiner circuitry configured to combine the video component(s) with the embedded audio component(s) so that synchronization between video frames of the video component and corresponding segments of the embedded audio component(s) is preserved; and

a video delay unit configured to store the video component(s) in a buffer while the audio watermark embedder embeds the audio component(s) so as to accommodate delays caused at least in-part by embedding of the audio component; and

an analog-to-digital converter and a digital-to-analog converter configured to, upon an indication that the at least one audio component is in analog form, convert the audio component(s) into digital form prior to embedding the at least one audio component and convert the at least one audio component back into analog from after embedding.

11. The apparatus of claim 10, wherein the multimedia content is in compressed digital form.

12. The apparatus of claim 11, further comprising:

a decompression unit configured to decompress the audio component(s) prior to embedding the audio component(s); and

a compression unit configured to compress the embedded audio component(s) prior to combination with the remaining portion of the multimedia content.

13. The apparatus of claim 10, wherein the multimedia content includes a metadata stream.

14. The apparatus of claim 13, wherein the audio-video combiner circuitry is configured to combine the video component(s) and the metadata stream with the embedded audio component(s) so that synchronization between the metadata stream and the corresponding segments of the embedded audio component(s) is preserved.

15. The apparatus of claim 13, wherein the metadata includes a time code.

16. The apparatus of claim 10, further comprising a batch processor configured to process an embedding list of time instances that indicate when a new clip of the multimedia content begins and ends.

17. The apparatus of claim 10, wherein:

the multimedia content includes at least three streams of data prior to separating the audio and the video component(s), the three streams including an audio stream corresponding to the audio component(s), a video stream corresponding to the video component, and a meta data stream comprising time codes; and

the audio-video combiner circuitry is configured to preserve synchronization between segments of the plurality of streams of data video and meta data streams and the corresponding segments of the embedded audio component(s).

18. A computer program product, embodied on a non-transitory computer readable medium and including program code that upon execution by the processor causes that processor to embed watermarks into a multimedia content, the computer program product comprising:

program code for separating at least one audio component from other components of

the multimedia content that is being received in real-time;

program code for embedding the separated audio component(s) imperceptibly and repeatedly with watermarks comprising identification information; and

program code for combining the other components of the multimedia content with the embedded audio component(s), while using a video delay unit configured to store a video component in a buffer as the separated audio component(s) are being embedded so as to accommodate delays caused at least in-part by embedding of the audio component so that synchronization between segments of the other components of the multimedia content and corresponding segments of the embedded audio component(s) is preserved, wherein upon an indication that the at least one audio component is in analog form, the computer program product including program code for converting the at least one audio component into digital form prior to the embedding and converting the at least one audio component back into analog form after the embedding.