Signal continuity assessment using embedded watermarks

• US 9,558,526 B2
• Filed: 02/01/2016
• Issued: 01/31/2017
• Est. Priority Date: 10/08/2003
• Status: Expired due to Term

• Current Assignee: IP Acquisitions, LLC
• Original Assignee: Verance Corporation
• Inventors: Tehranchi, Babak, Petrovic, Rade, Winograd, Joseph M., Angelico, Dean Anthony
• Primary Examiner(s): Allison, Andrae S
• Application Number:
  US15/012,675
• Publication Number:
  US 20160225116A1
• Time in Patent Office: 365 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 21/1063 Personalisation
• CPC Class Codes: G06F 21/16 Program or content traceability, e.g. by watermarking
• CPC Class Codes: G06F 21/64 Protecting data integrity, e.g. using checksums, certificates or signatures
• CPC Class Codes: G06F 2221/2111 Location-sensitive, e.g. geographical location, GPS
• CPC Class Codes: G06F 2221/2151 Time stamp
• CPC Class Codes: G06T 1/0071 using multiple or alternating watermarks
• CPC Class Codes: G06T 2201/0065 Extraction of an embedded watermark; Reliable detection
• CPC Class Codes: G10L 19/018 Audio watermarking, i.e. embedding inaudible data in the audio signal
• CPC Class Codes: H04H 60/56 Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
• CPC Class Codes: H04L 2463/103 applying security measure for protecting copyright
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 1/32101 Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
• CPC Class Codes: H04N 1/32288 Multiple embedding, e.g. cocktail embedding, or redundant embedding, e.g. repeating the additional information at a plurality of locations in the image
• CPC Class Codes: H04N 1/32315 Selecting a particular method from amongst a plurality of methods
• CPC Class Codes: H04N 1/32352 Controlling detectability or arrangements to facilitate detection or retrieval of the embedded information, e.g. using markers for decoding, detection or retrieval operations H04N1/32149 and subgroups take precedence
• CPC Class Codes: H04N 21/8358 involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 2201/3233 of authentication information, e.g. digital signature, watermark
• CPC Class Codes: H04N 2201/3269 of machine readable codes or marks, e.g. bar codes or glyphs

Abstract

Methods, apparatus, and systems for signal continuity assessment using embedded watermarks are provided. The embedded watermarks are recovered from the content and one or more attributes associated with the recovered watermarks are identified. A continuity of the content can then be assessed in accordance with the one or more attributes. The continuity assessment may be based on a variety of factors, including but not limited to a determined heartbeat of the recovered watermarks, a density, separation, location, or extent, of the recovered watermarks, as well as information associated with the watermarks, such as a stego key, channel bits, packet numbers, a fingerprint, or the like.

Claims

1. A method for detecting a change in arrangement of sections of a content, comprising:

receiving a multimedia content;

extracting at least two watermark messages from the multimedia content;

determining a separation between a first one of the at least two extracted watermark messages and a second one of the at least two extracted watermark messages within the multimedia content;

using the payloads of the at least two extracted watermark messages to retrieve metadata associated with the at least two watermark messages; and

processing the retrieved metadata in conjunction with the determined separation to detect a change in arrangement of the multimedia content sections, wherein each watermark message enables recovery of at least a first field and a second field, the first field including an identical value for each watermark embedded in a plurality of segments of the multimedia content, and the second field including different values in different segments of the multimedia content and wherein processing the metadata in conjunction with the determined separation includes one or both of;

comparing the first field associated with the second extracted watermark message with the first field associated with the first extracted watermark message to detect a first difference value, or

comparing the second field associated with the second extracted watermark message with the second field associated with the first extracted watermark message to detect a second difference value.

2. The method of claim 1, further comprising using the first difference or the second difference values to obtain an expected separation between the first and the second watermark messages, wherein the expected separation has a value that is smaller than the value of the determined separation, and the detected change is identified as an insertion of one or more additional content sections into the multimedia content.

3. The method of claim 1, using the first difference or the second difference values to obtain an expected separation between the first and the second watermark messages, wherein the expected separation has a value that is larger than the value of the determined separation, and the detected change is identified as a removal of one or more sections of the multimedia content.

4. The method of claim 1, wherein the second difference value indicates a sequential ordering of the segments of the multimedia content that is different from an expected sequential ordering of the segments of the multimedia content, and the detected change is identified as reordering of sections of the multimedia content.

5. The method of claim 1, wherein the separation between the first and the second watermark messages is determined based on relative locations of the first and the second extracted watermark messages within the multimedia content.

6. The method of claim 5, wherein the separation is determined in one of:

a temporal domain, a spatial domain, or a frequency domain.

7. The method of claim 1, wherein:

determining the separation includes aggregating all extracted watermark messages with a first identically valued second fields into a first aggregated segment, aggregating all extracted watermark messages with a second identically valued second fields into a second aggregated segment, and comparing a location of the first aggregated segment with a location of the second aggregated segment within the multimedia content.

8. The method of claim 7, wherein:

the retrieved metadata includes a duration field, and

detecting the change includes using the duration field to ascertain an expected separation between the first and the second aggregated content segments.

9. The method of claim 1, wherein the multimedia content includes one or more of:

an audio content, a video content or a still image.

10. A computer program product embodied on one or more non-transitory computer readable media, comprising:

program code for receiving a multimedia content;

program code extracting at least two watermark messages from the multimedia content;

program code determining a separation between a first one of the at least two extracted watermark messages and a second one of the at least two extracted watermark messages within the multimedia content;

program code using the payloads of the at least two extracted watermark messages to retrieve metadata associated with the at least two watermark messages; and

program code processing the retrieved metadata in conjunction with the determined separation to detect a change in arrangement of the multimedia content sections, wherein each watermark message enables recovery of at least a first field and a second field, the first field including an identical value for each watermark embedded in a plurality of segments of the multimedia content, and the second field including different values in different segments of the multimedia content and wherein processing the metadata in conjunction with the determined separation includes one or both of;

comparing the first field associated with the second extracted watermark message with the first field associated with the first extracted watermark message to detect a first difference value, or

comparing the second field associated with the second extracted watermark message with the second field associated with the first extracted watermark message to detect a second difference value.

11. The computer program product of claim 10, further comprising program code for using the first difference or the second difference values to obtain an expected separation between the first and the second watermark messages, wherein the expected separation has a value that is smaller than the value of the determined separation, and the detected change is identified as an insertion of one or more additional content sections into the multimedia content.

12. The computer program product of claim 10, further comprising program code for using the first difference or the second difference values to obtain an expected separation between the first and the second watermark messages, wherein the expected separation has a value that is larger than the value of the determined separation, and the detected change is identified as a removal of one or more sections of the multimedia content.

13. The computer program product of claim 10, wherein the second difference value indicates a sequential ordering of the segments of the multimedia content that is different from an expected sequential ordering of the segments of the multimedia content, and the detected change is identified as reordering of sections of the multimedia content.

14. The computer program product of claim 10, wherein the separation between the first and the second watermark messages is determined based on relative locations of the first and the second extracted watermark messages within the multimedia content.

15. A device, comprising:

a processor; and

a memory including processor executable code, the processor executable code, when executed by the processor, causes the processor to;

receive a multimedia content;

extract at least two watermark messages from the multimedia content;

determine a separation between a first one of the at least two extracted watermark messages and a second one of the at least two extracted watermark messages within the multimedia content;

recover of at least a first field and a second field from each extracted watermark message, the first field including an identical value for each watermark embedded in a plurality of segments of the multimedia content, and the second field including different values in different segments of the multimedia content;

retrieve metadata associated with the at least two watermark messages using the payloads of the at least two extracted watermark messages; and

process the retrieved metadata in conjunction with the determined separation to detect a change in arrangement of the multimedia content sections, wherein processing of the retrieved metadata includes one or both of;

comparison of the first field associated with the second extracted watermark message with the first field associated with the first extracted watermark message to detect a first difference value, or

comparison of the second field associated with the second extracted watermark message with the second field associated with the first extracted watermark message to detect a second difference value.

16. The device of claim 15, wherein the processor executable code, when executed by the processor, causes the processor to:

obtain an expected separation between the first and the second watermark messages using the first difference or the second difference values, and

identify the detected change as an insertion of one or more additional content sections into the multimedia content upon a determination that the expected separation has a value that is smaller than the value of the determined separation.

17. The device of claim 15, wherein the processor executable code, when executed by the processor, causes the processor to:

obtain an expected separation between the first and the second watermark messages using the first difference or the second difference values, and

identify the detected change is identified as a removal of one or more sections of the multimedia content upon a determination that the expected separation has a value that is larger than the value of the determined separation.

18. The device of claim 15, wherein:

the second difference value indicates a sequential ordering of the segments of the multimedia content, and

the processor executable code, when executed by the processor, causes the processor to identify the detected changes as reordering of sections of the multimedia content upon a determination that the sequential ordering according to the second difference value is different from an expected sequential ordering of the segments of the multimedia content.

19. The device of claim 15, wherein the separation between the first and the second watermark messages is determined based on relative locations of the first and the second extracted watermark messages within the multimedia content.

20. The device of claim 19, wherein the separation is determined in one of:

a temporal domain, a spatial domain, or a frequency domain.

21. The device of claim 15, wherein:

the processor executable code, when executed by the processor, causes the processor to determine the separation by aggregating all extracted watermark messages with a first identically valued second fields into a first aggregated segment, aggregating all extracted watermark messages with a second identically valued second fields into a second aggregated segment, and comparing a location of the first aggregated segment with a location of the second aggregated segment within the multimedia content.

22. The device of claim 21, wherein:

the retrieved metadata includes a duration field, and

the processor executable code, when executed by the processor, causes the processor to detect the change by determining an expected separation between the first and the second aggregated content segments using the duration field.

23. The device of claim 15, wherein the multimedia content includes one or more of:

an audio content, a video content or a still image.