Efficient watermarking approaches of compressed media

• US 8,995,711 B2
• Filed: 08/16/2013
• Issued: 03/31/2015
• Est. Priority Date: 07/03/2008
• Status: Active Grant

• Current Assignee: Verimatrix Incorporated (Verimatrix SA)
• Original Assignee: Verimatrix Incorporated (Verimatrix SA)
• Inventors: Thorwirth, Niels J.
• Primary Examiner(s): Alavi, Amir
• Application Number:
  US13/969,405
• Publication Number:
  US 20130329941A1
• Time in Patent Office: 592 Days
• Field of Search: 382/100, 382118-120, 382/212, 382/232, 382248-250, 382/276, 382/280, 382/284, 382/293, 382/296, 380/54, 380/210, 380/252, 380/287, 713/176
• US Class Current: 382/100
• CPC Class Codes: G06T 1/0092 Payload characteristic determination in a watermarking scheme, e.g. number of bits to be embedded
• CPC Class Codes: H04N 19/467 characterised by the embedded information being invisible, e.g. watermarking

Abstract

Systems and methods are described for imperceptibly embedding information by identifying locations that can be imperceptibly modified, where the imperceptible modification by replacing original content using replacement content derived from elsewhere in the compressed bitstream to remove at least a portion of the original content, generating at least one piece of replacement data for each identified location, where overwriting a portion of the compressed bitstream with replacement data prevents a decoder from decoding original content due to decoding replacement content derived from elsewhere in the compressed bitstream, selecting pieces of replacement data using an embedding device, where overwriting portions of the compressed bitstream using pieces of replacement data encodes payload information in accordance with a predetermined coding scheme, and embedding the payload information in the compressed bitstream by using the embedding device to overwrite at least a portion of the compressed bitstream with the selected replacement data.

Claims

1. A method of imperceptibly embedding information in a compressed video bitstream, comprising:

analyzing the compressed bitstream using a pre-processor to identify locations that can be imperceptibly modified, where the imperceptible modification includes replacing original content using replacement content derived from elsewhere in the compressed bitstream;

selecting using the pre-processor one or more of the identified locations to be modified;

generating at least one piece of replacement data for each selected location using the pre-processor, where overwriting a portion of the compressed bitstream at a selected location with a piece of replacement data causes a decoder to decode the replacement data instead of the overwritten portion of the compressed bitstream;

selecting pieces of replacement data using an embedding device, where each selected piece of replacement data corresponds to a selected location in the compressed bitstream; and

embedding the payload information in the compressed bitstream in accordance with a predetermined coding scheme by using the embedding device to overwrite the selected locations in the compressed bitstream with the selected pieces of replacement data.

2. The method of claim 1, wherein the replacement data is stored on a physical media with the compressed video stream.

3. The method of claim 1, wherein the embedding device is a media server configured to transmit the compressed bitstream to a decoder, and the method further comprises:

generating payload information using the media server, where the payload information is indicative of a decoder that requests the transmission of the compressed bitstream; and

transmitting the compressed bitstream in which the payload information is embedded to the decoder using the media server.

4. The method of claim 1, wherein the embedding device is a decoder configured to receive the compressed bitstream and the replacement data, and the method further comprises:

decoding the video in the compressed bitstream after the decoder has embedded the payload information; and

outputting the decoded video to a rendering device using the decoder.

5. The method of claim 4, wherein the unmodified compressed bitstream is transmitted as broadcast to the decoder.

6. The method of claim 4, wherein:

generating at least one piece of replacement data for each selected location using the pre-processor comprises securing the at least one piece of replacement data using the secret key.

7. The method of claim 1, wherein the embedding device comprises a media server and a decoder, and the decoder selects the pieces of replacement data used to embed the payload information, and embedding the payload information in the compressed bitstream further comprises:

overwriting portions of the compressed bitstream with portions from a plurality of the generated pieces of replacement data so that a decoder cannot decode the original content in the overwritten locations without perceptible errors;

transmitting from the media server to the decoder the compressed bitstream, the original overwritten portions of the compressed bitstream and the portions of the generated pieces of replacement data that were not used by the media server in the overwriting of the compressed bitstream; and

embedding the payload information in accordance with the predetermined coding scheme by;

overwriting portions of the compressed bitstream using portions of the generated pieces of replacement data that were not used by the media server in the overwriting of the compressed bitstream, where the portions the decoder uses to overwrite the compressed bitstream are from the generated pieces of replacement data selected by the decoder; and

overwriting portions of replacement data within the compressed bitstream using the original overwritten portions of the compressed bitstream, where the portions of replacement data within the compressed bitstream that are overwritten by the decoder are from the generated pieces of replacement data that were not selected by the decoder.

8. The method of claim 1, wherein analyzing the compressed bitstream using a pre-processor to identify locations that can be imperceptibly modified further comprises identifying at least a portion of a video frame from within the compressed bitstream that can be imperceptibly modified, where the imperceptible modification includes replacing at least a portion of the original content of the video frame using replacement content derived from at least one other frame in the compressed bitstream.

9. The method of claim 1, wherein the replacement content is the average of the content of the previous and subsequent video frames.

10. The method of claim 8, wherein the replacement content is derived by adding delta additions to the at least one other frame in the compressed bitstream.

11. The method of claim 10, wherein the delta additions contain visible watermark patterns.

12. The method of claim 10, wherein the delta additions contain imperceptible watermark patterns.

13. The method of claim 10, further comprising subtracting a frame from a replacement frame using an extractor to derive the delta additions without video content that is noise to the extractor.

14. The method of claim 1 further comprising generating at least one piece of helper data for each selected location using the pre-processor, where each piece of helper data is derived using at least part of the original content at the corresponding selected location.

15. The method of claim 14, where playing back content from the compressed bitstream contains perceptible errors unless the at least one piece of helper data is applied to the corresponding selected locations.

16. The method of claim 14, where the helper data is marked as private data so that it is ignored by a regular decoder.

17. The method of claim 14 further comprising:

sending the at least one piece of helper data and at least a portion of the compressed bistream to a client device; and

overwriting the selected locations in the compressed bitstream with the at least one piece of helper data.

18. The method of claim 14 further comprising removing data from the compressed bitstream so that embedding the payload information in the compressed bitstream does not increase the file size.

19. The method of claim 1, wherein the compressed bitstream is encrypted and the pieces of replacement data are encrypted using the same key and encryption mechanism as the compressed bitstream.

20. The method of claim 1, wherein the compressed bitstream is encrypted except the selected locations to be modified remain unencrypted.

21. The method of claim 1, wherein embedding the payload information in the compressed bitstream applies part of a modification and renders the compressed bitstream unplayable by a decoder until the decoder applies the remainder of the modification.

22. The method of claim 1, wherein the at least one piece of replacement data is generated in a first location and transmitted to a second location.

23. The method of claim 1, further comprising storing the locations of areas that can be modified and instructions to exchange data depending on the information to be embedded in a separate file.

24. The method of claim 1 wherein the selected locations comprise one or more macroblocks and the predetermined coding scheme comprises which frame and which macroblock within the frame to copy replacement data from.

25. The method of claim 1, wherein embedding the payload information in the compressed bitstream in accordance with a predetermined coding scheme comprises encoding an N-ary value is encoded by the position of a modification out of N possible locations.

26. The method of claim 1, wherein the embedding device is a media server configured to transmit the compressed bitstream to a decoder, and the method further comprises:

assigning a unique identifier to the decoder;

storing several bitstream files with unique identifiers; and

transmitting the compressed bitstream and replacement data to the decoder using the media server.