DATA PROCESSING APPARATUS AND METHOD

• US 20090257618A1
• Filed: 12/06/2005
• Published: 10/15/2009
• Est. Priority Date: 12/09/2004
• Status: Abandoned Application

• Current Assignee: Sony United Kingdom Limited (Sony Group Corp.)
• Original Assignee: Sony United Kingdom Limited (Sony Group Corp.)
• Inventors: Tapson, Daniel Warren, Hooper, Daniel Luke
• Application Number:
  US11/721,343
• Publication Number:
  US 20090257618A1
• Time in Patent Office: Days
• US Class Current: 382/100
• CPC Class Codes: G06T 1/005 Robust watermarking, e.g. average attack or collusion attack resistant
• CPC Class Codes: G06T 2201/0051 Embedding of the watermark in the spatial domain
• CPC Class Codes: G06T 2201/0061 Embedding of the watermark in each block of the image, e.g. segmented watermarking
• CPC Class Codes: G06T 2201/0065 Extraction of an embedded watermark; Reliable detection
• CPC Class Codes: G06T 2201/0083 whereby only watermarked image required at decoder, e.g. source-based, blind, oblivious

Abstract

A data processing apparatus registers an image encoded with a two-dimensional water mark pattern. The water mark includes for each image frame a water mark frame pattern of water mark blocks. The water mark pattern includes plural regions each including one water mark block selected from a predetermined set of possible water mark blocks based on a key sequence. The key sequence provides a predetermined sequence of selected water mark blocks to form the water mark pattern of each frame to provide a predetermined sequence of water marked frames. The data processing apparatus includes a block match processor generating block match probabilities including for each region of a current frame of the water marked image a probability surface of possible distortion vectors for each possible water mark block of the set of possible water marked blocks that may have been added to that region of the image frame.

Claims

1. A data processing apparatus for registering an image which has been encoded with a two-dimensional water mark pattern, the water mark comprising for each frame of the image a water mark frame pattern of water mark blocks, the water mark pattern comprising a plurality of regions, each region of the pattern including one water mark block selected from a predetermined set of possible water mark blocks in accordance with a key sequence, the key sequence providing a predetermined sequence of selected water mark blocks to form the water mark pattern of each frame to provide a predetermined sequence of water marked frames, the data processing apparatus comprising

a block match processor operable

to generate block match probabilities comprising for each region of a current frame of the water marked image a probability surface of possible distortion vectors for each possible water mark block of the set of possible water marked blocks which may have been added to that region of the image frame,

a water mark block prior probability calculator operable

to form block prior probabilities providing for each region of the current frame of the watermarked image a probability value for each of the possible water mark blocks of the set which may be present in the region using current frame number prior probability value estimates, providing for each possible frame in the predetermined sequence of frames a probability that the frame in the sequence is the current frame of the water marked image,

a distortion probability calculator operable

to form a spatial prior probability surface for each region of the current image frame from the block prior probabilities and the block match probabilities, providing a probability distribution of distortion vectors for the region,

a markov distortion processor operable

to adapt the spatial prior probability surface for each region of the current water marked image frame pattern with respect to other the probability surface of each of the other regions in the frame following to a predetermined path through the pattern,

to form for each region a current spatial extrinsic probability surface,

to form an estimate of a distortion vector for each region from the adapted spatial prior probabilities, and

a frame number probability calculator is operable

to combine the spatial extrinsic probability surface for each region with the block match probability surface for each of the possible water mark blocks for the region,

to form a block extrinsic probability value for each possible water mark block which may be present in the region of the current image frame,

to calculate a frame number extrinsic probability value of each of the possible frames in the sequence that the current frame is that frame, by combining the block extrinsic values with the probability of the water mark block for each region, and

to update the current frame number prior probability value estimates from the frame number extrinsic probabilities.

2. A data processing apparatus as claimed in claim 1, wherein the water mark block prior probability calculator is operable to calculate the block prior probabilities by

regenerating each possible water mark frame pattern for each frame in the predetermined sequence of frames,

defining for each region of each re-generated water mark frame a presence probability value representing the presence or absence of each possible block of the set of water mark blocks in each region of the water mark frame pattern,

combining each region presence probability of each of the water mark frame patterns with a frame probability value estimate that the re-generated water mark frame pattern is the current frame of the water marked image, to form the block prior probabilities providing for each region of the cu rent frame of the watermarked image a probability value for each of the possible water mark blocks of the set which may be present in the region.

3. A data processing apparatus as claimed in claim 1, wherein the distortion probability calculator is operable to calculate the spatial prior probability

by combining the block prior probabilities with the block match probability surfaces, by

multiplying a probability of each of the possible water mark blocks of the set for each region with the corresponding block match probability surface for the block from the set provided by the block match processor, and combining each of the resulting probability surfaces, to form the spatial prior probability surface for each region of the current image frame providing a probability distribution of distortion vectors for the region.

4. A data processing apparatus as claimed in claim 1, wherein the frame number probability calculator is operable to calculate the frame number extrinsic probabilities by

re-generating each possible water mark frame patter for each frame in the predetermined sequence of frames,

defining for each region of each regenerated water mark frame a presence probability value representing the presence or absence of each possible block of the set of water mark blocks in each region of the water mark frame patterns,

combining the block extrinsic values with the presence probability value of the water mark block for each region to form the frame number extrinsic probability value of each of the possible frames in the sequence that the current frame is that frame in the sequence.

5. A data processing apparatus as claimed in claim 4, wherein the frame number probability calculator is operable

to define the presence probability by forming a reference mask comprising for each region of the water mark pattern a sample value for each possible block in the set of blocks,

to take the logarithm of the block extrinsic probabilities, and

to convolve the reference mask with the logarithm of the block extrinsic probabilities to form an intermediate result, and

to take an inverse logarithm of the intermediate result to form the frame number extrinsic probabilities.

6. A data processing apparatus as claimed in claim 1, wherein the distortion probability calculator includes a data store for storing an accumulated spatial prior probability surfaces formed from previous frames, the distortion probability calculator being operable

to retrieve from the store the accumulated spatial prior probability surfaces for the previous water marked image frames,

to combine the spatial prior probability surface for the current frame with the accumulated spatial prior probability surface to form an intermediate spatial prior probability surface,

to filter the intermediate spatial prior probability surface with a transition filter, to form the current accumulated spatial prior probabilities, and

to store the current accumulated spatial prior probabilities in the data store.

7. A data processing apparatus as claimed in claim 1, wherein the image which has been encoded with a two-dimensional water mark pattern, in which the order of the blocks of the water mark pattern are scrambled with a scrambling code, and the water mark block prior probability calculator is operable to scramble the block prior probabilities before the distortion probability calculator forms the spatial prior probabilities by combining the block prior probabilities and the block match probabilities,

and the frame number probability calculator is operable to unscramble the block extrinsic probabilities before combining the block extrinsic probabilities with the probability of the water mark block for each region to form the frame number extrinsic probabilities.

8. A data processing apparatus, wherein the frame number probability calculator is operable to identify one or more best estimates of the current frame number from one or more frame number having higher probability values with respect to other frame numbers.

9. An encoding data processor operable to form a water marked image, the encoding data processor comprising

a sequence generator operable to generate a sequence of block selection values, each selection value identifying one of a predetermined set of water mark blocks,

a water mark frame pattern for er operable to form the blocks identified by the key sequence into a two-dimensional water mark pattern providing a plurality of regions, each of the blocks identified by the key sequence being provided for one of the regions of the pattern, and

a combiner operable to combine each water mark pattern with one of a number of frames forming a predetermined sequence of frames, wherein the length of the key sequence is predetermined and in accordance with the number of regions per water mark pattern, a different water mark pattern is provided for each of the image frames in the predetermined sequence of image frames.

10. An encoding data processor as claimed in claim 9, comprising

a scrambler operable to change the order of the water mark blocks in each of the water mark patterns for each frame in accordance with a scrambling code, before the scrambled water mark pattern is combined with the image frame.

11. A method of registering an image which has been encoded with a two-dimensional water mark pattern, the water mark comprising, for each frame of the image a water mark frame pattern of water mark blocks, the water mark patter comprising a plurality of regions, each region of the pattern including one water mark block selected from a predetermined set of possible water mark blocks in accordance with a key sequence, the key sequence providing a predetermined sequence of selected water mark blocks to form the water mark pattern of each frame to provide a predetermined sequence of water marked frames, the method comprising

generating block match probabilities comprising for each region of a current frame of the water marked image a probability surface of possible distortion vectors for each possible water mark block of the set of possible water marked blocks which may have been added to that region of the image frame,

forming block prior probabilities providing for each region of the current frame of the watermarked image a probability value for each of the possible water mark blocks of the set which may be present in the region using current frame number prior probability value estimates, providing for each possible frame in the predetermined sequence of frames a probability that the frame in the sequence is the current frame of the water marked image,

forming a spatial prior probability surface for each region of the current image frame from the block prior probabilities and the block match probabilities providing a probability distribution of distortion vectors for the region,

adapting the spatial prior probability surface for each region of the current water marked image frame pattern with respect to other the probability surface of each of the other regions in the frame following to a predetermined path through the pattern,

forming for each region a current spatial extrinsic probability surface,

forming an estimate of a distortion vector for each region from the adapted spatial prior probabilities, and

combining the spatial extrinsic probability surface for each region with the block match probability surface for each of the possible water mark blocks for the region

forming a block extrinsic probability value for each possible water mark block which may be present in the region of the current image frame,

calculating a frame number extrinsic probability value of each of the possible frames in the sequence that the current frame is that frame, by combining the block extrinsic values with the probability of the water mark block for each region, and

updating the current frame number prior probability value estimates from the frame number extrinsic probabilities.

15. A computer program providing computer executable instructions, which when loaded on to a data processor causes the data processor to perform the method according to claim 11.

16. A computer program product having a computer readable medium having recorded thereon information signals representative of the computer program claimed in claim 15.

17. A carrying medium bearing a computer program as claimed in claim 15.

12. A method of forming a water marked image, the method comprising

generating a sequence of block selection values, each selection value identifying one of a predetermined set of water mark blocks,

forming the blocks identified by the key sequence into a two-dimensional water mark pattern providing a plurality of regions, each of the blocks identified by the key sequence being provided for one of the regions of the pattern, and

combining each water mark pattern with one of a number of frames forming a predetermined sequence of frames, wherein the length of the key sequence is predetermined and in accordance with the number of regions per water mark pattern, a different water mark pattern is provided for each of the image frames in the predetermined sequence of image frames.

20. A computer program providing computer executable instructions, which when loaded on to a data processor causes the data processor to perform the method according to claim 12.

21. A computer program product having a computer readable medium having recorded thereon information signals representative of the computer program claimed in claim 20.

22. A carrying medium bearing a computer program as claimed in claim 20.

13. A data processing apparatus for registering an image which has been encoded with a two-dimensional water mark pattern, the water mark comprising, for each frame of the image a water mark frame pattern of water mark blocks, the water mark pattern comprising a plurality of regions, each region of the pattern including one water mark block selected from a predetermined set of possible water mark blocks, the data processing apparatus comprising

a block match processor operable

to generate block match probabilities comprising for each region of a frame of the water marked image a probability surface of possible distortion vectors for each possible water mark block of the set of possible water marked blocks which may have been added to that region of the image frame,

a water mark block prior probability calculator operable

to form block prior probabilities providing for each region of the frame of the watermarked image a probability value for each of the possible water mark blocks of the set which may be present in the region,

a distortion probability calculator operable

to form a spatial prior probability surface for each region of the current image frame from the block prior probabilities and the block match probabilities, providing a probability distribution of distortion vectors for the region,

a markov distortion processor operable

to adapt the spatial prior probability surface for each region of the water marked image frame pattern with respect to other the probability surface of each of the other regions in the frame following to a predetermined path through the pattern,

to form for each region a current spatial extrinsic probability surface, and

to form an estimate of a distortion vector for each region from the adapted spatial prior probabilities, and

to process the water marked image to the effect of reducing distortion in accordance with the estimated distortion probability vectors.

14. A data processing apparatus as claimed in claim 13, comprising

a frame number probability calculator is operable

to combine the spatial extrinsic probability surface for each region with the block match probability surface for each of the possible water mark blocks for the region,

to form a block extrinsic probability value for each possible water mark block which may be present in the region of the current image frame,

to calculate a frame number extrinsic probability value of each possible frame in a sequence of frames that the current frame is that frame, by combining the block extrinsic values with the probability of the water mark block for each region, and

to update the current frame number prior probability value estimates from the frame number extrinsic probabilities.

18-19. -19. (canceled)