Data processing apparatus and method

• US 7,609,850 B2
• Filed: 12/07/2005
• Issued: 10/27/2009
• Est. Priority Date: 12/09/2004
• Status: Expired due to Fees

• Current Assignee: Sony United Kingdom Limited (Sony Group Corp.)
• Original Assignee: Sony United Kingdom Limited (Sony Group Corp.)
• Inventors: Tapson, Daniel Warren
• Primary Examiner(s): BHATNAGAR, ANAND P
• Application Number:
  US11/296,797
• Publication Number:
  US 20060126892A1
• Time in Patent Office: 1,420 Days
• Field of Search: 382/100, 382/232, 380/54, 380/210, 380/252, 713/176, 348/460, 348/463, 381/73.1, 704/200.1, 704/273
• US Class Current: 382/100
• CPC Class Codes: G06T 1/005 Robust watermarking, e.g. average attack or collusion attack resistant
• CPC Class Codes: G06T 2201/0051 Embedding of the watermark in the spatial domain
• CPC Class Codes: G06T 2201/0061 Embedding of the watermark in each block of the image, e.g. segmented watermarking
• CPC Class Codes: G06T 2201/0065 Extraction of an embedded watermark; Reliable detection
• CPC Class Codes: G06T 2201/0081 whereby both original and watermarked images are required at decoder, e.g. destination-based, non-blind, non-oblivious
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: H04N 1/32154 Transform domain methods H04N1/32309 takes precedence
• CPC Class Codes: H04N 2201/3233 of authentication information, e.g. digital signature, watermark
• CPC Class Codes: H04N 2201/327 which are undetectable to the naked eye, e.g. embedded codes

Abstract

A data processing apparatus includes a registration processor that divides a frame of a water marked image into a plurality of image blocks. For each of the image blocks, an observed probability of possible distortion vectors representing shifts of the image block with respect to positions of the block in the original version of the image is estimated. For each of the image blocks, forward and backward probability distribution estimates of possible distortion vectors within the image block are generated recursively from the respective observed probability of distortion vectors for the image block and forward and backward probability distribution estimates determined respectively from previous and subsequent image blocks for a predetermined path through the blocks. For each image block, the forward and backward probability distribution estimates and the observed probability of distortion vector are combined to form a most likely distortion vector estimate.

Claims

1. A data processing apparatus for detecting at least one of a set of code words which has been embedded in a water marked version of an image, the apparatus comprising:

a registration processor operable to register the water marked version of the image and an original version of the image with respect to one another; and

a detection processor operable to recover an estimate of the at least one of the set of code words from the water marked version of the image by comparing the water marked version of the image with the original version of the image, and to detect the at least one of the set of code words by correlating each of the set of code words with the at least one of the set of code words, wherein

the registration processor includes,

an image analyser operable to divide a frame of the water marked version of the image into a plurality of image blocks,

a distortion vector probability estimator operable to estimate for each of the plurality of image blocks of the water marked version of the image an observed probability of possible distortion vectors representing shifts of the image block with respect to positions of the image block in the original version of the image,

a forward probability estimator operable, for each of the plurality of image blocks, to generate an estimate of a forward probability distribution of the possible distortion vectors within the image block recursively from the observed probability of possible distortion vectors for the image block and forward probability distribution estimates determined from previous image blocks for a predetermined path through the plurality of image blocks,

a backward probability estimator operable, for each of the plurality of image blocks, to generate an estimate of a backward probability distribution of the possible distortion vectors within the image block recursively from the observed probability of possible distortion vectors for the image block and backward probability distribution estimates determined from subsequent image blocks for a predetermined pattern,

a combining engine operable to combine for each of the plurality of image blocks, the estimate of the forward probability distribution, the estimate of the backward probability distribution, and the observed probability of possible distortion vectors to form a most likely distortion vector estimate, and to form a map of distortion vectors from the most likely distortion vector estimate for each of the plurality of image blocks, and

an inverse distortion engine operable to apply a reverse of the map of distortion vectors to register the water marked version of the image with the original version of the image to detect the at least one of the set of code words.

2. The data processing apparatus as claimed in claim 1, wherein the inverse distortion engine comprises:

a modelling processor operable to generate a modelling function which best fits the map of distortion vectors, the modelling function representing a distortion present in the water marked version of the image; and

a re-sampler operable to re-sample the water marked version of the image to register the water marked version of the image with the original version of the image.

3. The data processing apparatus as claimed in claim 2, wherein the re-sampler is operable to re-sample pixels of the water marked version of the image to reverse the distortion according to the modelling function.

4. The data processing apparatus as claimed in claim 1, further comprising:

a second forward probability estimator operable, for each of the plurality of image blocks, to generate a second estimate of the forward probability distribution of the possible distortion vectors within the image block recursively from the most likely distortion vector estimate for the image block and forward probability distribution estimates determined from previous image blocks for a second predetermined pattern through the plurality of image blocks, the predetermined pattern including a first predetermined pattern and the second predetermined pattern; and

a second backward probability estimator operable, for each of the plurality of image blocks, to generate a second estimate of the backward probability distribution of the possible distortion vectors within the image block recursively from the most likely distortion vector estimate for the image block and backward probability distribution estimates determined from subsequent image blocks for the second predetermined pattern, wherein

the combining engine is operable to combine the second estimate of the forward probability distribution with the second estimate of the backward probability distribution and the most likely distortion vector estimate to form a refined distortion probability map providing a refinement of the distortion vectors, and

the inverse distortion engine being operable to apply a reverse of the refined distortion probability map to register the water marked version of the image with the original version of the image.

5. The data processing apparatus as claimed in claim 4, wherein

the first predetermined pattern identifies the image blocks for processing row-by-row, and

the second predetermined pattern identifies the image blocks for processing column-by-column.

6. The data processing apparatus as claimed in claim 4, wherein

at least one of the forward probability estimator and the second forward probability estimator includes a filter configured to adjust a respective one of the estimate of the forward probability distribution and the second estimate of the forward probability distribution of the possible distortion vectors in accordance with a predetermined probability distribution, effecting a likelihood of the respective one of the estimate of the forward probability distribution and the second estimate of the forward probability distribution occurring, and

at least one of the backward probability estimator and the second backward probability estimator includes a filter configured to adjust a respective one of the estimate of the backward probability distribution and the second estimate of the backward probability distribution of the possible distortion vectors in accordance with the predetermined probability distribution, effecting a likelihood of the respective one of the estimate of the backward probability distribution and the second estimate of the backward probability distribution occurring.

7. The data processing apparatus as claimed in claim 6, wherein the predetermined probability distribution is a Gaussian distribution.

8. A method for an image processing apparatus of detecting at least one of a set of code words which has been embedded in a water marked version of an image, the method comprising:

registering, with the image processing apparatus, the water marked version of the image and an original version of the image with respect to one another;

recovering, with the image processing apparatus, an estimate of the at least one of the set of code words from the water marked version of the image by comparing the water marked version of the image with the original version of the image; and

detecting the at least one of the set of code words with the image processing apparatus by correlating each of the set of code words with the at least one of the set of code words, wherein

the registering the water marked version of the image and the original version of the image comprises,

dividing, with the image processing apparatus, a frame of the water marked version of the image into a plurality of image blocks,

estimating, with the image processing apparatus, for each of the plurality of image blocks of the water marked version of the image, an observed probability of possible distortion vectors representing shifts of the image block with respect to positions of the image block in the original version of the image,

generating, with the image processing apparatus, for each of the plurality of image blocks, an estimate of a forward probability distribution of the possible distortion vectors within the image block recursively from the observed probability of possible distortion vectors for the image block and forward probability distribution estimates determined from previous image blocks for a predetermined path through the plurality of image blocks,

generating, with the image processing apparatus, for each of the plurality of image blocks, an estimate of a backward probability distribution of the possible distortion vectors within the image block recursively from the observed probability of possible distortion vectors for the image block and backward probability distribution estimates determined from subsequent image blocks for a predetermined pattern,

combining for each of the plurality of image blocks the estimate of the forward probability distribution, the estimate of the backward probability distribution, and the observed probability of possible distortion vectors with the image processing apparatus to form a most likely distortion vector estimate,

forming, with the image processing apparatus, a map of distortion vectors from the most likely distortion vector estimate for each of the plurality of image blocks, and

applying, with the image processing apparatus, a reverse of the most likely distortion vector for each of the plurality of image blocks by re-sampling the water marked version of the image to register the water marked version of the image with the original version of the image to detect the at least one of the set of code words.

9. The method as claimed in claim 8, wherein the applying the reverse of the most likely distortion vector comprises:

generating a modelling function which best fits the map of distortion vectors, the modelling function representing a distortion present in the water marked version of the image; and

re-sampling the water marked version of the image to register the water marked version of the image with the original version of the image.

10. The method as claimed in claim 9, wherein the re-sampling comprises:

re-sampling pixels of the water marked version of the image to reverse the distortion according to the modelling function.

11. The method as claimed in claim 8, further comprising:

generating for each of the plurality of image blocks a second estimate of the forward probability distribution of the possible distortion vectors within the image block from the most likely distortion vector for the image block and forward probability distribution estimates determined from previous image blocks for a second predetermined pattern through the plurality of image blocks, the predetermined pattern including a first predetermined pattern and the second predetermined pattern;

generating for each of the plurality of image blocks a second estimate of the backward probability distribution of the possible distortion vectors within the image block from the most likely distortion vector for the image block and backward probability distribution estimates determined from subsequent image blocks for the second predetermined pattern;

combining the second estimate of the forward probability distribution with the second estimate of the backward probability distribution and the most likely distortion vector to form a refined distortion probability map providing a refinement of the distortion vectors; and

applying a reverse of the refined distortion probability map to register the water marked version of the image with the original version of the image.

12. The method as claimed in claim 11, wherein

the first predetermined pattern identifies the image blocks for processing row-by-row, and

the second predetermined pattern identifies the image blocks for processing column-by-column.

13. The method as claimed in claim 8, further comprising:

adjusting the estimate of the forward probability distribution in accordance with a predetermined probability distribution, effecting a likelihood of the estimate of the forward probability distribution occurring; and

adjusting the backward probability distribution in accordance with the predetermined probability distribution, effecting a likelihood of the estimate of the backward probability distribution occurring.

14. The method as claimed in claim 13, wherein the predetermined probability distribution is a Gaussian distribution.

15. A computer readable medium having recorded thereon a computer program providing computer executable instructions, which when loaded on to a data processor, cause the data processor to perform a method comprising:

registering a water marked version of an image and an original version of the image with respect to one another;

recovering an estimate of at least one of a set of code words embedded in the water marked version of the image by comparing the water marked version of the image with the original version of the image; and

detecting the at least one of the set of code words by correlating each of the set of code words with the at least one of the set of code words, wherein

the registering the water marked version of the image and the original version of the image includes,

dividing a frame of the water marked version of the image into a plurality of image blocks,

estimating, with the data processor, for each of the plurality of image blocks of the water marked version of the image, an observed probability of possible distortion vectors representing shifts of the image block with respect to positions of the image block in the original version of the image,

generating, with the data processor, for each of the plurality of image blocks, an estimate of a forward probability distribution of the possible distortion vectors within the image block recursively from the observed probability of possible distortion vectors for the image block and forward probability distribution estimates determined from previous image blocks for a predetermined path through the plurality of image blocks,

generating, with the data processor, for each of the plurality of image blocks, an estimate of a backward probability distribution of the possible distortion vectors within the image block recursively from the observed probability of possible distortion vectors for the image block and backward probability distribution estimates determined from subsequent image blocks for a predetermined pattern,

combining for each of the plurality of image blocks the estimate of the forward probability distribution, the estimate of the backward probability distribution, and the observed probability of possible distortion vectors, with the data processor, to form a most likely distortion vector estimate,

forming a map of distortion vectors from the most likely distortion vector estimate for each of the plurality of image blocks, and

applying a reverse of the most likely distortion vector for each of the plurality of image blocks by re-sampling the water marked version of the image to register the water marked version of the image with the original version of the image to detect the at least one of the set of code words.