Steganographic encoding and decoding

• US 9,607,350 B2
• Filed: 03/07/2016
• Issued: 03/28/2017
• Est. Priority Date: 07/02/2004
• Status: Active Grant

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Reed, Alastair M., Sharma, Ravi K., Rodriguez, Tony F.
• Primary Examiner(s): Johns, Andrew W
• Application Number:
  US15/063,131
• Publication Number:
  US 20160350889A1
• Time in Patent Office: 386 Days
• US Class Current: 1/1
• CPC Class Codes: G06T 1/0021 Image watermarking
• CPC Class Codes: G06T 1/005 Robust watermarking, e.g. average attack or collusion attack resistant
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 2201/0083 whereby only watermarked image required at decoder, e.g. source-based, blind, oblivious
• CPC Class Codes: H04N 1/32144 embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
• CPC Class Codes: H04N 1/32267 combined with processing of the image
• CPC Class Codes: H04N 1/32309 in colour image data
• CPC Class Codes: H04N 1/6005 with luminance or chrominance signals, e.g. LC1C2, HSL or YUV
• CPC Class Codes: H04N 1/6008 with primary colour signals, e.g. RGB or CMY(K)
• CPC Class Codes: H04N 2201/3228 further additional information (metadata) being comprised in the identification information
• CPC Class Codes: H04N 2201/3233 of authentication information, e.g. digital signature, watermark
• CPC Class Codes: H04N 2201/327 which are undetectable to the naked eye, e.g. embedded codes

Abstract

This patent document relates generally to encoded information and digital watermarking. One claim recites an image capture device comprising: an optical system; an image sensor on a substrate for capturing imagery provided by the optical system, in which captured imagery includes encoded information, and in which the captured imagery comprises first color information, second color information and third color information; means for compressing the captured imagery captured by said image sensor; means for detecting the encoded information from the captured imagery, in which said detecting utilizes different color information weightings so that at least the first color information and the third color information are weighted differently than one another for detection of the encoded information; and means for providing the encoded information for output or display, once the encoded information is detected. Of course, other claims and combinations are provided as well.

Claims

1. An image capture device comprising:

an optical system;

an image sensor on a substrate for capturing imagery provided by the optical system, in which captured imagery includes encoded information, and in which the captured imagery comprises first color information, second color information and third color information;

a compression module for compressing the captured imagery captured by said image sensor, in which the compression module transforms the captured imagery into compressed captured imagery;

one or more processors configured for;

detecting the encoded information from the compressed captured imagery, in which said detecting utilizes different color information weightings so that at least the first color information and the third color information are weighted differently than one another for detection of the encoded information; and

once detected, providing the encoded information for output or display.

2. The image capture device of claim 1, in which the first color information comprises red color information, and the third color information comprises blue color information.

3. The image capture device of claim 2 in which the red color information is more heavily weighted compared to the blue color information.

4. The image capture device of claim 3 in which the weightings comprise a 4:

1;

1 ratio across compressed versions of the first color information, the second color information and the third color information.

5. The image capture device of claim 1 in which said one or more processors are configured for adjusting the color information weightings prior to detecting to compensate for noise or compression in the compressed captured imagery.

6. The image capture device of claim 1 in which said one or more processors are configured for estimating relative noise included in different color information of the compressed captured imagery, and adjusting the color information weightings based on a relative noise estimate prior to the detecting.

7. The image capture device of claim 6 in which said one or more processors are configured for estimating sampling rates corresponding to the captured imagery, and in which the adjusting adjusts based on both the relative noise estimate and on a sampling rate estimate.

8. The image capture device of claim 1 in which said one or more processors are configured for measuring an encoded information detection rate of the compressed captured imagery, and adjusting the weightings according to a measurement.

9. The image capture device of claim 1 in which said one or more processors are configured for updating the color information weightings according to a different set of weightings, in which the different set of weightings corresponds with sampled image sensor characteristics.

10. An image capture device comprising:

an optical system;

an image sensor on a substrate for capturing imagery provided by the optical system, in which captured imagery includes encoded information, and in which the captured imagery comprises first color information, second color information and third color information;

means for compressing the captured imagery to yield compressed captured imagery;

means for detecting the encoded information from the compressed captured imagery, in which said means for detecting utilizes different color information weightings so that at least the first color information and the third color information are weighted differently than one another for detection of the encoded information; and

means for providing the encoded information for output or display, once the encoded information is detected.

11. The image capture device of claim 10, in which the first color information comprises red color information, and the third color information comprises blue color information.

12. The image capture device of claim 11 in which the red color information is more heavily weighted compared to the blue color information.

13. The image capture device of claim 12 in which the weightings comprise a 4:

1;

1 ratio across compressed versions of the first color information, the second color information and the third color information, in which the second color information comprises green color information.

14. The image capture device of claim 10 further comprising means for adjusting the color information weightings prior to detecting to compensate for noise or compression in the compressed captured imagery.

15. The image capture device of claim 10 further comprising means for estimating relative noise included in different color information of the compressed captured imagery, and means for adjusting the color information weightings based on a relative noise estimate prior to the detecting.

16. The image capture device of claim 15 further comprising means for estimating sampling rates corresponding to the captured imagery, and in which the means for adjusting adjusts based on both the relative noise estimate and on a sampling rate estimate.

17. The image capture device of claim 10 further comprising means for measuring an encoded information detection rate of the compressed captured imagery, and means for adjusting the weightings according to a measurement.

18. The image capture device of claim 10 further comprising means for updating the color information weightings according to a different set of weightings, in which the different set of weightings corresponds with sampled image sensor characteristics.

19. A method comprising:

obtaining image data captured by an optical system, the image data including encoded information, and in which the image data comprises first color information, second color information and third color information;

transforming the image data through compression to produce compressed image data, the compressed image data comprising compressed versions of the first color information, second color information and third color information;

extracting the encoded information from the compressed image data, in which said extracting utilizes color information weightings so that at least the compressed versions of the first color information and the third color information are weighted differently than one another for extraction of the encoded information; and

once extracted, providing the encoded information for output or display.

20. The method of claim 19 in which the first color information comprises red color information, and the third color information comprises blue color information.

21. The method of claim 20 in which the compressed version of the red color information is weighted more relative to the compressed version of the blue color information.

22. The method of claim 21 in which the color information weightings comprise a 4:

1;

1 ratio across the compressed versions of the first color information, the second color information and the third color information.

23. The method of claim 19 further comprising changing the color information weightings prior to said extracting to compensate for noise or compression in the compressed image data.

24. The method of claim 19 further comprising estimating relative noise across the compressed versions of the first color information, second color information and third color information, and changing the color information weightings based on a relative noise estimate prior to the extracting.

25. The method claim 24 further comprising determining sampling rates corresponding to the image data, and in which said changing utilizes both the relative noise estimate and on a sampling rate estimate.

26. The method of claim 19 further comprising determining an encoded information detection rate of the compressed image data, and adjusting the weightings according to a determined detection rate.

27. The method of claim 19 further comprising altering the color information weightings according to sampled image sensor characteristics.