Information coding and decoding in spectral differences

• US 10,447,888 B2
• Filed: 05/21/2018
• Issued: 10/15/2019
• Est. Priority Date: 06/07/2013
• Status: Active Grant

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Rhoads, Geoffrey B., Reed, Alastair M.
• Primary Examiner(s): Yang, Wei Wen
• Application Number:
  US15/985,262
• Publication Number:
  US 20180376027A1
• Time in Patent Office: 512 Days
• Field of Search: None
• CPC Class Codes: A61B 5/0075 by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy A61B5/0071 takes precedence
• CPC Class Codes: G01J 3/0272 Handheld
• CPC Class Codes: G01J 3/2823 Imaging spectrometer
• CPC Class Codes: G01J 3/36 Investigating two or more bands of a spectrum by separate detectors
• CPC Class Codes: G01J 3/447 Polarisation spectrometry
• CPC Class Codes: G01J 3/51 using colour filters
• CPC Class Codes: G01J 3/513 having fixed filter-detector pairs
• CPC Class Codes: G06T 1/0028 Adaptive watermarking, e.g. Human Visual System [HVS]-based watermarking
• CPC Class Codes: G06T 2201/0051 Embedding of the watermark in the spatial domain
• CPC Class Codes: H04N 1/32144 embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
• CPC Class Codes: H04N 1/32309 in colour image data
• CPC Class Codes: H04N 21/8358 involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 2201/3233 of authentication information, e.g. digital signature, watermark
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means
• CPC Class Codes: H05B 45/22 using optical feedback

Abstract

Information is encoded in an image signal by exploiting spectral differences between colors that appear the same when rendered. These spectral differences are detected using image sensing that discerns the spectral differences. Spectral difference detection methods include using sensor-synchronized spectrally-structured-light imaging, 3D sensors, imaging spectrophotometers, and higher resolution Bayer pattern capture relative to resolution of patches used to convey a spectral difference signal.

Claims

1. A method of encoding a machine-readable data signal in an image, the method comprising, with a programmed processor:

generating an information signal comprising message symbols;

mapping message symbol elements of the information signal to insertion locations within a host image signal; and

at the insertion locations, inserting the information signal by computing values for controlling application of a spot color ink and a combination of process color inks, the values for controlling application of process color inks forming a spectral difference signal between process color ink applied at a first pixel location and spot color ink applied at a second pixel location to encode a message symbol element in relative spectral difference between the process color ink at the first pixel location and spot color ink at the second pixel location, the computing encoding a relative spectral difference at the first and second pixel locations that conveys the message symbol element within the host image, the spectral difference signal representing a distinguishable spectra between a spot color and a combination of process colors that appear similar in the human visual system;

wherein the relative spectral differences at the insertion locations comprise differences between spectral distributions of spot and process color inks at corresponding pairs or sets of locations.

2. The method of claim 1 wherein the mapping of message symbol elements comprises mapping discrete elements of the information signal to spatial locations within the host image signal.

3. The method of claim 2 wherein the mapping comprises mapping the discrete elements to plural dimensions of colors at the spatial locations.

4. The method of claim 2 wherein the spatial locations comprise regions of plural pixels in the host image signal.

5. The method of claim 1 wherein the process color inks comprise Cyan, Magenta and Yellow inks.

6. The method of claim 1 wherein values for controlling application of process color inks at a first insertion location are adjusted toward a first color combination to encode a first binary value of the information signal, and values for controlling application of process color inks at a second insertion location are adjusted toward a second color combination to encode a second binary value of the information signal.

7. The method of claim 1 wherein values for controlling application of process color inks at a first insertion location are adjusted toward a first color combination to encode a first M-ary value of the information signal, and values for controlling application of process color inks at a second insertion location are adjusted toward a second color combination to encode a second M-ary value of the information signal, and the M-ary value comprises more than two different data values.

8. A non-transitory computer readable medium, on which is stored instructions, which configure a processor to perform a method of encoding a machine-readable data signal in an image, the method comprising:

generating an information signal comprising message symbols;

mapping message symbol elements of the information signal to insertion locations within a host image signal; and

at the insertion locations, inserting the information signal by computing values for controlling application of a spot color ink and a combination of process color inks, the values for controlling application of process color inks forming a spectral difference signal between process color ink applied at a first pixel location and spot color ink applied at a second pixel location to encode a message symbol element in relative spectral difference between the process color ink at the first pixel location and spot color ink at the second pixel location, the computing encoding a relative spectral difference at the first and second pixel locations that conveys the message symbol element within the host image, the spectral difference signal representing a distinguishable spectra between a spot color and a combination of process colors that appear similar in the human visual system;

wherein the relative spectral differences at the insertion locations comprise differences between spectral distributions of spot and process color inks at corresponding pairs or sets of locations.

9. The computer readable medium of claim 8 wherein the mapping of message symbol elements comprises mapping discrete elements of the information signal to spatial locations within the host image signal.

10. The computer readable medium of claim 9 wherein the mapping comprises mapping the discrete elements to plural dimensions of colors at the spatial locations.

11. The computer readable medium of claim 9 wherein the spatial locations comprise regions of plural pixels in the host image signal.

12. The computer readable medium of claim 8 wherein the process color inks comprise Cyan, Magenta and Yellow inks.

13. The computer readable medium of claim 8 wherein values for controlling application of process color inks at a first insertion location are adjusted toward a first color combination to encode a first binary value of the information signal, and values for controlling application of process color inks at a second insertion location are adjusted toward a second color combination to encode a second binary value of the information signal.

14. The computer readable medium of claim 8 wherein values for controlling application of process color inks at a first insertion location are adjusted toward a first color combination to encode a first M-ary value of the information signal, and values for controlling application of process color inks at a second insertion location are adjusted toward a second color combination to encode a second M-ary value of the information signal, and the M- ary value comprises more than two different data values.

15. A method of decoding an information signal from an image comprising:

obtaining spectra of an image signal at locations within the image signal;

detecting a spectral difference at the locations by determining, at the locations, a relative difference between a spectral distribution of a combination of process inks and a spot color ink;

the process color inks forming a spectral difference signal between process color ink applied at a first pixel location and spot color ink applied at a second pixel location that encodes a message symbol element in relative spectral difference between the process color ink at the first pixel location and spot color ink at the second pixel location, the detecting comprising determining a relative spectral difference at the first and second pixel locations to extract the message symbol element from the host image, the spectral difference signal representing a distinguishable spectra between a spot color and a combination of process colors that appear similar in the human visual system;

wherein the relative spectral differences at the locations comprise differences between spectral distributions of spot and process color inks at corresponding pairs or sets of locations; and

decoding an information signal from the spectral difference by extracting message symbols from the message symbol elements extracted from relative differences between spectral distributions of the process and spot color inks, and error correction decoding a message from the message symbols.

16. The method of claim 15 wherein the detecting the spectral difference comprises determining whether a spectra at a location is one of a particular set of distinguishable spectra of a combination of process inks.

17. The method of claim 16 wherein the particular set of distinguishable spectra include a first spectra with a first shape, and a second spectra with a second shape.

18. The method of claim 17 wherein the first shape corresponds to a combination of process inks, and the second shape corresponds to a spot color ink.

19. The method of claim 15 wherein the combination of process color inks and the spot color appear similar to human vision yet have spectral differences, and detecting the spectral difference includes computing ratio of a measurement of reflectance of a combination of process color inks and reflectance of a spot color ink at plural different spectral bands.

20. The method of claim 15 wherein the spot color and combination of process color inks form a spatial arrangement of first or second visible inks of a metameric pair, which are similar as determined by a human vision model, yet have spectral differences that are detectable in the spectra of the image signal;

and obtaining the spectra of the image signal comprises capturing distinct image frames of an object, each being illuminated with different narrow band LED illumination.