Detecting conflicts between multiple different encoded signals within imagery

• US 9,690,967 B1
• Filed: 05/13/2016
• Issued: 06/27/2017
• Est. Priority Date: 10/29/2015
• Status: Active Grant

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Brundage, Trent J., Holub, Vojtech, Cushman, David A.
• Primary Examiner(s): Labaze, Edwyn
• Application Number:
  US15/154,572
• Time in Patent Office: 410 Days
• Field of Search: 235375, 235487, 23546209, 2354621
• CPC Class Codes: G06T 1/0021 Image watermarking
• CPC Class Codes: G06T 1/0028 Adaptive watermarking, e.g. Human Visual System [HVS]-based watermarking
• CPC Class Codes: G06T 1/0035 Output size adaptive watermarking
• CPC Class Codes: G06T 1/005 Robust watermarking, e.g. average attack or collusion attack resistant
• CPC Class Codes: G06T 1/0078 using multiple thresholds
• CPC Class Codes: G06T 1/0092 Payload characteristic determination in a watermarking scheme, e.g. number of bits to be embedded
• CPC Class Codes: G06T 2201/0202 whereby the quality of watermarked images is measured; Measuring quality or performance of watermarking methods; Balancing between quality and robustness

Abstract

This disclosure relates to advanced signal processing technology including steganographic embedding and digital watermarking. One combination disclosed in the description is an image processing apparatus including: electronic memory for storing an image, in which the image comprises at least a 1D or 2D barcode represented therein and a first encoded signal encoded therein, the 1D or 2D barcode comprising a first plural-bit code and the first encoded signal comprising a second plural-bit code; means for decoding the 1D or 2D barcode from the image to obtain the first plural-bit code; means for analyzing data representing the image to obtain the second plural-bit code from the first encoded signal; means for determining whether the second plural-bit code conflicts with the first plural-bit code; and means for generating a conflict map, the conflict map comprising an identification of a code conflict, and a spatial location of the code conflict relative to the image. Of course, other features and combinations are described as well.

Claims

1. An image processing method comprising:

obtaining an image comprising a plurality of color separations or channels, in which the image comprises at least a 1D or 2D barcode associated therewith and the image comprises plural encoded signals encoded therein, the 1D or 2D barcode comprising a first plural-bit code and the plural encoded signals comprising a second plural-bit code, in which the first plural-bit code comprises a first UPC code or a first GTIN code, and the second plural-bit code comprise comprises a second UPC code or a second GTIN code;

first analyzing data representing the image to decode the 1D or 2D barcode, said first analyzing yields the first plural-bit code comprising the first UPC code or the first GTIN code;

for each of the plurality of color separations or channels, second analyzing data representing image data to decode the plural encoded signals, said second analyzing yielding plural instances of the second plural-bit code comprising the second UPC code or the second GTIN code;

determining whether the plural instances of the second UPC code or the second GTIN code are different than the first UPC code or the first GTIN code; and

for each difference, providing information associated with a spatial location of the difference relative to the image, in which the information comprises information to help identify potential code conflicts.

2. The image processing method of claim 1 in which said obtaining occurs prior to a printing plate manufacture process.

3. The image processing method of claim 1 in which said first analyzing data representing the image to decode the 1D or 2D barcode operates on nonadjacent scanline data from the image.

4. The image processing method of claim 1 in which the information associated with the spatial location is formatted as a conflict map, the conflict map comprising a graphical box or highlight for a spatial location of the conflict relative to the image.

5. The image processing method of claim 1 in which the plural encoded signals comprise digital watermarking.

6. An image processing method comprising:

obtaining an image comprising a plurality of color separations or channels, in which the image comprises at least a 1D or 2D barcode associated therewith and the image comprises plural encoded signals encoded therein, the 1D or 2D barcode comprising a first plural-bit code and the plural encoded signals comprising a second plural-bit code;

first analyzing data representing the image to decode the 1D or 2D barcode, said first analyzing yields the first plural-bit code, in which said first analyzing data representing the image to decode the 1D or 2D barcode operates on nonadjacent scanline data representing the image, until the first plural-bit code is decoded, then said first analyzing data operates on N adjacent scanlines, N being an integer greater than 2, with the first plural-bit code being yielded only when analysis of the N adjacent scanlines each yields the first plural-bit code;

for each of the plurality of color separations or channels, second analyzing data representing image data to decode the plural encoded signals, said second analyzing yielding plural instances of the second plural-bit code;

determining whether the plural instances of the second plural-bit code conflict with the first plural-bit code; and

for each conflict, providing information associated with a spatial location of the conflict relative to the image.

7. The image processing method of claim 6 in which the plural encoded signals comprise digital watermarking.

8. An image processing method comprising:

obtaining an image comprising a plurality of color separations or channels, in which the image comprises at least a 1D or 2D barcode associated therewith and the image comprises plural encoded signals encoded therein, the 1D or 2D barcode comprising a first plural-bit code and the plural encoded signals comprising a second plural-bit code;

first analyzing data representing the image to decode the 1D or 2D barcode, said first analyzing yields the first plural-bit code;

segmenting at least a portion of the image into a plurality of blocks or tiles, in which a second analyzing operates on individual blocks or tiles from the plurality of blocks or tiles for each of the plurality of separations or channels;

for each of the plurality of color separations or channels, and after said act of segmenting, second analyzing data representing image data to decode the plural encoded signals, said second analyzing yielding plural instances of the second plural-bit code;

determining whether the plural instances of the second plural-bit code conflict with the first plural-bit code; and

for each conflict, providing information associated with a spatial location of the conflict relative to the image.

9. The image processing method of claim 8 in which the first plural-bit code and the second plural-bit code comprise data representing a UPC code or a GTIN code.

10. The image processing method of claim 8 in which the plural encoded signals comprise digital watermarking.

11. An image processing method comprising:

obtaining an image comprising a plurality of color separations or channels, in which the image comprises at least a 1D or 2D barcode associated therewith and the image comprises plural encoded signals encoded therein, the 1D or 2D barcode comprising a first plural-bit code and the plural encoded signals comprising a second plural-bit code, in which the plural encoded signals comprise a synchronization component and a message component;

first analyzing data representing the image to decode the 1D or 2D barcode, said first analyzing yields the first plural-bit code;

for each of the plurality of color separations or channels, second analyzing data representing image data to decode the plural encoded signals, said second analyzing yielding plural instances of the second plural-bit code;

determining whether the plural instances of the second plural-bit code conflict with the first plural-bit code;

for each conflict, providing information associated with a spatial location of the conflict relative to the image;

transforming data representing the image to yield transformed data;

analyzing the transformed data to obtain detectability indicators, in which a first detectability indicator corresponds to synchronization component strength, and a second indicator corresponds to message component strength;

predicting, based on the first detectability indicator and on the second detectability indicator, a likelihood that the transformed data, once printed on a physical substrate, will be detectable from optical scan data representing such printed transformed data on the physical substrate; and

providing information for a conflict map, in which the information represents predicted signal detection of the encoded signals.

12. The image processing method of claim 11 in which the conflict map represents predicted signal detection for one or more swipe paths across the image.

13. The image processing method of claim 11 in which the plural encoded signals comprise digital watermarking.

14. An image processing apparatus comprising:

electronic memory for storing an image, the image comprising a plurality of color separations or channels, in which the image comprises at least a 1D or 2D barcode represented therein and a first encoded signal encoded therein, the 1D or 2D barcode comprising a first plural-bit code and the first encoded signal comprising a second plural-bit code;

a barcode module configured for analyzing data representing the image to decode the 1D or 2D barcode to obtain the first plural-bit code;

a decoder module configured for analyzing each of the plurality of color separations or channels to decode the first encoded signal to obtain the second plural-bit code;

a comparator module configured for comparing the second plural-bit code with the first plural-bit code to determine whether the second plural-bit code conflicts with the first plural-bit code; and

a results module configured for producing a conflict map, the conflict map comprising an identification of a code conflict, and a spatial location of the code conflict relative to the image.

15. The image processing apparatus of claim 14 in which said barcode module is configured for analyzing scanline data representing the image, in which once a 1D or 2D barcode is detected from a first scanline, the barcode module analyzes the next N scanlines below the first scanline, in which the first plural-bit code is not obtained unless the 1D or 2D barcode is detected in all N scanlines, where N is an integer.

16. The image processing apparatus of claim 14 further comprising a display for displaying the conflict map.

17. The image processing apparatus of claim 14 in which the image comprises redundant instances of the first encoded signal encoded therein, and in which the first encoded signal comprises digital watermarking.

18. The image processing apparatus of claim 17 in which said decoder module is configured for analyzing each of the plurality of color separations or channels to decode the redundant instances of the first encoded signal to obtain plural instances of the second plural-bit code;

in which said comparator module is configured for comparing the plural instances of the second plural-bit code to the first plural-bit code to determine any conflicts; and

said results module is configured for producing a conflict map, the conflict map comprising an identification of code conflicts, and a spatial location of the code conflicts relative to the image.

19. The image processing apparatus of claim 17 in which the image comprises redundant instance of a second encoded signal encoded therein, in which the second encoded signal comprises a third plural-bit code.

20. The image processing apparatus of claim 19 in which said decoder module is configured for analyzing each of the plurality of color separations or channels to decode:

i) the redundant instances of the first encoded signal to obtain plural instances of the second plural-bit code, and ii) the redundant instances of the second encoded signal to obtain plural instances of the third plural-bit code;

in which said comparator module is configured for;

i) comparing the plural instances of the second plural-bit code to the first plural-bit code to determine any conflicts, ii) comparing the plural instances of the third plural-bit code to the first plural-bit code to determine any conflicts; and

said results module is configured for producing a conflict map, the conflict map comprising an identification of code conflicts, and a spatial location of the code conflicts relative to the image.

21. The image processing apparatus of claim 20 in which said comparator module is configured for:

iii) comparing the plural instances of the second plural-bit code to the plural instances of the third plural-bit code to determine any conflicts.

22. The image processing apparatus of claim 14, in which the first encoded signal comprise a synchronization component and a message component, said image processing apparatus further comprising:

one or more processors configured for;

transforming data representing the image to yield transformed data;

analyzing the transformed data to obtain detectability indicators, in which a first detectability indicator corresponds to synchronization component strength, and a second indicator corresponds to message component strength;

predicting, based on the first detectability indicator and on the second detectability indicator, a likelihood that the transformed data, once printed on a physical substrate, will be detectable from optical scan data representing such printed transformed data on the physical substrate;

providing information for the conflict map, the information representing predicted signal detection of the first encoded signal.

23. The image processing apparatus of claim 22 in which the conflict map represents predicted signal detection for one or more swipe paths across the image.

24. An image processing apparatus comprising:

electronic memory for storing an image, in which the image comprises at least a 1D or 2D barcode represented therein and a first encoded signal encoded therein, the 1D or 2D barcode comprising a first plural-bit code and the first encoded signal comprising a second plural-bit code;

means for decoding the 1D or 2D barcode from the image to obtain the first plural-bit code;

means for analyzing data representing the image to obtain the second plural-bit code from the first encoded signal;

means for determining whether the second plural-bit code conflicts with the first plural-bit code; and

means for generating a conflict map, the conflict map comprising an identification of a code conflict, and a spatial location of the code conflict relative to the image.

25. The image processing apparatus of claim 24 further comprising a display for displaying the conflict map.

26. The image processing apparatus of claim 24 in which the image comprises redundant instances of the first encoded signal encoded therein, and in which the first encoded signal comprises digital watermarking.

27. The image processing apparatus of claim 26 in which said means for analyzing data obtains plural instances of the second plural-bit code and identifies a spatial location relative to the image for each instance;

in which said means for determining determines whether any of the plural instances of the second plural-bit code conflicts with the first plural-bit code;

in which the conflict map comprises an identification of code conflicts, and a spatial location of the code conflicts relative to the image.

28. The image processing apparatus of claim 26 in which the image comprises redundant instances of a second encoded signal encoded therein, in which the second encoded signal comprises a third plural-bit code.

29. The image processing apparatus of claim 28 in which said means for analyzing data:

i) obtains plural instances of the second plural-bit code and identifies a spatial location relative to the image for each of the plural instances of the second plural-bit code, and ii) obtains plural instances of the third plural-bit code and identifies a spatial location relative to the image for each of the plural instances of the third plural-bit code;

in which said means for determining determines;

i) whether any of the plural instances of the second plural-bit code conflict with the first plural-bit code, and ii) whether any of the plural instances of the third plural-bit code conflict with the first plural-bit code;

in which the conflict map comprises an identification of code conflicts, and a spatial location of the code conflicts relative to the image.

30. The image processing apparatus of claim 29 in which said means for determining determines:

iii) whether any of the plural instances of the second plural-bit code conflict with any of the plural instance of the third plural-bit code.

31. An image processing method comprising:

obtaining an image, the image comprising a plurality of color separations or channels, in which the image comprises at least a 1D or 2D barcode represented therein and a first encoded signal encoded therein, the 1D or 2D barcode comprising a first plural-bit code and the first encoded signal comprising a second plural-bit code;

controlling a barcode reader to analyze data representing the image to decode the 1D or 2D barcode to obtain the first plural-bit code;

controlling a signal decoder to analyze each of the plurality of color separations or channels to decode the first encoded signal to obtain the second plural-bit code;

comparing the second plural-bit code with the first plural-bit code to determine whether the second plural-bit code conflicts with the first plural-bit code; and

producing a conflict map including one or more spatial images areas comprising a conflict between the first plural-bit code and the second plural-bit code, the conflict map comprising an identification of a code conflict, and a spatial location of the code conflict relative to the image.

32. The image processing method of claim 31 in which the barcode reader is controlled to analyze scanline data representing the image, in which once a 1D or 2D barcode is detected from a first scanline, the barcode module analyzes the next N scanlines below the first scanline, in which the first plural-bit code is not obtained unless the 1D or 2D barcode is detected in all N scanlines, where N is an integer.

33. The image processing method of claim 31 in which said providing comprises providing the conflict map for display.

34. The image processing method of claim 31 in which the image comprises redundant instances of the first encoded signal encoded therein, and in which the first encoded signal comprises digital watermarking.

35. The image processing method of claim 31 in which the signal decoder is controlled to analyze each of the plurality of color separations or channels to decode the redundant instances of the first encoded signal to obtain plural instances of the second plural-bit code;

in which said comparing compares the plural instances of the second plural-bit code to the first plural-bit code to determine any conflicts; and

in which the conflict map comprising an identification of code conflicts, and a spatial location of the code conflicts relative to the image.

36. The image processing method of claim 31, in which the first encoded signal comprise a synchronization component and a message component, said image processing method further comprising:

transforming data representing the image to yield transformed data;

obtaining detectability indicators from the transformed data, in which a first detectability indicator corresponds to synchronization component strength, and a second indicator corresponds to message component strength;

estimating, based on the first detectability indicator and on the second detectability indicator, a likelihood that the transformed data, once printed on a physical substrate, will be detectable from optical scan data representing such printed transformed data on the physical substrate;

providing information for the conflict map, the information representing estimated signal detection of the first encoded signal.

37. The image processing method of claim 36 in which the conflict map represents estimated signal detection for one or more swipe paths across the image.