Detecting conflicts between multiple different signals within imagery

• US 10,275,847 B2
• Filed: 06/09/2017
• Issued: 04/30/2019
• Est. Priority Date: 10/29/2015
• Status: Active Grant

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Brundage, Trent J., Holub, Vojtech
• Primary Examiner(s): Labaze, Edwyn
• Application Number:
  US15/619,308
• Publication Number:
  US 20180129847A1
• Time in Patent Office: 690 Days
• Field of Search: 235375, 235487, 23546209, 2354621
• CPC Class Codes: G06T 1/0021 Image watermarking
• CPC Class Codes: G06T 1/0028 Adaptive watermarking, e.g. Human Visual System [HVS]-based watermarking
• CPC Class Codes: G06T 1/0035 Output size adaptive watermarking
• CPC Class Codes: G06T 1/005 Robust watermarking, e.g. average attack or collusion attack resistant
• CPC Class Codes: G06T 1/0078 using multiple thresholds
• CPC Class Codes: G06T 1/0092 Payload characteristic determination in a watermarking scheme, e.g. number of bits to be embedded
• CPC Class Codes: G06T 2201/0202 whereby the quality of watermarked images is measured; Measuring quality or performance of watermarking methods; Balancing between quality and robustness

Abstract

This disclosure relates to advanced signal processing technology including signal encoding. One combination disclosed in the description is an image processing method comprising: accessing a design file to obtain image data, the image data comprising a plurality of color separations or channels, in which the image data comprises at least a 1D or 2D barcode represented therein and a first encoded signal encoded therein, the 1D or 2D barcode comprising a first plural-bit code and the first encoded signal comprising a second plural-bit code; operating a barcode reader to analyze the image data to decode the 1D or 2D barcode to obtain the first plural-bit code; operating a signal decoder to analyze one or more combinations of color separations or channels of the plurality of color separations or channels to decode the first encoded signal to obtain the second plural-bit code; determining whether the second plural-bit code conflicts with the first plural-bit code; and identifying a conflict based on said act of determining. Of course, other features and combinations are described as well.

Claims

1. An image processing method comprising:

obtaining image data, the image data comprising a plurality of color separations or channels, in which the image data comprises at least a first type of machine-readable symbology comprising a 1D or 2D barcode represented therein and a second type of machine-readable symbology comprising a first encoded signal encoded therein, in which the second type of machine-readable symbology comprises a different type of machine-readable symbology relative to the first type of machine-readable symbology, the 1D or 2D barcode comprising a first plural-bit code and the first encoded signal comprising a second plural-bit code;

operating a barcode reader to analyze the image data to decode the 1D or 2D barcode to obtain the first plural-bit code;

operating a signal decoder to analyze one or more color separations or channels of the plurality of color separations or channels to decode the first encoded signal to obtain the second plural-bit code;

determining whether the second plural-bit code conflicts with the first plural-bit code; and

identifying a conflict based on said act of determining.

2. The image processing method of claim 1 in which said operating the signal decoder operates to analyze one or more combinations of color separations or channels of the plurality of color separations or channels to decode the first encoded signal to obtain the second plural-bit code, and in which the plurality of color separations or channels comprise a Red separation (Red) and a Green separation (Green), and the one or more combinations of color separations or channels comprise Red-Green.

3. The image processing method of claim 1 in which said operating the signal decoder operates to analyze one or more combinations of color separations or channels of the plurality of color separations or channels to decode the first encoded signal to obtain the second plural-bit code, and in which the plurality of color separations or channels comprise a Red separation (Red) and a Green separation (Green), and the one or more combinations of color separations or channels comprise k*Red−

1*Green, where k and 1 comprise weights.

4. The image processing method of claim 1 in which said operating the signal decoder operates to analyze one or more combinations of color separations or channels of the plurality of color separations or channels to decode the first encoded signal to obtain the second plural-bit code, and in which the plurality of color separations or channels comprise a Red separation (Red), a Green separation (Green) and a Blue separation (Blue), and the one or more combinations of color separations or channels comprise Red+Green+Blue.

5. The image processing method of claim 1 in which said operating the signal decoder operates to analyze one or more combinations of color separations or channels of the plurality of color separations or channels to decode the first encoded signal to obtain the second plural-bit code, and in which the plurality of color separations or channels comprise a Red separation (Red), a Green separation (Green) and a Blue separation (Blue), and the one or more combinations of color separations or channels comprise k*Red+1*Green+m*Blue, where k, 1 and m comprise weights.

6. The image processing method of claim 1 in which the image data comprises redundant instances of the first encoded signal encoded therein.

7. The image processing method of claim 1, in which the first encoded signal comprises a synchronization component and a message component, said image processing method further comprising:

transforming the image data to yield transformed data;

generating a first detectability indicator from the transformed data, in which the first detectability indicator corresponds to synchronization component strength;

generating a second detectability indicator corresponding to message component strength;

generating, based on the first detectability indicator and on the second detectability indicator, a likelihood that the image data, once printed on a physical substrate, will be detectable from optical scan data representing the image data printed on the physical substrate;

providing information representing a likelihood of signal detection for the first encoded signal.

8. The image processing method of claim 7 in which the likelihood of signal detection represents estimated signal detection for one or more swipe paths across the image data.

9. The image processing method of claim 1 in which the first encoded signal comprises digital watermarking.

16. The image processing method of claim 6 further comprising generating a conflict map including one or more-spatial image areas comprising a conflict between the first plural-bit code and the second plural-bit code, the conflict map comprising an identification of code conflicts, and a spatial location of the code conflicts relative to the image.

17. The image processing method of claim 16 in which the conflict map comprises multiple colors to represent code conflicts.

10. An image processing method comprising:

obtaining image data, the image data comprising a plurality of color separations or channels, in which the image data comprises at least a 1D or 2D barcode represented therein and a first encoded signal encoded therein, the 1D or 2D barcode comprising a first plural-bit code and the first encoded signal comprising a second plural-bit code;

operating a barcode reader to analyze the image data to decode the 1D or 2D barcode to obtain the first plural-bit code;

operating a signal decoder to analyze one or more color separations or channels of the plurality of color separations or channels to decode the first encoded signal to obtain the second plural-bit code;

determining whether the second plural-bit code conflicts with the first plural-bit code;

identifying a conflict based on said act of determining; and

generating a conflict map including one or more spatial image areas comprising a conflict between the first plural-bit code and the second plural-bit code, the conflict map comprising an identification of a code conflict, and a spatial location of the code conflict relative to the image data.

11. The image processing method of claim 10 further comprising displaying the conflict map on a display screen.

12. The image processing method of claim 10 in which the first encoded signal comprises digital watermarking.

13. An image processing method comprising:

obtaining image data, the image data comprising a plurality of color separations or channels, in which the image data comprises at least a 1D or 2D barcode represented therein and a first encoded signal encoded therein, the 1D or 2D barcode comprising a first plural-bit code and the first encoded signal comprising a second plural-bit code;

operating a barcode reader to analyze the image data to decode the 1D or 2D barcode to obtain the first plural-bit code, in which said operating the barcode reader operates to analyze scanline data representing the image data, in which once a 1D or 2D barcode is detected from a first scanline, the barcode reader analyzes the next N scanlines below the first scanline, in which the first plural-bit code is not obtained unless the 1D or 2D barcode is detected in all N scanlines, where N is an integer;

operating a signal decoder to analyze one or more color separations or channels of the plurality of color separations or channels to decode the first encoded signal to obtain the second plural-bit code;

determining whether the second plural-bit code conflicts with the first plural-bit code; and

identifying a conflict based on said act of determining.

14. The image processing method of claim 13 in which the first encoded signal comprises digital watermarking.

15. An image processing method comprising:

obtaining image data, the image data comprising a plurality of color separations or channels, in which the image data comprises at least a 1D or 2D barcode represented therein and a first encoded signal encoded therein, the 1D or 2D barcode comprising a first plural-bit code and the first encoded signal comprising a second plural-bit code, in which the image data comprises redundant instances of the first encoded signal encoded therein;

operating a barcode reader to analyze the image data to decode the 1D or 2D barcode to obtain the first plural-bit code;

operating a signal decoder to analyze each of the plurality of color separations or channels to decode the redundant instances of the first encoded signal to obtain plural instances of the second plural-bit code;

determining whether the plural instances of the second plural-bit code conflict with the first plural-bit code; and

identifying a conflict based on said act of determining.

18. The image processing method of claim 15 in which the first encoded signal comprises digital watermarking.

19. An image processing apparatus comprising:

memory storing image data, the image data comprising a plurality of color separations or channels, in which the image data comprises a first type of machine-readable symbology comprising at least a 1D or 2D barcode represented therein and a second type of machine-readable symbology comprising a first encoded signal encoded therein, in which the second type of machine-readable symbology comprises a different type of machine-readable symbology relative to the first type of machine-readable symbology, the 1D or 2D barcode comprising a first plural-bit code and the first encoded signal comprising a second plural-bit code;

one or more multi-core processors configured for;

analyzing the image data to decode the 1D or 2D barcode to obtain the first plural-bit code;

analyzing one or more color separations or channels of the plurality of color separations or channels to decode the first encoded signal to obtain the second plural-bit code;

determining whether the second plural-bit code conflicts with the first plural-bit code; and

identifying a conflict based on said determining.

20. The image processing apparatus of claim 19 in which the analyzing analyzes one or more combinations of color separations or channels of the plurality of color separations or channels to decode the first encoded signal to obtain the second plural-bit code, and in which plurality of color separations or channels comprise a Red separation (Red) and a Green separation (Green), and the one or more combinations of color separations or channels comprise Red−

Green.

21. The image processing apparatus of claim 19 in which the analyzing analyzes one or more combinations of color separations or channels of the plurality of color separations or channels to decode the first encoded signal to obtain the second plural-bit code, and in which the plurality of color separations or channels comprise a Red separation (Red) and a Green separation (Green), and the one or more combinations of color separations or channels comprise k*Red−

1*Green, where k and 1 comprise weights.

22. The image processing apparatus of claim 19 in which the analyzing analyzes one or more combinations of color separations or channels of the plurality of color separations or channels to decode the first encoded signal to obtain the second plural-bit code, and in which the plurality of color separations or channels comprise a Red separation (Red), a Green separation (Green) and a Blue separation (Blue), and the one or more combinations of color separations or channels comprise Red+Green+Blue.

23. The image processing apparatus of claim 19 in which the analyzing analyzes one or more combinations of color separations or channels of the plurality of color separations or channels to decode the first encoded signal to obtain the second plural-bit code, and in which the plurality of color separations or channels comprise a Red separation (Red), a Green separation (Green) and a Blue separation (Blue), and the one or more combinations of color separations or channels comprise k*Red+1*Green+m*Blue, where k, 1 and m comprise weights.

24. The image processing apparatus of claim 19 in which the image data comprises redundant instances of the first encoded signal encoded therein.

25. The image processing apparatus of claim 19, in which the first encoded signal comprises a synchronization component and a message component, said one or more multi-core processors configured for:

transforming the image data to yield transformed data;

generating a first detectability indicator from the transformed data, in which the first detectability indicator corresponds to synchronization component strength;

generating a second detectability indicator corresponding to message component strength;

generating, based on the first detectability indicator and on the second detectability indicator, a likelihood that the image data, once printed on a physical substrate, will be detectable from optical scan data representing the image data printed on the physical substrate;

providing information representing a likelihood of signal detection for the first encoded signal.

26. The image processing apparatus of claim 25 in which the likelihood of signal detection represents estimated signal detection for one or more swipe paths across the image data.

27. The image processing apparatus of claim 19 in which the first encoded signal comprises digital watermarking.

28. An image processing apparatus comprising:

memory storing image data, the image data comprising a plurality of color separations or channels, in which the image data comprises at least a 1D or 2D barcode represented therein and a first encoded signal encoded therein, the 1D or 2D barcode comprising a first plural-bit code and the first encoded signal comprising a second plural-bit code;

one or more multi-core processors configured for;

analyzing the image data to decode the 1D or 2D barcode to obtain the first plural-bit code;

analyzing color separations or channels of the plurality of color separations or channels to decode the first encoded signal to obtain the second plural-bit code;

determining whether the second plural-bit code conflicts with the first plural-bit code;

identifying a conflict based on said determining; and

generating a conflict map including one or more spatial image areas comprising a conflict between the first plural-bit code and the second plural-bit code, the conflict map comprising an identification of a code conflict, and a spatial location of the code conflict relative to the image data.

29. The image processing apparatus of claim 28 further comprising a display screen, in which said one or more multi-core processors are configured for:

controlling display of the conflict map on said display screen.

30. The image processing apparatus of claim 28 in which the first encoded signal comprises digital watermarking.

31. An image processing apparatus comprising:

memory storing image data, the image data comprising a plurality of color separations or channels, and in which the image data comprises at least a 1D or 2D barcode represented therein and a first encoded signal encoded therein, the 1D or 2D barcode comprising a first plural-bit code and the first encoded signal comprising a second plural-bit code, in which the image data comprises multiple instances of the first encoded signal encoded therein;

one or more multi-core processors configured for;

analyzing the image data to decode the 1D or 2D barcode to obtain the first plural-bit code;

analyzing each of the plurality of color separations or channels to decode the multiple instances of the first encoded signal to obtain plural instances of the second plural-bit code;

determining whether the plural instances of the second plural-bit code conflict with the first plural-bit code;

generating a conflict map identifying code conflicts, in which the conflict map comprises multi-colors to represent the code conflicts;

identifying a conflict based on said determining.

32. The image processing apparatus of claim 31 in which the conflict map includes one or more spatial image areas comprising a conflict between the first plural-bit code and the second plural-bit code, the conflict map comprising an identification of code conflicts, and a spatial location of the code conflicts relative to the image data.

33. The image processing apparatus of claim 31 in which the first encoded signal comprises digital watermarking.

34. A non-transitory computer readable medium comprising instructions stored thereon, that, when executed by one or more processors, cause the one or more processors to perform the following:

obtain image data, the image data comprising a plurality of color separations or channels, in which the image data comprises at least a first type of machine-readable symbology comprising a 1D or 2D barcode represented therein and a second type of machine-readable symbology comprising a first encoded signal encoded therein, in which the second type of machine-readable symbology comprises a different type of machine-readable symbology relative to the first type of machine-readable symbology, the 1D or 2D barcode comprising a first plural-bit code and the first encoded signal comprising a second plural-bit code;

operate a barcode reader to analyze the image data to decode the 1D or 2D barcode to obtain the first plural-bit code;

operate a signal decoder to analyze one or more color separations or channels of the plurality of color separations or channels to decode the first encoded signal to obtain the second plural-bit code;

determine whether the second plural-bit code conflicts with the first plural-bit code; and

identify a conflict based on said act of determining.

35. The non-transitory computer readable medium of claim 34, in which said instructions comprise instructions, that, when executed by the one or more processors, cause the one or more processors to perform the following:

generate a conflict map including one or more spatial image areas comprising a conflict between the first plural-bit code and the second plural-bit code, the conflict map comprising an identification of a code conflict, and a spatial location of the code conflict relative to the image data.

36. The non-transitory computer readable medium of claim 34, in which said instructions comprise instructions, that, when executed by the one or more processors, cause the one or more processors to perform the following:

operate the barcode reader to analyze scanline data representing the image data, in which once a 1D or 2D barcode is detected from a first scanline, the barcode reader analyzes the next N scanlines below the first scanline, in which the first plural-bit code is not obtained unless the 1D or 2D barcode is detected in all N scanlines, where N is an integer.

37. The non-transitory computer readable medium of claim 34, in which the image data comprises redundant instances of the first encoded signal encoded therein, and in which said instructions comprise instructions, that, when executed by the one or more processors, cause the one or more processors to perform the following:

operate the signal decoder to analyze each of the plurality of color separations or channels to decode the redundant instances of the first encoded signal to obtain plural instances of the second plural-bit code; and

determine whether the plural instances of the second plural-bit code conflict with the first plural-bit code.

38. The non-transitory computer readable medium of claim 37 in which said instructions comprise instructions, that, when executed by the one or more processors, cause the one or more processors to perform the following:

generate a conflict map including one or more image areas comprising a conflict between the first plural-bit code and the second plural-bit code, the conflict map comprising an identification of code conflicts, and a spatial location of the code conflicts relative to the image data.

39. The non-transitory computer readable medium of claim 34, in which the first encoded signal comprises a synchronization component and a message component, and in which said instructions comprise instructions, that, when executed by the one or more processors, cause the one or more processors to perform the following:

transform the image data to yield transformed data;

generate a first detectability indicator from the transformed data, in which the first detectability indicator corresponds to synchronization component strength;

generate a second detectability indicator corresponding to message component strength;

generate, based on the first detectability indicator and on the second detectability indicator, a likelihood that the image data, once printed on a physical substrate, will be detectable from optical scan data representing the image data printed on the physical substrate;

provide information representing a likelihood of signal detection for the first encoded signal.

40. The non-transitory computer readable medium of claim 39, in which the likelihood of signal detection represents estimated signal detection for one or more swipe paths across the image data.

41. The non-transitory computer readable medium of claim 34 in which the first encoded signal comprises digital watermarking.

42. An image processing method comprising:

obtaining image data, the image data comprising a plurality of color separations or channels, in which the image data comprises at least a first type of machine-readable symbology comprising a 1D barcode represented therein and a second type of machine-readable symbology comprising a first signal represented therein, in which the second type of machine-readable symbology comprises a different type of machine-readable symbology relative to the first type of machine-readable symbology, the 1D barcode comprising a first plural-bit code and the first signal comprising a second plural-bit code;

operating a barcode reader to analyze the image data to decode the 1D barcode to obtain the first plural-bit code;

operating a signal decoder to analyze one or more color separations or channels of the plurality of color separations or channels to decode the first signal to obtain the second plural-bit code;

determining whether the second plural-bit code and the first plural-bit code conflict; and

identifying a conflict based on said act of determining.

43. The image processing method of claim 42 in which the second type of machine-readable symbology comprises digital watermarking or steganographic encoding.

44. The image processing method of claim 43 in which said operating the signal decoder operates to analyze one or more combinations of color separations or channels of the plurality of color separations or channels to decode the first signal to obtain the second plural-bit code, and in which the plurality of color separations or channels comprise a Red separation (Red) and a Green separation (Green), and the one or more combinations of color separations or channels comprise Red−

Green.

45. The image processing method of claim 42 in which the second type of machine-readable symbology comprises a 2D barcode symbology and the first signal comprises a 2D barcode, and in which the signal decoder comprises a barcode reader.

46. The image processing method of claim 45 in which the 2D barcode comprises a QR code or Data Matrix.

47. The image processing method of claim 45 in which the first plural-bit code comprises a first GTIN code and the second plural-bit code comprises a second GTIN code, and in which a conflict occurs when the first GTIN code and the second GTIN code comprise different codes.

48. The image processing method of claim 47 in which the first plural-bit code comprises the first GTIN code and additional data.

49. The image processing method of claim 48 in which the additional data comprises one or more flags.

50. The image processing method of claim 48 in which the second plural-bit code comprises the second GTIN code and additional data.

51. The image processing method of claim 50 in which the additional data of the second plural-bit code comprises one or more flags.

52. The image processing method of claim 45, further comprising:

generating a conflict map including one or more image areas comprising a conflict between the first plural-bit code and the second plural-bit code, the conflict map comprising an identification of code conflicts, and a spatial location of the code conflicts relative to the image data.

53. The image processing method of claim 42 in which said operating the signal decoder operates to analyze one or more combinations of color separations or channels of the plurality of color separations or channels to decode the first signal to obtain the second plural-bit code, and in which the plurality of color separations or channels comprise a Red separation (Red) and a Green separation (Green), and the one or more combinations of color separations or channels comprise k*Red−

1*Green, where k and 1 comprise weights.

54. The image processing method of claim 42 in which said operating the signal decoder operates to analyze one or more color separations or channels to decode the first signal to obtain the second plural-bit code, and in which the plurality of color separations or channels comprises a black separation or black channel.