Hidden image signalling

• US 8,401,224 B2
• Filed: 05/05/2010
• Issued: 03/19/2013
• Est. Priority Date: 05/05/2010
• Status: Expired due to Fees

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Rhoads, Geoffrey B.
• Primary Examiner(s): CHANG, JON CARLTON
• Application Number:
  US12/774,512
• Publication Number:
  US 20110274310A1
• Time in Patent Office: 1,049 Days
• Field of Search: 382/100, 382/162, 382/165, 382/217, 382/276, 382/280
• US Class Current: 382/100
• CPC Class Codes: G06T 1/00 General purpose image data processing
• CPC Class Codes: G06T 1/005 Robust watermarking, e.g. average attack or collusion attack resistant
• CPC Class Codes: G06T 2201/0052 Embedding of the watermark in the frequency domain
• CPC Class Codes: G06T 2201/0601 whereby calibration information is embedded in the watermark, e.g. a grid, a scale, a list of transformations
• CPC Class Codes: H04N 1/32 Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device H04N1/38, H04N1/387 take precedence
• CPC Class Codes: H04N 1/3216 using Fourier transforms
• CPC Class Codes: H04N 1/32187 with selective or adaptive application of the additional information, e.g. in selected frequency coefficients
• CPC Class Codes: H04N 1/32309 in colour image data
• CPC Class Codes: H04N 2201/3249 data relating to a linked page or object, e.g. hyperlink
• CPC Class Codes: H04N 2201/3264 of sound signals

Abstract

An image is encoded to define one or more spatial regions that can be sensed by a suitably-equipped mobile device (e.g., a smart phone), but are imperceptible to humans. When such a mobile device senses one of these regions, it takes an action in response (e.g., rendering an associated tone, playing linked video, etc.). The regions may overlap in layered fashion. One form of encoding employs modification of the color content of the image at higher spatial frequencies, where human vision is not acute. In a particular embodiment, the encoding comprises altering a transform domain representation of the image by adding signal energy in a first chrominance channel, where the added signal energy falls primarily within a segmented arc region in a transform domain space.

Claims

1. A method of marking color imagery employing a device having a processor, configured by software stored in a memory, to perform at least certain acts of the method, the method comprising the acts:

within imagery in a spatial or pixel domain, identifying at least one two-dimensional image sub-region;

the device processor encoding one or more chroma keys in said sub-region by altering a transform domain representation thereof, said altering comprising adding image signal energy in a first chrominance channel, said added image signal energy falling primarily within a segmented arc region in a transform domain space; and

transmitting, storing or presenting the altered imagery, together with different auxiliary information;

wherein the encoded chroma key(s), in conjunction with the auxiliary information, serve to cooperatively define a response to said image sub-region when sensed by a mobile device including an image sensor.

2. The method of claim 1 in which the segmented arc region has a lower spatial frequency of at least 10 cycles per degree.

3. The method of claim 1 in which the segmented arc region has a lower spatial frequency of at least 20 cycles per degree.

4. The method of claim 1 in which the segmented arc region has a lower spatial frequency of at least 25 cycles per degree.

5. The method of claim 1 in which the segmented arc region has a lower spatial frequency of at least 30 cycles per degree.

6. The method of claim 1 wherein the two-dimensional sub-region comprises an area less than 20% of the color imagery.

7. The method of claim 1 wherein the two-dimensional sub-region comprises an area less than 10% of the color imagery.

8. The method of claim 1 wherein the two-dimensional sub-region comprises an area less than 5% of the color imagery.

9. The method of claim 1 wherein the two-dimensional sub-region comprises an area less than 3% of the color imagery.

10. The method of claim 1 wherein the two-dimensional sub-region comprises an area less than 1.5% of the color imagery.

11. The method of claim 1 wherein the auxiliary information comprises digital watermark information steganographically encoded in the imagery.

12. The method of claim 1 that further includes sensing said image sub-region by said mobile device, and identifying a response associated with said sub-region through use of the auxiliary information.

13. The method of claim 1 wherein said altering further comprises subtracting image signal energy in a second chrominance channel.

14. The method of claim 13 wherein the added and subtracted image signal energies fall predominantly within the segmented arc region.

15. The method of claim 13 wherein the added and subtracted image signal energies fall essentially within the segmented arc region.

16. The method of claim 13 wherein the added and subtracted image signal energies fall almost exclusively within the segmented arc region.

17. The method of claim 13 wherein the added and subtracted image signal energies fall exclusively within the segmented arc region.

18. A method employing a portable user device having a processor configured to perform at least certain acts of the method, and having a camera portion for capturing imagery, the method comprising the acts:

transforming imagery captured by the camera portion to yield corresponding data in a transform domain;

applying a template to detect therein a key in a segmented arc region of the transform domain;

receiving plural-bit auxiliary data;

through use of the plural-bit auxiliary data, determine a response corresponding to the detected key; and

initiating said response.

19. A non-transitory computer readable storage medium containing software instructions that, when executed by a processor of a camera-equipped device, cause the device to perform acts including:

transforming imagery captured by the camera to yield corresponding data in a transform domain;

applying a template to detect therein a key in a segmented arc region of the transform domain;

receiving plural-bit auxiliary data;

through use of the plural-bit auxiliary data, determine a response corresponding to the detected key; and

initiating said response.