Methods for controlling systems using control signals embedded in empirical data

• US 5,832,119 A
• Filed: 09/25/1995
• Issued: 11/03/1998
• Est. Priority Date: 11/18/1993
• Status: Expired due to Term

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Rhoads, Geoffrey B.
• Primary Examiner(s): Mancuso, Joseph
• Assistant Examiner(s): Prikockis, Larry J.
• Application Number:
  US08/534,005
• Time in Patent Office: 1,135 Days
• Field of Search: 382/191, 382/296, 382/298, 382/289, 382/135, 382/137, 382/280, 382/232, 382/113, 382/254, 283/902, 399/366, 380/3, 350/124.5, 235/382
• US Class Current: 382/232
• CPC Class Codes: B42D 25/00 Information-bearing cards or sheet-like structures characterised by identification or security features; Manufacture thereof printing processes to produce identification or security features B41M3/14
• CPC Class Codes: B42D 25/333 Watermarks
• CPC Class Codes: G06F 16/955 using information identifiers, e.g. uniform resource locators [URL]
• CPC Class Codes: G06K 19/06037 multi-dimensional coding
• CPC Class Codes: G06K 19/06046 Constructional details
• CPC Class Codes: G06K 19/14 the marking being sensed by radiation
• CPC Class Codes: G06K 19/18 Constructional details
• CPC Class Codes: G06K 2019/06253 for a specific application
• CPC Class Codes: G06K 7/1417 2D bar codes
• CPC Class Codes: G06K 7/1447 extracting optical codes from image or text carrying said optical code
• CPC Class Codes: G06Q 20/341 Active cards, i.e. cards including their own processing means, e.g. including an IC or chip
• CPC Class Codes: G06Q 20/40145 Biometric identity checks
• CPC Class Codes: G06T 1/005 Robust watermarking, e.g. average attack or collusion attack resistant
• CPC Class Codes: G06T 2201/0052 Embedding of the watermark in the frequency domain
• CPC Class Codes: G07C 9/253 visually
• CPC Class Codes: G07D 7/0032 using holograms
• CPC Class Codes: G07D 7/0034 using watermarks
• CPC Class Codes: G07D 7/004 using digital security elements, e.g. information coded on a magnetic thread or strip
• CPC Class Codes: G07F 17/26 for printing, stamping, franking, typing or teleprinting apparatus ticket printing or the like apparatus G07F17/42
• CPC Class Codes: G07F 7/12 Card verification
• CPC Class Codes: G10L 19/018 : Audio watermarking, i.e. embedding inaudible data in the audio signal
• CPC Class Codes: G11B 20/00086 : Circuits for prevention of unauthorised reproduction or copying, e.g. piracy indicating unauthorised use of record carriers in general G11B23/28; scrambling for television signal recording H04N5/913; network architectures or network protocols for network security H04L63/00; cryptographic mechanisms or cryptographic arrangements for secret or secure communication H04L9/00
• CPC Class Codes: G11B 20/00094 : involving measures which result in a restriction to authorised record carriers
• CPC Class Codes: G11B 20/00166 : involving measures which result in a restriction to authorised contents recorded on or reproduced from a record carrier, e.g. music or software
• CPC Class Codes: G11B 20/0021 : involving encryption or decryption of contents recorded on or reproduced from a record carrier
• CPC Class Codes: G11B 20/00884 : involving a watermark, i.e. a barely perceptible transformation of the original data which can nevertheless be recognised by an algorithm
• CPC Class Codes: G11B 20/00891 : embedded in audio data
• CPC Class Codes: H04B 1/665 : using psychoacoustic properties of the ear, e.g. masking effect
• CPC Class Codes: H04N 1/00005 : relating to image data
• CPC Class Codes: H04N 1/00037 : Detecting, i.e. determining the occurrence of a predetermined state H04N1/00031 takes precedence
• CPC Class Codes: H04N 1/00079 : remotely
• CPC Class Codes: H04N 1/32122 : in a separate device, e.g. in a memory or on a display separate from image data
• CPC Class Codes: H04N 1/32144 : embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
• CPC Class Codes: H04N 1/3216 : using Fourier transforms
• CPC Class Codes: H04N 1/32203 : Spatial or amplitude domain methods H04N1/32309 takes precedence
• CPC Class Codes: H04N 1/32288 : Multiple embedding, e.g. cocktail embedding, or redundant embedding, e.g. repeating the additional information at a plurality of locations in the image
• CPC Class Codes: H04N 1/32352 : Controlling detectability or arrangements to facilitate detection or retrieval of the embedded information, e.g. using markers for decoding, detection or retrieval operations H04N1/32149 and subgroups take precedence
• CPC Class Codes: H04N 19/467 : characterised by the embedded information being invisible, e.g. watermarking
• CPC Class Codes: H04N 2005/91321 : the copy protection signal being a copy protection control signal, e.g. a record inhibit signal
• CPC Class Codes: H04N 2005/91335 : the copy protection signal being a watermark
• CPC Class Codes: H04N 2201/0091 : Digital copier; digital 'photocopier' H04N2201/0093 and H04N2201/0094 take precedence
• CPC Class Codes: H04N 2201/3205 : of identification information, e.g. name or ID code H04N2201/3209 takes precedence
• CPC Class Codes: H04N 2201/3225 : of data relating to an image, a page or a document
• CPC Class Codes: H04N 2201/3226 : of identification information or the like, e.g. ID code, index, title, part of an image, reduced-size image
• CPC Class Codes: H04N 2201/3233 : of authentication information, e.g. digital signature, watermark
• CPC Class Codes: H04N 2201/327 : which are undetectable to the naked eye, e.g. embedded codes
• CPC Class Codes: H04N 2201/3271 : Printing or stamping
• CPC Class Codes: H04N 5/913 : for scrambling ; for copy protection

Abstract

An embedded multi-bit signal is steganographically detected from empirical data, such as image or audio data, and some aspect of a related system'"'"'s operation is controlled in accordance therewith. One application of the invention is a video playback or recording device that is controlled in accordance with the embedded multi-bit signal to limit playback or recording operations. Another is a photo-duplication kiosk that recognizes certain steganographic markings in an image being copied and interrupts the copying operation.

Claims

1. A method of using an input image signal to control operation of a system, comprising:

discerning, from said input image signal, an N-bit code signal steganographically encoded therein, where N is greater than or equal to two, said discerning including performing an algorithmic registration process to resolve an initially unknown variable needed to discern the code signal from the input image signal, said input image signal corresponding to an originally encoded image corrupted by scaling and/or rotation processes, wherein the N-bit code signal is discerned notwithstanding said corruption; and

controlling an operation of the system in accordance with the code signal discerned from the input image signal.

2. The method of claim 1 in which said processing is performed without reference to the originally encoded image.

3. The method of claim 1 in which said discerning includes:

analyzing said input image signal to determine at least one corruption characterization parameter, said parameter characterizing at least one aspect of said corruption; and

employing said corruption characterization parameter in discerning from said input image signal the N-bit code signal steganographically encoded therein.

4. The method of claim 3 which includes employing said corruption characterization parameter to compensate the input image signal for said corruption, and discerning the N-bit code signal from a compensated image signal.

5. The method of claim 3 in which said corruption characterization parameter is a scale factor.

6. The method of claim 3 in which said corruption characterization parameter is a rotation factor.

7. The method of claim 1 in which said input image signal is a video signal.

8. The method of claim 7 in which said N-bit code signal includes a copy control signal.

9. The method of claim 7 which includes limiting a recording capability of a video system in accordance with said N-bit code signal.

10. The method of claim 7 which includes incrementing a program specific billing meter in response to said N-bit code signal.

11. The method of claim 1 in which said discerning step is performed by dedicated decoder circuitry within the system.

12. The method of claim 1 in which said discerning includes performing a plurality of statistical analyses on said input image signal to discern the N-bit code signal therefrom.

13. The method of claim 12 in which each statistical analysis includes analyzing a collection of spaced apart image signal values to discern a single, first datum related to the N-bit code signal therefrom, said analysis to discern said first datum encompassing not just said spaced apart image signal values, but also image signal values adjacent thereto, said adjacent image signal values not being encoded with said first datum.

14. The method of claim 13 in which said spaced apart image signal values are pixel data and are spaced apart in the spatial image domain.

15. The method of claim 13 in which said datum is one bit of the N-bit code signal.

16. The method of claim 1 in which the input image signal comprises a corrupted motion picture signal having data corresponding to a plurality of frames, and in which said discerning step includes processing a plurality of said frames to determine the N-bit code signal therefrom, wherein greater or lesser confidence in the N-bit code signal discerned from said corrupted motion picture signal can be obtained by processing more or less frames, respectively.

17. The method of claim 1 in which said discerning includes processing in accordance with pseudo-random key data.

18. The method of claim 1 in which the input image signal is produced by a process in which the relative strength of the encoded N-bit code signal changes locally in accordance with local characteristics of the image signal.

19. The method of claim 1 wherein the input image signal is produced by a process in which, when said input image signal is represented in the pixel domain, values of a plurality of pixels therein are each a function of the values of both first and second bits of the N-bit code signal, wherein there is a many bit-to-one pixel mapping between bits of said code signal and pixels of said input image signal representation.

20. The method of claim 1 in which said discerning is performed using a representation of said input image signal in the spatial image domain, rather than in a transformed domain.

21. The method of claim 1 in which said controlling step comprises indicating that the originally encoded image is copyrighted.

22. A computer storage medium having stored thereon instructions for causing a programmable computer to perform the method of claim 1 in conjunction with said system.

23. The method of claim 1 which includes generating said input image signal by scanning an identification document with a scanner, said identification document including a photograph of a bearer thereof from which the N-bit code is steganographically decoded.

24. The method of claim 23 which includes controlling said system to indicate either a valid or invalid identification, based in part on the N-bit code discerned from the photograph.

25. The method of claim 1 in which said N-bit code signal serves as a pointer to remote data stored at a remote location, the system'"'"'s operation being controlled in accordance with said remote data.

26. The method of claim 1 in which said N-bit code signal comprises a computer instruction, the method including interpreting said instruction and controlling said system in accordance therewith.

27. The method of claim 1 in which the system is a photo duplication kiosk, the kiosk including a lens for imaging a customer-provided original medium onto an opto-electronic detector, and a print-writing device for printing an image in accordance with image data gathered by the detector, the controlling including interrupting a print-writing operation of said kiosk.

28. A method of controlling operation of a system comprising:

processing an encoded input signal to recover a multi-bit information signal embedded therein, the encoded input signal corresponding to an audio track or a visual image whose representation by said input signal has been altered in slight respects to encode the information signal therein,

a calibration signal being present within the encoded input signal, said calibration signal within the encoded input signal being substantially imperceptible to a human listener of the encoded audio track or viewer of the encoded visual image, said calibration signal having one or more known properties facilitating identification thereof during decoding of the encoded input signal,

the method including identifying the calibration signal within said encoded input signal, and using data obtained thereby to aid in steganographically recovering the information signal from the encoded input signal,

said the encoded input signal having been corrupted since being encoded, said corruption including a process selected from the group consisting of;

misregistration of the encoded input signal, and scaling of the encoded input signal,

the method further including using said data to compensate for said corruption, so that the information signal can be recovered from the encoded input signal notwithstanding said corruption; and

controlling an operation of said system in accordance with said information signal.

29. The method of claim 28 in which said processing is performed without reference to other data corresponding to the contents of said audio track or visual image.

30. The method of claim 28 in which said encoded input signal is a video signal.

31. The method of claim 30 in which said multi-bit information signal includes a copy control signal.

32. The method of claim 30 which includes limiting a recording capability of a video system in accordance with said multi-bit information signal.

33. The method of claim 30 which includes incrementing a program specific billing meter in response to said multi-bit information signal.

34. The method of claim 28 in which said processing step is performed by dedicated decoder circuitry within the system.

35. The method of claim 28 in which said processing includes performing a plurality of statistical analyses on said encoded input signal to discern the multi-bit information signal therefrom.

36. The method of claim 35 in which each statistical analysis includes analyzing a collection of spaced apart signal values to discern a single, first datum related to the multi-bit information signal therefrom, said analysis to discern said first datum encompassing not just said spaced apart signal values, but also signal values adjacent thereto, said adjacent signal values not being encoded with said first datum.

37. The method of claim 36 in which said spaced apart image signal values are pixel data and are spaced apart in the spatial image domain.

38. The method of claim 36 in which said datum is one bit of the multi-bit information signal.

39. The method of claim 28 in which the encoded input signal comprises a corrupted motion picture signal having data corresponding to a plurality of frames, and in which said processing step includes processing a plurality of said frames to determine the multi-bit information-signal therefrom, wherein greater or lesser confidence in the multi-bit information signal discerned from said corrupted motion picture signal can be obtained by processing more or less frames, respectively.

40. The method of claim 28 in which said processing includes processing in accordance with pseudo-random key data.

41. The method of claim 28 in which the encoded input signal is produced by a process in which the relative strength of the encoded multi-bit information signal changes locally in accordance with local characteristics of the audio track or visual image.

42. The method of claim 28 wherein the encoded input signal is produced by a process in which, when said encoded input signal is represented in the pixel domain, values of a plurality of pixels therein are each a function of the values of both first and second bits of the multi-bit information signal, wherein there is a many bit-to-one pixel mapping between bits of said information signal and pixels of said encoded input signal representation.

43. The method of claim 28 in which said processing is performed using a representation of said encoded input signal in the spatial image domain, rather than in a transformed domain.

44. The method of claim 28 in which said controlling step comprises indicating that the audio track or visual image represented by said encoded input signal is copyrighted.

45. The method of claim 28 in which said multi-bit information signal serves as a pointer to remote data stored at a remote location, the system'"'"'s operation being controlled in accordance with said remote data.

46. The method of claim 28 in which said multi-bit information signal comprises a computer instruction, the method including interpreting said instruction and controlling said system in accordance therewith.

47. A computer storage medium having stored thereon instructions for causing a programmable computer to perform the method of claim 28 in conjunction with said system.

48. A method useful for restricting use of video signals comprising:

providing an input video image signal, said signal representing a plurality of image frames;

providing a multi-bit data signal with which the input video image signal is to be steganographically encoded, said multi-bit data signal including a usage control signal;

establishing a global scaling parameter for use with said input video image signal, said global parameter determining a relative visibility at which the multi-bit data signal will be steganographically encoded therein;

processing the input video image signal in accordance with said multi-bit data signal and said global scaling parameter, wherein an encoded video image signal is produced having the multi-bit data signal encoded therein, said encoding being manifested as slight changes to pixel values in said video image signal when said signal is represented in the spatial image domain;

compressing the encoded video image signal with a lossy compression process;

storing the compressed encoded video image signal on an optically encoded storage medium;

reading the compressed encoded video image signal from said optically encoded storage medium using a video device that includes a video playback feature;

decompressing said read compressed encoded video image signal, yielding a corrupted video image signal, said corruption being due to lossiness of the compression/decompression process;

applying said corrupted video image signal to hardware decoder circuitry within said video device;

said hardware decoder circuitry recovering said multi-bit data signal from the corrupted video image signal over the course of a plurality of image frames thereof, said plurality of frames enhancing a signal-to-noise ratio of said encoded multi-bit data signal, allowing reliable recovery thereof despite steganographic encoding of said multi-bit data signal, and corruption of said video image signal by said compression/decompression lossiness; and

limiting use of said video device in accordance with the usage control signal included in said multi-bit data signal.

49. The method of claim 48 which includes:

algorithmically determining a plurality of local scaling parameters based on characteristics of said input video image signal, each local scaling parameter corresponding to a local region of said input video image signal when represented in a particular domain, wherein said local scaling parameters are adaptively related to image contents; and

processing the input video image signal in accordance with (1) said multi-bit data signal, (2) said global scaling parameter, and (3) said plurality of local scaling parameters, wherein an encoded video image signal is produced having the multi-bit data signal encoded therein.

50. The method of claim 48 in which, for each of a plurality of pixels in a single frame of said encoded video image signal when said signal is represented in a spatial image domain, the value of each pixel is a function of both first and second bits of said multi-bit data signal, wherein there is a many bit-to-one pixel mapping between bits of said multi-bit data signal and pixels of said image frame.

51. The method of claim 48 in which said processing includes performing a binary addition operation between a representation of said input video image signal, and an auxiliary signal embodying the multi-bit data signal.

52. A method useful for restricting use of video signals comprising:

providing an input video image signal, said signal representing a plurality of image frames;

providing a multi-bit data signal with which the input video image signal is to be steganographically encoded, said multi-bit data signal including a usage control signal;

establishing a global scaling parameter for use with said input video image signal, said global parameter determining a relative visibility at which the multi-bit data signal will be steganographically encoded therein;

processing the input video image signal in accordance with said multi-bit data signal and said global scaling parameter, wherein an encoded video image signal is produced having the multi-bit data signal encoded therein, said encoding being manifested as slight changes to pixel values in said video image signal when said signal is represented in the spatial image domain;

compressing the encoded video image signal with a lossy compression process;

storing the compressed encoded video image signal on an optically encoded storage medium;

reading the compressed encoded video image signal from said optically encoded storage medium using a video device;

decompressing said read compressed encoded video image signal, yielding a corrupted video image signal, said corruption being due to lossiness of the compression/decompression process;

applying said corrupted video image signal to a processor within said video device;

said processor recovering said multi-bit data signal from the corrupted video image signal notwithstanding corruption of said video image signal by said compression/decompression lossiness; and

limiting use of said video device in accordance with the usage control signal included in said multi-bit data signal.

53. The method of claim 52 which includes:

algorithmically determining a plurality of local scaling parameters based on characteristics of said input video image signal, each local scaling parameter corresponding to a local region of said input video image signal when represented in a particular domain, wherein said local scaling parameters are adaptively related to image contents; and

processing the input video image signal in accordance with (1) said multi-bit data signal, (2) said global scaling parameter, and (3) said plurality of local scaling parameters, wherein an encoded video image signal is produced having the multi-bit data signal encoded therein.

54. The method of claim 52 in which, for each of a plurality of pixels in a single frame of said encoded video image signal when said signal is represented in a spatial image domain, the value of each pixel is a function of both first and second bits of said multi-bit data signal, wherein there is a many bit-to-one pixel mapping between bits of said multi-bit data signal and pixels of said image frame.

55. The method of claim 52 in which said processing includes performing a binary addition operation between a representation of said input video image signal, and an auxiliary signal embodying the multi-bit data signal.

56. A computer storage medium having instructions stored thereon for causing a processor programmed thereby to perform the following steganographic decoding method:

processing an encoded input signal to recover a multi-bit information signal embedded therein, the encoded input signal corresponding to a visual image whose representation by said input signal has been altered in slight respects to encode the information signal therein, the encoded input signal having been corrupted since being encoded, said corruption comprising rotation of the image corresponding to said encoded input signal from an original orientation, said encoded input signal including a calibration signal, said calibration signal within the encoded input signal being substantially imperceptible to a human viewer of the encoded visual image, said calibration signal having one or more known properties facilitating identification thereof during decoding of the encoded input signal,

said processing including identifying the calibration signal within said encoded input signal, and using data obtained thereby to aid in steganographically recovering the information signal from the encoded input signal,

said processing further including using said obtained data to compensate for said corruption, so that the information signal can be recovered from the encoded input signal notwithstanding said corruption.

57. The computer storage medium of claim 56 in which said instructions further cause the programmed processor to control an operation of an associated system in accordance with said information signal.