Compression embedding

• US 5,778,102 A
• Filed: 12/19/1996
• Issued: 07/07/1998
• Est. Priority Date: 05/17/1995
• Status: Expired due to Fees

• Current Assignee: Regents of the University of California (University of California)
• Original Assignee: Regents of the University of California (University of California)
• Inventors: Handel, Theodore G., Sandford, Maxwell T. II, Bradley, Jonathan N.
• Primary Examiner(s): Boudreau, Leo H.
• Assistant Examiner(s): Tadayon, Bijan
• Application Number:
  US08/772,188
• Time in Patent Office: 565 Days
• Field of Search: 364/715.02, 382/233, 382/236, 382/250, 382/232, 382/254, 382/234, 382/235, 382/238, 382/239, 382/240, 382/244, 382/248, 382/251, 382/252, 382/253, 382/168, 382/170, 382/166, 382/274, 382/245, 382/246, 382/247, 382/306, 348/416, 358/426, 358/434, 358/470, 358/456, 358/261.1, 358/261.2, 358/261.3, 358/261.4, 358/427, 358/262.1, 235/382, 235/494, 380/7, 380/10, 380/54, 395/162, 395/118, 395/101
• US Class Current: 382/251
• CPC Class Codes: H04N 1/32154 Transform domain methods H04N1/32309 takes precedence
• CPC Class Codes: H04N 1/32165 using cosine transforms
• CPC Class Codes: H04N 1/32277 Compression
• CPC Class Codes: H04N 19/467 characterised by the embedded information being invisible, e.g. watermarking
• CPC Class Codes: H04N 19/60 using transform coding
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/63 using sub-band based transform, e.g. wavelets
• CPC Class Codes: H04N 21/23892 involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level
• CPC Class Codes: H04N 21/8358 involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 2201/327 which are undetectable to the naked eye, e.g. embedded codes
• CPC Class Codes: H04N 7/52 Systems for transmission of a pulse code modulated video signal with one or more other pulse code modulated signals, e.g. an audio signal or a synchronizing signal assembling of a multiplex stream by combining a video stream with other content or additional data, remultiplexing of multiplex streams, insertion of stuffing bits into the multiplex stream, assembling of a packetised elementary stream at server side H04N21/236; disassembling of a multiplex stream, remultiplexing of multiplex streams, extraction or processing of Service Information, disassembling of packetised elementary stream at client side H04N21/434

Abstract

A method and apparatus for embedding auxiliary information into the digital representation of host data created by a lossy compression technique and a method and apparatus for constructing auxiliary data from the correspondence between values in a digital key-pair table with integer index values existing in a representation of host data created by a lossy compression technique. The methods apply to data compressed with algorithms based on series expansion, quantization to a finite number of symbols, and entropy coding. Lossy compression methods represent the original data as ordered sequences of blocks containing integer indices having redundancy and uncertainty of value by one unit, allowing indices which are adjacent in value to be manipulated to encode auxiliary data. Also included is a method to improve the efficiency of lossy compression algorithms by embedding white noise into the integer indices. Lossy compression methods use loss-less compression to reduce to the final size the intermediate representation as indices. The efficiency of the loss-less compression, known also as entropy coding compression, is increased by manipulating the indices at the intermediate stage. Manipulation of the intermediate representation improves lossy compression performance by 1 to 10%.

Claims

1. A method of embedding auxiliary data into host data compressed by lossy compression ratio methods that use series expansion and quantization techniques comprising the steps of:

creating a duplicate digital compression representation of said host data in terms of intermediate integer indices representing coefficients, said digital compression representation having certain statistical properties;

creating a digital representation of said auxiliary data in the form of a sequence of individual bit values;

evaluating said digital compression representation to determine pairs of integer indices differing by a specified number of units and occurring with similar frequency in said digital compression representation;

replacing individual integer indices in said digital compression representation with values taken from a digital key comprising a schedule of said pairs of integer indices in order to embed individual bit values corresponding to said sequence of individual bit values of said auxiliary data; and

outputting said digital compression representation with said auxiliary data embedded into a file format specified for said compressed data.

2. The method as described in claim 1 further comprising the step of combining said auxiliary data with predetermined information indicative of the presence of said auxiliary data, its file name, and file size, said step to be performed after the step of digitizing said auxiliary data.

3. The method as described in claim 1 further comprising the step of equalizing said statistical properties of said digital compression representation for the purpose of improving said lossy compression ratio methods.

4. The method as described in claim 1, wherein said digital compression representation originates from a color image compressed with the JPEG or WSQ algorithm, and their derivative compression representations.

5. The method as described in claim 1, wherein said digital compression representation originates from a black and white image compressed with the JPEG or WSQ algorithm, and their derivative compression representations.

6. The method as described in claim 1, wherein said digital compression representation originates from a television or video disc signal compressed with the MPEG and DCT-based algorithms, and their derivative compression representations.

7. The method as described in claim 1, wherein said digital compression representation originates from digital audio represented by lossy compression representations.

8. The method as described in claim 1, wherein said digital compression representation originates from X-ray, CT-scan, or Magnetic Resonance Imaging data.

9. The method as described in claim 1, wherein said digital compression representation originates from personal security and identification information.

10. The method as described in claim 1, wherein said digital compression representation originates from fingerprint images.

11. The method as described in claim 1, wherein said digital compression representation originates from images made with a camera producing digital images.

12. A method of constructing embedded a quantity of auxiliary data from a machine readable lossy digital compression representation containing integer indices comprising the steps of:

creating a look-up table defining a correlation between decoded integer indices from said lossy digital compression representation and elements of a key-pair table;

matching said decoded integer indices from said lossy digital compression representation with entries in said look-up table, for determining correspondence of said integer indices from said lossy digital compression representation with said elements in said key-pair;

constructing said auxiliary data according to said correspondence in said look-up table between said integer indices from said lossy digital compression representation and an element in said key-pair table;

validating the content and correctness of said auxiliary data by examining header data constructed from the correspondence between said integer indices and said key-pair values; and

interpreting said auxiliary bits as data unrelated to said lossy compressed data.

13. The method as described in claim 12, wherein said auxiliary data consist of digital text.

14. The method as described in claim 12, wherein said auxiliary data consist of script or code intended for execution on a network client or server machine.

15. The method as described in claim 12, wherein said auxiliary data consist of motion vector data or script used in the reconstruction of a digital motion picture.

16. The method as described in claim 12, wherein said auxiliary data consist of text or digital audio data used for subtitles or language translation of digital motion picture audio.

17. The method as described in claim 12, wherein said auxiliary data consist of information used to correct degraded, or to decode scrambled image data, for the purpose of controlled service delivery.

18. The method as described in claim 12, wherein said auxiliary data consist of additional or supplemental digital imagery.

19. The method as described in claim 12, wherein said auxiliary data consist of personal identification information.

20. The method as described in claim 12, wherein said auxiliary data consist of medical record or diagnostic information.

21. The method as described in claim 12, wherein said auxiliary data consist of a portion of the said original lossy compressed data.

22. The method as described in claim 12, wherein said auxiliary data consist of encrypted information.

23. The method as described in claim 12, wherein said auxiliary data consist of information transmitted in the space of said lossy compressed representation afforded by the existence of a correspondence between said integer indices and said pair key table.

24. Apparatus for embedding auxiliary data into individual frames of host data having integer indices of certain values and frequencies of occurrence compressed by lossy compression ratio methods that use series expansion and quantization techniques comprising:

buffer storage means receiving said individual frames of host data for entropy decoding, modifying and momentarily storing said integer indices of said individual frames of host data, entropy coding said modifications to said integer indices of said individual frames of host data, and outputting said entropy coded modifications to said integer indices of said individual frames of host data;

histogram analysis means receiving said entropy decoded integer indices of said individual frames of host data for processing a statistical relationship between said frequency of occurrence and said value of said integer indices of said individual frame of host data identify embedding pair candidates in said individual frames of host data, and outputting said embedding pair candidates;

key-pair table means receiving said embedding pair candidates for creating a key-pair table for each of said individual frames of host data, and outputting said embedding pair candidates as a randomized table;

compression embedding means receiving said embedding key pair table, said integer indices from said individual frames of host data retained in said buffer storage, and said auxiliary data for embedding said auxiliary data and said key-pair table into said individual frames of host data and outputting an embedded stream of individual frames of host data.

25. The apparatus as described in claim 24 wherein said buffer storage means, said key-pair table means, and said compression embedding means are contained within a chipset.

26. The apparatus as described in claim 24 wherein said buffer storage means, said key-pair table means, and said compression embedding means are implemented in circuit board circuitry.

27. Apparatus for constructing auxiliary data and a key-pair table embedded into individual frames of host data compressed by lossy compression ratio methods that use series expansion and quantization techniques comprising:

look-up table means receiving said key-pair table from said individual frames of host data for extracting said key-pair table and outputting a key-pair index corresponding to each of said integer indices from said individual frames of host data in a buffer storage; and

auxiliary data construction means receiving said key pair table for each of said individual frames of host data and said integer indices from said individual frames of host data stored in said buffer storage for using said key pair to construct said auxiliary data from said individual frames of host data and outputting an auxiliary data bit stream.

28. The apparatus as described in claim 27 wherein said look-up table means and said auxiliary data construction means are contained within a chipset.

29. The apparatus as described in claim 27 wherein said look-up table means and said auxiliary data construction means are implemented in circuit board circuitry.