Post-compression hidden data transport

• US 5,687,191 A
• Filed: 02/26/1996
• Issued: 11/11/1997
• Est. Priority Date: 12/06/1995
• Status: Expired due to Term

• Current Assignee: Verance Corporation
• Original Assignee: Solana Technology Development Corp. (Verance Corporation)
• Inventors: Lee, Chong U., Moallemi, Kamran, Hinderling, Jurg
• Primary Examiner(s): Bocure, Tesfaldet
• Application Number:
  US08/607,330
• Time in Patent Office: 624 Days
• Field of Search: 395/2, 395/2.1, 375/206, 375/208, 375/200, 375/260, 375/240, 375/242, 375/245, 375/241, 375/216, 375/295, 375/316, 375/341, 381/100, 381/101, 381/2, 370/522, 370/527, 370/529, 348/384, 348/381, 348/388, 348/390, 455/3.1, 455/6.36, 341/155
• US Class Current: 375/216
• CPC Class Codes: G10L 19/018 Audio watermarking, i.e. embedding inaudible data in the audio signal
• CPC Class Codes: H04B 1/665 using psychoacoustic properties of the ear, e.g. masking effect
• CPC Class Codes: H04B 1/707 using direct sequence modulation
• CPC Class Codes: H04B 2201/70715 with application-specific features

Abstract

Auxiliary data subband samples representing an auxiliary data signal are transported in a subband-coded compressed digital audio signal without decompressing the data. A pre-existing packetized data stream is provided to an input of a encoder. Subband audio samples are extracted from the packet stream and normalized if required. The data to be transported modulates data carrier subbands including, for example, a pseudo-noise (PN) spread spectrum signal, each subband of which has a bandwidth corresponding to those of the digital audio signal. The data carrier sequence can also include a sparse PN sequence, sample twiddle sequence, or a bit twiddle sequence. The modulated data carrier sequence is combined with the audio subband samples to form a combined signal in which the auxiliary data subband samples are carried. The combined signal is then multiplexed into the pre-existing packet stream. In a decoder, the combined signal is demodulated to recover the auxiliary data signal. The recovered auxiliary data signal is carried substantially inaudibly in the audio signal and is spectrally shaped according to the audio signal to enhance concealment.

Claims

1. A method for providing auxiliary data subband samples in a compressed subband coded digital audio data stream, comprising the steps of:

providing a plurality of audio subband samples from said data stream;

providing a data carrier sequence;

modulating said data carrier sequence by an auxiliary data signal to provide said auxiliary data subband samples;

combining said auxiliary data subband samples with corresponding audio subband samples to produce combined subband samples in which said auxiliary data subband samples are carried substantially inaudibly; and

providing said combined subband samples for transport in said digital audio data stream.

2. The method of claim 1, wherein said audio subband samples have a nonuniform power spectrum, comprising the further steps of:

normalizing said audio subband samples to provide an approximately uniform power spectrum thereof; and

de-normalizing said combined subband samples subsequent to said normalizing step to restore said nonuniform power spectrum of said audio subband samples, and to spectrally shape said auxiliary data subband samples in said combined subband samples according to said nonuniform power spectrum.

3. The method of claim 1, wherein said audio subband samples have a nonuniform power spectrum, comprising the further step of:

shaping said auxiliary data subband samples according to said nonuniform power spectrum.

4. The method of claim 1, wherein said data carrier sequence is modulated by different auxiliary data signals, thereby allowing combined subband samples in which auxiliary data subband samples corresponding to said different auxiliary data signals are carried.

5. The method of claim 1, wherein auxiliary data subband samples from a plurality of auxiliary signals are carried in one of said audio subbands.

6. The method of claim 1, comprising the further step of:

inverse quantizing said audio subband samples;

quantizing said combined subband samples subsequent to said inverse quantizing step; and

allocating bits for said inverse quantizing and quantizing steps.

7. The method of claim 1, wherein said data carrier sequence comprises at least one of:

(a) a pseudo-noise (PN) subband sequence provided over at least one subband;

(b) different PN subband sequences provided over one subband;

(c) time-shifted versions of the same PN subband sequence provided over one subband;

(d) a sparse PN sequence provided over at least one subband;

(e) different sparse PN sequences provided over one subband;

(f) time-shifted versions of the same sparse PN sequence provided over one subband;

(g) a sample twiddling sequence provided over at least one subband;

(h) different sample twiddling sequences provided over one subband;

(i) time-shifted versions of the same sample twiddling sequence provided over one subband;

(j) a bit twiddling sequence provided over at least one subband;

(k) different bit twiddling sequences provided over one subband; and

(l) time-shifted versions of the same bit twiddling sequence provided over one subband.

8. The method of claim 1, comprising the further step of:

combining said data carrier sequence with said audio subband samples to produce combined subband samples in which said data carrier sequence is carried substantially inaudibly.

9. The method of claim 1, wherein said data carrier sequence is subband filtered over a plurality of subbands corresponding to said plurality of audio subband samples.

10. The method of claim 9 wherein said auxiliary data subband samples are carried in a plurality of subbands of said combined subband samples.

11. A method for recovering auxiliary data subband samples representative of an auxiliary data signal from a compressed digital data stream, said auxiliary data subband samples being provided by modulating a first data carrier sequence by said auxiliary data signal, said auxiliary data subband samples being carried with audio subband samples in combined subband samples in said compressed digital data stream, comprising the steps of:

recovering said combined subband samples from said data stream;

providing a recovery data carrier sequence corresponding to said first data carrier sequence; and

demodulating said combined subband samples using said recovery data carrier sequence to recover said auxiliary data subband samples from said recovered combined subband samples.

12. The method of claim 11, wherein said recovery data carrier sequence comprises at least one of:

(a) a pseudo-noise (PN) subband sequence provided over at least one subband;

(b) different PN subband sequences provided over one subband;

(c) time-shifted versions of the same PN subband sequence provided over one subband;

(d) a sparse PN sequence provided over at least one subband;

(e) different sparse PN sequences provided over one subband;

(f) time-shifted versions of the same sparse PN sequence provided over one subband;

(g) a sample twiddling sequence provided over at least one subband;

(h) different sample twiddling sequences provided over one subband;

(i) time-shifted versions of the same sample twiddling sequence provided over one subband;

(j) a bit twiddling sequence provided over at least one subband;

(k) different bit twiddling sequences provided over one subband; and

(l) time-shifted versions of the same bit twiddling sequence provided over one subband;

said method comprising the further steps of;

despreading said recovered auxiliary data subband samples using said recovery data carrier sequence; and

summing said despread auxiliary data subband samples across selected subband channels to recover said auxiliary data signal.

13. The method of claim 12, wherein said despreading step integrates said recovered auxiliary data subband samples to provide said despread auxiliary data subband samples.

14. The method of claim 11, wherein said audio subband samples have a nonuniform power spectrum, comprising the further step of:

normalizing said combined subband samples to provide an approximately uniform power spectrum for said audio subband samples in said combined subband samples.

15. The method of claim 11, comprising the further step of:

inverse quantizing said combined subband samples; and

allocating bits for said inverse quantizing step.

16. The method of claim 11, wherein said recovery data carrier sequence is subband filtered over a plurality of subbands corresponding to said plurality of audio subband samples.

17. The method of claim 16 wherein said auxiliary data subband samples are carried in a plurality of subbands of said combined subband samples.

18. An encoder for providing auxiliary data subband samples, which are representative of an auxiliary data signal, in a compressed subband coded digital audio data stream, comprising:

an input terminal for receiving said digital audio data stream and providing a plurality of audio subband samples;

a data carrier generator for providing a data carrier sequence;

a modulator for modulating said data carrier sequence by said auxiliary data signal to provide said auxiliary data subband samples;

a combiner coupled to said modulator for combining said auxiliary data subband samples with corresponding audio subband samples to produce combined subband samples in which said auxiliary data subband samples are carried substantially inaudibly; and

an output terminal coupled to said combiner for providing said combined subband samples for transport in said digital audio data stream.

19. The encoder of claim 18, wherein said audio subband samples have a nonuniform power spectrum, further comprising:

a normalizer for normalizing said audio subband samples to provide an approximately uniform power spectrum thereof; and

a de-normalizer for de-normalizing said combined subband samples subsequent to said normalizing step to restore said nonuniform power spectrum and to spectrally shape said auxiliary data subband samples in said combined subband samples according to said nonuniform power spectrum.

20. The encoder of claim 18, wherein said audio subband samples have a nonuniform power spectrum, further comprising:

a normalizer for normalizing said auxiliary data subband samples to spectrally shape said auxiliary data subband samples according to said nonuniform power spectrum.

21. The encoder of claim 18, further comprising:

a packetizer for packetizing said combined subband samples; and

a multiplexer for multiplexing the packetized combined subband samples into a packetized transport stream.

22. The encoder of claim 18, wherein said data carrier sequence is modulated by different auxiliary data signals to provide auxiliary data subband samples, thereby allowing combined subband samples in which said auxiliary data subband samples corresponding to said different auxiliary data signals are carried.

23. The encoder of claim 18, further comprising:

an inverse quantizer for inverse quantizing said combined subband samples;

a quantizer for quantizing said combined subband samples; and

bit allocation means coupled to said inverse quantizer and said quantizer for allocating bits for said inverse quantizing and said quantizing.

24. The encoder of claim 18, wherein said data carrier sequence comprises at least one of:

(a) a pseudo-noise (PN) subband sequence provided over at least one subband;

(b) different PN subband sequences provided over one subband;

(c) time-shifted versions of the same PN noise subband sequence provided over one subband;

(d) a sparse PN sequence provided over at least one subband;

(e) different sparse PN sequences provided over one subband;

(f) time-shifted versions of the same sparse PN sequence provided over one subband;

(g) a sample twiddling sequence provided over at least one subband;

(h) different sample twiddling sequences provided over one subband;

(i) time-shifted versions of the same sample twiddling sequence provided over one subband;

(j) a bit twiddling sequence provided over at least one subband;

(k) different bit twiddling sequences provided over one subband; and

(l) time-shifted versions of the same bit twiddling sequence provided over one subband.

25. The encoder of claim 18, further comprising:

means for combining said data carrier sequence with said audio subband samples to produce combined subband samples in which said data carrier sequence is carried substantially inaudibly.

26. The encoder of claim 18, wherein said data carrier sequence is subband filtered over a plurality of subbands corresponding to said plurality of audio subband samples.

27. The encoder of claim 26 wherein said auxiliary data subband samples are carried in a plurality of subbands of said combined subband samples.

28. A decoder for recovering auxiliary data subband samples which are representative of an auxiliary data signal from a compressed digital data stream, said auxiliary data subband samples being provided by modulating a first data carrier sequence by said auxiliary data signal, said auxiliary data subband samples being carried with audio subband samples in combined subband samples in said compressed digital data stream, comprising:

means for recovering said combined subband samples from said compressed digital data stream;

means for providing a recovery data carrier sequence corresponding to said first data carrier sequence; and

a demodulator for demodulating said combined subband samples using said recovery data carrier sequence to recover said auxiliary data subband samples from said recovered combined subband samples.

29. The decoder of claim 28 further comprising:

means for despreading said recovered auxiliary data subband samples to provide a corresponding plurality of despread auxiliary data subband samples; and

a summer for summing said despread auxiliary data subband samples across said subband channels to recover said auxiliary data signal.

30. The decoder of claim 29, wherein said despreading means comprises integrators for integrating said recovered auxiliary data subband samples to provide said despread auxiliary data subband samples.

31. The decoder of claim 28, further comprising:

a normalizer for normalizing said audio subband samples in said combined subband samples prior to said demodulating to provide an approximately uniform power spectrum for said audio subband samples.

32. The decoder of claim 28, further comprising:

a normalizer for normalizing said combined subband signals prior to said demodulating to provide an approximately uniform power spectrum for said auxiliary data subband samples.

33. The decoder of claim 28, wherein auxiliary data subband samples corresponding to different auxiliary data signals are carried in said combined subbands of said digital audio data stream;

and

said demodulator recovers said auxiliary data subband samples using different recovery data carrier sequences.

34. The decoder of claim 28, further comprising:

an inverse quantizer for inverse quantizing said combined subband samples; and

bit allocation means for allocating bits for said inverse quantizing.

35. The decoder of claim 28, wherein said recovery data carrier sequence comprises at least one of:

(a) a pseudo-noise (PN) subband sequence provided over at least one subband;

(b) different PN subband sequences provided over one subband;

(c) time-shifted versions of the same PN subband sequence provided over one subband;

(d) a sparse PN sequence provided over at least one subband;

(e) different sparse PN sequences provided over one subband;

(f) time-shifted versions of the same sparse PN sequence provided over one subband;

(g) a sample twiddling sequence provided over at least one subband;

(h) different sample twiddling sequences provided over one subband;

(i) time-shifted versions of the same sample twiddling sequence provided over one subband;

(j) a bit twiddling sequence provided over at least one subband;

(k) different bit twiddling sequences provided over one subband; and

(l) time-shifted versions of the same bit twiddling sequence provided over one subband.

36. The decoder of claim 28, wherein said recovery data carrier sequence is subband filtered over a plurality of subbands corresponding to said plurality of audio subband samples.

37. The decoder of claim 36, wherein said auxiliary data subband samples are carried in a plurality of subbands of said combined subband samples.

38. A compressed digital data storage media, comprising:

(i) storage means for storing combined subband samples including audio subband samples which represent an audio signal, and auxiliary data subband samples which represent an auxiliary data signal;

said auxiliary data subband samples being provided by modulating a data carrier sequence by said auxiliary data signal over at least one subband corresponding to said audio subband samples;

said auxiliary data signal being carried substantially inaudibly in said audio signal;

said auxiliary data signal being spectrally shaped according to said audio signal; and

(ii) means for allowing the recovery of said auxiliary data signal from said auxiliary data subband samples.

39. The storage media of claim 38, wherein auxiliary data subband samples corresponding to different auxiliary data signals are carried in said combined subband samples.

40. The storage media of claim 38, wherein auxiliary data subband samples corresponding to different auxiliary data signals are carried in one of said audio subbands.

41. The storage media of claim 38, wherein said data carrier sequence comprises at least one of:

(a) a pseudo-noise (PN) subband sequence provided over at least one subband;

(b) different PN subband sequences provided over one subband;

(c) time-shifted versions of the same PN subband sequence provided over one subband;

(d) a sparse PN sequence provided over at least one subband;

(e) different sparse PN sequences provided over one subband;

(f) time-shifted versions of the same sparse PN sequence provided over one subband;

(g) a sample twiddling sequence provided over at least one subband;

(h) different sample twiddling sequences provided over one subband;

(i) time-shifted versions of the same sample twiddling sequence provided over one subband;

(j) a bit twiddling sequence provided over at least one subband;

(k) different bit twiddling sequences provided over one subband; and

(l) time-shifted versions of the same bit twiddling sequence provided over one subband.

42. The storage media of claim 38, wherein said data carrier sequence is subband filtered over a plurality of subbands corresponding to said audio subband samples.

43. The storage media of claim 42, wherein said auxiliary data subband samples are carried in a plurality of subbands of said combined subband samples.