System and method for shaping a data signal for embedding within an audio signal

• US 7,460,991 B2
• Filed: 11/30/2001
• Issued: 12/02/2008
• Est. Priority Date: 11/30/2000
• Status: Expired due to Term

• Current Assignee: Intrasonics SARL
• Original Assignee: Intrasonics Limited (Ipsos SA)
• Inventors: Jones, Aled Wynne, Bartlett, David, Reynolds, Michael Raymond, Timson, Daniel Reginald Ewart, Kelly, Peter John, Hosking, Ian Michael, Vasilopolous, Nicolas, Hart, Alan Michael, Morland, Robert John, Guy, Donald Glenn
• Primary Examiner(s): Hudspeth; David R.
• Assistant Examiner(s): Sked; Matthew J.
• Application Number:
  US10/432,889
• Publication Number:
  US 20050219068A1
• Time in Patent Office: 2,559 Days
• Field of Search: None
• US Class Current: 704/211
• CPC Class Codes: A63H 2200/00 Computerized interactive toys, e.g. dolls
• CPC Class Codes: A63H 3/365 allowing a choice of facial features, e.g. to change the facial expression change of expression through animation A63H3/48, self-moving A63H13/005; movable eyes A63H3/40
• CPC Class Codes: G01S 5/30 Determining absolute distances from a plurality of spaced points of known location
• CPC Class Codes: G10L 19/018 Audio watermarking, i.e. embedding inaudible data in the audio signal
• CPC Class Codes: H04H 20/31 using in-band signals, e.g. subsonic or cue signal
• CPC Class Codes: H04M 1/2155 Acoustic coupling
• CPC Class Codes: H04M 1/253 Telephone sets using digital voice transmission
• CPC Class Codes: H04M 1/2757 by data transmission, e.g. downloading
• CPC Class Codes: H04M 1/57 Arrangements for indicating or recording the number of the calling subscriber at the called subscriber's set at the operator set in a manual exchange H04M5/20
• CPC Class Codes: H04M 1/578 associated with a synthesized vocal announcement
• CPC Class Codes: H04M 1/7243 with interactive means for internal management of messages
• CPC Class Codes: H04M 1/72445 for supporting Internet browser applications
• CPC Class Codes: H04N 21/233 Processing of audio elementary streams monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/439 Processing of audio elementary streams
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/488 Data services, e.g. news ticker systems specially adapted for using meteorological information in broadcast systems H04H60/71
• CPC Class Codes: H04N 21/8133 : specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/8358 : involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 21/8586 : by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02
• CPC Class Codes: H04N 5/607 : for more than one sound signal, e.g. stereo, multilanguages H04N5/602 takes precedence
• CPC Class Codes: H04N 7/08 : Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band , e.g. by time division H04N7/007 takes precedence
• CPC Class Codes: H04N 7/088 : the inserted signal being digital

Abstract

There is described a number of encoders for encoding a data signal within an audio signal. In some of the encoders, the audio signal is separated into a tonal part and a residual part, and the data signal is shaped based on the residual part. In other encoders, the data signal is separated into a tonal part and a residual part, and the data signal is combined with the audio signal independence upon the residual part. In other encoders, the rate at which the data is encoded within the audio signal is varied in dependence upon the audio signal. There are also described various decoders associated with the described encoders.

Claims

1. An apparatus for shaping a data signal for embedding within an audio signal, the apparatus comprising:

a first receiver operable to receive the data signal;

a second receiver operable to receive the audio signal;

a time series modeler operable to apply a time series model to the audio signal in order to generate a plurality of coefficients indicative of the audio signal;

a synthesizer operable to synthesize a time domain tonal signal using the generated coefficients;

a subtractor operable to difference the synthesized tonal signal and the audio signal to generate a time domain residual signal; and

a shaper operable to shape the spectrum of the data signal in dependence upon the residual signal to form a shaped data signal.

2. An apparatus according to claim 1, wherein the time series modeler is operable to perform linear predictive coding in order to generate said coefficients.

3. An apparatus according to claim 1, further comprising a modifier operable to modify the time series model in order to vary the number of coefficients generated by said time series modeler.

4. An apparatus according to claim 3, in which the modifier comprises a user interface, wherein the modifier is operable to vary the number of generated coefficients in accordance with a user signal received via the user interface.

5. An apparatus according to claim 3, in which the modifier comprises a tonality determiner operable to determine a level of tonality of the audio signal, wherein the modifier is operable to vary the number of generated coefficients in dependence upon the determined level of tonality.

6. An apparatus according to claim 1, wherein the data signal has a data signal spectrum and the shaper comprises:

a spectrum analyser operable to analyse the spectrum of the residual signal to generate a plurality of frequency-dependent coefficients;

a scaling factors generator operable to generate a plurality of scaling factors using the plurality of frequency-dependent coefficients; and

an adjuster operable to adjust the data signal spectrum using the plurality of scaling factors to generate the shaped data signal.

7. An apparatus according to claim 6, wherein the spectrum analyser is a first spectrum analyser and is operable to generate a first plurality of frequency-dependent coefficients, and the adjuster comprises:

a second spectrum analyser operable to analyse the spectrum of the data signal to generate a second plurality of frequency-dependent coefficients;

a scaler operable to scale the second plurality of frequency-dependent coefficients using the plurality of scaling factors to generate a plurality of scaled coefficients; and

a synthesizer operable to synthesize the shaped data signal using the plurality of scaled coefficients.

8. An apparatus according to claim 7, wherein the first and second spectrum analysers are operable to perform a Fourier transform.

9. An apparatus according to claim 7, wherein the first and second spectrum analysers are operable to perform a wavelet transform.

10. An apparatus according to claim 7, wherein the scaling factors generator is operable to perform a psycho-acoustic analysis of the first plurality of frequency dependent coefficients.

11. An apparatus according to claim 10, wherein the scaling factors generator comprises a psycho-acoustic filter for performing the psycho-acoustic analysis.

12. An apparatus according to claim 11, wherein the psycho-acoustic filter has a variable bandwidth, and wherein said scaling factors generator comprises an adjuster operable to vary the variable bandwidth of the psycho-acoustic filter.

13. An apparatus according to claim 12, wherein said adjuster comprises a user interface and a setter operable to set the bandwidth of the psycho-acoustic filter in accordance with a user input received via the user interface.

14. An apparatus according to claim 12, wherein the adjuster comprises:

a tonality determiner operable to determine a level of tonality of the residual signal; and

an adjuster operable to set the bandwidth of the psycho-acoustic filer in dependence upon the determined level of tonality.

15. An apparatus according to claim 1, wherein the data signal has a data signal spectrum, the residual signal has a residual signal spectrum, and the shaper is arranged to shape the data signal spectrum to match the residual signal spectrum.

16. An apparatus according to claim 1, wherein the shaper is arranged to shape the data signal so that the temporal profile of the shaped data signal substantially matches the temporal profile of the residual signal.

17. An apparatus according to claim 1, further comprising a data spreader operable to spread the data signal to generate a spread data signal having a spread spectrum,

wherein the shaper is operable to shape the spread spectrum in dependence upon the residual signal to form the shaped data signal.

18. An apparatus according to claim 17, in which the data spreader comprises a first pseudo-noise code generator operable to generate a first pseudo-noise code,

wherein the data spreader is operable to perform direct sequence spread spectrum encoding using the first pseudo-noise code.

19. An apparatus according to claim 18, wherein the data signal comprises a sequence of data symbols, and wherein the data spreader is operable to combine each data symbol of the data signal with at least part of the first pseudo-noise code.

20. An apparatus according to claim 18, wherein the data signal comprises a sequence of data symbols,

wherein the data spreader further comprises a second pseudo-noise code generator operable to generate a second pseudo-noise code which is different from the first pseudo-noise code, and

wherein the data spreader is operable to represent each data symbol of the data signal by a code sequence from either the first pseudo-noise code or the second pseudo-noise code in dependence upon the value of the data element.

21. An apparatus according to claim 20, wherein the second pseudo-noise code generator is operable to generate a second pseudo-noise code which is substantially orthogonal to the first pseudo-noise code.

22. An apparatus for embedding a data signal within an audio signal, the apparatus comprising:

a first receiver operable to receive the data signal;

a second receiver operable to receive the audio signal;

a time series modeler operable to apply a time series model to the audio signal in order to generate a plurality of coefficients indicative of the audio signal;

a synthesizer operable to synthesize a time domain tonal signal using the generated coefficients;

a subtractor operable to difference the synthesized tonal signal and the audio signal to generate a time domain residual signal;

a sharper operable to shape the spectrum of the data signal in dependence upon the residual signal to form a shaped data signal; and

a signal combiner operable to combine the shaped data signal and the audio signal to generate a modified audio signal.

23. An apparatus according to claim 22, wherein the signal combiner comprises an adder operable to add the shaped data signal and the audio signal to form the modified audio signal.

24. An apparatus according to claim 23, wherein the adder comprises a weighted adder operable to perform a weighted addition in accordance with at least one weighting factor.

25. An apparatus according to claim 24, wherein the signal combiner further comprises an adjuster operable to vary the at least one weighting factor.

26. An apparatus according to claim 25, wherein the adjuster comprises:

a first power monitor operable to determine a power level of the audio signal;

a second power monitor operable to determine a power level of the shaped data signal; and

a setter operable to set the at least one weighting factor in dependence upon the determined power levels of the audio signal and the shaped data signal.

27. An apparatus according to claim 26, wherein the setter is operable to set the at least one weighting factor so that, after weighting, the ratio of the power level of the shaped data signal and the power level of the audio signal is above a predetermined value.

28. An apparatus according to claim 26, wherein the setter is operable to set the at least one weighting factor so that, after weighting, the ratio of the power level of the shaped data signal and the power level of the modified audio signal is above a predetermined value.

29. An apparatus according to claim 25, wherein the adjuster comprises a user interface for receiving a user signal indicative of the at least one weighting factor.

30. An apparatus according to claim 22, wherein the signal combiner comprises:

a first adder operable to add the shaped data signal and the residual signal to form a modified residual signal; and

a second adder operable to add the modified residual signal and the audio signal to form the modified audio signal.

31. An apparatus according to claim 30, wherein the first adder comprises a weighted adder operable to perform a weighted addition of the shaped data signal and the residual signal in dependence upon at least one weighting factor.

32. An apparatus according to claim 31, wherein the first adder further comprises an adjuster operable to vary the at least one weighting factor.

33. An apparatus according to claim 32, wherein the adjuster comprises a user interface for receiving a user signal indicative of the at least one weighting factor.

34. An apparatus according to claim 32, wherein the adjuster comprises:

a tonality monitor operable to determine a level of tonality of the audio signal; and

a setter operable to set the at least one weighting factor in dependence upon the determined level of tonality of the audio signal.

35. An apparatus according to claim 32, wherein the adjuster comprises:

a first power level monitor operable to determine a power level of the residual signal;

a second power level monitor operable to determine a power level of the shaped data signal; and

a setter operable to set the at least one weighting factor in dependence upon the determined power levels of the audio signal and the shaped data signal.

36. An apparatus according to claim 35, wherein the setter is arranged to set the at least one weighting factor so that the ratio of the power level of the shaped data signal and the power level of the residual signal is above a predetermined value.

37. An apparatus for embedding a data signal within an audio signal, the apparatus comprising:

a first receiver operable to receive the data signal;

a second receiver operable to receive the audio signal;

a processor operable to process the audio signal to generate a residual signal representative of a difference between a tonal component of the received audio signal and the received audio signal;

a shaper operable to shape the spectrum of the data signal in dependence upon the residual signal to form a shaped data signal; and

a signal generator operable to generate a tonal signal representative of the tonal component of the received audio signal; and

a signal combiner operable to combine the shaped data signal and the tonal signal to generate a modified audio signal.

38. An apparatus according to claim 37, wherein the signal combiner comprises an adder operable to add the shaped data signal and the tonal signal to form the modified audio signal.

39. An apparatus according to claim 37, wherein the signal combiner comprises:

a first adder operable to add the shaped data signal and the residual signal to form a modified residual signal; and

a second adder operable to add the modified residual signal and the tonal signal to form the modified audio signal.

40. An apparatus according to claim 39, wherein the first adder comprises a weighted adder operable to perform a weighted addition of the shaped data signal and the residual signal in dependence upon at least one weighting factor.

41. An apparatus according to claim 40, wherein the first adder further comprises and adjuster operable to vary the at least one weighting factor.

42. An apparatus according to claim 41, wherein the adjuster comprises a user interface for receiving a user signal indicative of the at least one weighting factor.

43. An apparatus according to claim 41, wherein the adjuster comprises:

a tonality monitor operable to determine a level of tonality of the residual signal; and

a setter operable to set the at least one weighting factor in dependence upon the determined level of tonality of the audio signal.

44. An apparatus according to claim 41, wherein the adjuster comprises:

a first power monitor operable to determine a power level of the residual signal;

means for determining a power level of the shaped data signal; and

a setter operable to set the at least one weighting factor in dependence upon the determined power levels of the audio signal and the shaped data signal.

45. An apparatus according to claim 44, wherein the setter is arranged to set the at least one weighting factor so that the ratio of the power level of the shaped data signal and the power level of the residual signal is above a predetermined value.

46. An apparatus according to claim 37, wherein said tonal signal and said audio signals are time domain signals that are combined by said combiner.

47. An apparatus according to claim 37, comprising a time series modeler operable to apply a time series model to the audio signal in order to generate a plurality of coefficients indicative of the audio signal;

wherein said signal generator is operable to generate said tonal signal using the generated coefficients; and

further comprising a subtractor operable to difference the generated tonal signal and the audio signal to generate a time domain residual signal.

48. A method of shaping a data signal for embedding within an audio signal, the method comprising:

receiving the data signal;

receiving the audio signal;

applying a time series model to the audio signal in order to generate a plurality of coefficients indicative of the audio signal;

synthesising a time domain tonal signal using the generated coefficients;

differencing the synthesized tonal signal and the audio signal to generate a time domain residual signal; and

shaping the data signal in dependence upon the residual signal to form a shaped data signal.

49. A storage device storing instructions including instructions for causing a programmable processing apparatus to shape a data signal for embedding within an audio signal, the instructions comprising:

instructions for receiving the data signal;

instructions for receiving the audio signal;

instructions for applying a time series model to the audio signal in order to generate a plurality of coefficients indicative of the audio signal;

instructions for synthesising a time domain tonal signal using the generated coefficients;

instructions for differencing the synthesized tonal signal and the audio signal to generate a time domain residual signal; and

instructions for shaping the data signal in dependence upon the residual signal to form a shaped data signal.