Sound modification employing spectral warping techniques

• US 6,182,042 B1
• Filed: 07/07/1998
• Issued: 01/30/2001
• Est. Priority Date: 07/07/1998
• Status: Expired due to Term

• Current Assignee: Creative Technology Ltd.
• Original Assignee: Creative Technology Ltd.
• Inventors: Peevers, Alan
• Primary Examiner(s): Hudspeth, David R.
• Assistant Examiner(s): MCFADDEN, SUSAN IRIS
• Application Number:
  US09/111,059
• Time in Patent Office: 938 Days
• Field of Search: 704/500, 704/501, 704/270, 704/203, 704/205, 704/241, 704/268, 704/269
• US Class Current: 704/269
• CPC Class Codes: G10H 2250/235 Fourier transform; Discrete Fourier Transform [DFT]; Fast Fourier Transform [FFT]
• CPC Class Codes: G10H 2250/261 Window, i.e. apodization function or tapering function amounting to the selection and appropriate weighting of a group of samples in a digital signal within some chosen time interval, outside of which it is zero valued
• CPC Class Codes: G10H 2250/501 Formant frequency shifting, sliding formants
• CPC Class Codes: G10H 7/08 by calculating functions or polynomial approximations to evaluate amplitudes at successive sample points of a tone waveform

Abstract

A system and method for modifying a subportion of information contained in an audio, such as magnitude information, without substantially effecting the remaining information contained therein, such a phase information. An incoming audio signal is segmented into a sequence of overlapping windowed DFT representations, during an analysis step, and during a synthesis step the DFT representations are converted back to a time domain signal. Each of the DFT representations consists of a plurality of frequency components obtained during a period of time. Each of the frequency components is associated with a unique increment of the period. Subsequent to the analysis step, but before the synthesis step, the frequency components of the DFT representations are re-mapped so as to have a differing temporal relationship with respect to the increments of the period of time.

Claims

1. A method of applying a transformation to a digital audio signal comprising the steps of:

capturing a frequency domain representation of a first time segment of said digital audio signal, said frequency domain representation comprising a plurality of bins, each said bin holding a complex value having a first magnitude and a first phase;

modifying said first magnitude of a first selected bin of said plurality of bins by using a bin number of said first selected bin as an index to a look-up table that provides a bin number of a second selected bin holding a second magnitude to be used to replace said first magnitude of said first selected bin;

repeating said modifying step for a plurality of selected bins of said plurality of bins; and

converting said digital audio signal into an analog audio signal in an digital-to-analog converter.

2. The method as recited in claim 1 wherein said modifying step comprises preserving a phase of said first selected bin while modifying said magnitude.

3. The method as recited in claim 1 wherein values stored at adjacent locations of said lookup table define a slope and further including a step, following said modifying step, of attenuating the said second magnitudes associated with adjacent bins of said plurality of bins having a slope of a predetermined value.

4. The method as recited in claim 1 wherein said second selected bin has associated therewith said second magnitude and a second phase, with said modifying step comprising the steps of normalizing said complex value associated with said first selected bin, defining a normalized value, and ascertaining a product of said normalized value and said second magnitude.

5. The method as recited in claim 1 wherein said second selected bin has associated therewith said second magnitude and a second phase, with said modifying step comprising replacing said first magnitude with said second magnitude and replacing said first phase with said second phase.

6. The method as recited in claim 1 wherein said look-up table includes multiple indices and stores a sequence of bin numbers, with each of said bin numbers of said sequence corresponding to one of said plurality of bins and further including the step, before said modifying step, of multiplying one of said bin numbers by a scalar, thereby referencing a different one of said plurality of bins and producing a different said second magnitude.

7. The method as recited in claim 5 wherein said capturing step includes capturing a frequency domain representation of successive time segments of said digital audio signal and further including a step, prior to said modifying step, of varying said scalar so as to be different for a subset of said successive time segments, defining successive bin numbers and second magnitudes.

8. The method as recited in claim 6 wherein said varying step comprises an interpolation between a first and second set of bin numbers.

9. The method as recited in claim 6 wherein said successive bin numbers define a slope, with said modifying step comprising the step of attenuating magnitudes associated with successive bin numbers having a slope of a predetermined value.

10. A method of applying a transformation to a digital audio signal comprising the steps of:

capturing a frequency domain representation of successive time segments of said digital audio signal, defining a plurality of frequency domain representations each of which includes a plurality of bins, with each of said plurality of bins having a complex value associated therewith comprising a first magnitude and a first phase;

modifying said first magnitude of a first selected bin of said plurality of bins while preserving said first phase of said first selected bin by using the bin number of said first selected bin as an index to a look-up table that provides a second bin number of a second selected bin having a second magnitude to be used to replace said first magnitude of said first selected bin;

repeating said modifying step for a plurality of selected bins of said plurality of bins; and

converting said digital audio signal into an analog audio signal in an digital-to-analog converter.

11. The method as recited in claim 10 wherein said second selected bin holds a second complex value having said second magnitude and a second phase, with said modifying step comprising the steps of normalizing said complex value associated with said first selected bin, defining a normalized value, and ascertaining a product of said normalized value and said second magnitude.

12. The method as recited in claim 10 further including a step, before said modifying step, of varying said second bin number associated with said second selected bin so as to be different for a subset of said successive time segments, referring to different successive bin magnitudes.

13. The method as recited in claim 12 wherein said varying step includes selectively multiplying said second bin number by a scalar.

14. The method as recited in claim 13 wherein said successive bin numbers associated with each bin of said plurality of bins define a slope, and further including the step, following said modifying step, of attenuating magnitudes associated with successive bin numbers having a slope of a predetermined value.

15. The system as recited in claim 14 wherein the slope of successive bin numbers in said look-up table defines a formant correcting characteristic, such that said slope is decreased as notes below a base note are played and slope is increased as notes above a base note are played.

16. The method as recited in claim 10 wherein said additional selected bins have associated therewith said second magnitude and a second phase, with said code to modify comprising code to replace said first magnitude with said second magnitude and replace said first phase with said second phase.

17. A signal processing system configured to process a digital audio signal comprising:

a processing unit; and

a memory holding digital data corresponding to said digital audio signal;

said memory storing code to be operated on by said processing unit, said code including means for capturing a frequency domain representation of a first time segment of said digital audio signal, said frequency domain representation comprising a plurality of bins, each said bin holding a complex value having a first magnitude and a first phase;

means for modifying said first magnitude of a first selected bin of said plurality of bins while preserving a phase of said first selected bin by using a bin number of said first selected bin as an index to a look-up table that provides a bin number of a second selected bin holding a second magnitude to be used to replace said first magnitude of said first selected bin; and

a digital-to-analog converter for converting said digital audio signal into an analog audio signal.

18. The system as recited in claim 17 wherein said capturing means captures multiples frequency domain representations each pair of which is associated with successive time segments of said digital audio signal, with said code further including means for varying said second magnitude associated with said second selected bin so as to be different for a subset of said successive time segments, defining successive bin magnitudes.

19. The system as recited in claim 17 wherein modifying means modifies said first magnitude of each of a subset of said plurality of bins.

20. The system as recited in claim 17 wherein the first magnitude associated with adjacent bins of said plurality of bins define a slope, with said code further including means for attenuating the magnitudes associated with adjacent bins of said plurality of bins having a slope of a predetermined value.

23. The computer program product as recited in claim 20 wherein said additional selected bins have associated therewith said second magnitude and a second phase, with said code to modify comprising code to normalize said complex value associated with said first selected bin, defining a normalized value, and ascertaining a product of said normalized value and said second magnitude.

21. A computer program product that controls a computer to transform a digital audio signal, comprising:

code to capture a frequency domain representation of a first time segment of said digital audio signal, said frequency domain representation comprising a plurality of bins, each said bin holding a complex value having a first magnitude and a first phase; and

code to modify said first magnitude of multiple selected bins of said plurality of bins by using a bin number of said multiple selected bins as an index to a look-up table that provides bin numbers of additional selected bins holding a second magnitude to be used to replace said first magnitude of said multiple selected bins;

wherein said modified digital audio signal is converted into an analog audio signal in a digital-to-analog converter.

22. The computer program product as recited in claim 21 wherein values stored at adjacent locations of said lookup table define a slope and further including code to attenuate the said second magnitudes associated with adjacent bins of said plurality of bins having a slope of a predetermined value.

24. The computer program product as recited in claim 21 wherein said code to modify further includes code to preserve a phase of said multiple selected bins when modifying said magnitude.