Fractal harmonic overtone mapping of speech and musical sounds

• US 20050008179A1
• Filed: 07/08/2004
• Published: 01/13/2005
• Est. Priority Date: 07/08/2003
• Status: Active Grant

• Current Assignee: Robert Patel Quinn
• Original Assignee: Robert Patel Quinn
• Inventors: Quinn, Robert Patel
• Granted Patent: US 7,376,553 B2
• Time in Patent Office: Days
• US Class Current: 381/326
• CPC Class Codes: G10L 21/0364 for improving intelligibility
• CPC Class Codes: H04R 2225/43 Signal processing in hearing aids to enhance the speech intelligibility
• CPC Class Codes: H04R 29/001 for loudspeakers H04R29/007 takes precedence

Abstract

An apparatus for signal processing based on an algorithm for representing harmonics in a fractal lattice. The apparatus includes a plurality of tuned segments, each tuned segment including a transceiver having an intrinsic resonant frequency the amplitude of the resonant frequency capable of being modified by either receiving an external input signal, or by internally generating a response to an applied feedback signal. A plurality of signal processing elements are arranged in an array pattern, the signal processing elements including at least one function selected from the group including buffers for storing information, a feedback device for generating a feedback signal, a controller for controlling an output signal, a connection circuit for connecting the plurality of tuned segments to signal processing elements, and a feedback connection circuit for conveying signals from the plurality of signal processing elements in the array to the tuned segments.

Claims

1. An apparatus for signal processing based on an algorithm for representing harmonics in a fractal lattice, the apparatus comprising:

(a) a plurality of tuned segments, each tuned segment including a transceiver having an intrinsic resonant frequency the amplitude of the resonant frequency capable of being modified by at least one of the group consisting of receiving an external input signal, and internally generating a response to an applied feedback signal;

(b) a plurality of signal processing elements arranged in an array pattern, the signal processing elements including at least one function selected from the group consisting of buffer means for storing information, feedback means for generating a feedback signal, controller means for controlling an output signal, connection means for connecting the plurality of tuned segments to signal processing elements, and feedback connection means for conveying signals from the plurality of signal processing elements in the array to the tuned segments.

2. The apparatus according to claim 1 wherein the tuned segments are arranged consecutively in a cochlea-like pattern and together form an active cochlear model device.

3. The apparatus according to claim 1, wherein individual ones of the signal processing elements include a neural-column structure having a plurality of layers, at least some of which layers are capable of functioning as counting circuits.

4. The apparatus according to claim 3, wherein the counting circuits are selected from the group consisting of 2:

1 counters, 3;

1 counters, 5;

1 counters, 7;

1 counters, and 11;

1 counters.

5. The apparatus according to claim 3, wherein the plurality of signal processing elements are arranged so that an output from the counting circuits can be directed to a counting circuit in another signal processing element in order to generate a plurality of signals at subharmonic frequencies, each subharmonic frequency being associated with a separate signal processing element.

6. The apparatus according to claim 1, wherein the algorithm comprises the steps of:

(a) creating a rectangular array, with position along the row indicating magnitude in the first dimension and position in the column indicating magnitude along a second dimension;

(b) making a plurality of copies of the array and displacing them horizontally for the next dimension, the plurality of arrays indicating the various magnitudes;

(c) making a plurality of copies of all the previous arrays and displacing them vertically, the plurality of arrays corresponding to various magnitudes in the next dimension, and the totality in effect being a larger array;

(d) repeating step (b) and then step (c) alternately for subsequent dimensions; and

(e) associating a value R with each point on a fractal lattice according to a formula having a factor for each dimension, with each factor having an integer exponent for each magnitude, the formulae following the prototype;

associating a value R with each point (j,k,l,m,n) on the fractal lattice, according to the formula for five dimensions;

#EQ1# R=2.sup.j*3.sup.k*5.sup.L*7.sup.m*11.sup.n.

where the factors 2, 3, 5, 7, and 11 are dimensions and j, k, l, m, and n are magnitudes.

7. The apparatus according to claim 1, wherein a fractal lattice of a reduced number of dimensions is provided, with mapping based on:

(a) four dimensions corresponding to the factors 3, 5, 7, and 11;

(b) mapping based on three dimensions corresponding to the factors 3, 5, and 7 or the factors 3, 5, and 11;

(c) mapping based on the two dimensions corresponding to the factors 3 and 5; and

(d) in (a), (b), and (c), associating values to points on the fractal lattice according to a formula with a factor for each dimension, and integer exponents for each magnitude.

8. The apparatus according to claim 1, wherein a fractal lattice with dimensions numbering greater than five is constructed based on factors selected from the group consisting of 13, 17, 19, 23, and higher prime numbers;

and a fractal lattice is constructed based on factors that are composite numbers, the mapping associating values with points on the fractal lattice according to a formula with a factor for each dimension, and integer exponents for each magnitude.

9. The apparatus according to claim 1, and including feedback adjustment means for adjusting feedback to tuned segments to provide a subthreshold signal (at the characteristic frequency) that improves sensitivity to amplitudes near a threshold value.

10. The apparatus according to claim 9, wherein feedback signals are fed from a plurality of points forming a pattern on a fractal map that includes harmonically related signals that minimize interference beating due to alternating constructive and destructive interference.

11. The apparatus according to claim 9, wherein feedback signals are from a plurality of points forming a pattern on a fractal map that are sampled rapidly to maintain phase sensitivity and produce a strobing effect in the cochlear model.

12. The apparatus according to claim 9, wherein harmonically related signals of similar phase derived from subharmonic generators are used to reinforce input signals at tuned segments by subthreshold strobing at the characteristic frequency of such segments.

13. The apparatus according to claim 9, wherein feedback signals are fed from a plurality of points on a fractal map having subregions with at least two separate phases simultaneously, each phase directed to distinct segments of the cochlear model, including but not limited to those responding to input signals from different sources.

14. The apparatus according to claim 9, wherein feedback signals from a single point on a fractal map are directed to a plurality of segments that correspond to magnitudes along one of the dimensions of the fractal map, wherein the magnitudes are selected from a multiplexed signal from one signal processing element to multiple segments having characteristic frequencies F, 2F, 4F, 8F, 16F and 32F.

15. The apparatus according to claim 9, wherein feedback signals from a plurality of points forming a pattern that moves sequentially across a fractal map are directed to a plurality of tuned segments to reinforce transient input signals.

16. The apparatus according to claim 1, wherein signal processing elements are combined to function as a rhythm generator for output signals or information storage.

17. The apparatus according to claim 1, wherein an optimal number of tuned segments and signal processing elements are determined by the degree of fine-grainedness and speed of acquisition of the input signal.

18. The apparatus according to claim 1, wherein an optimal number of tuned segments and signal processing elements are determined by the degree of fine-grainedness and speed of a feedback response.

19. The apparatus according to claim 1, wherein an optimal number of dimensions in the fractal lattice and range of values in each dimension is sensitivity and specificity of input and feedback signals of the individual tuned segments of the transceiver.

20. The apparatus according to claim 1, wherein an optimal number of dimensions in the fractal lattice and range of values in each dimension is determined by computational complexity and processing speed.

21. The apparatus according to claim 1, wherein the fractal lattice includes guide means for guiding an organizational pattern for local sections of the array by performing at least one of the processes in a group consisting of:

(a) establishing sensory and feedback connections between the signal processing element for a given frequency and the tuned segment having approximately the same characteristic frequency;

(b) generating a plurality of subharmonic signals that fall within the relevant frequency range of the tuned segments, and tentatively connecting these signal processing elements to the appropriate tuned segments;

(c) selecting unassigned tuned segments and tentatively connecting them to available signal processing elements at dispersed points in the array, approximately matching the intrinsic frequency of each tuned segment with signal processing elements that can create a rhythm generator for another local area of subharmonic frequencies;

(d) maintaining areas of overlapping subharmonics if their interacting counting circuits can be shared and are consistent, and removing the tentative connections if they are inconsistent;

(e) removing the tentative connections from elements in the array if their feedback goes to neighboring tuning segments that are too close together, so that similarly tuned neighboring segments become associated with signal processing elements that are widely spaced; and

(f) continuing until signal processing elements are connected to a sufficient number of tuning segments and a sufficient number of subharmonic generators have been organized to cover the array.

22. The apparatus according to claim 1, wherein the apparatus comprises a computer readable medium.

23. A method of signal processing based on an algorithm for distributed representation of signals, and of the harmonic relations between components of such signals, represented by a fractal lattice which includes multiple dimensions based on harmonic fields, the method comprising the steps of:

(a) mapping input signals to signal processing elements arranged in an array;

(b) processing signals to generate a plurality of feedback signals at subharmonic frequencies; and

(c) combining the plurality of feedback signals with subsequent input signals.

24. The method according to claim 23, and further including the step of providing additional harmonic information in an expanded fractal lattice reflecting a dimension selected from the group consisting of 13, 17, 19, 23, and higher prime numbers.

25. The method according to claim 23, and including the step of simplifying the algorithm by removing one or more factors in order to allow a fractal lattice of a recorded dimension.

26. The method according to claim 23, and including the step of modeling an input signal as a spectral representation selected from the group consisting of a discrete Fourier transform and a logarithmic frequency spectrum.

27. The method according to claim 23, and including the step of deriving the input signal from speech sounds.

28. The method according to claim 23, and including the step of deriving the input signal from the group consisting of musical sounds, a mixture of speech and music, and a mixture of audio signals other than speech, music and a mixture of speech and music.

29. The method according to claim 23, and including the step of deriving the input signal from signals of unknown origin.

30. A computer readable medium having instructions for performing steps according to the method of claim 23.

31. A method for connecting tuned segments to elements in a signal processing array, the method including a step selected from the group consisting of:

(a) establishing initial sensory and feedback connections between a signal processing element for a given frequency and a tuned segment having approximately the same characteristic frequency;

(b) making connections to segments with a frequency lower than a given segment, by generating a plurality of subharmonic signal that fall within the relevant frequency range of the tuned segments, and tentatively connecting at least one signal processing elements to the appropriate tuned segments;

(c) making connections to segments with a frequency higher than a given segment, by using a fractal map with a reduced number of dimensions so that the magnitude along one dimension is not specified;

(d) allowing in effect a multiplexed feedback signal from a point in the fractal map, such as a signal at characteristic frequencies F, 2F, 4F, 8F, 16F and 32F;

(e) selecting unassigned tuned segments and tentatively connecting them to available signal processing elements at dispersed points in the array, thereby approximately matching the intrinsic frequency of each tuned segment;

(f) balancing the processes of connecting signal processing elements to lower frequency segments and the process of connecting signal processing elements to higher frequency segments;

(g) maintaining areas of overlapping subharmonics if their interacting counting circuits can be shared and are consistent, and removing tentative connections if they are inconsistent;

(h) maintaining connections to points in the fractal map of higher frequency if their multiplexed signals are consistent, and removing tentative connections from the points in the fractal map if they are inconsistent; and

(i) repeating any one of steps (a)-(h) until signal processing elements are connected to a sufficient number of tuning segments, and a sufficient number of subharmonic generators have been organized to cover the array.