Envelope-controlled dynamic layering of audio signal processing and synthesis for music applications

• US 20050120870A1
• Filed: 01/21/2005
• Published: 06/09/2005
• Est. Priority Date: 05/15/1998
• Status: Abandoned Application

• Current Assignee: NRI R&D Patent Licensing, LLC (Advanced Touchscreen and Gesture Technologies, LLC)
• Original Assignee: NRI R&D Patent Licensing, LLC (Advanced Touchscreen and Gesture Technologies, LLC)
• Inventors: Ludwig, Lester F.
• Application Number:
  US11/040,163
• Publication Number:
  US 20050120870A1
• Time in Patent Office: Days
• US Class Current: 84/661
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 1/0058 Transmission between separate instruments or between individual components of a musical system G10H1/0083 takes precedence
• CPC Class Codes: G10H 2220/521 Hall effect transducers or similar magnetic field sensing semiconductor devices, e.g. for string vibration sensing or key movement sensing
• CPC Class Codes: G10H 2230/095 Spint zither, i.e. mimicking any neckless stringed instrument in which the strings do not extend beyond the sounding board
• CPC Class Codes: G10H 2230/101 Spint koto, i.e. mimicking any traditional asian-style plucked zither with movable bridges
• CPC Class Codes: G10H 2230/115 Spint sitar, i.e. mimicking any long-necked plucked string instrument with a large number of additional non-playable sympathetic resonating strings or an additional gourd-like resonating chamber
• CPC Class Codes: G10H 2230/145 Spint guitar keyboard, i.e. mimicking a combination of a guitar-like instrument, with or without strings, and a piano-like keyboard, e.g. with white and black keys arranged like on a piano
• CPC Class Codes: G10H 2230/271 Spint gong, i.e. mimicking circular flat, nippled or bowl-shaped metallic percussion instruments G10H2230/321 takes precedence
• CPC Class Codes: G10H 3/26 using electric feedback

Abstract

Parallel operations on the amplitude envelope of a single-channel or multiple-channel electronic instrument or vocal signal may be used to control rich layered audio signal processing and/or audio synthesis environments. The controllable layered audio signal processing and audio synthesis environments may comprise dedicated or shared processor and synthesis elements, respectively, though use of pre-mixing and merging operations. Detection operations performed on the envelope of an applied audio signal may include level detection operations, rate sign (i.e., level increasing versus decreasing) detection operations, and rate magnitude detection operations. These operations may control rich layered audio signal processing environments and/or audio synthesis environments directly, while other embodiments may incorporate the use of state machines in the control chain. The applied audio signal may be pre-processed by signal processing before application to envelope detection, and combinations of such envelopes may be used. Hysteretic effects may be invoked across increasing and decreasing variation in envelope parameters.

Claims

1. A method for processing audio signals, comprising:

receiving an incoming audio signal;

producing an envelope signal responsive to said incoming audio signal; and

processing said envelope signal according to a parameterized transformation of said envelope signal to generate a plurality of control signals.

2. The method according to claim 1, wherein said parameterized transformation is determined by a plurality of parameters, each defined by data.

3. The method according to claim 1, wherein said parameterized transformation is determined by at least one parameter defined by data.

4. The method according to claim 3, said method further comprising:

storing said data in memory.

5. The method according to claim 3, said method further comprising:

retrieving said data from memory.

6. The method according to claim 5, said method further comprising:

initiating said retrieving responsive to an incoming MIDI signal.

7. The method according to claim 4, said method further comprising:

selecting said data responsive to an incoming MIDI signal.

8. The method according to claim 3, said method further comprising:

using a data entry editor to manipulate said data.

9. The method according to claim 1, wherein said parameterized transformation comprises at least one interpolating curve.

10. The method according to claim 9, said method further comprising:

specifying said at least one interpolating curve from a plurality of possible interpolating curves.

11. The method according to claim 10, wherein said specifying is responsive to an incoming MIDI signal.

12. The method according to claim 9, said method further comprising:

retrieving curve specification data from memory, said curve specification data defining said at least one interpolating curve.

13. The method according to claim 12, wherein said retrieving is responsive to an incoming MIDI signal.

14. The method according to claim 1, said method further comprising:

comparing values of said envelope signal relative to a magnitude of a threshold value; and

determining said parameterized transformation based upon said magnitude.

15. The method according to claim 1, said method further comprising:

detecting a rate of change in value of said envelope signal; and

determining said parameterized transformation based upon said rate of change.

16. The method according to claim 1, said method further comprising:

detecting a relative increase or decrease in rate of change in value of said envelope signal; and

determining said parameterized transformation based upon said relative increase or decrease in rate of change in value of said envelope signal.

17. The method according to claim 1, said method further comprising:

detecting magnitude of a rate of change in value of said envelope signal; and

determining said parameterized transformation based upon said magnitude.

18. The method according to claim 1, said method further comprising:

controlling a plurality of audio signal processors using said plurality of control signals.

19. The method according to claim 18, said method further comprising:

communicating said incoming audio signal to each of said plurality of controllable audio signal processors.

20. The method according to claim 1, wherein each of said plurality of control signals is individually determined according to an associated attribute of said parameterized transformation.

21. The method according to claim 1, said method further comprising:

controlling a plurality of audio synthesis elements using said plurality of control signals

22. The method according to claim 21, said method further comprising:

communicating said incoming audio signal to each of said plurality of audio synthesis elements, wherein at least one of said plurality of audio synthesis elements creates an audio signal responsive to said incoming audio signal.

23. The method according to claim 1, said method further comprising:

controlling a plurality of audio signal processors using said plurality of control signals; and

controlling a plurality of audio synthesis elements using said plurality of control signals.

24. The method according to claim 23, wherein said plurality of audio signal processors and said plurality of audio synthesis elements are controlled by the same plurality of said control signals.

25. The method according to claim 23, wherein said plurality of audio signal processors and said plurality of audio synthesis elements are controlled by a different plurality of said control signals.

26. The method according to claim 23, said method further comprising:

communicating said incoming audio signal to at least one of said plurality of audio synthesis elements, wherein at least one of said plurality of audio synthesis elements creates an audio signal responsive to said incoming audio signal.

27. The method according to claim 1, said method further comprising:

receiving a plurality of incoming audio signals;

producing a separate envelope signal responsive to each of said plurality of incoming audio signals; and

processing each of said plurality of envelope signals according to a parameterized transformation of said plurality of envelope signals to generate a plurality of control signals for each of said plurality of envelope signals.

28. The method according to claim 27, wherein said processing of each of said plurality of envelope signals is performed by a single processor.

29. The method according to claim 1, said method further comprising:

responsively controlling said processing using a remote control signal provided by a user control device.

30. The method according to claim 29, wherein said user control device comprises a footswitch.

31. The method according to claim 1, said method further comprising:

controlling said processing responsive to a state of a state machine.

32. The method according to claim 31, said method further comprising:

comparing values of said envelope signal relative to a magnitude of a threshold value; and

determining said state of said state machine responsive to said magnitude.

33. The method according to claim 31, said method further comprising:

detecting a rate of change in value of said envelope signal; and

determining said state of said state machine responsive to said rate of change in value of said envelope signal.

34. The method according to claim 31, said method further comprising:

detecting a relative increase or decrease in rate of change in value of said envelope signal; and

determining said state of said state machine responsive to said relative increase or decrease in rate of change in value of said envelope signal.

35. The method according to claim 31, said method further comprising:

detecting magnitude of a rate of change in value of said envelope signal; and

determining a state of said state machine responsive to said magnitude.

36. The method according to claim 1, wherein said plurality of control signals are signals of MIDI format.

37. The method according to claim 36, said method further comprising:

communicating said plurality of control signals to a corresponding plurality of MIDI output ports.

38. The method according to claim 1, said method further comprising:

initiating said processing responsive to a incoming MIDI signal.

39. A system for processing audio signals, comprising:

an envelope detector for producing an envelope signal responsive to an incoming audio signal; and

a processor for processing said envelope signal according to a parameterized transformation of said envelope signal, said processor responsively generating a plurality of control signals.

40. A system for processing audio signals, comprising:

means for receiving an incoming audio signal;

means for producing an envelope signal responsive to said incoming audio signal; and

means for processing said envelope signal according to a parameterized transformation of said envelope signal, said processing means responsively generating a plurality of control signals.