Processing and generation of control signals for real-time control of music signal processing, mixing, video, and lighting

• US 7,786,370 B2
• Filed: 03/19/2001
• Issued: 08/31/2010
• Est. Priority Date: 05/15/1998
• Status: Expired due to Fees

• Current Assignee: NRI R&D Patent Licensing, LLC (Advanced Touchscreen and Gesture Technologies, LLC)
• Original Assignee: Lester Frank Ludwig
• Inventors: Ludwig, Lester Frank
• Primary Examiner(s): Fletcher; Marlon T
• Application Number:
  US09/812,400
• Publication Number:
  US 20020007723A1
• Time in Patent Office: 3,452 Days
• Field of Search: 846/45, 84600-603, 84609-614, 84622-633, 846/58, 84687-690, 844/64.R, 844/64.A, 327/555
• US Class Current: 84/645
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 1/0058 Transmission between separate instruments or between individual components of a musical system G10H1/0083 takes precedence
• CPC Class Codes: G10H 1/0066 using a MIDI interface
• CPC Class Codes: G10H 1/348 Switches actuated by parts of the body other than fingers
• CPC Class Codes: G10H 1/46 Volume control
• CPC Class Codes: G10H 2220/521 Hall effect transducers or similar magnetic field sensing semiconductor devices, e.g. for string vibration sensing or key movement sensing
• CPC Class Codes: G10H 2220/525 Piezoelectric transducers for vibration sensing or vibration excitation in the audio range; Piezoelectric strain sensing, e.g. as key velocity sensor; Piezoelectric actuators, e.g. key actuation in response to a control voltage
• CPC Class Codes: G10H 2230/095 Spint zither, i.e. mimicking any neckless stringed instrument in which the strings do not extend beyond the sounding board
• CPC Class Codes: G10H 2230/101 Spint koto, i.e. mimicking any traditional asian-style plucked zither with movable bridges
• CPC Class Codes: G10H 2230/115 Spint sitar, i.e. mimicking any long-necked plucked string instrument with a large number of additional non-playable sympathetic resonating strings or an additional gourd-like resonating chamber
• CPC Class Codes: G10H 2230/145 Spint guitar keyboard, i.e. mimicking a combination of a guitar-like instrument, with or without strings, and a piano-like keyboard, e.g. with white and black keys arranged like on a piano
• CPC Class Codes: G10H 2230/271 Spint gong, i.e. mimicking circular flat, nippled or bowl-shaped metallic percussion instruments G10H2230/321 takes precedence
• CPC Class Codes: G10H 3/18 using a string, e.g. electric guitar mechanical features G10D1/085
• CPC Class Codes: G10H 3/26 : using electric feedback
• CPC Class Codes: Y10S 84/10 : Feedback

Abstract

A system and method for processing and generating control signals for the real-time controlling of signal processors, synthesizers, musical instruments, MIDI processors, lighting, video, and special effects in performance, recording, and composition environments. The invention provides for the use of incoming control signals to control events and parameters of low-frequency oscillators and transient generators. The invention also provides for the processing of control signal values such as addition, multiplication, mirroring, offset, etc., individually or in combination with one another. The invention further provides for the conversion of one type of control signal to another type of control signal, for example conversion of MIDI “note-on message” parameters such as note number and velocity into MIDI “continuous controller messages” etc. The invention is particularly directed towards, but not limited to, the processing and generation of control signals in the form of MIDI messages.

Claims

1. A control signal processing system for responsively generating MIDI control signals, said system comprising:

an incoming control signal interface adapted to receive an incoming MIDI control signal;

a controllable low frequency oscillator comprising at least one parameter, said at least one parameter comprising a value selectable from a plurality of values, wherein said value of said at least one parameter is determined by said incoming MIDI control signal, and wherein said controllable low frequency oscillator is adapted to generate an outgoing MIDI control signal responsive to said value of said at least one parameter; and

an outgoing control signal interface adapted to communicate said outgoing MIDI control signal.

2. The system according to claim 1, wherein frequency of said controllable low frequency oscillator is controlled by said value of said at least one parameter.

3. The system according to claim 1, wherein a waveform of said controllable low frequency oscillator is controlled by said value of said at least one parameter.

4. The system according to claim 1, further comprising:

a plurality of controllable low frequency oscillators, each comprising at least one parameter, wherein said at least one parameter, for each of said plurality of controllable low frequency oscillators, comprises a value selectable from a plurality of values, wherein said value of said at least one parameter is determined by said incoming MIDI control signal, and wherein each of said plurality of controllable low frequency oscillators is adapted to generate a separate outgoing MIDI control signal responsive to said at least one parameter.

5. The system according to claim 4, wherein one of said plurality of controllable low frequency oscillators is a master low frequency oscillator.

6. The system according to claim 5, wherein at least one of said plurality of controllable low frequency oscillators is a slave low frequency oscillator producing an oscillation that is driven by said master low frequency oscillator.

7. The system according to claim 6, wherein said slave low frequency oscillator produces an oscillation that is phase shifted.

8. The system according to claim 6, wherein said slave low frequency oscillator produces a waveform that is different from a waveform that is produced by said master low frequency oscillator.

9. The system according to claim 6, wherein phase of said slave low frequency oscillator is controlled by said value of said at least one parameter.

10. The system according to claim 6, wherein frequency of said master low frequency oscillator is controlled by said value of said at least one parameter.

11. A control signal processing system for responsively generating MIDI control signals, said system comprising:

an incoming control signal interface adapted to receive an incoming MIDI control signal;

a controllable envelope generator comprising at least one parameter, said at least one parameter comprising a value selectable from a plurality of values, wherein said value of said at least one parameter is determined by said incoming MIDI control signal, and wherein said controllable envelope generator is adapted to generate an outgoing MIDI control signal responsive to said value of said at least one parameter; and

an outgoing control signal interface adapted to communicate said outgoing MIDI control signal.

12. The system according to claim 11, wherein said controllable envelope generator is a ramp generator.

13. The system according to claim 11, wherein said controllable envelope generator is a transient generator comprising a slew limiter.

14. A method for processing control signals to generate a non-merging mathematical function of values of said control signals, said method comprising:

obtaining a first control signal value from a first incoming real-time MIDI control signal;

obtaining a second control signal value from a second incoming MIDI control signal;

numerically multiplying said first control value and said second control value to produce a multiplied value; and

generating an outgoing MIDI control signal based upon said multiplied value.

15. The method according to claim 14, wherein prior to said generating, said method further comprising:

adding an offset to said multiplied value.

16. The method according to claim 15, wherein said offset is determined by a third incoming MIDI control signal.

17. A method for processing control signals to generate a non-merging mathematical function of values of said control signals, said method comprising:

obtaining a first control signal value from a first incoming real-time MIDI control signal;

obtaining a second control signal value from a second incoming MIDI control signal;

numerically adding said first control value and said second control value to produce a summed value; and

generating an outgoing MDI control signal based upon said summed value.

18. The method according to claim 17, wherein prior to said generating, said method Thither comprising:

multiplying said summed value by a scaling value.

19. The method according to claim 18, wherein said scaling value is determined by a third incoming MIDI control signal.

20. A method for generating an outgoing control signal, said method comprising:

receiving a first incoming MIDI control signal comprising a first event and a first control signal value;

receiving a second incoming MDI control signal comprising a second event and a second control signal value;

identifying a temporal sequence of said first and second events of said first and second incoming MIDI control signals;

obtaining a first control signal value from a first incoming MDI control signal;

obtaining a second control signal value from a second incoming MIDI control signal; and

generating an outgoing MIDI control signal comprising an output value determined by a combination of said temporal sequence, said first control signal value, and said second control signal value.

21. The method according to claim 20, wherein said first incoming MIDI control signal comprises a plurality of first events and a plurality of first control signal values;

and wherein

said second incoming MDI control signal comprises a plurality of second events and a plurality of second control signal values, said method Thither comprising;

identifying a temporal sequence of said plurality of first and second events of said first and second incoming MIDI control signals; and

generating said outgoing MIDI control signal comprising said output value determined by said temporal sequence of said plurality of first and second events, said first control signal value, and said second control signal value.

22. A method for processing real-time MIDI control signals, said method comprising:

receiving an incoming real-time MIDI note event control signal;

obtaining a MIDI note number value from said incoming real-time MIDI note event control signal;

changing said MIDI note number value to a MIDI continuous controller value; and

generating an outgoing real-time MIDI control signal comprising said MIDI continuous controller value.

23. A method for processing real-time MIDI control signals, said method comprising:

receiving an incoming real-time MIDI note event control signal;

obtaining a MDI note velocity value from said incoming real-time MIDI note event control signal;

changing said MIDI note velocity value to a MIDI continuous controller value; and

generating an outgoing real-time MIDI control signal comprising said MIDI continuous controller value.

24. A method for processing real-lime MIDI control signals, said method comprising:

receiving an incoming real-time MIDI continuous controller control signal;

obtaining a MIDI continuous controller value from said incoming real-time MIDI continuous controller control signal;

changing said MIDI continuous controller value to a MIDI note value; and

generating an outgoing real-time MIDI note event control signal comprising said MIDI note value.

25. A method for processing real-time MIDI control signals, said method comprising:

receiving an incoming real-time MIDI continuous controller control signal;

obtaining a MIDI continuous controller value from said incoming real-time MIDI continuous controller control signal;

multiplying said MDI continuous controller value with a scale value; and

generating an outgoing real-time MIDI control signal comprising said MIDI continuous controller value multiplied by said scale value.

26. A method for processing real-time MDI control signals, sald method comprising:

receiving an incoming real-time MDI continuous controller control signal;

obtaining a MDI continuous controller value from said incoming real-time MIDI continuous controller control signal;

adding an offset to said MIDI continuous controller value; and

generating an outgoing real-time MDI control signal comprising said MIDI continuous controller value and said added offset.

27. A method for processing real-time MDI control signals, said method comprising:

receiving an incoming real-time MIDI continuous controller control signal;

obtaining an incoming MIDI continuous controller value from said incoming real-time MIDI continuous controller control signal;

generating an outgoing MIDI continuous controller value having a magnitude which is complementary to said MIDI continuous controller value; and

generating an outgoing real-time MIDI control signal comprising said outgoing MIDI continuous controller value.

28. A method for processing real-time MIDI control signals, said method comprising:

receiving an incoming real-time MIDI note event control signal;

obtaining an incoming MIDI note number value from said incoming real-time MIDI note event control signal;

changing said incoming MIDI note number value to an outgoing MIDI note number value according to a variably transposed intelligent harmony; and

generating an outgoing real-time MIDI note event control signal comprising said outgoing MIDI note number value.

29. The method according to claim 28, said method further comprising:

controlling said variably transposed intelligent harmony using information provided in a second incoming real-time MIDI control signal.

30. The method according to claim 29, wherein said second incoming real-time MIDI control signal is a MIDI note event control signal.

31. The method according to claim 29, wherein said second incoming real-time MIDI control signal is a MIDI continuous controller control signal.