COMPUTER INTERFACE FOR POLYPHONIC STRINGED INSTRUMENTS

• US 20100037755A1
• Filed: 07/10/2009
• Published: 02/18/2010
• Est. Priority Date: 07/10/2008
• Status: Abandoned Application

• Current Assignee: Stringport, LLC
• Original Assignee: Stringport, LLC
• Inventors: Shaver, Chris, McMillen, Keith
• Application Number:
  US12/501,015
• Publication Number:
  US 20100037755A1
• Time in Patent Office: Days
• US Class Current: 84/645
• CPC Class Codes: G10H 1/125 using a digital filter
• CPC Class Codes: G10H 1/342 for guitar-like instruments with or without strings and with a neck on which switches or string-fret contacts are used to detect the notes being played electric guitars in which the tones are generated by the vibration of strings G10H3/18
• CPC Class Codes: G10H 2210/031 Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal
• CPC Class Codes: G10H 2210/155 Musical effects
• CPC Class Codes: G10H 2210/311 Distortion, i.e. desired non-linear audio processing to change the tone colour, e.g. by adding harmonics or deliberately distorting the amplitude of an audio waveform
• CPC Class Codes: G10H 2220/155 User input interfaces for electrophonic musical instruments
• CPC Class Codes: G10H 2220/161 with 2D or x/y surface coordinates sensing
• CPC Class Codes: G10H 2220/361 Mouth control in general, i.e. breath, mouth, teeth, tongue or lip-controlled input devices or sensors detecting, e.g. lip position, lip vibration, air pressure, air velocity, air flow or air jet angle
• CPC Class Codes: G10H 2220/395 Acceleration sensing or accelerometer use, e.g. 3D movement computation by integration of accelerometer data, angle sensing with respect to the vertical, i.e. gravity sensing
• CPC Class Codes: G10H 2240/285 USB, i.e. either using a USB plug as power supply or using the USB protocol to exchange data
• CPC Class Codes: G10H 2240/311 MIDI transmission G10H2240/056 takes precedence
• CPC Class Codes: G10H 2250/311 Neural networks for electrophonic musical instruments or musical processing, e.g. for musical recognition or control, automatic composition or improvisation
• CPC Class Codes: G10H 2250/501 Formant frequency shifting, sliding formants
• CPC Class Codes: G10H 2250/615 Waveform editing, i.e. setting or modifying parameters for waveform synthesis
• CPC Class Codes: G10H 3/186 Means for processing the signal picked up from the strings filtering G10H1/12
• CPC Class Codes: G10H 3/188 for converting the signal to digital format transmission using a MIDI interface G10H1/0066

Abstract

An interface device is described that allows the audio signals from a polyphonic stringed instrument to be introduced into a personal computer environment for feature extraction and signal processing.

Claims

1. A computer interface for a polyphonic stringed instrument, comprising:

an analog interface configured to receive a plurality of individual analog audio signals, each analog audio signal corresponding to one of a plurality of strings of the stringed instrument;

analog-to-digital conversion (ADC) circuitry configured to convert each of the analog audio signals to a corresponding digital audio signal;

a processor configured to combine the digital audio signals into a single serial data stream; and

a serial data interface configured to transmit the serial data stream to a computer system.

2. The interface of claim 1 further comprising one or more digitally-controlled gain stages configured to receive the analog audio signals and adjust one or more gains for the analog audio signals relative to one or more ranges associated with the ADC circuitry.

3. The interface of claim 1 further comprising one or more subsonic analog filters configured to receive the analog audio signal.

4. The interface of claim 1 wherein the analog interface is configured to receive one or more of additional analog signals having digital information superimposed thereon prior to reception of the additional analog signals by the analog interface, the processor being further configured to extract the digital information from one or more additional digital signals corresponding to the additional analog signals and encode the digital information in the serial data stream.

5. The interface of claim 4 wherein the additional analog signals are bi-directional, and wherein the processor is further configured to generate uplink data for transmission to the stringed instrument via the additional analog signals.

6. The interface of claim 4 wherein the digital information represents one or more of fret scanning data, fingerboard scanning data, accelerometer data, touch surface data, knob data, switch data, slider data, hall effect sensor data, optical sensor data, pressure sensor data, proximity detector data, gyroscope data, or breath controller data.

7. The interface of claim 1 further comprising one or more digital-to-analog converters (DACs) and a stereo output interface, the processor being further configured in conjunction with the DACs to provide a stereo output signal via the stereo output interface, the stereo output signal comprising a stereo representation of processed versions of the plurality of digital audio signals received from the computer system.

8. The interface of claim 1 further comprising one or more digital-to-analog converters (DACs) and a stereo output interface, the processor being further configured in conjunction with the DACs to provide a stereo output signal via the stereo output interface, the stereo output signal comprising synthesized audio rendered with reference to information extracted from the serial data stream by the computer system.

9. The interface of claim 1 wherein the analog interface is further configured to receive a mono audio signal corresponding to a combination of the analog audio signals from the plurality of strings of the stringed instrument, the processor further being configured to encode a digital version of the mono audio signal in the serial data stream.

10. The interface of claim 9 further comprising an auxiliary input configured to receive an auxiliary analog signal, the processor further being configured to encode a digital version of the auxiliary analog signal in the serial data stream.

11. The interface of claim 1 wherein the serial data interface comprises a universal serial bus (USB interface).

12. A computer-implemented method for processing audio signals for a stringed instrument, comprising:

receiving a serial data stream with a serial data interface of a computing device, the serial data stream encoding a plurality of digital audio signals, each digital audio signal representing one of a plurality of strings of the stringed instrument;

extracting the encoded digital audio signals from the serial data stream using the computing device; and

processing each of the extracted digital audio signals with the computing device, thereby generating a plurality of processed digital audio signals, each of the processed digital audio signals corresponding to one of the plurality of strings of the stringed instrument.

13. The method of claim 12 wherein processing the extracted digital audio signals comprises one or more of dynamics processing, equalization, pitch-shifting, filtering, frequency modulation, amplitude modulation, delay, reverberation, distortion, wave shaping, driving wave tables, stimulating resonances, gating, or limiting.

14. The method of claim 12 wherein processing each of the extracted digital audio signals comprises processing each of the extracted digital audio signals using a plurality of processing modules that simultaneously process each extracted digital audio signal in both a time domain and a frequency domain.

15. The method of claim 12 further comprising recording each of the digital audio signals for subsequent processing.

16. The method of claim 12 further comprising generating graphical representations corresponding to each of the digital audio signals, the graphical representations representing one or more of pitch, dynamics, or timbre for the corresponding string of the string instrument.

17. The method of claim 12 further comprising controlling a special effect using information extracted from the serial digital stream.

18. The method of claim 12 further comprising generating performance event data representing performance events for each of the plurality of strings with reference to the corresponding extracted digital audio signals, the performance events relating to specific types of interaction with the strings by a musician, wherein processing of the extracted digital audio signals is done with reference to the performance event data.

19. The method of claim 18 wherein generating the performance event data comprises detecting event candidates with reference to peaks associated with the extracted digital audio signals, and classifying the event candidates into one or more of a plurality of event classifications.

20. The method of claim 19 further comprising identifying a beginning of a note with reference to classification of the event candidates.

21. The method of claim 19 wherein classifying the event candidates into the one or more event classifications is done using a neural network.

22. The method of claim 12 further comprising extracting a plurality of audio signal characteristics from the extracted digital audio signals, wherein processing of the extracted digital audio signals is done with reference to the audio signal characteristics.

23. The method of claim 22 wherein the audio signal characteristics include any of a continuous pitch of a fundamental harmonic of a string, an amplitude, a centroid, brightness, even/odd harmonic balance, noise, spectral shape, or complete spectrum.

24. The method of claim 12 further comprising generating a plurality of acoustic instrument messages with reference to the extracted digital audio signals, each acoustic instrument message summarizing spectral information corresponding to a particular one of the plurality of strings of the stringed instrument.

25. A computer program product for processing audio signals for a stringed instrument, the computer program product comprising at least one computer-readable storage medium having computer program instructions stored therein configured to enable at least one computing device to:

receive a serial data stream with a serial data interface of a computing device, the serial data stream encoding a plurality of digital audio signals, each digital audio signal representing one of a plurality of strings of the stringed instrument;

extract the encoded digital audio signals from the serial data stream using the computing device; and

process each of the extracted digital audio signals with the computing device, thereby generating a plurality of processed digital audio signals, each of the processed digital audio signals corresponding to one of the plurality of strings of the stringed instrument.