System, method and software for detecting signals generated by one or more sensors and translating those signals into auditory, visual or kinesthetic expression

• US 20080250914A1
• Filed: 04/13/2007
• Published: 10/16/2008
• Est. Priority Date: 04/13/2007
• Status: Abandoned Application

• Current Assignee: Manhattan New Music Project
• Original Assignee: Manhattan New Music Project
• Inventors: Reinhart, Julia Christine, Seldess, Zachary Nathan, Rigler, Jane Agatha
• Application Number:
  US11/786,881
• Publication Number:
  US 20080250914A1
• Time in Patent Office: Days
• US Class Current: 84/645
• CPC Class Codes: G10H 1/0025 Automatic or semi-automatic music composition, e.g. producing random music, applying rules from music theory or modifying a musical piece automatically producing a series of tones G10H1/26
• CPC Class Codes: G10H 2210/105 Composing aid, e.g. for supporting creation, edition or modification of a piece of music
• CPC Class Codes: G10H 2220/005 Non-interactive screen display of musical or status data
• CPC Class Codes: G10H 2220/321 Garment sensors, i.e. musical control means with trigger surfaces or joint angle sensors, worn as a garment by the player, e.g. bracelet, intelligent clothing
• CPC Class Codes: G10H 2220/351 Environmental parameters, e.g. temperature, ambient light, atmospheric pressure, humidity, used as input for musical purposes
• CPC Class Codes: G10H 2220/395 Acceleration sensing or accelerometer use, e.g. 3D movement computation by integration of accelerometer data, angle sensing with respect to the vertical, i.e. gravity sensing
• CPC Class Codes: G10H 2240/056 MIDI or other note-oriented file format
• CPC Class Codes: G10H 2240/211 Wireless transmission, e.g. of music parameters or control data by radio, infrared or ultrasound
• CPC Class Codes: G10H 2240/305 Internet or TCP/IP protocol use for any electrophonic musical instrument data or musical parameter transmission purposes
• CPC Class Codes: G10H 2240/321 Bluetooth
• CPC Class Codes: G10H 2250/641 Waveform sampler, i.e. music samplers; Sampled music loop processing, wherein a loop is a sample of a performance that has been edited to repeat seamlessly without clicks or artifacts

Abstract

The present invention comprises an interactive system controlled by modifiable responsive sensors in which players can control auditory, visual and/or kinesthetic expression in real-time. As an auditory example of this system, one or more users can interact with accelerometers to trigger a variety of computer-generated sounds, MIDI instruments and/or pre-recorded sound files and combinations thereof. Sensor sensitivity is modifiable for each user so that even very small movements can control a sound. The system is flexible, permitting a user to act alone or with others, simultaneously, each user using one or more sensors, and each sensor controlling a separate sound. The sensors control elements of music: starting, stopping, generating higher and/or lower pitches, rhythmic complexity, looping patterns, restarting looping patterns, etc. This system allows users to record sounds for playback, to use pre-existing soundfiles, as well as to add unique soundfiles into the system.

Claims

1-6. -6. (canceled)

7. A system for composing an auditory and visual expression comprising more than one musical devices, each music device comprising:

a computer coupled to one or more input devices, each of said one or more input devices capable of sensing a change in state, and each of said one or more input devices capable of generating a signal based on said change in state;

an interface coupled to said computer and coupled to each of said one or more input devices, wherein said interface is capable of communicating said signal from said one or more input devices to said computer, and wherein said computer is capable of converting said signal into sound data and display data;

a user interface coupled to said computer and said interface, wherein said user interface is capable of setting a user calibration;

a sound emitting device coupled to said computer to emit said sound data; and

a display device for displaying said display data;

wherein each music device is played by a user.

8. The system of claim 7 wherein said one or more input devices are selected from a group of input devices comprising:

motion sensor, accelerometer, light sensor, pressure sensor, switch, magnetic sensor, potentiometer, thermistor, proximity sensor, flex/bend sensor, wind sensor, air sensor, force sensor, solenoid, keyboard, computer mouse, and gaming device.

9. The system of claim 7 wherein each of said one or more input devices is further capable of generating a signal based on a user calibrated range of motion.

10. The system of claim 7 wherein said computer converts said sound data and display data based on said user calibration.

11. The system of claim 7 wherein said one or more input devices is wirelessly coupled to said computer.

12. The system of claim 7 wherein said user interface is capable of receiving an input for a selected instrument.

13. The system of claim 7 further comprising a MIDI interface for converting a input device signal into sound data.

14. The system of claim 7 further comprising a storage component capable of recording said signal, said sound data, and said display data.

15. The system of claim 14 wherein said storage component is further capable of storing said user calibration.

16. The system of claim 7 wherein said user interface is further adapted for input of a mode, wherein said mode affects a conversion of said signal into said sound data and said visual data.

17. A method for composing an auditory and visual expression using more than one musical device, said method comprising:

sensing a change in state using one or more input devices, wherein said one or more input devices are being used by more than one user;

receiving a user calibration for each of said more than one user;

generating a signal based on said sensed change in state;

converting said signal into sound data and display data;

emitting said sound data; and

displaying said display data.

18. The method of claim 17 wherein said one or more input devices are selected from a group of input devices comprising:

motion sensor, accelerometer, light sensor, pressure sensor, switch, magnetic sensor, potentiometer, thermistor, proximity sensor, flex/bend sensor, wind sensor, air sensor, force sensor, solenoid, keyboard, computer mouse, and gaming device.

19. The method of claim 17 further comprising generating a signal based on a user calibrated range of motion.

20. The method of claim 17 further comprising selecting an instrument.

21. The method of claim 17 wherein converting said signal into sound data and display data is based on said user calibration.

22. The method of claim 17 further comprising storing said signal, said sound data, and said display data.

23. The method of claim 17 further comprising storing said user calibration.

24. The method of claim 17 further comprising selecting a mode, wherein said mode affects a conversion of said signal into said sound data and said visual data.