System and method for synthesizing music by scanning real or simulated vibrating object

• US 6,647,359 B1
• Filed: 07/16/1999
• Issued: 11/11/2003
• Est. Priority Date: 07/16/1999
• Status: Expired due to Term

• Current Assignee: Vulcan Patents LLC
• Original Assignee: Interval Research Corporation
• Inventors: Verplank, William L., Mathews, Max V., Shaw, Robert S.
• Primary Examiner(s): Teska, Kevin J.
• Assistant Examiner(s): FERRIS III, FRED O
• Application Number:
  US09/356,246
• Time in Patent Office: 1,579 Days
• Field of Search: 703/13, 703/2, 381/119, 846/01, 844/77
• US Class Current: 703/2
• CPC Class Codes: G10H 2250/535 Waveguide or transmission line-based models
• CPC Class Codes: G10H 3/12 using mechanical resonant generators, e.g. strings or percussive instruments, the tones of which are picked up by electromechanical transducers, the electrical signals being further manipulated or amplified and subsequently converted to sound by a loudspeaker or equivalent instrument
• CPC Class Codes: G10H 5/007 Real-time simulation of G10B, G10C, G10D-type instruments using recursive or non-linear techniques, e.g. waveguide networks, recursive algorithms

Abstract

In a music synthesis system, a scanning apparatus repeatedly scans a physical attribute of a vibrating object at a sequence of points of the vibrating object so as to repeatedly generate corresponding sequences of values. The music synthesis system generates an audio frequency waveform whose shape corresponds to the sequences of values. The vibrating object may be a physical object or a simulated object. The system may include a sensor for receiving user input, and means for mapping the user input into a stimulus signal that is applied to the vibrating object. In a preferred embodiment, the object vibrates and is manipulated by the user at haptic frequencies (0 to 15 hertz), while the sequences of scanned values are cyclically read at an audio frequencies so as to generate an audio frequency waveform whose timbre varies at the haptic frequencies associated with the object'"'"'s vibration.

Claims

1. A method of synthesizing musical sounds, comprising:

simulating a vibrating object in accordance with a predefined physical model;

repeatedly scanning, at a rate independent of any parameter associated with the simulating step, a specified physical attribute of the simulated vibrating object at a sequence of points of the simulated vibrating object so as to repeatedly generate corresponding sequences of values; and

independently of the simulating step, generating an audio frequency waveform whose shape corresponds to the sequences of values.

2. The method of claim 1, wherein

the specified physical attribute is selected from the group consisting of: a position coordinate, a velocity, an acceleration, a third derivative of a position coordinate, a fourth derivative of a position coordinate, a linear combination of at least two of the position, velocity, acceleration, third derivative and fourth derivative, and a non-linear combination of at least two of the position, velocity, acceleration, third derivative and fourth derivative.

3. The method of claim 1, further including:

stimulating the simulated vibrating object in accordance with user input.

4. The method of claim 3, wherein

the stimulating step includes displacing a portion of the simulated vibrating object in accordance with the user input.

5. The method of claim 3, wherein

the user input is generated by a sensor selected from the group consisting of:

a keyboard, a set of one or more foot pedals, a set of one or more position sensors, an audio microphone, a set of one or more pressure sensors, and any combination thereof.

6. The method of claim 5, wherein

the stimulating step includes mapping one or more physical measurement signals received from the sensor into a model stimulus signal and applying the model stimulus signal to the simulated vibrating object.

7. The method of claim 1, wherein

the physical model is a finite element model.

8. The method of claim 1, wherein

the finite element model is selected from the group consisting of:

a finite element wave model, a finite element heat model, and a difference equation finite element model.

9. The method of claim 1, further including:

varying the sequence of points in accordance with user input.

10. The method of claim 1, further including:

varying a rate at which the scanning step is performed in accordance with user input.

11. The method of claim 1, wherein

the sequence of points at which the simulated vibrating object is scanned independent of any parameter associated with the simulating step.

12. The method of claim 1, wherein

the simulating step includes varying the physical attribute of the simulated physical object at a rate of less than 15 hertz;

and

the generating step includes processing the sequences of values at an audio frequency rate in the range of 50 to 2,500 cycles per second.

13. The method of claim 12, wherein

the generating step includes

periodically storing an array of values corresponding to a latest sequence of the sequences of values;

repeatedly outputting values corresponding to the stored array of values at a repetition rate of 50 to 2,500 cycles per second.

14. The method of claim 1, further including:

varying a rate at which the generating step is performed in accordance with user input.

15. A method of synthesizing musical sounds, comprising:

repeatedly sensing a specified physical attribute of a vibrating physical object at a sequence of points of the vibrating physical object so as to repeatedly generate corresponding sequences of values, the specified physical attribute is selected from the group consisting of a position coordinate, a velocity, an acceleration, a third derivative of a position coordinate, a fourth derivative of a position coordinate, a linear combination of at least two of the position, velocity, acceleration, third derivative and fourth derivative, and a non-linear combination of at least two of the position, velocity, acceleration, third derivative and fourth derivative; and

generating an audio frequency waveform whose shape corresponds to the sequences of values.

16. The method of claim 15, further including:

stimulating the vibrating object in accordance with user input applied to the vibrating physical object.

17. The method of claim 16, wherein

the stimulating step includes displacing a portion of the vibrating physical object.

18. The method of claim 16, wherein

the user input is received by a sensor, and then mapped into a stimulus signal that is applied to the vibrating physical object;

and

the sensor is selected from the group consisting of;

a keyboard, a set of one or more foot pedals, a set of one or more position sensors, an audio microphone, a set of one or more pressure sensors, and any combination thereof.

19. The method of claim 15, further including:

varying the sequence of points in accordance with user input.

20. The method of claim 15, further including:

varying a rate at which the scanning step is performed in accordance with user input.

21. The method of claim 15, further including:

the generating step includes processing the sequences of values at an audio frequency rate in the range of 50 to 2,500 cycles per second.

22. The method of claim 21, wherein

the generating step includes

periodically storing an array of values corresponding to a latest sequence of the sequences of values;

repeatedly outputting values corresponding to the stored array of values at a repetition rate of 50 to 2,500 cycles per second.

23. The method of claim 15, further including:

varying a rate at which the generating step is performed in accordance with user input.

24. A computer program product for use in conjunction with a computer system, the computer program product comprising a computer readable storage medium and a computer program mechanism embedded therein, the computer program mechanism comprising:

a simulation module for simulating a vibrating object in accordance with a predefined physical model;

scanning instructions for repeatedly scanning, at a rate independent of any parameter associated with the physical model, a specified physical attribute of the simulated vibrating object at a sequence of points of the simulated vibrating object so as to repeatedly generate corresponding sequences of values; and

music waveform generation instructions for generating an audio frequency waveform whose shape corresponds to the sequences of values.

25. The computer program product of claim 24, wherein

the specified physical attribute is selected from the group consisting of: a position coordinate, a velocity, an acceleration, a third derivative of a position coordinate, a fourth derivative of a position coordinate, a linear combination of at least two of the position, velocity, acceleration, third derivative and fourth derivative, and a non-linear combination of at least two of the position, velocity, acceleration, third derivative and fourth derivative.

26. The computer program product of claim 24, further including:

the simulation module including instructions for stimulating the simulated vibrating object in accordance with user input.

27. The computer program product of claim 26, wherein

the simulation module instructions include instructions for displacing a portion of the simulated vibrating object in accordance with the user input.

28. The computer program product of claim 26, wherein

the user input is generated using a sensor selected from the group consisting of:

a keyboard, a set of one or more foot pedals, a set of one or more position sensors, an audio microphone, a set of one or more pressure sensors, and any combination thereof.

29. The computer program product of claim 28, wherein

the simulation module instructions include instructions for mapping one or more physical measurement signals received from the sensor into a model stimulus signal and applying the model stimulus signal to the simulated vibrating object.

30. The computer program product of claim 24, wherein

the physical model is a finite element model.

31. The computer program product of claim 24, wherein

the finite element model is selected from the group consisting of:

a finite element wave model, a finite element heat model, and a difference equation finite element model.

32. The computer program product of claim 24, wherein

the scanning instructions include instructions for varying the sequence of points in accordance with user input.

33. The computer program product of claim 24, further including:

the scanning instructions include instructions for varying a rate at which the scanning is performed in accordance with user input.

34. The computer program product of claim 24, wherein

the sequence of points at which the simulated vibrating object is scanned independent of any parameter associated with the physical model.

35. The computer program product of claim 24, wherein

the simulation module includes instructions for varying the physical attribute of the simulated physical object at a rate of less than 15 hertz;

and

the music waveform generation instructions includes instructions for processing the sequences of values at an audio frequency rate in the range of 50 to 2,500 cycles per second.

36. The computer program product of claim 35, wherein

the music waveform generation instructions include instructions for:

periodically storing an array of values corresponding to a latest sequence of the sequences of values; and

repeatedly outputting values corresponding to the stored array of values at a repetition rate of 50 to 2,500 cycles per second.

37. The computer program product of claim 24, further including:

music waveform generation instructions including instructions for varying a rate at which the audio frequency waveform is generated in accordance with user input.

38. A music synthesis system, comprising:

a data processor;

an audio speaker;

signal conversion apparatus for converting a digital signal into an analog signal, the signal conversion apparatus having an input coupled to the data processor and an output coupled to the audio speaker; and

a memory coupled to the data processor, the memory storing procedures for execution by the data processor, the stored procedures including;

a simulation module for simulating a vibrating object in accordance with a predefined physical model wherein the physical model is a finite element model;

scanning instructions for repeatedly scanning a specified physical attribute of the simulated vibrating object at a sequence of points of the simulated vibrating object so as to repeatedly generate corresponding sequences of values; and

music waveform generation instructions for generating the digital signal, the digital signal comprising an audio frequency waveform whose shape corresponds to the sequences of values, wherein the music waveform generation instructions are executed by the data processor independently of execution of the simulation module.

39. The music synthesis system of claim 38, wherein

the specified physical attribute is selected from the group consisting of: a position coordinate, a velocity, an acceleration, a third derivative of a position coordinate, a fourth derivative of a position coordinate, a linear combination of at least two of the position, velocity, acceleration, third derivative and fourth derivative, and a non-linear combination of at least two of the position, velocity, acceleration, third derivative and fourth derivative.

40. The music synthesis system of claim 38, including:

a user interface for receiving user input and stimulating the simulated vibrating object in accordance with the user input.

41. The music synthesis system of claim 40, wherein

the user interface includes a sensor for receiving the user input, and means for mapping the user input into a stimulus signal that is applied to the simulated vibrating physical object;

and

the sensor is selected from the group consisting of;

a keyboard, a set of one or more foot pedals, a set of one or more position sensors, an audio microphone, a set of one or more pressure sensors, and any combination thereof.

42. The music synthesis system of claim 38, wherein

the finite element model is selected from the group consisting of:

a finite element wave model, a finite element heat model, and a difference equation finite element model.

43. The music synthesis system of claim 38, wherein

the scanning instructions include instructions for varying the sequence of points in accordance with a user input received by a sensor.

44. The music synthesis system of claim 38, further including:

the scanning instructions include instructions for varying a rate at which the scanning is performed in accordance with a user input received by a sensor.

45. The music synthesis system of claim 38, wherein

the scanning is performed at a rate independent of any parameter associated with the physical model.

46. The music synthesis system of claim 38, wherein

the music waveform generation instructions include instructions for:

periodically storing an array of values corresponding to a latest sequence of the sequences of values; and

repeatedly outputting values corresponding to the stored array of values at a repetition rate of 50 to 2,500 cycles per second.