Multiple-paramenter instrument keyboard combining key-surface touch and key-displacement sensor arrays

• US 7,408,108 B2
• Filed: 10/10/2003
• Issued: 08/05/2008
• Est. Priority Date: 05/15/1998
• Status: Expired due to Fees

• Current Assignee: Advance Touchscreen And Gesture Technologies, LLC
• Original Assignee: Lester F. Ludwig
• Inventors: Ludwig, Lester F.
• Primary Examiner(s): Fletcher, Marlon T
• Application Number:
  US10/683,914
• Publication Number:
  US 20040074379A1
• Time in Patent Office: 1,761 Days
• Field of Search: None
• US Class Current: 84/719
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 1/0058 Transmission between separate instruments or between individual components of a musical system G10H1/0083 takes precedence
• CPC Class Codes: G10H 1/0066 using a MIDI interface
• CPC Class Codes: G10H 1/348 Switches actuated by parts of the body other than fingers
• CPC Class Codes: G10H 1/46 Volume control
• CPC Class Codes: G10H 2220/521 Hall effect transducers or similar magnetic field sensing semiconductor devices, e.g. for string vibration sensing or key movement sensing
• CPC Class Codes: G10H 2220/525 Piezoelectric transducers for vibration sensing or vibration excitation in the audio range; Piezoelectric strain sensing, e.g. as key velocity sensor; Piezoelectric actuators, e.g. key actuation in response to a control voltage
• CPC Class Codes: G10H 2230/095 Spint zither, i.e. mimicking any neckless stringed instrument in which the strings do not extend beyond the sounding board
• CPC Class Codes: G10H 2230/101 Spint koto, i.e. mimicking any traditional asian-style plucked zither with movable bridges
• CPC Class Codes: G10H 2230/115 Spint sitar, i.e. mimicking any long-necked plucked string instrument with a large number of additional non-playable sympathetic resonating strings or an additional gourd-like resonating chamber
• CPC Class Codes: G10H 2230/145 Spint guitar keyboard, i.e. mimicking a combination of a guitar-like instrument, with or without strings, and a piano-like keyboard, e.g. with white and black keys arranged like on a piano
• CPC Class Codes: G10H 2230/271 Spint gong, i.e. mimicking circular flat, nippled or bowl-shaped metallic percussion instruments G10H2230/321 takes precedence
• CPC Class Codes: G10H 3/18 using a string, e.g. electric guitar mechanical features G10D1/085
• CPC Class Codes: G10H 3/26 : using electric feedback
• CPC Class Codes: Y10S 84/10 : Feedback

Abstract

An invention extending functionality and applications of traditional music keyboards. Individual musical keyboard keys may have individual key displacement sensors measuring key travel. Individual keys may further include surface sensors measuring two additional parameters, creating three independent continuous parameters essential for controlled rendering of vowel sounds and orchestral timbre spaces. Surface sensors may comprise pressure sensor arrays, which, via geometric image-processing, may produce five to six readily controlled independent parameters per key, useful in controlling expressive soloing and long-duration background sounds. Per-key pressure sensor arrays may comprise mass-produced modular components including intelligent distributed image processing to simplify manufacturing and substantially reduce cost. Synthesized tactile feedback may render variable keyboard actions or create ‘multi-level’ key travel functionality. Outgoing MIDI signals may also be provided.

Claims

1. An electronic musical instrument control system comprising:

a keyboard comprising a plurality of keys, wherein each key of said plurality of keys is physically displaceable within a key travel range;

a separate key position sensor associated with each key of said plurality of keys, wherein each key position sensor of said plurality of key position sensors responsively provides a key displacement signal corresponding to the position of an associated key within said key travel range;

at least one displacement sensor interface for receiving said key displacement signals from at least one of said plurality of key position sensors, wherein said at least one displacement sensor interface responsively generates an individual output control signal for each key displacement signal received at said at least one displacement sensor, and wherein each output control signal generated by said at least one displacement sensor is adapted to provide control of sounds generated by an electronic musical system;

a separate surface sensor associated with each key of said plurality of keys, wherein each surface sensor of said plurality of surface sensors responsively generates multi-parameter sensor signals corresponding to user contact of an associated key of said plurality of keys; and

at least one surface sensor interface for receiving said multi-parameter sensor signals from at least one surface sensor of said plurality of surface sensors, wherein said at least one surface sensor interface responsively generates a multi-parameter surface sensor output control signal for each multi-parameter sensor signal received at said at least one surface sensor interface, and wherein each multi-parameter surface sensor output control signal generated by said at least one surface sensor interface is adapted to further provide control of sounds generated by said electronic musical system.

2. The control system according to claim 1, wherein an output control signal associated with at least one key of said plurality of keys is adapted to provide volume control of a synthesized sound generated by said electronic musical system, wherein said volume control is obtained by varying the location of said at least one key within said key travel range.

3. The control system according to claim 1, wherein an output control signal associated with at least one key of said plurality of keys is adapted to provide timbre control of a synthesized sound generated by said electronic musical system, wherein said timbre control is obtained by varying the location of said at least one key within said key travel range.

4. The control system according to claim 1, said control system further comprising:

a signal processor coupled to said at least one displacement sensor interface and said at least one surface sensor interface, wherein said signal processor responsively generates an outgoing unified control signal based upon individual or selected combinations of output control signals generated by said at least one displacement sensor interface and said at least one surface sensor interface.

5. The control system according to claim 1, wherein each key of said plurality of keys provides for the control of at least three independent, substantially continuous parameters, wherein said at least three independent, substantially continuous parameters are controlled using output control signals generated by said at least one displacement sensor interface and said at least one surface sensor interface.

6. The control system according to claim 1, wherein each surface sensor associated with each key of said plurality of keys comprises a pressure sensor.

7. The control system according to claim 1, wherein each surface sensor associated with each key of said plurality of keys comprises a null contact sensor.

8. The control system according to claim 5, wherein said at least three independent, substantially continuous parameters, for at least one key of said plurality of keys, are adapted to control filter formants of sounds generated by said electronic musical system.

9. The control system according to claim 8, wherein said filter formants are used to control vowel synthesis of sounds generated by said electronic musical system.

10. The control system according to claim 5, wherein said at least three independent, substantially continuous parameters, for at least one key of said plurality of keys, are adapted to control sounds generated by said electronic musical system, wherein said sounds are generated using a timbre-space model.

11. The control system according to claim 10, wherein said timbre-space model is accomplished using volume cross-fading.

12. The control system according to claim 10, wherein said timbre-space model is accomplished using morphable numerical instrument models.

13. The control system according to claim 6, wherein each key of said plurality of keys provides for the control of at least four independent, substantially continuous parameters, wherein said at least four independent, substantially continuous parameters are controlled using output control signals generated by said at least one displacement sensor interface and said at least one surface sensor interface.

14. The control system according to claim 1, wherein each surface sensor associated with each key of said plurality of keys includes a pressure sensor formed with sensor mini-array chips.

15. The control system according to claim 1, wherein each key of said plurality of keys provides per-key modulation control of long-duration notes using output control signals generated by said at least one displacement sensor interface and said at least one surface sensor interface.

16. The control system according to claim 1, wherein one or more predetermined values of said key displacement signal associated with at least one key of said plurality of keys trigger the generation of particular synthesizer sounds by said electronic musical system.

17. The control system according to claim 1, said control system further comprising:

a control signal generator for generating a physical restoring force signal for each key of said plurality of keys, wherein each physical restoring force signal of said plurality of physical restoring force signals is generated based upon a corresponding key displacement signal generated in response to the position of an associated key within said key travel range, wherein said physical restoring force signal identifies an amount of necessary force to provide a desired level of tactile feedback for said associated key; and

a restoring force actuator coupled to each key of said plurality of keys, wherein said restoring force actuator responsively provides said desired level of tactile feedback in response to an associated physical restoring force signal generated by said control signal generator.

18. The control system according to claim 1, wherein each output control signal of said plurality of individual output control signals comprise signals of MIDI format.

19. A method for controlling an electronic musical instrument, said method comprising:

providing a keyboard comprising a plurality of keys, wherein each key of said plurality of keys is physically displaceable within a key travel range;

associating a separate key position sensor with each key of said plurality of keys, wherein each key position sensor of said plurality of key position sensors responsively provides a key displacement signal corresponding to the position of an associated key within said key travel range;

receiving said key displacement signals from at least one of said plurality of key position sensors using at least one displacement sensor interface, wherein said at least one displacement sensor interface responsively generates an individual output control signal for each key displacement signal received at said at least one displacement sensor, and wherein each output control signal generated by said at least one displacement sensor is adapted to provide control of sounds generated by an electronic musical system;

associating a separate surface sensor with each key of said plurality of keys, wherein each surface sensor of said plurality of surface sensors responsively generates multi-parameter sensor signals corresponding to user contact of an associated key of said plurality of keys; and

receiving said multi-parameter sensor signals from at least one surface sensor of said plurality of surface sensors using at least one surface sensor interface, wherein said at least one surface sensor interface responsively generates a multi-parameter surface sensor output control signal for each multi-parameter sensor signal received at said at least one surface sensor interface, and wherein each multi-parameter surface sensor output control signal generated by said at least one surface sensor interface is adapted to further provide control of sounds generated by said electronic musical system.

20. The method according to claim 19, wherein an output control signal associated with at least one key of said plurality of keys is adapted to provide volume control of a synthesized sound generated by said electronic musical system, wherein said volume control is obtained by varying the location of said at least one key within said key travel range.

21. The method according to claim 19, wherein an output control signal associated with at least one key of said plurality of keys is adapted to provide timbre control of a synthesized sound generated by said electronic musical system, wherein said timbre control is obtained by varying the location of said at least one key within said key travel range.

22. The method according to claim 19, said method further comprising:

coupling a signal processor to said at least one displacement sensor interface and said at least one surface sensor interface, wherein said signal processor responsively generates an outgoing unified control signal based upon individual or selected combinations of output control signals generated by said at least one displacement sensor interface and said at least one surface sensor interface.

23. The method according to claim 19, wherein each key of said plurality of keys provides for the control of at least three independent, substantially continuous parameters, wherein said at least three independent, substantially continuous parameters are controlled using output control signals generated by said at least one displacement sensor interface and said at least one surface sensor interface.

24. The method according to claim 19, wherein each surface sensor associated with each key of said plurality of keys comprises a pressure sensor.

25. The method according to claim 19, wherein each surface sensor associated with each key of said plurality of keys comprises a null contact sensor.

26. The method according to claim 23, wherein said at least three independent, substantially continuous parameters, for at least one key of said plurality of keys, are adapted to control filter formants of sounds generated by said electronic musical system.

27. The method according to claim 26, wherein said filter formants are used to control vowel synthesis of sounds generated by said electronic musical system.

28. The method according to claim 23, wherein said at least three independent, substantially continuous parameters, for at least one key of said plurality of keys, are adapted to control sounds generated by said electronic musical system, wherein said sounds are generated using a timbre-space model.

29. The method according to claim 28, wherein said timbre-space model is accomplished using volume cross-fading.

30. The method according to claim 28, wherein said timbre-space model is accomplished using morphable numerical instrument models.

31. The method according to claim 24, wherein each key of said plurality of keys provides for the control of at least four independent, substantially continuous parameters, wherein said at least four independent, substantially continuous parameters are controlled using output control signals generated by said at least one displacement sensor interface and said at least one surface sensor interface.

32. The method according to claim 19, wherein each surface sensor associated with each key of said plurality of keys includes a pressure sensor formed with sensor mini-array chips.

33. The method according to claim 19, wherein each key of said plurality of keys provides per-key modulation control of long-duration notes using output control signals generated by said at least one displacement sensor interface and said at least one surface sensor interface.

34. The method according to claim 19, wherein one or more predetermined values of said key displacement signal associated with at least one key of said plurality of keys trigger the generation of particular synthesizer sounds by said electronic musical system.

35. The method according to claim 19, said method further comprising:

generating a physical restoring force signal for each key of said plurality of keys using a control signal generator, wherein each physical restoring force signal of said plurality of physical restoring force signals is generated based upon a corresponding key displacement signal generated in response to the position of an associated key within said key travel range, wherein said physical restoring force signal identifies an amount of necessary force to provide a desired level of tactile feedback for said associated key; and

coupling a restoring force actuator to each key of said plurality of keys, wherein said restoring force actuator responsively provides said desired level of tactile feedback in response to an associated physical restoring force signal generated by said control signal generator.

36. The method according to claim 19, wherein each output control signal of said plurality of individual output control signals comprise signals of MIDI format.

37. An electronic musical control system comprising:

a musical keyboard comprising a plurality of keys;

a separate surface sensor associated with each key of said plurality of keys, wherein each surface sensor of said plurality of surface sensors responsively generates multi-parameter sensor signals corresponding to user contact of an associated key of said plurality of keys; and

at least one surface sensor interface for receiving said multi-parameter sensor signals from at least one surface sensor of said plurality of surface sensors, wherein said at least one surface sensor interface responsively generates a multi-parameter surface sensor output control signal for each multi-parameter sensor signal received at said at least one surface sensor interface, and wherein each multi-parameter surface sensor output control signal generated by said at least one surface sensor is adapted to provide control of sound generated by an electronic musical system.

38. The control system according to claim 37, wherein an output control signal associated with at least one key of said plurality of keys is adapted to provide volume control of a synthesized sound generated by said electronic musical system.

39. The control system according to claim 37, wherein an output control signal associated with at least one key of said plurality of keys is adapted to provide timbre control of a synthesized sound generated by said electronic musical system.

40. The control system according to claim 37, said control system further comprising:

a key switch associated with each key of said plurality of keys, wherein each key switch of said plurality of key switches responsively provides a key switch signal whenever an associated key experiences a threshold level of user contact; and

at least one key switch interface for receiving said key switch signals from said plurality of key switches, wherein said at least one key switch interface responsively generates an individual output control signal for each of said plurality of said key switch signals, and wherein each output control signal of said plurality of individual output control signals is adapted to provide control of sounds generated by said electronic musical system.

41. The control system according to claim 37, wherein each key of said plurality of keys provides for the control of at least three independent, substantially continuous parameters, wherein said at least three independent, substantially continuous parameters are controlled using output control signals generated by said at least one surface sensor interface.

42. The control system according to claim 37, wherein each surface sensor associated with each key of said plurality of keys comprises a pressure sensor.

43. The control system according to claim 37, wherein each surface sensor associated with each key of said plurality of keys comprises a null contact sensor.

44. The control system according to claim 41, wherein said at least three independent, substantially continuous parameters, for at least one key of said plurality of keys, are adapted to control filter formants of sounds generated by said electronic musical system.

45. The control system according to claim 44, wherein said filter formants are used to control vowel synthesis of sounds generated by said electronic musical system.

46. The control system according to claim 41, wherein said at least three independent, substantially continuous parameters, for at least one key of said plurality of keys, are adapted to control sounds generated by said electronic musical system, wherein said sounds are generated using a timbre-space model.

47. The control system according to claim 46, wherein said timbre-space model is accomplished using volume cross-fading.

48. The control system according to claim 46, wherein said timbre-space model is accomplished using morphable numerical instrument models.

49. The control system according to claim 42, wherein each key of said plurality of keys provides for the control of at least four independent, substantially continuous parameters, wherein said at least four independent, substantially continuous parameters are controlled using output control signals generated by said at least one surface sensor interface.

50. The control system according to claim 37, wherein each surface sensor associated with each key of said plurality of keys includes a pressure sensor formed with sensor mini-array chips.

51. The control system according to claim 37, wherein each key of said plurality of keys provides per-key modulation control of long-duration notes using output control signals generated by said at least one surface sensor interface.

52. The control system according to claim 37, wherein each output control signal of said plurality of individual output control signals comprise signals of MIDI format.

53. A method for controlling an electronic musical control system, said method comprising:

providing a musical keyboard comprising a plurality of keys;

associating a separate surface sensor with each key of said plurality of keys, wherein each surface sensor of said plurality of surface sensors responsively generates multi-parameter sensor signals corresponding to user contact of an associated key of said plurality of keys; and

receiving said multi-parameter sensor signals from at least one surface sensor of said plurality of surface sensors using at least one surface sensor interface, wherein said at least one surface sensor interface responsively generates a multi-parameter surface sensor output control signal for each multi-parameter sensor signal received at said at least one surface sensor interface, and wherein each multi-parameter surface sensor output control signal generated by said at least one surface sensor is adapted to provide control of sound generated by an electronic musical system.

54. The method according to claim 53, wherein an output control signal associated with at least one key of said plurality of keys is adapted to provide volume control of a synthesized sound generated by said electronic musical system.

55. The method according to claim 53, wherein an output control signal associated with at least one key of said plurality of keys is adapted to provide timbre control of a synthesized sound generated by said electronic musical system.

56. The method according to claim 53, said method further comprising:

associating a key switch with each key of said plurality of keys, wherein each key switch of said plurality of key switches responsively provides a key switch signal whenever an associated key experiences a threshold level of user contact; and

receiving said key switch signals from said plurality of key switches using at least one key switch interface, wherein said at least one key switch interface responsively generates an individual output control signal for each of said plurality of said key switch signals, and wherein each output control signal of said plurality of individual output control signals is adapted to provide control of sounds generated by said electronic musical system.

57. The method according to claim 53, wherein each key of said plurality of keys provides for the control of at least three independent, substantially continuous parameters, wherein said at least three independent, substantially continuous parameters are controlled using output control signals generated by said at least one surface sensor interface.

58. The method according to claim 53, wherein each surface sensor associated with each key of said plurality of keys comprises a pressure sensor.

59. The method according to claim 53, wherein each surface sensor associated with each key of said plurality of keys comprises a null contact sensor.

60. The method according to claim 57, wherein said at least three independent, substantially continuous parameters, for at least one key of said plurality of keys, are adapted to control filter formants of sounds generated by said electronic musical system.

61. The method according to claim 60, wherein said filter formants are used to control vowel synthesis of sounds generated by said electronic musical system.

62. The method according to claim 57, wherein said at least three independent, substantially continuous parameters, for at least one key of said plurality of keys, are adapted to control sounds generated by said electronic musical system, wherein said sounds are generated using a timbre-space model.

63. The method according to claim 62, wherein said timbre-space model is accomplished using volume cross-fading.

64. The method according to claim 62, wherein said timbre-space model is accomplished using morphable numerical instrument models.

65. The method according to claim 58, wherein each key of said plurality of keys provides for the control of at least four independent, substantially continuous parameters, wherein said at least four independent, substantially continuous parameters are controlled using output control signals generated by said at least one surface sensor interface.

66. The method according to claim 53, wherein each surface sensor associated with each key of said plurality of keys includes a pressure sensor formed with sensor mini-array chips.

67. The method according to claim 53, wherein each key of said plurality of keys provides per-key modulation control of long-duration notes using output control signals generated by said at least one surface sensor interface.

68. The method according to claim 53, wherein one or more pre-determined values of said key displacement signal associated with at least one key of said plurality of keys trigger the generation of particular synthesizer sounds by said electronic musical system.

69. The method according to claim 53, wherein each output control signal of said plurality of individual output control signals comprise signals of MIDI format.