Performance environments supporting interactions among performers and self-organizing processes

• US 7,217,878 B2
• Filed: 09/30/2003
• Issued: 05/15/2007
• Est. Priority Date: 05/15/1998
• Status: Expired due to Fees

• Current Assignee: NRI R&D Patent Licensing, LLC (Advanced Touchscreen and Gesture Technologies, LLC)
• Original Assignee: Lester F. Ludwig
• Inventors: Ludwig, Lester F.
• Primary Examiner(s): FLETCHER, MARLON T
• Application Number:
  US10/676,165
• Publication Number:
  US 20040069125A1
• Time in Patent Office: 1,323 Days
• Field of Search: None
• US Class Current: 84/609
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 1/0058 Transmission between separate instruments or between individual components of a musical system G10H1/0083 takes precedence
• CPC Class Codes: G10H 1/0066 using a MIDI interface
• CPC Class Codes: G10H 1/348 Switches actuated by parts of the body other than fingers
• CPC Class Codes: G10H 1/46 Volume control
• CPC Class Codes: G10H 2220/521 Hall effect transducers or similar magnetic field sensing semiconductor devices, e.g. for string vibration sensing or key movement sensing
• CPC Class Codes: G10H 2220/525 Piezoelectric transducers for vibration sensing or vibration excitation in the audio range; Piezoelectric strain sensing, e.g. as key velocity sensor; Piezoelectric actuators, e.g. key actuation in response to a control voltage
• CPC Class Codes: G10H 2230/095 Spint zither, i.e. mimicking any neckless stringed instrument in which the strings do not extend beyond the sounding board
• CPC Class Codes: G10H 2230/101 Spint koto, i.e. mimicking any traditional asian-style plucked zither with movable bridges
• CPC Class Codes: G10H 2230/115 Spint sitar, i.e. mimicking any long-necked plucked string instrument with a large number of additional non-playable sympathetic resonating strings or an additional gourd-like resonating chamber
• CPC Class Codes: G10H 2230/145 Spint guitar keyboard, i.e. mimicking a combination of a guitar-like instrument, with or without strings, and a piano-like keyboard, e.g. with white and black keys arranged like on a piano
• CPC Class Codes: G10H 2230/271 Spint gong, i.e. mimicking circular flat, nippled or bowl-shaped metallic percussion instruments G10H2230/321 takes precedence
• CPC Class Codes: G10H 3/18 using a string, e.g. electric guitar mechanical features G10D1/085
• CPC Class Codes: G10H 3/26 : using electric feedback
• CPC Class Codes: Y10S 84/10 : Feedback

Abstract

A system for supporting performer interactions with a self-organizing chemical reaction based on monitoring and interpretation of a controllable self-organizing chemical reaction contained within a reaction vessel. The self-organizing chemical reaction initially includes two or more constituent chemical reactants which may be controllably replenished. Controller elements, responsive to reaction control signals, influence the reaction. Reaction control signals are generated by a processor in response to incoming performance signals. Selectable control-conversion algorithms may be used for this purpose, permitting an incoming performance signal to responsively influence the self-organizing chemical reaction. One or more electrodes or chemical sensors, a video camera, or other monitoring devices may be used to monitor the chemical reaction and produce outgoing control signals for controlling synthesizers, signal processing, lighting, or video synthesis. Outgoing control signals are created by interpreting monitoring signals according to selectable algorithms. Video camera signals may be displayed or projected in a visual performance environment

Claims

1. A system for supporting performer interactions with a self-organizing chemical reaction, said system comprising:

a chemical reaction vessel;

a self-organizing chemical reaction contained within said chemical reaction vessel, said self-organizing chemical reaction initially comprising at least two constituent chemical reactants;

a monitor element for monitoring said self-organizing chemical reaction, said monitor element producing observation signals associated with said self-organizing chemical reaction;

at least one controller element for controlling chemical reactions of said self-organizing chemical reaction, wherein said at least one controller element is responsive to a reaction control signal; and

a processing element for converting at least one incoming performance signal into said reaction control signal, said converting accomplished using one of a selectable plurality of control-conversion algorithms, wherein said at least one incoming performance signal responsively controls chemical variations of said self-organizing chemical reaction.

2. The system according to claim 1, wherein said at least one controller element comprises an electrode.

3. The system according to claim 1, wherein said at least one controller element comprises an intake element for introducing new reactants to said chemical reaction vessel.

4. The system according to claim 1, wherein said at least one controller element comprises an outtake element for extracting existing reactants from said chemical reaction vessel.

5. The system according to claim 1, wherein the relative concentrations of chemicals contained within said chemical reaction vessel are varied through reactant refreshing, wherein said reactant refreshing is controlled by said at least one incoming performance signal.

6. The system according to claim 1, wherein said at least one incoming performance signal comprises signals of MIDI format.

7. The system according to claim 1, said system further comprising:

a plurality of monitor elements for monitoring said self-organizing chemical reaction, wherein each monitoring element of said plurality of monitoring elements generate an observation signal associated with said self-organizing chemical reaction.

8. The system according to claim 1, wherein said monitor element comprises an electrode.

9. The system according to claim 1, wherein said monitor element comprises a chemical sensor.

10. The system according to claim 1, wherein said monitor element comprises a video camera.

11. The system according to claim 1, wherein said observation signals are converted into an outgoing signal of MIDI format.

12. The system according to claim 11, wherein said conversion of said observation signals to said outgoing signal of MIDI format is performed by a processor according to an observation-conversion algorithm.

13. The system according to claim 12, wherein said observation-conversion algorithm is selected from a plurality of pre-programmed observation-conversion algorithms.

14. The system according to claim 13, wherein an incoming control signal of MIDI format is used to select a particular observation-conversion algorithm from said plurality of pre-programmed observation-conversion algorithm.

15. The system according to claim 12, wherein an incoming control signal of MIDI format is used by said observation-conversion algorithm to generate said self-organizing chemical reaction.

16. The system according to claim 1, wherein said control-conversion algorithm is selected from a plurality of pre-programmed control-conversion algorithms.

17. The system according to claim 16, wherein an incoming control signal of MIDI format is used to select a particular control-conversion algorithm from said plurality of pre-programmed control-conversion algorithms.

18. The system according to claim 16, wherein an incoming control signal of MIDI format is used by said observation-conversion algorithm to generate said self-organizing chemical reaction.

19. The system according to claim 11, wherein said conversion of said observation signals to said outgoing signal of MIDI format is performed by said processing element according to an observation-conversion algorithm.

20. The system according to claim 1, wherein a visual indicator compound is introduced into said self-organizing chemical reaction to visually enhance said self-organizing chemical reaction.

21. The system according to claim 1, wherein said chemical reaction vessel comprises a substantially flat dish.

22. The system according to claim 1, wherein said monitor element comprises a two-dimensional array of monitor elements.

23. The system according to claim 1, wherein said monitor element comprises a two-dimensional array of component control elements.

24. The system according to claim 1, wherein said monitor element comprises a three-dimensional array of component monitor elements.

25. The system according to claim 1, wherein said monitor element comprises a three-dimensional array of component control elements.

26. The system according to claim 1, wherein said monitor element comprises a video camera for producing said observation signals, wherein said observation signals are converted by a processor into an outgoing signal, wherein said conversion of said observation signal to said outgoing signal is performed by said processor according to an observation-conversion algorithm performing at least one real-time image processing operation.

27. The system according to claim 26, wherein said at least one real-time image processing operation comprises position threshold detection.

28. The system according to claim 26, wherein said at least one real-time image processing operation comprises edge detection.

29. The system according to claim 26, wherein said at least one real-time image processing operation comprises edge detection location.

30. The system according to claim 26, wherein said at least one real-time image processing operation comprises pattern recognition.

31. The system according to claim 26, wherein said at least one real-time image processing operation comprises pattern area measurement.

32. The system according to claim 26, wherein said at least one real-time image processing operation comprises pattern rate-of-change measurement.

33. The system according to claim 26, wherein said observation signals comprise video signals communicated to a video display.

34. The system according to claim 33, wherein said video display is a component of a video projection system.

35. The system according to claim 26, wherein said observation signals comprise video signals provided to a real-time video processor to produce a processed video signal, said processed video signal provided to a video display.

36. The system according to claim 1, wherein said observations signals are converted into an outgoing signal of MIDI format, wherein

said outgoing signal of MIDI format is communicated to an external audio synthesizer system, and wherein

said outgoing signal of MIDI format is adapted to control said external audio synthesizer system.

37. The system according to claim 1, wherein said observations signals are converted into an outgoing signal of MIDI format, wherein

said outgoing signal of MIDI format is communicated to an external signal processing system, and wherein

said outgoing signal of MIDI format is adapted to control said external signal processing system.

38. The system according to claim 1, wherein said observations signals are converted into an outgoing signal of MIDI format, wherein

said outgoing signal of MIDI format is communicated to an external lighting system, and wherein

said outgoing signal of MIDI format is adapted to control said external lighting system.

39. The system according to claim 1, wherein said observations signals are converted into an outgoing video signal.

40. The system according to claim 39, wherein said outgoing video signal comprises recorded video.

41. The system according to claim 39, wherein said outgoing video signal comprises rendered graphics.

42. A method for supporting performer interactions with a self-organizing chemical reaction, said method comprising:

initiating a self-organizing chemical reaction within a chemical reaction vessel, said self-organizing chemical reaction initially comprising at least two constituent chemical reactants;

monitoring said self-organizing chemical reaction using a monitor element, said monitor element producing observation signals associated with said self-organizing chemical reaction;

controlling chemical reactions of said self-organizing chemical reaction using at least one controller element, wherein said at least one controller element is responsive to a reaction control signal; and

converting at least one incoming performance signal into said reaction control signal using a processing element, said converting accomplished using one of a selectable plurality of control-conversion algorithms, wherein said at least one incoming performance signal responsively controls chemical variations of said self-organizing chemical reaction.

43. The method according to claim 42, wherein said at least one controller element comprises an electrode.

44. The method according to claim 42, wherein said at least one controller element comprises an intake element for introducing new reactants to said chemical reaction vessel.

45. The method according to claim 42, wherein said at least one controller element comprises an outtake element for extracting existing reactants from said chemical reaction vessel.

46. The method according to claim 42, wherein the relative concentrations of chemicals contained within said chemical reaction vessel are varied through reactant refreshing, wherein said reactant refreshing is controlled by said at least one incoming performance signal.

47. The method according to claim 42, wherein said at least one incoming performance signal comprises signals of MIDI format.

48. The method according to claim 42, said method further comprising:

monitoring said self-organizing chemical reaction using a plurality of monitor elements, wherein each monitoring element of said plurality of monitoring elements generate an observation signal associated with said self-organizing chemical reaction.

49. The method according to claim 42, wherein said monitor element comprises an electrode.

50. The method according to claim 42, wherein said monitor element comprises a chemical sensor.

51. The method according to claim 42, wherein said monitor element comprises a video camera.

52. The method according to claim 42, wherein said observation signals are converted into an outgoing signal of MIDI format.

53. The method according to claim 52, wherein said conversion of said observation signals to said outgoing signal of MIDI format is performed by a processor according to an observation-conversion algorithm.

54. The method according to claim 52, wherein said observation-conversion algorithm is selected from a plurality of pre-programmed observation-conversion algorithms.

55. The method according to claim 54, wherein an incoming control signal of MIDI format is used to select a particular observation-conversion algorithm from said plurality of pre-programmed observation-conversion algorithm.

56. The method according to claim 53, wherein an incoming control signal of MIDI format is used by said observation-conversion algorithm to generate said self-organizing chemical reaction.

57. The method according to claim 42, wherein said control-conversion algorithm is selected from a plurality of pre-programmed control-conversion algorithms.

58. The method according to claim 57, wherein an incoming control signal of MIDI format is used to select a particular control-conversion algorithm from said plurality of pre-programmed control-conversion algorithms.

59. The method according to claim 57, wherein an incoming control signal of MIDI format is used by said observation-conversion algorithm to generate said self-organizing chemical reaction.

60. The method according to claim 57, wherein said conversion of said observation signals to said outgoing signal of MIDI format is performed by said processing element according to an observation-conversion algorithm.

61. The method according to claim 42, wherein a visual indicator compound is introduced into said self-organizing chemical reaction to visually enhance said self-organizing chemical reaction.

62. The method according to claim 42, wherein said chemical reaction vessel comprises a substantially flat dish.

63. The method according to claim 42, wherein said monitor element comprises a two-dimensional array of monitor elements.

64. The method according to claim 42, wherein said monitor element comprises a two-dimensional array of component control elements.

65. The method according to claim 42, wherein said monitor element comprises a three-dimensional array of component monitor elements.

66. The method according to claim 42, wherein said monitor element comprises a three-dimensional array of component control elements.

67. The method according to claim 42, wherein said monitor element comprises a video camera for producing said observation signals, wherein said observation signals are converted by a processor into an outgoing signal, wherein said conversion of said observation signal to said outgoing signal is performed by said processor according to an observation-conversion algorithm performing at least one real-time image processing operation.

68. The method according to claim 67, wherein said at least one real-time image processing operation comprises position threshold detection.

69. The method according to claim 67, wherein said at least one real-time image processing operation comprises edge detection.

70. The method according to claim 67, wherein said at least one real-time image processing operation comprises edge detection location.

71. The method according to claim 67, wherein said at least one real-time image processing operation comprises pattern recognition.

72. The method according to claim 67, wherein said at least one real-time image processing operation comprises pattern area measurement.

73. The method according to claim 67, wherein said at least one real-time image processing operation comprises pattern rate-of-change measurement.

74. The method according to claim 67, wherein said observation signals comprise video signals communicated to a video display.

75. The method according to claim 74, wherein said video display is a component of a video projection system.

76. The method according to claim 67, wherein said observation signals comprise video signals provided to a real-time video processor to produce a processed video signal, said processed video signal provided to a video display.

77. The method according to claim 42, wherein said observations signals are converted into an outgoing signal of MIDI format, wherein

said outgoing signal of MIDI format is communicated to an external audio synthesizer system, and wherein

said outgoing signal of MIDI format is adapted to control said external audio synthesizer system.

78. The method according to claim 42, wherein said observations signals are converted into an outgoing signal of MIDI format, wherein

said outgoing signal of MIDI format is communicated to an external signal processing system, and wherein

said outgoing signal of MIDI format is adapted to control said external signal processing system.

79. The method according to claim 42, wherein said observations signals are converted into an outgoing signal of MIDI format, wherein

said outgoing signal of MIDI format is communicated to an external lighting system, and wherein

said outgoing signal of MIDI format is adapted to control said external lighting system.

80. The method according to claim 42, wherein said observations signals are converted into an outgoing video signal.

81. The method according to claim 80, wherein said outgoing video signal comprises recorded video.

82. The method according to claim 80, wherein said outgoing video signal comprises rendered graphics.

83. A method for supporting performer interactions with a self-organizing chemical reaction, said method comprising:

initiating a self-organizing chemical reaction comprising at least two constituent chemical reactants;

monitoring said self-organizing chemical reaction using a monitor element, said monitor element producing observation signals associated with said self-organizing chemical reaction;

responsively controlling chemical reactions of said self-organizing chemical reaction using a reaction control signal; and

converting at least one incoming performance signal into said reaction control signal, said converting accomplished using one of a selectable plurality of control-conversion algorithms, wherein said at least one incoming performance signal responsively controls chemical variations of said self-organizing chemical reaction.