Method and apparatus for translating the EEG into music to induce and control various psychological and physiological states and to control a musical instrument

• US 4,883,067 A
• Filed: 05/15/1987
• Issued: 11/28/1989
• Est. Priority Date: 05/15/1987
• Status: Expired due to Term

• Current Assignee: NeuroSonics, Inc.
• Original Assignee: NeuroSonics, Inc.
• Inventors: Wright, Geoffrey, Knispel, Joel
• Primary Examiner(s): Coven, Edward M.
• Assistant Examiner(s): NOT, DEFINED
• Application Number:
  US07/049,992
• Time in Patent Office: 928 Days
• Field of Search: 128/731-733, 128/1 C, 128/905, 84/1.24-1.27
• US Class Current: 600/545
• CPC Class Codes: A61B 5/375 using biofeedback
• CPC Class Codes: A61M 2021/0027 by the hearing sense
• CPC Class Codes: A61M 21/00 Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
• CPC Class Codes: A61M 2230/005 Parameter used as control input for the apparatus
• CPC Class Codes: A61M 2230/10 Electroencephalographic signals
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 2220/376 using brain waves, e.g. EEG
• CPC Class Codes: G10H 2230/351 Spint bell, i.e. mimicking bells, e.g. cow-bells bells in general G10K1/06
• CPC Class Codes: G10H 2250/475 FM synthesis, i.e. altering the timbre of simple waveforms by frequency modulating them with frequencies also in the audio range, resulting in different-sounding tones exhibiting more complex waveforms

Abstract

A method and apparatus for applying a musical feedback signal to the human brain, or any other brain, to induce controllable psychological and physiological responses. A signal representing the ongoing electroencephalographic (EEG) signal of a brain preferably is obtained from the electrode location on the scalp known as CZ or P3 in clinical notation. A signal processor converts the ongoing EEG into electrical signals which are converted into music by synthesizers. The music is acoustically fed back to the brain after a time delay calculated to shift the phase of the feedback in order to reinforce specific or desired ongoing EEG activity from the scalp position of interest. The music is comprised of at least one voice that follows the moment-by-moment contour of the EEG in real time to reinforce the desired EEG activity. The music drives the brain into resonance with the music to provide a closed loop or physiological feedback effect. Preferably, the musical feedback comprises additional voices that embody psychoacoustic principles as well as provide the content and direction normally supplied by the therapist in conventional biofeedback. The invention contemplates numerous applications for the results obtained.

Claims

1. A biofeedback apparatus useful for creating music, comprising:

means for receiving an ongoing EEG signal from at least one region of the brain of a biological entity, said at least one region of the brain responding to acoustical stimulation, said ongoing EEG signal having a voltage amplitude exhibiting semiperiodic change;

means for translating said ongoing EEG signal into music, said translating means including

means for generating an acoustical indication of the semiperiodic change in said ongoing EEG signal, and

means for generating musical flavor and adding said musical flavor to said acoustical indication;

means for directing said music so as to be received by the brain; and

means for delaying said directing means for a period of time determined so that the brain response to said music occurs with a predetermined phase relationship with respect to the ongoing EEG signal received from said region of the brain.

2. A biofeedback apparatus as claimed in claim 1, further comprising means for anticipating an occurrence of said semiperiodic change in said ongoing EEG signal.

3. A biofeedback apparatus as claimed in claim 2, wherein said anticipating means comprises means for determining a preferred frequency at which said brain produces said semiperiodic change over a predetermined period of time.

4. A biofeedback apparatus as claimed in claim 2, wherein said anticipating means comprises means for determining a period for a most recent preceding semiperiodic change.

5. A biofeedback apparatus as claimed in claim 2, further comprising means for modifying said delaying means to correspond to said anticipated occurrence of said semiperiodic change in said ongoing EEG signal.

6. A biofeedback apparatus as claimed in claim 2, wherein said means for generating said acoustical indication comprises means for generating sound selected from the group consisting of:

a tone chord that is frequency modulated with said ongoing EEG signal;

a punctate sound having a short attack time that is produced in response to a predetermined recurrent feature of said ongoing EEG signal; and

timbre modulation produced by modulating an overtone sweep with said ongoing EEG signal.

7. A biofeedback apparatus as claimed in claim 6, wherein the generated sound is a punctate sound and said means for generating said punctate sound comprises means for generating a sound selected from the group consisting of:

a bell;

a drum; and

a harp.

8. A biofeedback apparatus as claimed in claim 6, wherein the generated sound is a punctate sound and said means for generating said punctate sound comprises means for generating a bell sound in response to a local maxima in said ongoing EEG signal.

9. A biofeedback apparatus as claimed in claim 2, wherein:

said means for generating said acoustical indication comprises means for generating a tone chord; and

means for frequency modulating said tone chord with said ongoing EEG signal.

10. A biofeedback apparatus as claimed in claim 9, wherein said means for generating musical flavor further comprises means for modulating an overtone sweep with a low frequency, pseudorandom control signal.

11. A biofeedback apparatus as claimed in claim 9, wherein said means for generating musical flavor comprises:

means for generating a timbre modulated tone chord that is modulated with a low frequency, pseudorandom control signal; and

means for generating a timbre modulated chord that is modulated with the voltage amplitude of said ongoing EEG signal.

12. A biofeedback apparatus as claimed in claim 9, wherein said means for generating musical flavor comprises means for generating a sound selected from the group consisting of:

a timbre modulated tone chord that is modulated with a low frequency, pseudorandom control signal;

a punctate sound having a short attack time that is produced in response to a predetermined recurrent feature of said ongoing EEG signal;

a timbre modulated tone chord that is modulated with said ongoing EEG signal; and

a sequence of musical notes.

13. A biofeedback apparatus as claimed in claim 12, wherein the generated sound is a punctate sound and said means for generating said punctate sound further comprises means for generating a sound selected from the group consisting of:

a bell;

a drum; and

a harp.

14. A biofeedback apparatus as claimed in claim 12, wherein the generated sound is a punctate sound and said means for generating said punctate sound comprises means for generating a bell sound in response to a local maxima in said ongoing EEG signal.

15. A biofeedback apparatus as claimed in claim 12, wherein the generated sound is a sequence of musical notes;

and

said means for generating said sequence of notes comprises means for generating said notes at a predetermined rate; and

means for slowing said rate in proportion to the frequency of occurrence of high amplitude waves of said ongoing EEG signal.

16. A biofeedback apparatus as claimed in claim 15, further comprising means for triggering said slowing means only when the amplitude of said ongoing EEG signal exceeds a first predetermined threshold level.

17. A biofeedback apparatus as claimed in claim 16, further comprising means for generating said sequence of notes over again when the amplitude of said ongoing EEG signal exceeds a second predetermined threshold level that is greater than said first predetermined threshold level.

18. A biofeedback apparatus as claimed in claim 15, further comprising means for generating said sequence of notes over again when the amplitude of said ongoing EEG signal exceeds a second predetermined threshold level that is greater than said first predetermined threshold level.

19. A biofeedback apparatus as claimed in claim 9, wherein said means for generating an acoustical indication of the semiperiodic change in said ongoing EEG signal produces a first musical voice.

20. A biofeedback apparatus as claimed in claim 19, wherein said musical flavor comprises:

means for generating a second musical voice indicative of a predetermined feature of said ongoing EEG signal;

means for generating a third musical voice indicative of the occurrence of a semiperiodic predetermined feature of the ongoing EEG signal; and

means for generating a fourth musical voice indicative of an average value of the ongoing EEG signal.

21. A biofeedback apparatus as claimed in claim 20, wherein:

said means for generating said first musical voice comprises means for generating a tone chord and means for frequency modulating said tone chord with said ongoing EEG signal;

said means for generating said second musical voice comprises means for generating a bell sound in response to a local maxima of said ongoing EEG signal;

said means for generating said third musical voice comprises means for generating an overtone sweep of a chord tone, said overtone sweep being modulated by the amplitude of said ongoing EEG signal at a local maxima; and

said means for generating said fourth musical voice comprises means for generating a series of notes in sequence at a rate determined by the amplitude of said ongoing EEG signal.

22. A biofeedback apparatus as claimed in claim 21, wherein:

said means for generating said second voice comprises means for not generating said second voice unless the amplitude of said ongoing EEG signal exceeds a first predetermined threshold level; and

said means for generating said fourth voice comprises means for not generating said sequence rate at a slower rate unless the amplitude of said ongoing EEG signal exceeds said first threshold level.

23. A biofeedback apparatus as claimed in claim 22, wherein:

said means for generating said third voice comprises means for not generating said third voice unless the amplitude of said ongoing EEG signal exceeds said first threshold level; and

said means for generating said sequence of notes comprises means for generating said sequence again whenever said ongoing EEG signal exceeds a second predetermined threshold level that is greater than said first predetermined threshold level.

24. A biofeedback apparatus as claimed in claim 23, wherein said means for generating said sequence of notes comprises means for generating a progressively more dissonant pattern.

25. A biofeedback apparatus as claimed in claim 23, wherein said means for generating said second voice comprises means for modulating the pitch of said bell sound around a center frequency in proportion to said amplitude of said ongoing EEG signal.

26. A biofeedback apparatus as claimed in claim 23, wherein said means for generating said fourth voice comprises an envelope generator means for amplitude modulating said fourth voice, said envelope generator means being triggered independently of said ongoing EEG signal.

27. A method of producing a biofeedback signal useful for creating music, comprising the steps of:

receiving an ongoing EEG signal from at least one region of the brain of a biological entity, said at least one region of the brain responding to acoustical stimulation, said ongoing EEG signal having a voltage amplitude exhibiting semiperiodic change;

translating said ongoing EEG signal into music, including the steps of

generating an acoustical indication of the semiperiodic change in said ongoing EEG signal,

generating a musical flavor, and adding said

musical flavor to said acoustical indication;

directing said music so as to be received by the brain; and

delaying said directing for a period of time determined so that the brain responds to said music with a predetermined phase relationship with respect to the ongoing EEG signal received from said region of the brain.

28. A method of producing a biofeedback signal as claimed in claim 27, further comprising the step of anticipating an occurrence of said semiperiodic change in said ongoing EEG signal.

29. A method of producing a biofeedback signal as claimed in claim 28, wherein said step of anticipating comprises the step of determining a preferred frequency at which said brain produces said semiperiodic change over a predetermined period of time.

30. A method of producing a biofeedback signal as claimed in claim 28, wherein said step of anticipating comprises the step of determining a period for a most recent preceding semiperiodic change.

31. A method of producing a biofeedback signal as claimed in claim 28, further comprising the step of modifying said delaying time period to correspond to anticipated occurrence of said semiperiodic change in said ongoing EEG signal.

32. A method of producing a biofeedback signal as claimed in claim 28, wherein said step of generating said acoustical indication comprises the step of generating a sound selected from the group consisting of:

a tone chord that is frequency modulated with said ongoing EEG signal;

a punctate sound having a short attack time that is produced in response to a predetermined recurrent feature of said ongoing EEG signal; and

timbre modulation produced by modulating an overtone sweep with said ongoing EEG signal.

33. A method of producing a biofeedback signal as claimed in claim 32, wherein the generated sound is punctate and said step of generating said punctate sound comprises generating a sound selected from the group consisting of:

a bell;

a drum and

a harp.

34. A method of producing biofeedback as claimed in claim 33 wherein said step of adding musical flavor to said acoustical indication comprises the step of modifying said musical flavor with said ongoing EEG signal.

35. A method of producing biofeedback as claimed in claim 34, wherein:

said step of generating said acoustical indication comprises generating a tone chord and the step of frequency modulating said tone chord with said ongoing EEG signal; and

said step of adding musical flavor comprises the step of timbre modulating said tone chord with the voltage amplitude of said ongoing EEG signal.

36. A method of producing biofeedback as claimed in claim 35, wherein said step of adding musical flavor further comprises the step of modulating said timbre of said tone chord with an independently produced signal that is independent of said ongoing EEG signal.

37. A method of producing biofeedback as claimed in claim 36, wherein said independently produced signal comprises a low frequency, pseudorandom signal.

38. A method of producing biofeedback as claimed in claim 34, wherein said step of generating said acoustical indication of the semiperiodic change in said ongoing EEG signal produces a first musical voice.

39. A method of producing biofeedback as claimed in claim 38, wherein said step of generating musical flavor comprises the steps of:

generating a second musical voice indicative of a predetermined feature of said ongoing EEG signal;

generating a third musical voice indicative of the recent amplitude of the ongoing EEG signal; and

generating a fourth musical voice indicative of an average value of the ongoing EEG signal,

40. A method of producing biofeedback as claimed in claim 39 wherein:

said step of generating said first musical voice comprises the step of generating a tone chord that is frequency modulated with said ongoing EEG signal;

said step of generating a second musical voice comprises the step of generating a bell sound in response to a local maxima of said ongoing EEG signal;

said step of generating said third musical voice comprises the step of generating an overtone sweep of a chord tone, said overtone sweep being modulated by the relative frequency of occurrence of an at least semiperiodic predetermined feature of said ongoing EEG signal; and

said step of generating said fourth musical voice comprises the step of generating a series of notes that are played in sequence at a rate determined by the amplitude of said ongoing EEG signal.

41. A method of producing biofeedback as claimed in claim 40, wherein:

said step of generating said second voice is performed only in response to the amplitude of said ongoing EEG signal exceeding a first predetermined threshold level; and

said step of generating said fourth voice comprises the step of slowing said sequence rate in proportion to the amplitude of said ongoing EEG signal only when said ongoing EEG signal exceeds said first threshold level.

42. A method of producing biofeedback as claimed in claim 41, wherein:

said step of generating said third voice comprises the step of modifying said third voice only when the amplitude of said ongoing EEG signal exceeds said first predetermined threshold level; and

said step of generating said fourth voice comprises the step of generating said sequence again whenever said ongoing EEG signal exceeds a second threshold level that is greater than said first threshold level.

43. A method of producing biofeedback as claimed in claim 42, wherein said sequence of notes comprises a progressively more dissonant pattern.

44. A method of producing biofeedback as claimed in claim 42, wherein said step of generating said second voice comprises the step of modulating the pitch of said bell sound around a center frequency in proportion to said amplitude of said ongoing EEG signal.

45. A method of producing biofeedback as claimed in claim 42, wherein said step of generating said fourth voice comprises the step of modifying the biofeedback signal with a signal that is independent of said ongoing EEG signal.

46. Music as derived by the process claimed in claim 39, wherein said steps of generating said acoustical indication and said musical flavor comprise generating a polyphonic hierarchy of musical voices that are mutually physiologically and psychoacoustically correct.

47. Music as derived by the process claimed in claim 46, wherein said first, second, third and fourth musical voices comprise sounds selected from the group consisting of:

a timbre modulated tone chord that is modulated with the ongoing EEG signal;

a punctate sound having a short attack time that is short relative to and produced in response to a predetermined recurrent feature of said ongoing EEG signal;

a timbre modulated tone chord that is modulated with said ongoing EEG signal; and

a sequence of dissonant musical notes.

48. A method of producing a biofeedback signal as claimed in claim 32, wherein the generated sound is punctate and said step of generating said punctate sound comprises the step of generating a bell sound in response to a local maxima in said ongoing EEG signal.

49. A method of producing a biofeedback signal as claimed in claim 28, wherein:

said step of generating said acoustical indication comprises the step of generating a tone chord and the step of frequency modulating said tone chord with said ongoing EEG signal.

50. A method of producing a biofeedback signal as claimed in claim 49, wherein said step of generating musical flavor further comprises the step of modulating an overtone sweep with a low frequency, pseudorandom control signal.

51. A method of producing a biofeedback signal as claimed in claim 49, wherein said step of generating musical flavor comprises the steps of:

generating a timbre modulated tone chord that is modulated with a low frequency, pseudorandom control signal; and

generating a timbre modulated chord that is modulated with the voltage amplitude of said ongoing EEG signal.

52. A method of producing a biofeedback signal as claimed in claim 49, wherein said step of generating musical flavor comprises the step of generating a sound selected from the group consisting of:

a timbre modulated tone chord that is modulated with a low frequency, pseudorandom control signal;

a punctate sound having a short attack time that is produced in response to a predetermined recurrent feature of said ongoing EEG signal;

a timbre modulated tone chord that is modulated with said ongoing EEG signal; and

a sequence of musical notes.

53. A method of producing a biofeedback signal as claimed in claim 52, wherein the generated sound is punctate and said step of generating said punctate sound further comprises the step of generating a sound selected from the group consisting of:

a bell;

a drum and

a harp.

54. A method of producing a biofeedback signal as claimed in claim 52, wherein the generated sound is a punctate sound and said step of generating said punctate sound further comprises the step of generating a bell sound in response to a local maxima in said ongoing EEG signal.

55. A method of producing a biofeedback signal as claimed in claim 52, wherein the sound is a sequence of musical notes, and

said step of generating said sequence of notes comprises the step of generating said notes at a predetermined rate;

and

the step of slowing said rate in proportion to the frequency of occurrence of high amplitude waves of said ongoing EEG signal.

56. A method of producing a biofeedback signal as claimed in claim 55, further comprising the step of triggering said slowing step only when the amplitude of said ongoing EEG signal exceeds a first predetermined threshold level.

57. A method of producing a biofeedback signal as claimed in claim 56, further comprising the step of generating said sequence of notes over again when the amplitude of said ongoing EEG signal exceeds a second predetermined threshold level that is greater than said first predetermined threshold level.

58. A method of producing a biofeedback signal as claimed in claim 55, further comprising the step of generating said sequence of notes over again when the amplitude of said ongoing EEG signal exceeds a second predetermined threshold level that is greater than said first predetermined threshold level.

59. Music derived from brain waves by a process comprising the steps of:

receiving an ongoing EEG signal from at least one region of the brain of a biological entity, said at least one region of the brain responding to acoustical stimulation, said ongoing EEG signal exhibiting semiperiodic, moment-by-moment change;

generating an acoustical indication of the moment-by-moment change of said ongoing EEG signal;

adding musical flavor to said acoustical indication;

directing said acoustical indication so as to be received by the brain; and

delaying said step of directing said acoustical indication for a period of time determined so that the brain responds to said acoustical indication with a predetermined phase relationship with respect to the ongoing EEG signal received from said region of the brain.

60. A brain wave driven cybernetic interface circuit adapted for cooperation with a nervous system, a brain, and an acoustical sensory organ, comprising:

means for selecting a predetermined form of electrical activity from the nervous system, said brain producing produce said electrical activity, said acoustical sensory organ adapted to respond to acoustical impulses, including

means for receiving an ongoing EEG signal from a region of the brain, and

means for filtering said ongoing EEG signal to select a particular type of neuroelectrical activity in the brain, said neuroelectrical activity exhibiting semiperiodic change;

means for reinforcing said neuroelectrical activity in the brain, including

means for generating an acoustical indication of said semiperiodic change,

means for adding musical flavor to said acoustical indication to form a musical feedback signal,

means for converting said musical feedback signal into acoustical impulses comprising feedback music,

means for directing said feedback music to be received by said acoustical sensory organ, and

means for delaying said directing means for a period of time determined so that the brain response to said feedback music occurs with a predetermined phase relationship with respect to the ongoing EEG signal received from said region of the brain; and

means for generating a control signal in response to a predetermined musical pattern in said feedback music.

61. A brain wave driven cybernetic interface circuit as claimed in claim 60, further comprising a musical instrument to receive said control signal and generate music in response thereto.

62. A method of forming a cybernetic interface, comprising the steps of:

selecting a predetermined form of electrical activity from a nervous system, said nervous system having a brain to produce said electrical activity and an acoustical sensory organ to respond to acoustical impulses, including the steps of

receiving an ongoing EEG signal from a region of the brain, and

filtering said ongoing EEG signal to select a particular type of neuroelectrical activity in the brain, said neuroelectrical activity exhibiting semiperiodic change;

reinforcing said neuroelectrical activity in the brain including the steps of

generating an acoustical indication of said semiperiodic change,

adding musical flavor to said acoustical indication to form a musical feedback signal,

converting said musical feedback signal into acoustical impulses comprising feedback music,

directing said feedback music to be received by said acoustical sensory organ, and

delaying said step of directing for a period of time determined so that the brain responds to said feedback music with a predetermined phase relationship with respect to the ongoing EEG signal received from said region of the brain; and

generating a control signal in response to a predetermined musical pattern in said feedback music.

63. A method of forming a cybernetic interface as claimed in claim 62, further comprising the step of directing said control signal to a musical instrument that generates music in response thereto.

64. A method of forming a cybernetic interface as claimed in claim 62, wherein said nervous system is a human nervous system.

65. A neural stimulation apparatus, comprising:

means for noninvasively extracting an ongoing EEG signal from a predetermined region of a brain;

means for converting said EEG signal into music, said music having physiological information and musical flavor;

means for directing said music to an auditory sensory organ of said brain; and

means for delaying said directing means for a period of time determined so that said response of said region of the brain said music occurs with a predetermined phase relationship with respect to the ongoing EEG signal extracted from said region of the brain.

66. A neural stimulation apparatus as claimed in claim 65, wherein said noninvasive extraction means comprises a magnetometer.

67. A neural stimulation apparatus as claimed in claim 66, wherein said magnetometer comprises means for triangulating EEG activity occurring within said brain.

68. A method of stimulating neural activity, comprising the steps of:

noninvasively extracting an ongoing EEG signal from a predetermined region of a brain;

converting said EEG signal into music, said music having physiological information and musical flavor;

directing said music to an auditory sensory organ of said brain; and

delaying said directing step for a period of time determined so that said region of the brain responds to said music with a predetermined phase relationship with respect to the ongoing EEG signal extracted from said region of the brain.

69. A method of stimulating neural activity as claimed in claim 68, wherein said step of extracting said ongoing EEG signal comprises the step of detecting semiperiodic changes in magnetic field indicative of said ongoing EEG activity.

70. A method of stimulating neural activity as claimed in claim 69, wherein said step of detecting semiperiodic changes in magnetic field comprises the step of triangulating said ongoing EEG activity so as to extract only ongoing EEG activity from a well defined region of said brain.

71. A method of stimulating neural activity as claimed in claim 70, wherein said brain is a human brain.