Speech-based biofeedback method and system

• US 5,647,834 A
• Filed: 06/30/1995
• Issued: 07/15/1997
• Est. Priority Date: 06/30/1995
• Status: Expired due to Term

• Current Assignee: BioControl LLC
• Original Assignee: Samuel Ron
• Inventors: Ron, Samuel
• Primary Examiner(s): Cohen, Lee S.
• Assistant Examiner(s): GILBERT, SAMUEL G
• Application Number:
  US08/497,253
• Time in Patent Office: 746 Days
• Field of Search: 128/731, 128/732, 128/898, 600/23, 600/27, 600/28
• US Class Current: 600/23
• CPC Class Codes: A61B 5/16 Devices for psychotechnics using teaching or educational appliances G09B1/00 - G09B7/00; Testing reaction times ; Devices for evaluating the psychological state
• CPC Class Codes: A61B 5/4803 Speech analysis specially adapted for diagnostic purposes
• CPC Class Codes: A61B 5/486 Bio-feedback A61B5/375 takes precedence
• CPC Class Codes: A63F 13/212 using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/424 involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
• CPC Class Codes: A63F 13/54 involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• CPC Class Codes: A63F 2300/1012 involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
• CPC Class Codes: A63F 2300/1081 Input via voice recognition
• CPC Class Codes: A63F 2300/6072 of an input signal, e.g. pitch and rhythm extraction, voice recognition
• CPC Class Codes: A63F 2300/6081 generating an output signal, e.g. under timing constraints, for spatialization
• CPC Class Codes: A63F 2300/6692 using special effects, generally involving post-processing, e.g. blooming
• CPC Class Codes: A63F 2300/8082 Virtual reality
• CPC Class Codes: A63F 9/24 Electric games; Games using electronic circuits not otherwise provided for video games A63F13/00; computerized gaming systems G07F17/32
• CPC Class Codes: G09B 19/00 Teaching not covered by other main groups of this subclass teaching or practice apparatus for gun-aiming or gun-laying F41G3/26
• CPC Class Codes: G10L 15/24 Speech recognition using non-acoustical features
• CPC Class Codes: G10L 17/26 Recognition of special voice characteristics, e.g. for use in lie detectors; Recognition of animal voices

Abstract

A method for effecting biofeedback regulation of at least one physiological variable characteristic of a subject'"'"'s emotional state, comprising the steps of monitoring at least one speech parameter characteristic of the subject'"'"'s emotional state so as to produce an indication signal, and using the indication signal to provide the subject with an indication of the at least one physiological variable. A system permits the method to be carried out in standalone mode or via the telephone line, in which case the indication signal may be derived at a location remote from the subject. Likewise, information relating to the subject'"'"'s emotional state can be conveyed vocally to a remote party or textually through the Internet, and then processed as required.

Claims

1. A method for effecting biofeedback regulation of at least one physiological variable characteristic of a subject'"'"'s emotional state, comprising the steps of:

(a) monitoring at least one speech parameter characteristic of the subject'"'"'s emotional state so as to produce an indication signal representative of the at least one physiological variable,

(b) consciously altering the subject'"'"'s emotional state so as to induce a desired change in the indication signal;

(c) monitoring at least one non-speech parameter characteristic of the subject'"'"'s emotional state so as to determine a reference level of said non-speech parameter when the at least one physiological variable is at a required level, and

consciously altering the at least one speech parameter so as to cause said non-speech parameter to assume said reference level.

2. The method according to claim 1 for training the subject to speak in a manner which does not reflect his emotional state, further comprising the steps of:

(c) monitoring at least one non-speech parameter characteristic of the subject'"'"'s emotional state so as to determine a reference level of said non-speech parameter when the at least one physiological variable is at a required level, and

(d) consciously altering the at least one speech parameter so as to cause said non-speech parameter to assume a different level to said reference level.

3. The method according to claim 1, wherein said indication signal is a pre-recorded audio-visual scenario whose content changes according to the subject'"'"'s emotional state.

4. The method according to claim 3, wherein the subject selects a desired audio-visual scenario according to a required emotion that is to be exposed.

5. The method according to claim 3, wherein the audio-visual scenario is a game having an objective which is achieved only when the subject reaches a required emotional state.

6. The method according to claim 3, wherein the audio-visual scenario changes at a rate dependent on the subject'"'"'s emotional state.

7. The method according to claim 3, wherein the subject selects a desired visual image according to a required emotion that is to be exposed.

8. The method according to claim 3, wherein the subject selects desired auditory sounds according to a required emotion that is to be exposed.

9. The method according to claim 1, wherein the indication signal is derived at a location remote from the subject.

10. The method according to claim 9, wherein the subject is fed the indication signal via a communication channel.

11. The method according to claim 10, wherein the subject communicates with a remote party via the communication channel and the indication signal is not fed to the remote party.

12. The method according to claim 11, wherein the subject transfers to the remote party via the communication channel a file encoding therein his emotional state which is decoded by the remote party so as to derive therefrom the subject'"'"'s emotional state which is then visually or audibly output by the remote party.

13. The method according to claim 10, wherein the subject communicates with a remote party via the communication channel and the indication signal is fed to the remote party.

14. The method according to claim 13, wherein the subject transfers to the remote party via the communication channel a file encoding therein his emotional state which is decoded by the remote party so as to derive therefrom the subject'"'"'s emotional state.

15. The method according to claim 1, wherein said indication signal is a set of icons each corresponding to a respective emotional state.

16. The method according to claim 1, wherein the subject is hearing-impaired and the indication signal is not audible.

17. The method according to claim 1, wherein the subject is unable to express himself emotionally and the indication signal is indicative of a broad category of emotional state.

18. The method according to claim 1, for quantitatively assessing an alertness level of the subject relative to an initial extreme state of tiredness or alertness, further comprising the steps of:

(c) deriving a reference indication signal when the subject is at said extreme state of tiredness or alertness and storing data representative of the reference indication signal,

(d) deriving the indication signal when it is required to assess the subject'"'"'s alertness level and comparing data representative of the indication signal with said stored data so as to derive a difference signal which provides a quantitative assessment of the subject'"'"'s relative alertness to said extreme state.

19. A system for effecting biofeedback regulation of at least one physiological variable characteristic of a subject'"'"'s emotional state, the system comprising:

a microphone for converting the subject'"'"'s speech to an electrical signal,

a processing means coupled to the microphone for deriving from the electrical signal at least one speech parameter characteristic of the subject'"'"'s emotional state and for producing therefrom an indication signal,

an indication means coupled to the processing means and responsive to the indication signal for providing the subject with an indication of the at least one physiological variable;

at least one sensor for detecting a non-speech parameter characteristic of the subject'"'"'s emotional state and producing a corresponding sensor signal, and

reference signal means coupled to the at least one sensor and responsive to the sensor signal for determining a reference level of said non-speech parameter when the at least one physiological variable is at a required level.

20. The system according to claim 19, wherein the indication means includes voice synthesizing means for producing a verbal indication of the at least one physiological variable.

21. The system according to claim 19, wherein the indication means is a display device for displaying visually said indication of the at least one physiological variable.

22. The system according to claim 19, further including a storage means coupled to the processing means for storing therein a pre-recorded audio-visual scenario;

the indication means being responsive to the indication signal for displaying different frames of said scenario according to the subject'"'"'s emotional state.

23. The system according to claim 22, further including a selection means coupled to the storage device for selecting a desired audio-visual scenario according to a required emotion that is to be exposed.

24. The system according to claim 22, wherein the audio-visual scenario is a game having an objective which is achieved only when the subject reaches a required emotional state.

25. The system according to claim 22, wherein the audio-visual scenario changes at a rate dependent on the subject'"'"'s emotional state.

26. The system according to claim 22, further including a selection means coupled to the storage device for selecting a desired visual image according to a required emotion that is to be exposed.

27. The system according to claim 22, further including a selection means coupled to the storage device for selecting desired auditory sounds according to a required emotion that is to be exposed.

28. The system according to claim 19, being a suitably programmed multimedia system.

29. The system according to claim 19, further including:

a virtual reality generator for producing a virtual reality scenario and which is responsively coupled to the indication signal for modifying the virtual reality scenario in accordance with the subject'"'"'s emotional state.

30. The system according to claim 19 being contained within a child'"'"'s toy, said indication means including voice synthesizing means for producing a verbal indication of the at least one physiological variable.

31. The system according to claim 30, wherein:

the toy further includes at least one pressure sensor for sensing pressure applied to the toy consequent to a child'"'"'s emotional state and producing a corresponding pressure signal, and

the voice synthesizing means are coupled to the at least one pressure sensor for producing a verbal indication of the child'"'"'s emotional state.

32. The system according to claim 19, further including a communication channel for conveying the indication signal to a remote party.

33. The system according to claim 32, wherein the microphone is contained within a telephone connected to a communication channel and the biofeedback signal is sent to the subject via the communication channel.

34. The system according to claim 32, further including a remote telephone connected to the communication channel remote from the subject for receiving the indication signal as a tone burst and for allowing the subject to converse with a remote party.

35. The system according to claim 34, further including a filtering means coupled to the remote telephone for preventing the subject from hearing the tone burst.

36. The system according to claim 35, wherein the filtering means is a multiplexer.

37. A method for effecting biofeedback regulation of at least one physiological variable characteristic of a subject'"'"'s emotional state, comprising the steps of:

(a) simultaneously monitoring a plurality of speech parameters having a combined response which is characteristic of the subject'"'"'s emotional state and having associated therewith a reference threshold corresponding to a reference emotional state of the subject,

(b) determining the reference threshold for the subject,

(c) comparing an instantaneous value of the combined response of each of the monitored speech parameters with the corresponding reference threshold so as to produce an indication signal representative of the at least one physiological variable, and

(d) consciously altering the subject'"'"'s emotional state so as to induce a desired change in the indication signal.

38. The method according to claim 37 further including the steps of:

monitoring at least one non-speech based physiological variable, and

deriving a combined indication signal based on the monitored speech-based physiological variables and the at least one non-speech based physiological variable.

39. A system for effecting biofeedback regulation of at least one physiological variable characteristic of a subject'"'"'s emotional state, the system comprising:

a microphone for converting the subject'"'"'s speech to an electrical signal,

a processing means coupled to the microphone for deriving from the electrical signal a plurality of speech parameters each having a combined response which is characteristic of the subject'"'"'s emotional state and having associated therewith a reference threshold corresponding to a reference emotional state of the subject;

said processing means further;

(a) determining the reference threshold for the subject, and

(b) comparing an instantaneous value of the combined response of each of the monitored speech parameters with the corresponding reference threshold so as to produce therefrom an indication signal, and

an indication means coupled to the processing means and responsive to the indication signal for providing the subject with an indication of the at least one physiological variable.