Method and system for an intelligent supervisory control system

• US 20030176806A1
• Filed: 02/26/2003
• Published: 09/18/2003
• Est. Priority Date: 02/26/2002
• Status: Abandoned Application

• Current Assignee: Brendan Z. Allison, Jaime A. Pineda
• Original Assignee: Brendan Z. Allison, Jaime A. Pineda
• Inventors: Allison, Brendan Z., Pineda, Jaime A.
• Application Number:
  US10/376,676
• Publication Number:
  US 20030176806A1
• Time in Patent Office: Days
• US Class Current: 600/544
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection

Abstract

An intelligent supervisory control system or neuro-user interface (NUI), and method that utilize bioelectric state of mind or cognitive profile to control electronic and mechanical resources in an environment, such as in a 3-D PC or console game, a simulation or virtual environment, a cockpit, automobile, home, or surgical theatre. The interface comprises means for acquiring the brain signals of a user or subject, which are converted into a digital stream and mathematically processed to define an electrical state of the mind or cognitive profile of the user. Incorporating microprocessor-based software and storage facilities, the interface dynamically maps the cognitive profile onto multiple functions, which are adaptable for actuating microprocessor commands. In conjunction with other standard input devices such as mouse, keyboard, or joystick, the intelligent supervisory control interface of the present invention thus provides a user with the maximal degrees of freedom for the control of the resources (or electrical and mechanical devices) in the environment.

Claims

1. A method for supervisory control over the external environment of a user, comprising:

acquiring a bioelectric signal of a user;

processing the bioelectric signal to define a cognitive profile of the user; and

mapping the cognitive profile onto a set of microprocessor system commands for controlling the external environment of the user.

2. The method of claim 1, wherein the bioelectric signal is an electroencephalogram (EEG) signal.

3. The method of claim 2, further comprising decomposing the EEG signal in to a plurality of signal subcomponents.

4. The method of claim 3, wherein the plurality of signal subcomponents comprises frequency domain subcomponents.

5. The method of claim 4, wherein the frequency domain subcomponents are selected from the group consisting of a mu rhythm, a theta rhythm, an alpha rhythm, and a beta rhythm.

6. The method of claim 3, wherein the plurality of signal subcomponents comprises time domain subcomponents.

7. The method of claim 6, wherein the time domain subcomponents are selected from the group consisting of event-related potentials (ERP) including N1, P3, and steady state visual evoked response (SSVER).

8. The method of claim 3, wherein the processing of the signal further comprises analyzing the signal using one of the group consisting of a variable epoch frequency decomposition (VEFD), a fast Fourier transform (FFT), and independent component analysis (ICA).

9. The method of claim 3, further comprising identifying and classifying feature clusters from the plurality of signal subcomponents.

10. The method of claim 9, further comprising creating a BCI feature map (BFM) from a feature cluster identified through one of the group consisting of a discriminant optimization analysis, a waveform analysis, a distribution function analysis, and fuzzy logic.

11. The method of claim 10, further comprising performing real-time pattern recognition on the BFM to produce a set of BCI neural activations (BNAs).

12. The method of claim 1, further comprising sending a feedback signal to the user.

13. A supervisory system for controlling the external environment of an user, comprising:

signal acquisition means for acquiring a bioelectric signal of a user, the bioelectric signal comprising an electroencephalogram (EEG) rhythm; and

a controller in communication with the signal acquisition means for controlling the external environment of a user, wherein the controller comprises;

a processor for processing the bioelectric signal to define a cognitive profile; and

a mapping algorithm for mapping the cognitive profile onto a set of microprocessor system commands for controlling the external environment of the user.

14. The system of claim 13, which further comprises a feature extractor for decomposing the digitized bioelectric signal in to a plurality of signal subcomponents.

15. The system of claim 14, wherein the plurality of signal subcomponents comprises frequency domain subcomponents.

16. The system of claim 15, wherein the frequency domain subcomponents are selected from the group consisting of a mu rhythm, a theta rhythm, an alpha rhythm, and a beta rhythm.

17. The system of claim 14, wherein the plurality of signal subcomponents comprises time domain subcomponents.

18. The system of claim 17, wherein the time domain subcomponents are selected from the group consisting of event-related potentials (ERP) including N1, P3, and steady state visual evoked response (SSVER).

19. The system of claim 13, wherein the processor analyzes the bioelectric signal using one of the group consisting of a variable epoch frequency decomposition (VEFD), a fast Fourier transform (FFT), and independent component analysis (ICA).

20. The system of claim 14, wherein the controller further comprises a feature classifier for identifying feature clusters from the signal subcomponents.

21. The system of claim 20, wherein the feature classifier creates a BCI feature map (BFM) from a feature cluster identified through one of the group consisting of a discriminant optimization analysis, a waveform analysis, a distribution function analysis, and fuzzy logic.

22. The system of claim 20, wherein the feature classifier performs real-time pattern recognition on the BFM to produce a set of BCI neural activations (BNAs).

23. The system of claim 13, further comprising a feedback signal generator for sending a feedback signal to the user.

24. The system of claim 13, further comprising an action generator coupled to the controller for controlling the movement of an electromechanical device in the external environment.

25. The system of claim 13, wherein the signal acquisition means is a sensor.

26. The system of claim 13, wherein the processor comprises a central processing unit (CPU).

27. The system of claim 13, wherein the processor comprises a software control program.