Wireless input system based on steady-state visual-evoked potentials

• US 9,927,872 B2
• Filed: 10/27/2015
• Issued: 03/27/2018
• Est. Priority Date: 07/20/2015
• Status: Active Grant

• Current Assignee: Beijing University of Technology (Beijing Education Commission)
• Original Assignee: Beijing University of Technology (Beijing Education Commission)
• Inventors: Yang, Chunlan, Nie, Yingnan, Li, Wan, Wu, Shuicai
• Primary Examiner(s): Amadiz, Rodney
• Application Number:
  US15/301,043
• Publication Number:
  US 20170185150A1
• Time in Patent Office: 882 Days
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: H04W 4/80 Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication

Abstract

A wireless BCI input system for mobile intelligent devices is described. The system may include an SSVEP keyboard for stimulating SSVEP signals and an EEG headband for acquiring EEG signals. The SSVEP keyboard may include sixteen virtual buttons and a mask that can be replaced to change functions of the virtual buttons. The EEG headband may include an EEG acquisition module, an EEG analysis module, and a Bluetooth communication module, which are used for acquiring EEG signals, determining the user'"'"'s input intentions, and sending characters or controlling commands to a matched mobile intelligent device via Bluetooth connection.

Claims

1. A wireless brain computer interface (BCI) input system associated with a mobile intelligent device implementing steady-state visual evoked potentials (SSVEP), the system comprising;

a SSVEP keyboard configured to represent characters and stimulate SSVEP signals such that the mobile intelligent device is controlled by a user via a virtual button; and

an EEG headband configured to acquire EEG signals, extract SSVEP signals, analyze the EEG signals, identify user intention, and communicate with the mobile intelligent device via Bluetooth connection, wherein;

the SSVEP keyboard comprises;

a flash light generator configured to generate flash light,

a casing configured to isolate light sources, and

a mask configured to represent characters, wherein;

the flash light generator comprising a NE555 chip, resistances, and capacitances,

the flash light generator generates a square wave with a constant frequency to drive light-emitting diode (LED) flashing,

LEDs are isolated with opaque plastic materials, the mask is a translucent mask covering on the LEDs, and

the translucent mask is located below a top window and above a bottom window of the casing of the SSVEP keyboard and is replaceable;

the EEG headband comprises;

an EEG acquisition module configured to acquire a user scalp EEG signal by amplification, filtration, and AD-conversion,

an EEG analysis module configured to extract SSVEP signals and to perform classification,

a communication module configured to transfer classification results to the mobile intelligent device, and

a headband on which the EEG acquisition module, the EEG analysis module and the communication module are fixed, wherein;

the EEG acquisition module comprises;

three electrodes consisting of a frontal electrode that is attached to a forehead of the user, an occipital electrode that is attached to an occipital area of the user, and an ear-clip electrode that is clipped to the left ear lobe of the user, and

an electric circuitry that comprises a two-stage amplifier with magnification of 1000 times of the original voltage, a band-pass filter with passband of about 5-40 Hz and an AD-converter with a rate of 512 Hz,

the EEG analysis module comprises;

a single-chip computer that runs an analysis program configured to buffer data, remove DC components, eliminate baseline drift, execute time-frequency transformation, extract features, identify none-control state, and perform classification,

the communication module comprises;

a Bluetooth module, and

an antenna, wherein the communication module is configured to send characters or control commands to the mobile intelligent device via Bluetooth communication protocols.

2. The system of claim 1, wherein the EEG headband is placed on a head of the user, the SSVEP keyboard is placed in front of the user, and the EEG headband is matched with the mobile intelligent device via the Bluetooth connection such that user input the mobile intelligence device by looking at the virtual buttons on the SSVEP keyboard;

the LEDs on the bottom of the SSVEP keyboard is configured to flash based on predefined frequencies, the mask is made of translucent material to filter the light of the LEDs and to protect eyes of the user, a window on top of the casing is made of transparent material, and the other parts of the casing are made of opaque materials;

a frontal electrode and an occipital electrode are embedded in the headband;

the EEG acquisition module, EEG analysis module, and communication module are assembled in a plastic casing, the headband of the system is adjustable to ensure frontal electrodes and occipital electrode cling on frontal skin and an occipital scalp of the user, respectively when using this system, and an ear-clip electrode is clipped to a left ear lobe of the user; and

the EEG signals are acquired by electrodes via the amplifier, the band-pass filter and an AD converter step-by-step such that the EEG signals are converted into a digital format and are then analyzed by the EEG analysis module, and characters and control commands resulting from the analysis program are transferred to the mobile intelligent device via the communication module.

3. The system of claim 1, wherein the EEG signals are segmented into 1 second pieces, and each piece of data is analyzed separately.

4. The system of claim 1, wherein each virtual button is customized by setting the EEG headband to a custom mode via a hardware switch such as to:

turn the Bluetooth module on standby when the system is set to custom mode and after which the system is connected to a smartphone or tablet PC;

send custom commands to the system via Bluetooth serial port protocols, wherein customized characters are a string or AT (Attention) command from a standard Bluetooth communication protocol; and

replace the mask to match the customized function of virtual buttons.