ACTIVATION APPARATUS, METHOD, AND COMPUTER PROGRAM FOR BRAINWAVE INTERFACE SYSTEM

• US 20100317988A1
• Filed: 10/21/2008
• Published: 12/16/2010
• Est. Priority Date: 10/29/2007
• Status: Active Grant

• Current Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: Morikawa, Koji, Terada, Yoshihisa, Adachi, Shinobu
• Granted Patent: US 8,369,939 B2
• Time in Patent Office: Days
• US Class Current: 600/544
• CPC Class Codes: A61B 5/378 Visual stimuli
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection

Abstract

A brain wave interface (IF) is started up using user'"'"'s brain wave signals. A brain wave IF system comprises a brain wave measuring portion for measuring brain wave signals, a function controlling portion which analyzes an event-related potential contained in brain signals and outputs a function control signal for controlling the function of the apparatus based on the analysis results, and an output portion for outputting the function control signal. A start-up device comprises a start-up judging portion and a stimulus-attention judging portion. The start-up judging portion transmits, to the output portion, a stimulus control signal for controlling presentation/extinction of a visual stimulus which is a single item in the output portion when the brain wave IF system is not working, and compares a value of a P200 component of the event-related potential starting on a presentation timing of a visual stimulus out of the brain wave signals acquired from the brain wave measuring portion with a predetermined threshold value to determine whether or not to output a start-up trigger to the function controlling portion based on the comparison results. The stimulus-attention judging portion judges whether the user is paying attention to the visual stimulus based on an N100 component of the event-related potential starting on the presentation timing of the visual stimulus and makes the start-up judging portion start processing according to the judgment results. The brain wave IF system is started by the start-up judging portion outputting the start-up trigger.

Claims

1. An activation apparatus for activating an electroencephalogram interface system,

the electroencephalogram interface system including

an electroencephalogram measurement section for measuring an electroencephalogram signal from a user,

a function control section for analyzing an event-related potential contained in the electroencephalogram signal and outputting a function control signal for controlling a function of a device based on a result of analysis, and

an output section for outputting the function control signal,

the activation apparatus comprising:

an activation determination section for, while the electroencephalogram interface system is not functioning, transmitting to the output section a stimulation control signal for controlling presentation and vanishing of a visual stimulation on a single-item on the output section, and, within the electroencephalogram signal acquired from the electroencephalogram measurement section, allowing a P200 component value of an event-related potential since a timing of presenting the visual stimulation as a starting point to be compared against a predetermined threshold value, and determining whether or not to output an activation trigger to the function control section based on a result of comparison; and

a stimulation attention determination section for determining whether or not the user is paying attention to the visual stimulation based on an N100 component of the event-related potential since the timing of presenting the visual stimulation as a starting point, and causing processing by the activation determination section to begin depending on a determination result, wherein,

the activation apparatus activates the electroencephalogram interface system by outputting the activation trigger.

2. The activation apparatus of claim 1, wherein, as the P200 component value, the activation determination section compares a value of the event-related potential in a zone of 200±

50 ms since the timing of presenting the visual stimulation as a starting point against the predetermined threshold value.

3. The activation apparatus of claim 1, wherein, as the P200 component value, the activation determination section compares a local maximum value, a maximum value, or a zone average value of the event-related potential in a zone of 200±

50 ms since the timing of presenting the visual stimulation as a starting point against the predetermined threshold value.

4. The activation apparatus of claim 1, wherein the stimulation attention determination section instructs the activation determination section to change a method of presenting the visual stimulation based on a determination result that the user is paying attention to the visual stimulation.

5. The activation apparatus of claim 1, wherein,

the electroencephalogram interface system includes an imaging device for imaging a video and outputting a video signal;

the activation apparatus further comprises

a flicker detection section for detecting based on the video signal a subject which is flickering in the video, and based on a characteristic quantity of the subject, generating function control information which designates a function to be executed by the function control section, and outputting information indicating a lighting timing of the subject and the function control information;

the activation determination section identifies a timing of presenting the visual stimulation based on the information indicating the lighting timing, and when outputting an activation trigger to the function control section, outputs a control signal based on the function control information; and

the function control section of the electroencephalogram interface system executes a specific function based on the activation trigger and the function control information.

6. The activation apparatus of claim 5, wherein,

the flicker detection section retains a database defining a correspondence between characteristic quantities of subjects and functions to be executed by the function control section, and

by recognizing a characteristic quantity of the subject and referring to the database based on the characteristic quantity, identifies a function to be executed by the function control section and outputs the function control information.

7. In an electroencephalogram interface system having an electroencephalogram measurement section for measuring an electroencephalogram signal from a user and a plurality of devices, an activation apparatus for activating at least one of the plurality of devices,

each of the plurality of devices including a function control section for outputting a function control signal for controlling a function of the device and an output section for outputting the function control signal;

the activation apparatus comprising;

a flicker timing control section for controlling the output section of each device to repeat presentation and vanishing of a visual stimulation, and outputting a determination trigger indicating a timing with which the visual stimulation is presented at any of the devices;

a storage medium for retaining determination trigger information identifying a timing of outputting the determination trigger and a device that is presenting the visual stimulation when the determination trigger is output; and

an activation determination section for, within the electroencephalogram signal acquired from the electroencephalogram measurement section, allowing a P200 component value of an event-related potential since a timing of receiving the determination trigger as a starting point to be compared against a predetermined threshold value, and based on a result of comparison, identifying the device presenting the visual stimulation based on the timing of receiving the determination trigger and the determination trigger information, and outputting an activation trigger to the function control section of the identified device; and

a stimulation attention determination section for determining whether or not the user is paying attention to the visual stimulation based on an N100 component of the event-related potential since the timing of presenting the visual stimulation as a starting point, and causing processing by the activation determination section to begin depending on a determination result, wherein,

the activation apparatus activates the device identified by the activation determination section by outputting the activation trigger.

8. An activation method for activating an electroencephalogram interface system,

the electroencephalogram interface system including

an electroencephalogram measurement section for measuring an electroencephalogram signal from a user,

a function control section for analyzing an event-related potential contained in the electroencephalogram signal and outputting a function control signal for controlling a function of a device based on a result of analysis, and

an output section for outputting the function control signal,

the activation method comprising the steps of:

while the electroencephalogram interface system is not functioning, transmitting to the output section a stimulation control signal for controlling presentation and vanishing of a visual stimulation on a single-item on the output section;

determining whether or not the user is paying attention to the visual stimulation based on an N100 component of the event-related potential since a timing of presenting the visual stimulation as a starting point;

based on a determination result, allowing a P200 component value of an event-related potential since the timing of presenting the visual stimulation as a starting point, within the electroencephalogram signal acquired from the electroencephalogram measurement section, to be compared against a predetermined threshold value;

determining whether or not to output an activation trigger to the function control section based on a result of comparison; and

activating the electroencephalogram interface system by outputting the activation trigger when it is determined to output the activation trigger.

9. A computer program stored on a computer-readable medium and executed by a computer of an activation apparatus incorporated in an electroencephalogram interface system,

the electroencephalogram interface system including

an electroencephalogram measurement section for measuring an electroencephalogram signal from a user,

a function control section for analyzing an event-related potential contained in the electroencephalogram signal and outputting a function control signal for controlling a function of a device based on a result of analysis, and

an output section for outputting the function control signal, wherein,

the computer program causes the computer of the activation apparatus to execute:

while the electroencephalogram interface system is not functioning, transmitting to the output section a stimulation control signal for controlling presentation and vanishing of a visual stimulation on a single-item on the output section;

determining whether or not the user is paying attention to the visual stimulation based on an N100 component of the event-related potential since a timing of presenting the visual stimulation as a starting point;

based on a determination result, allowing a P200 component value of an event-related potential since the timing of presenting the visual stimulation as a starting point, within the electroencephalogram signal acquired from the electroencephalogram measurement section, to be compared against a predetermined threshold value;

determining whether or not to output an activation trigger to the function control section based on a result of comparison; and

activating the electroencephalogram interface system by outputting the activation trigger when it is determined to output the activation trigger.