Activation apparatus, method, and computer program for brainwave interface system

• US 8,369,939 B2
• Filed: 10/21/2008
• Issued: 02/05/2013
• Est. Priority Date: 10/29/2007
• Status: Active Grant

• Current Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: Terada, Yoshihisa, Adachi, Shinobu, Morikawa, Koji
• Primary Examiner(s): Mallari, Patricia
• Assistant Examiner(s): WESTON, TIFFANY C
• Application Number:
  US12/447,718
• Publication Number:
  US 20100317988A1
• Time in Patent Office: 1,568 Days
• Field of Search: 600/544, 600/545
• US Class Current: 600/544
• CPC Class Codes: A61B 5/378 Visual stimuli
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection

Abstract

An electroencephalogram IF system includes an electroencephalogram measurement section for measuring an electroencephalogram signal, a function control section for analyzing an event-related potential contained in the electroencephalogram signal and outputting a function control signal for controlling a function of a device based on the result of analysis, and an output section for outputting the function control signal. The activation apparatus includes: an activation determination section for, while the electroencephalogram IF system is not functioning, transmitting to the output section a stimulation control signal for controlling presentation and vanishing of a visual stimulation on a single-item on the output section and, within the electroencephalogram signal acquired from the electroencephalogram measurement section, allowing a P200 component value of an event-related potential since the timing of presenting the visual stimulation as a starting point to be compared against a predetermined threshold value, and determining whether or not to output an activation trigger to the function control section based on the result of comparison; and a stimulation attention determination section for determining whether or not the user is paying attention to the visual stimulation based on an N100 component of the event-related potential since the timing of presenting the visual stimulation as a starting point, and causing processing by the activation determination section to begin depending on the determination result. When the activation determination section outputs an activation trigger, the electroencephalogram IF system is activated.

Claims

1. An electroencephalogram interface system comprising:

an electroencephalogram measurement section for measuring an electroencephalogram signal from a user,

a function control section for analyzing an event-related potential contained in the electroencephalogram signal and outputting a function control signal for controlling a function of a device based on a result of analysis,

an output section for outputting the function control signal, and

an activation apparatus for activating the electroencephalogram interface system, the activation apparatus comprising;

an activation determination section for, while the function control section of the electroencephalogram interface system is inactive, transmitting to the output section a stimulation control signal for controlling presentation and vanishing of a visual stimulation of a single-item on the output section, and, within the electroencephalogram signal acquired from the electroencephalogram measurement section, comparing a P200 component value of an event-related potential since a timing of presenting the visual stimulation as a starting point against a predetermined threshold value, and determining whether or not to output an activation trigger to the function control section based on a result of comparison; and

a stimulation attention determination section for determining whether or not the user is paying attention to the visual stimulation based on an N100 component of the event-related potential since the timing of presenting the visual stimulation as a starting point, and causing processing by the activation determination section to begin depending on a determination result, wherein,

the activation apparatus activates the electroencephalogram interface system by outputting the activation trigger to the function control section.

2. The electroencephalogram interface system of claim 1, wherein, as the P200 component value, the activation determination section compares a value of the event-related potential in a zone of 200±

50 ms since the timing of presenting the visual stimulation as a starting point against the predetermined threshold value.

3. The electroencephalogram interface system of claim 1, wherein, as the P200 component value, the activation determination section compares a local maximum value, a maximum value, or a zone average value of the event-related potential in a zone of 200±

50 ms since the timing of presenting the visual stimulation as a starting point against the predetermined threshold value.

4. The electroencephalogram interface system of claim 1, wherein the stimulation attention determination section instructs the activation determination section to change a method of presenting the visual stimulation based on a determination result that the user is paying attention to the visual stimulation.

5. The electroencephalogram interface system of claim 1, further comprising:

an imaging device for imaging a video and outputting a video signal; and

wherein

the activation apparatus further comprises

a flicker detection section for detecting based on the video signal a subject which is flickering in the video, and based on a characteristic quantity of the subject, generating function control information which designates a function to be executed by the function control section, and outputting information indicating a lighting timing of the subject and the function control information;

the activation determination section identifies a timing of presenting the visual stimulation based on the information indicating the lighting timing, and when outputting an activation trigger to the function control section, outputs a control signal based on the function control information; and

the function control section of the electroencephalogram interface system executes a specific function based on the activation trigger and the function control information.

6. The electroencephalogram interface system of claim 5, wherein,

the flicker detection section retains a database defining a correspondence between characteristic quantities of subjects and functions to be executed by the function control section, and

by recognizing a characteristic quantity of the subject and referring to the database based on the characteristic quantity, identifies a function to be executed by the function control section and outputs the function control information.

7. The electroencephalogram interface system of claim 1, wherein:

the activation apparatus outputs the activation trigger when the stimulation attention determination section determines that the N100 component has a larger amplitude than a threshold value, and the activation determination section determines that the P200 component value is larger than the predetermined threshold value.

8. The electroencephalogram interface system of claim 1, wherein:

the activation apparatus does not output the activation trigger when the stimulation attention determination section determines that the N100 component has a larger amplitude than a threshold value, and the activation determination section determines that the P200 component value is smaller than the predetermined threshold value.

9. The electroencephalogram interface system of claim 1, wherein:

the activation apparatus does not output the activation trigger when the stimulation attention determination section determines that the N100 component has a smaller amplitude than a threshold value, and the activation determination section determines that the P200 component value is smaller than the predetermined threshold value.

10. An electroencephalogram interface system comprising:

an electroencephalogram measurement section for measuring an electroencephalogram signal from a user and a plurality of devices, and

an activation apparatus for activating at least one of the plurality of devices,

each of the plurality of devices including a function control section for outputting a function control signal for controlling a function of the device and an output section for outputting the function control signal;

the activation apparatus comprising;

a flicker timing control section for controlling the output section of each device to repeat presentation and vanishing of a visual stimulation, and outputting a determination trigger indicating a timing with which the visual stimulation is presented at any of the devices;

a storage medium for retaining determination trigger information identifying a timing of outputting the determination trigger and a device that is presenting the visual stimulation when the determination trigger is output; and

an activation determination section for, within the electroencephalogram signal acquired from the electroencephalogram measurement section, comparing a P200 component value of an event-related potential since a timing of receiving the determination trigger as a starting point against a predetermined threshold value, and based on a result of comparison, identifying the device presenting the visual stimulation based on the timing of receiving the determination trigger and the determination trigger information, and outputting an activation trigger to the function control section of the identified device; and

a stimulation attention determination section for determining whether or not the user is paying attention to the visual stimulation based on an N100 component of the event-related potential since the timing of presenting the visual stimulation as a starting point, and causing processing by the activation determination section to begin depending on a determination result, wherein,

the activation apparatus activates the device identified by the activation determination section by outputting the activation trigger.

11. An activation method for activating an electroencephalogram interface system,

the electroencephalogram interface system including

an electroencephalogram measurement section for measuring an electroencephalogram signal from a user,

a function control section for analyzing an event-related potential contained in the electroencephalogram signal and outputting a function control signal for controlling a function of a device based on a result of analysis, and

an output section for outputting the function control signal,

the activation method comprising the steps of:

while the function control section of the electroencephalogram interface system is inactive, transmitting to the output section a stimulation control signal for controlling presentation and vanishing of a visual stimulation on a single-item on the output section;

determining whether or not the user is paying attention to the visual stimulation based on an N100 component of the event-related potential since a timing of presenting the visual stimulation as a starting point;

based on a determination result, comparing a P200 component value of an event-related potential since the timing of presenting the visual stimulation as a starting point, within the electroencephalogram signal acquired from the electroencephalogram measurement section, to be compared against a predetermined threshold value;

determining whether or not to output an activation trigger to the function control section based on a result of comparison; and

activating the electroencephalogram interface system by outputting the activation trigger to the function control section when it is determined to output the activation trigger.

12. A non-transitory computer-readable medium storing a computer program that is executed by a computer of an activation apparatus incorporated in an electroencephalogram interface system,

the electroencephalogram interface system including

an electroencephalogram measurement section for measuring an electroencephalogram signal from a user,

a function control section for analyzing an event-related potential contained in the electroencephalogram signal and outputting a function control signal for controlling a function of a device based on a result of analysis, and

an output section for outputting the function control signal, wherein,

the computer program causes the computer of the activation apparatus to execute:

while the function control section of the electroencephalogram interface system is inactive, transmitting to the output section a stimulation control signal for controlling presentation and vanishing of a visual stimulation on a single-item on the output section;

determining whether or not the user is paying attention to the visual stimulation based on an N100 component of the event-related potential since a timing of presenting the visual stimulation as a starting point;

based on a determination result, comparing a P200 component value of an event-related potential since the timing of presenting the visual stimulation as a starting point, within the electroencephalogram signal acquired from the electroencephalogram measurement section, against a predetermined threshold value;

determining whether or not to output an activation trigger to the function control section based on a result of comparison; and

activating the electroencephalogram interface system by outputting the activation trigger to the function control section when it is determined to output the activation trigger.