METHOD AND SYSTEM FOR COLLECTING AND PROCESSING BIOELECTRICAL AND AUDIO SIGNALS

• US 20170041699A1
• Filed: 07/13/2016
• Published: 02/09/2017
• Est. Priority Date: 08/05/2015
• Status: Active Grant

• Current Assignee: Brainwear Incorporated
• Original Assignee: EMOTIV Inc.
• Inventors: Mackellar, Geoffrey, Le, Tan
• Granted Patent: US 10,291,977 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A61B 5/02405 Determining heart rate variability
• CPC Class Codes: A61B 5/02438 with portable devices, e.g. worn by the patient
• CPC Class Codes: A61B 5/316 Modalities, i.e. specific diagnostic methods
• CPC Class Codes: A61B 5/369 Electroencephalography [EEG] devices for psychotechnics A61B5/16
• CPC Class Codes: A61B 5/374 Detecting the frequency distribution of signals, e.g. detecting delta, theta, alpha, beta or gamma waves
• CPC Class Codes: A61B 5/6816 Ear lobe
• CPC Class Codes: A61B 5/7203 for noise prevention, reduction or removal
• CPC Class Codes: A61M 2021/0027 by the hearing sense
• CPC Class Codes: A61M 21/02 for inducing sleep or relaxation, e.g. by direct nerve stimulation, hypnosis, analgesia for massage A61H; electrotherapy A61N, e.g. applying alternating or intermittent electric currents for producing anaesthesia A61N1/36021
• CPC Class Codes: A61M 2205/3375 Acoustical, e.g. ultrasonic, measuring means
• CPC Class Codes: A61M 2230/005 Parameter used as control input for the apparatus
• CPC Class Codes: A61M 2230/06 Heartbeat rate only
• CPC Class Codes: A61M 2230/10 Electroencephalographic signals
• CPC Class Codes: A61M 2230/14 Electro-oculogram [EOG]
• CPC Class Codes: A61M 2230/63 Motion, e.g. physical activity
• CPC Class Codes: G10L 25/63 for estimating an emotional state
• CPC Class Codes: G10L 25/66 for extracting parameters related to health condition detecting or measuring for diagnostic purposes A61B5/00
• CPC Class Codes: H04R 1/105 Earpiece supports, e.g. ear hooks for stereophonic headphones H04R5/0335
• CPC Class Codes: H04R 1/1075 Mountings of transducers in earphones or headphones
• CPC Class Codes: H04R 1/1091 Details not provided for in groups H04R1/1008 - H04R1/1083

Abstract

A method and system for detecting bioelectrical signals and audio signals from a user, including establishing bioelectrical contact between a user and one or more sensors of a biomonitoring neuroheadset; collecting, at the one or more sensors, one or more bioelectrical signal datasets; collecting one or more reference signal datasets; collecting, at a microphone of the biomonitoring neuroheadset, an audio signal dataset; and generating a combined audio and bioelectrical signal processed dataset, including producing a noise-reduced bioelectrical signal dataset, and producing a conditioned audio signal dataset.

Claims

1. A method for detecting bioelectrical signals and audio signals from a user, comprising:

establishing bioelectrical contact between a first subregion of an ear region of the user and a first electroencephalogram (EEG) sensor of a biomonitoring neuroheadset;

establishing bioelectrical contact between a second subregion of the ear region of the user and a first common mode sensor of a noise reduction subsystem of the biomonitoring neuroheadset, wherein the first subregion is proximal the second subregion, and wherein the first EEG sensor is proximal the common mode sensor;

collecting, at the first EEG sensor, a first EEG signal dataset from the user during a first time period;

collecting, at the first common mode sensor, a first common mode signal dataset contemporaneously with collecting the first EEG signal dataset during the first time period;

collecting, at a microphone of the biomonitoring neuroheadset, a first audio signal dataset from the user contemporaneously with collecting the first EEG signal dataset and the first common mode signal dataset during the first time period; and

generating a first combined audio and EEG processed dataset, comprising;

producing a common noise-reduced EEG dataset from the first EEG signal dataset and the first common mode signal dataset,

producing a conditioned audio signal dataset from processing the first audio signal dataset for transmission with the common noise-reduced EEG dataset, and

generating the first combined audio and EEG processed dataset from the common noise-reduced EEG dataset and the conditioned audio signal dataset.

2. The method of claim 1, wherein generating the first combined audio and EEG processed dataset comprises generating a driven right leg signal using a driven right leg module characterized by a first feedback reference location at a third subregion of the ear region, the third subregion proximal the first and the second subregions of the ear region, wherein the noise reduction subsystem comprises the driven right leg module, and wherein producing the common noise-reduced EEG dataset comprises producing the common noise-reduced EEG dataset from the driven right leg signal.

3. The method of claim 2, further comprising:

establishing bioelectrical contact between a first contralateral subregion of a contralateral ear region of the user and a second EEG sensor of the biomonitoring neuroheadset;

establishing bioelectrical contact between a second contralateral subregion of the contralateral ear region of the user and a second common mode sensor of a noise reduction subsystem of the biomonitoring neuroheadset, wherein the first contralateral subregion is proximal the second contralateral subregion, and wherein the second EEG sensor is proximal the second common mode sensor;

collecting, at the second EEG sensor, a second EEG signal dataset contemporaneously with collecting the first EEG signal dataset, the first common mode signal dataset, and the audio signal dataset during the first time period;

collecting, at the second common mode sensor, a second common mode signal dataset contemporaneously with collecting the first and the second EEG signal datasets, the first common mode signal dataset, and the audio signal dataset during the first time period, wherein producing the common noise-reduced EEG dataset comprises producing the common noise-reduced EEG dataset from the second EEG signal dataset and the second common mode signal dataset.

4. The method of claim 3, wherein the first subregion comprises an ear canal of the user, wherein the first contralateral subregion comprises a contralateral ear canal of the user, wherein the second subregion comprises an ear subregion proximal a mastoid process of a temporal bone of the user, and wherein the second contralateral subregion comprises a contralateral ear subregion proximal a contralateral mastoid process of a contralateral temporal bone of the user.

5. The method of claim 3, wherein generating the first combined audio and EEG processed dataset comprises generating a averaged common mode signal dataset from performing an averaging operation with the first common mode signal dataset and the second common mode signal dataset, and wherein producing the common noise-reduced EEG dataset comprises producing the common noise-reduced EEG dataset from the averaged common mode signal dataset.

6. The method of claim 3, wherein the driven right leg module is further characterized by a second feedback reference location at a third contralateral subregion of the contralateral ear region, the third contralateral subregion proximal the first and the second contralateral subregions of the contralateral ear region, wherein generating the driven right leg signal is in response to adequate contact between the user and the driven right leg module at least at one of the first feedback reference location and the second feedback reference location.

7. The method of claim 1, further comprising:

applying a reference signal to the user at the ear region with the first common mode sensor during a second time period;

in response to applying the reference signal, collecting, at the first EEG sensor, a contact quality dataset during the second time period; and

evaluating a quality of the bioelectrical contact between the first subregion of the ear region and the first EEG sensor, based on the contact quality dataset.

8. The method of claim 1, further comprising:

transmitting the first combined audio and EEG processed dataset to a computing device of the user;

generating, at a software component executing on the computing device, an analysis of an audio signal portion of the first combined audio and EEG processed dataset;

receiving, at the biomonitoring neuroheadset, operation instructions transmitted by the computing device and generated based on the analysis of the audio signal portion; and

operating the biomonitoring neuroheadset based on the operation instructions.

9. The method of claim 1, further comprising:

receiving, at a remote server, a common noise-reduced EEG signal portion and an audio signal portion of the first combined audio and EEG processed dataset;

generating a cognitive state metric based on the common noise-reduced EEG signal portion and the audio signal portion, wherein the cognitive state metric indicates a cognitive state of the user during the first time period;

determining an audio therapy to modify the cognitive state of the user, based on the cognitive state metric; and

promoting, at a speaker of the biomonitoring neuroheadset, the audio therapy to the user.

10. The method of claim 9, further comprising:

in response to promoting the audio therapy to the user at the speaker;

collecting, at the first EEG sensor, a second EEG signal dataset from the user during a second time period;

collecting, at the first common mode sensor, a second common mode signal dataset contemporaneously with collecting the second EEG signal dataset during the second time period;

collecting, at the microphone, a second audio signal dataset from the user contemporaneously with collecting the second EEG signal dataset and the second common mode signal dataset during the second time period; and

generating a second combined audio and EEG processed dataset based on the second EEG signal dataset, the second common mode signal dataset, and the second audio signal.

generating a second cognitive state metric based on the second combined audio and EEG processed dataset, wherein the second cognitive state metric indicates a cognitive state response to the audio therapy during the second time period.

11. The method of claim 1, further comprising:

identifying a blood flow time-varying oscillation in noise-reduced values of the common noise-reduced EEG dataset;

estimating at least one of a heart rate and a heart rate variability based on the blood flow time-varying oscillation in noise-reduced values, wherein the at least one of the heart rate and the heart rate variability corresponds to the first time period.

12. The method of claim 11, wherein identifying the blood flow time-varying oscillation in noise-reduced values comprises identifying a set of QRS complex sequences in the noise-reduced values of the common noise-reduced EEG dataset, and wherein estimating the at least one of the heart rate and the heart rate variability is based on the set of QRS complex sequences.

13. The method of claim 11, further comprising generating a cognitive state metric for the user based on the common noise-reduced EEG dataset, the audio signal dataset, and the at least one of the heart rate and the heart rate variability, wherein the cognitive state metric indicates a cognitive state of the user during the first time period.

14. A system for detecting bioelectrical signals and audio signals from a user, comprising:

a first EEG sensor positioned proximal an ear canal of the user, the first EEG sensor configured to collect a first EEG signal dataset from the user during a first time period;

a noise reduction subsystem comprising a reference sensor positioned proximal a mastoid process of a temporal bone proximal the ear canal, the reference sensor configured to collect a reference signal dataset contemporaneously with collection of the first EEG signal dataset during the first time period;

a microphone positioned proximal an oral cavity of the user, the microphone configured to collect an audio signal dataset from the user contemporaneously with collection of the first EEG signal dataset and the reference signal dataset during the first time period;

a wearable support frame worn at a head region of the user and cooperatively supported at an ear region proximal the temporal bone and an ear flap of the user, the wearable support frame supporting and physically connecting the EEG sensor and the reference sensor; and

an electronics subsystem comprising a processing module configured to produce a noise-reduced EEG dataset from processing the first EEG signal dataset with the reference signal dataset, and to produce a conditioned audio signal dataset from processing the audio signal dataset for transmission with the noise-reduced EEG dataset, the electronics subsystem electronically connected to the first EEG sensor, the noise reduction subsystem, and the microphone.

15. The system of claim 14, wherein the reference sensor is a first common mode sensor, wherein the reference signal dataset is a first common mode signal dataset, wherein the noise reduction subsystem further comprises a driven right leg module positioned proximal the first common mode sensor and the mastoid process of the temporal bone, and wherein the processing module is further configured to produce the noise-reduced EEG dataset from a driven right leg dataset generated from using the driven right leg module and the first common mode signal dataset.

16. The system of claim 15, wherein the system further comprises a second EEG sensor positioned proximal a contralateral ear canal of the user, the second EEG sensor configured to collect a second EEG dataset from the user during the first time period, wherein the noise reduction subsystem further comprises a second common mode sensor positioned proximal a contralateral mastoid process of a contralateral temporal bone proximal the contralateral ear canal, the second common mode sensor configured to collect a second common mode signal dataset, and wherein the processing module is further configured to produce the noise-reduced EEG dataset from the second EEG signal dataset and a combined common mode signal dataset generated from combining the first and the second common mode signal datasets.

17. The method of claim 16, wherein the processing module comprises:

a first processing module positioned proximal the first EEG sensor, and

a second processing module positioned proximal the second EEG sensor.

18. The system of claim 14, further comprising:

a remote processing module remote from the first EEG sensor, the noise reduction subsystem, the microphone, the wearable support frame, and the electronics subsystem;

a communications module of the electronics subsystem, the communications module configured to;

transmit the noise-reduced EEG dataset to the mobile computing device for transmission to the remote processing module,

transmit the audio signal dataset to the mobile computing device, wherein the audio signal dataset specifies instructions for controlling operation of the mobile computing device.

19. The system of claim 18, wherein the remote processing module is configured to:

identify a blood flow time-varying oscillation in noise-reduced values of the noise-reduced EEG dataset; and

estimate at least one of a heart rate and a heart rate variability based on the blood flow time-varying oscillation in noise-reduced values.

20. The system of claim 18,

wherein the communications module is further configured to receive from the mobile computing device an audio sample transmitted based on the specified instructions, the system further comprising a speaker positioned proximal the first EEG sensor and the ear canal of the user, the speaker configured to emit the audio sample,

wherein the first EEG sensor is configured to collect a second EEG signal dataset from the user during a second time period in response to emission of the audio sample, and

wherein the reference sensor is further configured to collect a second reference signal dataset from the user contemporaneously with collection of the second EEG signal dataset during the second time period.

21. The system of claim 14, further comprising:

a cable connecting the processing module to the first EEG sensor and the microphone;

an EEG sensor power wire for the first EEG sensor, the EEG sensor power wire positioned within the connecting cable;

a microphone power wire for the microphone, the microphone power wire positioned within the connecting cable; and

a screen separating the EEG sensor power wire from the microphone power wire within the connecting cable, the screen configured to facilitate prevention of cross-talk between the first EEG signal dataset and the audio signal dataset.