BRAIN COMPUTER INTERFACE FOR AUGMENTED REALITY

• US 20200133393A1
• Filed: 01/09/2019
• Published: 04/30/2020
• Est. Priority Date: 10/29/2018
• Status: Active Grant

• Current Assignee: Cognixion Inc.
• Original Assignee: Cognixion Inc.
• Inventors: Forsland, Andreas, Zerman, Leonard
• Granted Patent: US 10,990,175 B2
• Time in Patent Office: Days
• CPC Class Codes: A61B 5/374 Detecting the frequency distribution of signals, e.g. detecting delta, theta, alpha, beta or gamma waves
• CPC Class Codes: A61B 5/378 Visual stimuli
• CPC Class Codes: A61B 5/38 Acoustic or auditory stimuli
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

A method and system of a brain computer interface in a headset including an augmented reality display, one or more sensors, a processing module, at least one biofeedback device, and a battery. The interface may include a printed circuit board that has the sensors to read bio-signals, provides biofeedback, and performs the processing, analyzing, and mapping of bio-signals into output. The output provides feedback via stimulation of multiple sensory brain systems of a user, including audio and visual on the augmented reality display, or audio and haptic in terms of vibration patterns that a human user may feel. All together this forms a closed-loop system, by detecting the bio-signal, then providing sensory-feedback, which in turn enhances the bio-signal.

Claims

1. A system of a brain computer interface in a headset, comprising:

an augmented reality display;

one or more sensors for reading a bio-signal from a user, the bio-signal comprising at least one of EEG (Electroencephalography) or, ECG (Electrocardiography) or, EMG (Electromyography), or, EOG (Electroocculography);

a processing module, including a processor that analyzes and maps the bio-signal into a visual output on the augmented reality display;

at least one biofeedback device in communication with the processing module, wherein the at least one biofeedback device provides feedback to the user; and

a battery, wherein the battery provides power to one or more of the augmented reality display, the one or more sensors, the processing module, and the at least one biofeedback device.

2. The system of claim 1, wherein the processing performed by the processing module includes a visually evoked potential.

3. The system of claim 1, wherein the headset further comprises a printed circuit board, wherein the printed circuit board includes at least one of the one or more sensors, the processing module, the at least one biofeedback device, the battery, and combinations thereof.

4. The system of claim 3, wherein the printed circuit board is configured to emulate a Bluetooth keyboard and output data to at least one of a mobile device, a computer, and the augmented reality display, the output data including at least one of:

a letter;

a character;

a number, and combinations thereof.

5. The system of claim 1, wherein the bio-signal is processed and analyzed in real-time.

6. The system of claim 1, wherein the processing module has different modes that may include at least one of a raw mode, a simmer mode, a cooked mode, a human interface device-keyboard mode, and combinations thereof.

7. The modes of claim 6, wherein the raw mode streams a full EEG sensor stream of data for further processing locally or in a cloud via a mobile or desktop internet connected device that may filter, recognize, or interact with the data.

8. The modes of claim 6, wherein the cooked mode is a fully processed custom message generated by a local recognizer and diagnoses, and no raw data is passed to the user.

9. The modes of claim 6, wherein the simmer mode is a hybrid combination between the raw mode and the cooked mode, and the processor intersperses a raw data stream with cooked messages.

10. A method of implementing a brain computer interface (BCI) in a headset, comprising:

utilizing an augmented reality display;

utilizing one or more sensors for reading a bio-signal from a user;

utilizing a processing module, including a processor that analyzes and maps the bio-signal into an output on the augmented reality display;

utilizing at least one biofeedback device in communication with the processing module, wherein the at least one biofeedback device provides feedback to the user; and

utilizing a battery, wherein the battery provides power to at least one of the augmented reality display, the one or more sensors, the processing module, the at least one biofeedback device, and combinations thereof.

11. The method of claim 10, wherein the bio-signal comprises at least one of EEG (Electroencephalography), ECG (Electrocardiography), EMG (Electromyography), EOG (Electroocculography), visually evoked potentials, audio evoked potentials, and motion evoked potentials.

12. The method of claim 10, wherein the processing performed by the processing module includes visually evoked potentials.

13. The method of claim 10, wherein the headset further comprises a printed circuit board, wherein the printed circuit board includes at least one of the one or more sensors, the processing module, the at least one biofeedback device, the battery, and combinations thereof.

14. The method of claim 13, wherein the printed circuit board can connect wirelessly to a mobile device or a computer, wherein the printed circuit board is configured to emulate a Bluetooth keyboard and output data to at least one of the mobile device, the computer, and the augmented reality display, the output data including at least one of:

a letter;

a character;

a number, and combinations thereof.

15. The method of claim 10, wherein the bio-signal is processed and analyzed in real time.

16. The method of claim 10, wherein the processing module has different modes including at least one of a raw mode, a simmer mode, a cooked mode, a human interface device-keyboard mode, and combinations thereof.

17. The modes of claim 16, wherein the raw mode streams a full EEG sensor stream of data for further processing locally or in a cloud via a mobile or desktop internet connected device, wherein the internet connected device is configured to at least one:

filter;

recognize; and

interact with the data.

18. The modes of claim 16, wherein the cooked mode is a fully processed custom message generated by a local recognizer and diagnoses, and no raw data is passed to the user.

19. The modes of claim 16, wherein the simmer mode is a hybrid combination between the raw mode and the cooked mode, and the processor intersperses a raw data stream with cooked messages.