ENHANCED BRAIN-MACHINE INTERFACES WITH NEUROMODULATION

• US 20190314600A1
• Filed: 05/30/2019
• Published: 10/17/2019
• Est. Priority Date: 10/23/2015
• Status: Active Grant

• Current Assignee: HRL Laboratories LLC (The Boeing Co.)
• Original Assignee: HRL Laboratories LLC (The Boeing Co.)
• Inventors: Patel, Aashish N., Pilly, Praveen K.
• Granted Patent: US 11,207,489 B2
• Time in Patent Office: Days
• CPC Class Codes: A61B 5/0075 by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy A61B5/0071 takes precedence
• CPC Class Codes: A61B 5/24 Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
• CPC Class Codes: A61B 5/369 Electroencephalography [EEG] devices for psychotechnics A61B5/16
• CPC Class Codes: A61B 5/6803 Head-worn items, e.g. helmets, masks, headphones or goggles
• CPC Class Codes: A61F 2/72 Bioelectric control, e.g. myoelectric
• CPC Class Codes: A61M 2021/0027 by the hearing sense
• CPC Class Codes: A61M 2021/0044 by the sight sense
• CPC Class Codes: A61M 2021/0055 with electric or electro-magnetic fields
• CPC Class Codes: A61M 21/00 Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
• CPC Class Codes: A61M 2205/3313 used specific wavelengths
• CPC Class Codes: A61M 2205/502 User interfaces, e.g. screens or keyboards
• CPC Class Codes: A61M 2205/52 with memories providing a history of measured variating parameters of apparatus or patient
• CPC Class Codes: A61M 2230/10 Electroencephalographic signals
• CPC Class Codes: A61N 1/0456 Specially adapted for transcutaneous electrical nerve stimulation [TENS]
• CPC Class Codes: A61N 1/36025 for treating a mental or cerebral condition

Abstract

Described is an improved brain-machine interface including a neural interface and a controllable device in communication with the neural interface. The neural interface includes a neural device with one or more sensors for collecting signals of interest and one or more processors for conditioning the signals of interest, extracting salient neural features from and decoding the conditioned signals of interest, and generating a control command for the controllable device. The controllable device performs one or more operations according to the control command, and the neural device administers neuromodulation stimulation to reinforce operation of the controllable device.

Claims

1. An enhanced brain-machine interface with neuromodulation, the enhanced brain-machine interface comprising:

a neural interface and a controllable device in communication with the neural interface,

wherein the neural interface comprises;

a neural device having one or more sensors for collecting signals of interest, wherein the neural device is configured to administer neuromodulation stimulation; and

one or more processors and a non-transitory computer-readable medium having executable instructions encoded thereon such that when executed, the one or more processors perform an operation of;

conditioning the signals of interest, resulting in conditioned signals of interest;

extracting salient neural features from the conditioned signals of interest;

decoding the salient neural features, providing a mapping between an input neural feature space and an output control space for the controllable device;

based on the mapping, generating at least one control command for the controllable device;

causing the controllable device to perform one or more operations according to the at least one control command; and

causing the neural device to administer neuromodulation stimulation to reinforce operation of the controllable device.

2. The system as set forth in claim 1, wherein the signals of interest comprise at least one of neural signals and environmental signals.

3. The system as set forth in claim 1, wherein the neuromodulation stimulation is one of auditory, visual, and electrical stimulation.

4. The system as set forth in claim 3, wherein the neuromodulation stimulation comprises unique spatiotemporal amplitude-modulated patterns (STAMPs) of stimulation.

5. The system as set forth in claim 1, wherein the controllable device is a prosthetic limb.

6. The system as set forth in claim 1, wherein the one or more neural sensors comprises one or more electrodes configured to perform at least one of sensing and applying stimulation.

7. A method for implementing an enhanced brain-machine interface with neuromodulation, the method comprising an act of:

causing one or more processers to execute instructions encoded on a non-transitory computer-readable medium, such that upon execution, the one or more processors perform operations of;

conditioning signals of interest obtained from a neural device having one or more sensors, wherein the neural device is configured to administer neuromodulation stimulation;

extracting salient neural features from the conditioned signals of interest;

decoding the salient neural features, providing a mapping between an input neural feature space and an output control space for the controllable device;

based on the mapping, generating at least one control command for the controllable device;

causing the controllable device to perform one or more operations according to the at least one control command; and

causing the neural device to administer neuromodulation stimulation to reinforce operation of the controllable device.

8. The method as set forth in claim 7, wherein the signals of interest comprise at least one of neural signals and environmental signals.

9. The method as set forth in claim 7, wherein the neuromodulation stimulation is one of auditory, visual, and electrical stimulation.

10. The method as set forth in claim 9, wherein the neuromodulation stimulation comprises unique spatiotemporal amplitude-modulated patterns (STAMPs) of stimulation.

11. The method as set forth in claim 7, wherein the controllable device is a prosthetic limb.

12. The method as set forth in claim 7, wherein the one or more neural sensors comprises one or more electrodes configured to perform at least one of sensing and applying stimulation.

13. A computer program product for implementing an enhanced brain-machine interface with neuromodulation, the computer program product comprising:

computer-readable instructions stored on a non-transitory computer-readable medium that are executable by a computer having one or more processors for causing the processor to perform operations of;

conditioning signals of interest obtained from a neural device having one or more sensors, wherein the neural device is configured to administer neuromodulation stimulation;

extracting salient neural features from the conditioned signals of interest;

decoding the salient neural features, providing a mapping between an input neural feature space and an output control space for the controllable device;

based on the mapping, generating at least one control command for the controllable device;

causing the controllable device to perform one or more operations according to the at least one control command; and

causing the neural device to administer neuromodulation stimulation to reinforce operation of the controllable device.

14. The computer program product as set forth in claim 13, wherein the signals of interest comprise at least one of neural signals and environmental signals.

15. The computer program product as set forth in claim 13, wherein the neuromodulation stimulation is one of auditory, visual, and electrical stimulation.

16. The computer program product as set forth in claim 15, wherein the neuromodulation stimulation comprises unique spatiotemporal amplitude-modulated patterns (STAMPs) of stimulation.

17. The computer program product as set forth in claim 13, wherein the controllable device is a prosthetic limb.

18. The computer program product as set forth in claim 13, wherein the one or more neural sensors comprises one or more electrodes configured to perform at least one of sensing and applying stimulation.