Biopotential wakeup word

• US 10,488,831 B2
• Filed: 11/21/2017
• Issued: 11/26/2019
• Est. Priority Date: 11/21/2017
• Status: Active Grant

• Current Assignee: Drowsy Digital Incorporated
• Original Assignee: Bose Corporation
• Inventors: Trott, Christian A., Mulhearn, Christopher J., Hetherman, Brian J., Daley, Michael J.
• Primary Examiner(s): Holloway, III, Edwin C
• Application Number:
  US15/819,973
• Publication Number:
  US 20190155226A1
• Time in Patent Office: 735 Days
• Field of Search: 340 1033
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: A61B 5/369 Electroencephalography [EEG] devices for psychotechnics A61B5/16
• CPC Class Codes: A61B 5/389 Electromyography [EMG]
• CPC Class Codes: A61B 5/398 Electrooculography [EOG], e.g. detecting nystagmus; Electroretinography [ERG]
• CPC Class Codes: A61B 5/6803 Head-worn items, e.g. helmets, masks, headphones or goggles
• CPC Class Codes: G05B 13/0265 the criterion being a learning criterion
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04R 1/1041 Mechanical or electronic switches, or control elements switches in general H01H

Abstract

Aspects of the present disclosure provide a product configured to obtain biological signals associated with a user. The biological signals may be used to trigger the product of an upcoming, separate command. The product may take action based on the received command. As described herein, the biological signals may comprise a change in electrical potential of a user, such as an EMG, EEG, or EOG signal. The separate command may be other biological signals, a voice command, or a gesture. The product may be configured to control itself and/or a device external to the product.

Claims

1. A system comprising:

an audio output device and a second product,

wherein the audio output device comprises a processor configured to;

detect a learned pattern of bio-signals associated with a user of the audio output device; and

wherein the second product comprises a processor configured to;

receive a separate command from the user after the audio output device detects the learned pattern of bio-signals, wherein the detection of the learned pattern of bio-signals by the audio output device triggers the processor of the second product in the system to attempt to receive the separate command; and

take action based on the received command.

2. The system of claim 1, wherein the bio-signals comprise one of an electromyogram (EMG), electrooculogram (EOG), or electroencephalogram (EEG) signal.

3. The system of claim 1, wherein the bio-signals comprise a time-varying electrical potential associated with the user of the system.

4. The system of claim 1, wherein the received command comprises at least a second bio-signal from the user.

5. The system of claim 1, wherein the received command comprises one of a gesture from the user or a voice command from the user.

6. The system of claim 1, wherein the received command comprises eye movement associated with the user.

7. The system of claim 1, wherein the second product further comprises:

a communication unit configured to communicate with the device external to the second product.

8. The system of claim 1, wherein the processor of the second product is configured to take the action by adjusting a volume of an output played by the second product, enter a low power state at the second product, or change an output of the second product.

9. The system of claim 1, wherein the processor of the audio output device is configured to detect the learned pattern of bio-signals via training with the user.

10. A system product comprising:

a first product and a second product,

wherein the first product comprises;

a first electrode;

a second electrode; and

a processor coupled to the first and second electrodes, wherein the processor is configured to;

detect a learned pattern of signals collected via the first and second electrodes; and

wherein the second product comprises a processor configured to;

in response to the detection, receive a separate command, wherein the

detected pattern triggers the processor of the second product to attempt to receive the separate command; and

take action to control one of the second product or a device external to the second product based on the command.

11. The system of claim 10, wherein the signals comprise an electromyogram (EMG), electrooculogram (EOG), or electroencephalogram (EEG) associated with a user of the system.

12. The system of claim 10, wherein the command comprises one of an electromyogram (EMG), electrooculogram (EOG), or electroencephalogram (EEG) of a user of the system.

13. The system of claim 10, wherein the command comprises one of voice or movement associated with a user of the system.

14. The of claim 10, wherein the processor of the second product is configured to take the action by one of:

adjusting a volume of an output played by the second product or the device external to the second product, entering a low power state at the second product or the device external to the second product, or changing an output of the second product or the device external to the second product.

15. The system of claim 10, wherein the processor of the second product is configured to take the action by changing a mode of operation of the second product or the device external to the second product.

16. A method performed by a system, comprising:

detecting, by a wearable audio output device, a pattern of bio-signals associated with a user of the system;

receiving, by a second device in the system, a separate command from the user after the wearable audio output device detects the pattern of bio-signals, wherein the detected pattern of bio-signals triggers the second device to attempt to receive the separate command; and

taking action, by the second device in the system, based on the received command.

17. The method of claim 16, wherein:

taking the action comprises one of controlling the second device or another device in the system.

18. The method of claim 16, wherein the bio-signals comprise one of an electromyogram (EMG), electrooculogram (EOG), or electroencephalogram (EEG) signal.

19. The method of claim 16, wherein the separate command comprises a pattern of electrical potential associated with the user of the product.

20. The method of claim 16, further comprising:

performing by the wearable audio output device, a machine-learned pattern recognition training with the user,

wherein the detecting is based, at least in part, on the training.