SYSTEM AND METHOD FOR TAKING RESPONSIVE ACTION TO HUMAN BIOSIGNALS

• US 20100094097A1
• Filed: 10/15/2008
• Published: 04/15/2010
• Est. Priority Date: 10/15/2008
• Status: Abandoned Application

• Current Assignee: Sony Ericsson Mobile Communications AB (Sony Group Corp.)
• Original Assignee: Sony Ericsson Mobile Communications AB (Sony Group Corp.)
• Inventors: Bloebaum, L. Scott, Liu, Charles
• Application Number:
  US12/251,910
• Publication Number:
  US 20100094097A1
• Time in Patent Office: Days
• US Class Current: 600/300
• CPC Class Codes: A61B 5/369 Electroencephalography [EEG] devices for psychotechnics A61B5/16
• CPC Class Codes: A61B 5/372 Analysis of electroencephalograms
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection

Abstract

To enhance interaction and use with electronic devices, the present disclosure describes several improved systems and methods of taking responsive action to a detected human mental state. A training signal containing biosignal data corresponding to a mental state of the user while the user concentrates on a perceptual cue may be established. In some embodiments, user input or other information may be stored in association with the training signal. Biosignal data from the user may be monitored at an appropriate time and, if a match between the monitored biosignal data and the training signal is determined, a predetermined response is taken by an electronic device.

Claims

1. A method of taking action in response to biosignals detected from a user, comprising:

establishing a training signal containing biosignal data corresponding to a mental state of the user while the user concentrates on a perceptual cue;

associating a user specified action to be carried out by an electronic device with the training signal;

monitoring biosignal data from the user; and

comparing the monitored biosignal data to the training signal and, if a match between the monitored biosignal data and the training signal is determined, commanding the electronic device to carry out the user specified action.

2. The method of claim 1, wherein the perceptual cue includes a visual representation of an item that is physically observed by the user at the time of establishing the training signal.

3. The method of claim 1, wherein the perceptual cue includes a trademark.

4. The method of claim 1, wherein the user specified action relates to one of a calling function, a messaging function, an audiovisual content playback function, a search function, or a navigation function.

5. The method of claim 1, wherein the perceptual cue includes a visual cue associated with a location, and a position of the electronic device is determined at the time of establishing the training signal.

6. The method of claim 5, wherein the user specified action is determining return directions to the position.

7. The method of claim 1, wherein the user specified action is automatically carried out if the match is made with a level of confidence that is above a predetermined threshold.

8. The method of claim 1, wherein the user specified action is established by recording a macro of steps.

9. The method of claim 1, wherein:

establishing the training signal includes establishing an ordered set of training signals, each containing biosignal data corresponding to a mental state of the user while the user concentrates on a perceptual cue;

for each training signal, the associated user specified action is outputting a navigational prompt associated with the training signal;

the monitoring of biosignal data is carried out as the user travels to a destination; and

if a match between the monitored biosignal data and one of the training signals is determined, the commanding of the electronic device includes outputting the corresponding navigational prompt to the user.

10. The method of claim 9, wherein at least one of the perceptual cues is a representation of a landmark at which a navigational prompt is desired.

11. The method of claim 9, wherein at least one of the perceptual cues is a trademark associated with a landmark at which a navigational prompt is desired.

12. The method of claim 9, further comprising detecting turns made by the user and advancing through the ordered set of training signals based on the detected turns.

13. The method of claim 1, wherein the user specified action is constructing a search string using text representing search criteria that is associated with the training signal.

14. The method of claim 13, further comprising receiving voice input from the user.

15. The method of claim 14, further comprising converting the voice input to text.

16. The method of claim 15, wherein the converted text is made part of the search string.

17. The method of claim 13, wherein the voice input is received during the monitoring.

18. A system for taking action in response to biosignals detected from a user, comprising:

a biosignal detection headset configured to detect biosignals from a user that are indicative of a mental state of the user and output corresponding biosignal data; and

an electronic device that includes an interface to receive the biosignal data from the biosignal detection headset and a control circuit configured to;

establish a training signal containing biosignal data corresponding to a mental state of the user while the user concentrates on a perceptual cue;

associate a user specified action to be carried out by the electronic device with the training signal;

monitor biosignal data from the user; and

compare the monitored biosignal data to the training signal and, if a match between the monitored biosignal data and the training signal is determined, command the electronic device to carry out the user specified action.

19. The system of claim 18, wherein:

the control circuit establishes an ordered set of training signals, each containing biosignal data corresponding to a mental state of the user while the user concentrates on a perceptual cue;

for each training signal, the associated user specified action is outputting a navigational prompt associated with the training signal;

biosignal data is monitored as the user travels to a destination; and

if a match between the monitored biosignal data and one of the training signals is determined, the corresponding navigational prompt is output to the user.

20. The system of claim 18, wherein the user specified action is constructing a search string using text representing search criteria that is associated with the training signal.