Brain response monitoring apparatus and method

• US 6,829,502 B2
• Filed: 05/30/2002
• Issued: 12/07/2004
• Est. Priority Date: 05/30/2002
• Status: Active Grant

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Motorola, Inc. (Motorola Solutions, Inc.)
• Inventors: Liu, Yong, Mathew, Tom, Hong, Di-an, Xiao, Weinin, Turlik, Iwona
• Primary Examiner(s): WINAKUR, ERIC FRANK
• Application Number:
  US10/158,451
• Publication Number:
  US 20030225342A1
• Time in Patent Office: 922 Days
• Field of Search: 600/544, 600/558, 600/545, 463/36, 128/924, 128/925, 340/825.19
• US Class Current: 600/544
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection

Abstract

Brain response signals of a user, such as electroencephalogram signals, and in particular visually evoked potential signals that correspond to predetermined illumination patterns, are detected and utilized to ascertain selection of specific functions and/or actions as desired by that user. Sources of illumination that exhibit such patterns are arranged to physically correspond to indicia of such functions and actions to facilitate knowing selection thereof.

Claims

1. A method of providing an electronic signal that corresponds to a desired action, comprising:

providing at least one source of illumination, which source of illumination has a corresponding pattern associated therewith;

monitoring a user'"'"'s brain response;

detecting via the user'"'"'s brain response when the user has viewed the at least one source of illumination for at least a predetermined period of time, at least in part by determining when at least two of a plurality of signal conditions that each correspond to the pattern have been detected, and providing the electronic signal in response thereto.

2. The method of claim 1 wherein providing at least one source of illumination includes providing a plurality of sources of illumination.

3. The method of claim 2 wherein providing a plurality of sources of illumination includes providing a plurality of sources of illumination wherein at least some of the sources of illumination have a substantially unique pattern associated therewith.

4. The method of claim 2 wherein providing a plurality of sources of illumination includes providing a plurality of sources of illumination wherein a group of the sources of illumination together form the corresponding pattern.

5. The method of claim 1 wherein providing at least one source of illumination, which source of illumination has a corresponding pattern associated therewith includes providing at least one source of illumination, which source of illumination has a corresponding flashing pattern associated therewith.

6. The method of claim 5 wherein providing at least one source of illumination, which source of illumination has a corresponding flashing pattern associated therewith includes providing a corresponding flashing pattern having a predetermined duty cycle.

7. The method of claim 6 wherein providing a corresponding flashing pattern having a predetermined duty cycle includes providing a corresponding flashing pattern having a predetermined duty cycle within a range of about 10% to about 90%.

8. The method of claim 5 wherein providing at least one source of illumination, which source of illumination has a corresponding flashing pattern associated therewith includes providing a source of illumination having a corresponding flashing pattern having a frequency of approximately 4 to 80 cycles per second.

9. The method of claim 1 wherein providing at least one source of illumination, which source of illumination has a corresponding pattern associated therewith includes providing a corresponding pattern comprising a pattern of illuminating lights.

10. The method of claim 1 wherein providing at least one source of illumination includes providing at least one discrete source of illumination.

11. The method of claim 1 wherein providing at least one source of illumination includes providing the at least one source of illumination using at least a portion of a pixelated display.

12. The method of claim 1 wherein providing at least one source of illumination, which source of illumination has a corresponding pattern associated therewith includes providing at least one source of illumination, which source of illumination has at least two corresponding patterns associated therewith.

13. The method of claim 1 wherein providing at least one source of illumination includes providing an indicia of the desired action in proximity to the at least one source of illumination.

14. The method of claim 1 wherein detecting via the user'"'"'s brain response when the user has viewed the at least one source of illumination includes using a fast Fourier transform to detect a signal condition corresponding to the pattern.

15. The method of claim 14 wherein detecting the signal condition corresponding to the pattern includes detecting a peak that corresponds to the pattern.

16. The method of claim 15 wherein detecting a peak that corresponds to the pattern includes detecting a peak that corresponds to a frequency that corresponds to a frequency at which the source of illumination is flashing.

17. The method of claim 1 wherein detecting via the user'"'"'s brain response when the user has viewed the at least one source of illumination includes detecting a unique brain response pattern for the user that corresponds to the pattern.

18. The method of claim 1 wherein determining when at least two of a plurality of signal conditions have been detected includes determining when at least three of the signal conditions within a predetermined period of time have been detected.

19. The method of claim 1 and further comprising:

providing at least another source of illumination, which at least another source of illumination has a different corresponding pattern associated therewith;

detecting via the user'"'"'s brain response when the user has viewed the at least another source of illumination for at least a predetermined period of time and providing another electronic signal in response thereto.

20. The method of claim 19 and further comprising actuating the desired action upon detecting the electronic signal followed by the another electronic signal.

21. The method of claim 1 and further comprising actuating the desired action upon detecting the electronic signal as followed by another electronic signal.

22. The method of claim 21 and further comprising monitoring for a non-brain response user signal that causes provision of the another electronic signal.

23. The method of claim 22 wherein the non-brain response user signal comprises an audible signal.

24. The method of claim 22 wherein the non-brain response user signal comprises a mechanical action.

25. The method of claim 1 wherein monitoring a user'"'"'s brain response includes monitoring a user'"'"'s electroencephalogram response.

26. The method of claim 25 wherein monitoring a user'"'"'s electroencephalogram response includes monitoring a user'"'"'s visual evoked potential signals.

27. A device comprising:

a light pattern brain response detection sensor;

a pattern detector operably coupled to the light pattern brain response detection sensor and having an output that provides at least a first signal indicating when a light pattern brain response of a user at least likely corresponds to a predetermined light pattern at least two of a plurality of times;

a control signal generator operably coupled to the pattern detector and having an output that provides a control signal comprising a correlation between the predetermined light pattern and a predetermined action.

28. The device of claim 27 wherein the light pattern brain response detector sensor comprises an electroencephalogram sensor.

29. The device of claim 27 wherein the light pattern brain response comprises a visual evoked potential signal.

30. The device of claim 29 wherein the predetermined light pattern comprises a frequency peak.

31. The device of claim 30 wherein the pattern detector comprises fast Fourier transformation means for detecting a frequency peak of the user'"'"'s light pattern brain response.

32. The device of claim 29 wherein the pattern detector comprises:

normalization means for normalizing the user'"'"'s light pattern brain response to provide normalized light pattern brain responses;

fast Fourier transformation means for processing the normalized light pattern brain responses to provide transformed light pattern brain responses;

pattern recognition means for comparing the transformed light pattern brain responses against at least one previously determined pattern that corresponds to a predetermined light pattern brain response.

33. The device of claim 32 wherein the previously determined pattern comprises at least one rule that correlates to a specific user.

34. The device of claim 32 wherein the pattern recognition means compares the transformed light pattern brain responses against a plurality of previously determined patterns, wherein at least some of the previously determined patterns each correspond to a different predetermined light pattern brain response.

35. The device of claim 27 and further comprising a source of at least one light pattern.

36. The device of claim 35 wherein the source comprises at least one light emitting diode.

37. The device of claim 35 wherein the source provides a light pattern comprising a flashing pattern.

38. The device of claim 37 wherein the flashing pattern has a frequency of approximately 4 to 80 cycles per second.