Systems and methods for communicating with a computer using brain activity patterns

• US 8,442,626 B2
• Filed: 06/21/2010
• Issued: 05/14/2013
• Est. Priority Date: 06/21/2010
• Status: Active Grant

• Current Assignee: Aleksandrs Zavoronkovs, Mikhail Bakhnyan
• Original Assignee: Aleksandrs Zavoronkovs, Mikhail Bakhnyan
• Inventors: Zavoronkovs, Aleksandrs, Bakhnyan, Mikhail
• Primary Examiner(s): Natnithithadha, Navin
• Assistant Examiner(s): BERHANU, ETSUB D
• Application Number:
  US12/819,937
• Publication Number:
  US 20110313308A1
• Time in Patent Office: 1,058 Days
• Field of Search: 600/544, 600/545, 706/20, 382/224
• US Class Current: 600/544
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/377 using evoked responses

Abstract

The embodiments described herein are directed to systems and methods for communicating with a computer. The system includes a capture device having sensors to capture a particular brain activity pattern indicative of the mental activity generated in the user by a particular subject, a data storage device operable for storing a plurality of stored brain activity patterns each of which being associated with at least one computer readable indicia indicative of a subject that generated that brain activity pattern. The system also has a processor operable to receive the captured brain activity pattern, search for matching stored brain activity patterns, and if there is at least one matching stored brain activity pattern, retrieve the at least one indicia associated with the at least one matching stored brain activity pattern. The capture device may be an EEG capture device and the captured and stored brain activity patterns are EEG profiles.

Claims

1. A system for communicating with a computer comprising:

a) a capture device wearable by a user, the capture device having sensors to monitor the user'"'"'s mental activity and to capture a particular brain activity pattern indicative of the mental activity generated in the user by a particular subject, wherein the capture device comprises an electroencephalogram (EEG) capture device and the captured brain activity pattern is a captured EEG profile;

b) at least one data storage device operable for storing a plurality of stored EEG profiles, each of the stored EEG profiles being associated with at least one computer readable indicia indicative of a subject that generated that EEG profile, wherein the computer readable indicia comprises at least one keyword;

c) at least one processor operatively connected to the capture device and the at least one data storage device, the at least one processor being operable to;

i) receive the captured EEG profile,

ii) compare the captured EEG profile to each of the plurality of stored EEG profiles in the data storage device to determine if the captured EEG profile matches at least one of the stored EEG profiles, and

iii) if there is at least one matching stored EEG profile, retrieve the at least one keyword associated with the at least one matching stored EEG profile,

d) at least one keyword information data storage device operatively connected to the at least one processor, the keyword information data storage device storing information relating to various keywords; and

e) wherein when at least one keyword associated with the captured EEG profile is retrieved, the at least one processor is further operable to;

i) connect to the at least one keyword information data storage device,

ii) conduct a search at the at least one keyword information data storage device using the at least one retrieved keyword as a search constraint for information related to the at least one retrieved keyword,

iii) if related information is located, obtain the related information associated with the retrieved keywords, and

iv) present the related information using an output device.

2. The system according to claim 1, wherein when there are a plurality of matching stored EEG profiles, the at least one processor is further operable to:

a) receive an input to identify which of the retrieved keywords are indicative of the subject that generated the mental activity; and

b) conduct the search only using the retrieved keywords identified by the input as being indicative of the subject that generated the mental activity.

3. The system according to claim 1 further comprising an input device operatively connected to the at least one processor, and the processor being further operable to:

a) receive at least one keyword from the user using the input device, the at least one keyword being indicative of the subject that generated the mental activity;

b) associate the at least one keyword with the captured EEG profile; and

c) store the captured EEG profile and the at least one associated keyword in the at least one data storage device.

4. The system according to claim 3, wherein the at least one data storage device comprises a local EEG data storage device and a group EEG data storage device, the local EEG data storage device is operable for storing at least one stored EEG profile and the at least one associated keyword provided by the user, and the group EEG data storage device is operable for storing a plurality of stored EEG profiles and associated keywords provided by a plurality of individuals.

5. The system according to claim 4, wherein the at least one processor is further operable to provide the captured EEG profile and the at least one associated keyword stored in the local EEG data storage device to the group EEG data storage device.

6. The system according to claim 3, wherein the processor is further operable to:

a) receive additional information related to at least one keyword from the user using an input device;

b) associate the additional information to the at least one keyword; and

c) store the additional information in the at least one keyword information data storage device.

7. The system according to claim 1, wherein the processor is further operable to:

a) calculate a similarity value for each stored EEG profile, the similarity value being indicative of the similarity of each stored EEG profile to the captured EEG profile, and

b) determine if the captured profile matches one or more of the stored EEG profiles based on the similarity value.

8. A system for communicating with a computer comprising:

a) a capture device wearable by a user, the capture device having sensors to monitor the user'"'"'s mental activity and to capture a particular brain activity pattern indicative of the mental activity generated in the user by a particular subject, wherein the capture device comprises an electroencephalogram (EEG) capture device and the captured brain activity pattern is a captured EEG profile;

b) at least one data storage device operable for storing a plurality of stored EEG profiles, each of the stored EEG profiles being associated with at least one computer readable indicia indicative of a subject that generated that EEG profile, wherein the computer readable indicia comprises at least one keyword; and

c) at least one processor operatively connected to the capture device and the at least one data storage device, the at least one processor being operable to;

i) receive the captured EEG profile,

ii) compare the captured EEG profile to each of the plurality of stored EEG profiles in the data storage device to determine if the captured EEG profile matches at least one of the stored EEG profiles, and

iii) if there is at least one matching stored EEG profile, retrieve the at least one keyword associated with the at least one matching stored EEG profile;

d) wherein the at least one processor is further operable to;

i) connect to at least one Internet search engine storing a plurality of stored keywords and related information,

ii) conduct a search at the Internet search engine using the at least one retrieved keyword as a search constraint for related information,

iii) if related information is located, obtain the related information associated with the retrieved keywords, and

iv) present the related information using an output device.

9. The system according to claim 8, wherein when there are a plurality of matching stored EEG profiles, the at least one processor is further operable to:

a) receive an input to identify which of the retrieved keywords are indicative of the subject that generated the mental activity; and

b) conduct the search only using the retrieved keywords identified by the input as being indicative of the subject that generated the mental activity.

10. The system according to claim 8 further comprising an input device operatively connected to the at least one processor, and the processor being further operable to:

a) receive at least one keyword from the user using the input device, the at least one keyword being indicative of the subject that generated the mental activity;

b) associate the at least one keyword with the captured EEG profile; and

c) store the captured EEG profile and the at least one associated keyword in the at least one data storage device.

11. The system according to claim 10, wherein the at least one data storage device comprises a local EEG data storage device and a group EEG data storage device, the local EEG data storage device is operable for storing at least one stored EEG profile and the at least one associated keyword provided by the user, and the group EEG data storage device is operable for storing a plurality of stored EEG profiles and associated keywords provided by a plurality of individuals.

12. The system according to claim 11, wherein the at least one processor is further operable to provide the captured EEG profile and the at least one associated keyword stored in the local EEG data storage device to the group EEG data storage device.

13. The system according to claim 10, further comprising at least one keyword information data storage device, wherein the processor is further operable to:

a) receive additional information related to at least one keyword from the user using an input device;

b) associate the additional information to the at least one keyword; and

c) store the additional information in the at least one keyword information data storage device.

14. The system according to claim 8, wherein the processor is further operable to:

a) calculate a similarity value for each stored EEG profile, the similarity value being indicative of the similarity of each stored EEG profile to the captured EEG profile, and

b) determine if the captured profile matches one or more of the stored EEG profiles based on the similarity value.

15. A system for communicating with a computer comprising:

a) a capture device wearable by a user, the capture device having sensors to monitor the user'"'"'s mental activity and to capture a particular brain activity pattern indicative of the mental activity generated in the user by a particular subject, wherein the capture device comprises an electroencephalogram (EEG) capture device and the captured brain activity pattern is a captured EEG profile;

b) at least one data storage device operable for storing a plurality of stored EEG profiles, each of the stored EEG profiles being associated with at least one computer readable indicia indicative of a subject that generated that EEG profile, wherein the computer readable indicia comprises at least one keyword; and

c) at least one processor operatively connected to the capture device and the at least one data storage device, the at least one processor being operable to;

i) receive the captured EEG profile,

ii) compare the captured EEG profile to each of the plurality of stored EEG profiles in the data storage device to determine if the captured EEG profile matches at least one of the stored EEG profiles, and

iii) if there is at least one matching stored EEG profile, retrieve the at least one keyword associated with the at least one matching stored EEG profile;

d) wherein when the at least one retrieved keyword is presented to the user, the processor is further operable to;

i) receive an input from the user to indicate whether the at least one retrieved keyword is indicative of the subject that generated the captured profile,

ii) based on the input from the user, compare the captured EEG profile to the stored EEG profile that is associated with the at least one retrieved keyword to determine a degree of similarity between those profiles, and

iii generate a match value for that stored EEG profile indicative of the degree of similarity between that stored EEG profile and the captured EEG profile required to generate a match.

16. The system according to claim 15, wherein when there are a plurality of matching stored EEG profiles, the at least one processor is further operable to:

a) receive an input to identify which of the retrieved keywords are indicative of the subject that generated the mental activity; and

b) conduct the search only using the retrieved keywords identified by the input as being indicative of the subject that generated the mental activity.

17. The system according to claim 15, further comprising an input device operatively connected to the at least one processor, and the processor being further operable to:

a) receive at least one keyword from the user using the input device, the at least one keyword being indicative of the subject that generated the mental activity;

b) associate the at least one keyword with the captured EEG profile; and

c) store the captured EEG profile and the at least one associated keyword in the at least one data storage device.

18. The system according to claim 17, wherein the at least one data storage device comprises a local EEG data storage device and a group EEG data storage device, the local EEG data storage device is operable for storing at least one stored EEG profile and the at least one associated keyword provided by the user, and the group EEG data storage device is operable for storing a plurality of stored EEG profiles and associated keywords provided by a plurality of individuals.

19. The system according to claim 18, wherein the at least one processor is further operable to provide the captured EEG profile and the at least one associated keyword stored in the local EEG data storage device to the group EEG data storage device.

20. The system according to claim 17, further comprising at least one keyword information data storage device, wherein the processor is further operable to:

a) receive additional information related to at least one keyword from the user using an input device;

b) associate the additional information to the at least one keyword; and

c) store the additional information in the at least one keyword information data storage device.

21. The system according to claim 15, wherein the processor is further operable to:

a) calculate a similarity value for each stored EEG profile, the similarity value being indicative of the similarity of each stored EEG profile to the captured EEG profile, and

b) determine if the captured profile matches one or more of the stored EEG profiles based on the similarity value.

22. A method for communicating with a computer comprising the steps of:

a) monitoring a user'"'"'s mental activity using a capture device coupled to the user, the capture device having sensors to detect a user'"'"'s mental activity, wherein the capture device comprises an electroencephalogram (EEG) capture device;

b) capturing a particular brain activity pattern indicative of mental activity generated by the user thinking about a particular subject using the capture device, wherein the captured brain activity pattern comprises a captured EEG profile;

c) connecting to at least one data storage device containing a plurality of stored EEG profiles, each of the plurality of stored EEG profiles being associated with at least one computer readable indicia indicative of a subject that generated that EEG profile, wherein the computer readable indicia comprises at least one keyword;

using at least one processor, and

d) comparing the captured EEG profile to each of the plurality of the stored EEG profiles to determine if the captured EEG profile matches at least one EEG profile;

e) if there is at least one matching EEG profile, retrieving the at least one keyword associated with the at least one matching EEG profile;

f) connecting to at least one keyword information data storage device containing a plurality of stored keywords and related information;

g) conducting a search for additional information related to the at least one retrieved keyword by using the at least one retrieved keyword as a search criteria in the at least one keyword information data storage device;

h) if related information is located, obtaining the related information associated with the at least one retrieved keyword; and

i) presenting the related information using an output device.

23. The method according to claim 22, wherein when there is a plurality of matching stored EEG profiles, the method further comprises the steps of:

j) presenting the at least one retrieved keyword using an output device;

k) receiving input to identify which of the at least one retrieved keywords are indicative of the subject that generated the mental activity; and

l) conducting the search only using the retrieved keywords identified by the input as being indicative of the subject that generated the mental activity.

24. The method according to claim 22 further comprising the steps of:

j) calculating a similarity value for each stored EEG profile, the similarity value being indicative of the similarity of each stored EEG profile to the captured EEG profile; and

k) determining if the captured profile matches one or more of the stored EEG profiles based on the similarity value.

25. A method for communicating with a computer comprising the steps of:

a) monitoring a user'"'"'s mental activity using a capture device coupled to the user, the capture device having sensors to detect a user'"'"'s mental activity, wherein the capture device comprises an electroencephalogram (EEG) capture device;

b) capturing a particular brain activity pattern indicative of mental activity generated by the user thinking about a particular subject using the capture device, wherein the captured brain activity pattern comprises a captured EEG profile;

c) connecting to at least one data storage device containing a plurality of stored EEG profiles, each of the plurality of stored EEG profiles being associated with at least one computer readable indicia indicative of a subject that generated that EEG profile, wherein the computer readable indicia comprises at least one keyword;

using at least one processor and

d) comparing the captured EEG profile to each of the plurality of the stored EEG profiles to determine if the captured EEG profile matches at least one EEG profile;

e) if there is at least one matching EEG profile, retrieving the at least one keyword associated with the at least one matching EEG profile;

f) connecting to at least one Internet search engine containing a plurality of stored keywords and related information;

g) conducting a search for additional information related to the at least one retrieved keyword by using the at least one retrieved keyword as a search criteria in the search engine;

h) if related information is located, obtaining the related information associated with the at least one retrieved keyword; and

i) presenting the related information using an output device.

26. The method according to claim 25, wherein when there is a plurality of matching stored EEG profiles, the method further comprises the steps of:

j) presenting the at least one retrieved keyword using an output device;

k) receiving input to identify which of the at least one retrieved keywords are indicative of the subject that generated the mental activity; and

l) conducting the search only using the retrieved keywords identified by the input as being indicative of the subject that generated the mental activity.

27. The method according to claim 25, further comprising the steps of:

j) calculating a similarity value for each stored EEG profile, the similarity value being indicative of the similarity of each stored EEG profile to the captured EEG profile; and

k) determining if the captured profile matches one or more of the stored EEG profiles based on the similarity value.

28. A method for communicating with a computer comprising the steps of:

a) monitoring a user'"'"'s mental activity using an capture device coupled to the user, the capture device having sensors to detect a user'"'"'s mental activity, wherein the capture device comprises an electroencephalogram (EEG) capture device;

b) capturing a particular brain activity pattern indicative of mental activity generated by the user thinking about a particular subject using the capture device, wherein the captured brain activity pattern comprises a captured EEG profile;

c) connecting to at least one data storage device containing a plurality of stored EEG profiles, each of the plurality of stored EEG profiles being associated with at least one computer readable indicia indicative of a subject that generated that EEG profile, wherein the computer readable indicia comprises at least one keyword;

using at least one processor and

d) comparing the captured EEG profile to each of the plurality of the stored EEG profiles to determine if the captured EEG profile matches at least one EEG profile; and

e) if there is at least one matching EEG profile, retrieving the at least one keyword associated with the at least one matching EEG profile;

f) wherein when the at least one retrieved keyword is presented to the user, the method further comprises the steps of;

i) receiving an input from the user to indicate whether the at least one retrieved keyword is indicative of the subject that generated the captured profile;

ii) based on the input from the user, comparing the captured EEG profile to the stored EEG profile that is associated with the keywords identified by the input to determine a degree of similarity between those profiles; and

iii) generating a match value for that stored EEG profile indicative of the degree of similarity between that stored EEG profile and the captured EEG profile required to generate a match.

29. The method according to claim 28, wherein when there is a plurality of matching stored EEG profiles, the method further comprises the steps of:

g) presenting the at least one retrieved keyword using an output device;

h) receiving input to identify which of the at least one retrieved keywords are indicative of the subject that generated the mental activity; and

i) conducting the search only using the retrieved keywords identified by the input as being indicative of the subject that generated the mental activity.

30. The method according to claim 28, further comprising the steps of:

g) calculating a similarity value for each stored EEG profile, the similarity value being indicative of the similarity of each stored EEG profile to the captured EEG profile; and

h) determining if the captured profile matches one or more of the stored EEG profiles based on the similarity value.