Electroencephalography (EEG) camera control

• US 9,712,736 B2
• Filed: 12/15/2015
• Issued: 07/18/2017
• Est. Priority Date: 12/15/2015
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Kearns, Phillip J., Lamkin, Andrew F.
• Primary Examiner(s): Perkey, W B
• Application Number:
  US14/970,066
• Publication Number:
  US 20170171441A1
• Time in Patent Office: 581 Days
• Field of Search: None
• CPC Class Codes: A61B 5/316 Modalities, i.e. specific diagnostic methods
• CPC Class Codes: A61B 5/369 Electroencephalography [EEG] devices for psychotechnics A61B5/16
• CPC Class Codes: A61B 5/6803 Head-worn items, e.g. helmets, masks, headphones or goggles
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 5/44 Receiver circuitry for the reception of television signals according to analogue transmission standards H04N5/14 takes precedence
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal
• CPC Class Codes: H04W 4/80 Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication

Abstract

Various techniques for performing camera control techniques based on brainwave data from an electroencephalography (EEG) headset are disclosed herein. In an example, a computing system operates to receive brainwave data representing brainwave activity, process the brainwave data, and transmit a command to a camera device based on the processed brainwave data. For example, the brainwave data may correlate to raw brainwave signals (from gamma, beta, alpha, theta, or delta brainwaves), or composite brainwave signals (from multiple brainwaves, representative of attention, meditation, or like states). As a result, the computing system may transmit a command to a camera device to capture an image, a burst of images, start/stop video recording, or like commands for image and video operations, based on a human user'"'"'s detected brainwave state. Further processing, detection, and training methods for brainwave control of camera operations are also disclosed.

Claims

1. A computing device, comprising:

processing circuitry; and

a camera command processing component, operable with the processing circuitry, to;

receive brainwave data from an electroencephalography (EEG) headset, the brainwave data including a composite brainwave value that represents a combination of raw brainwave measurements of multiple brainwaves including two or more of;

gamma, beta, alpha, theta, or delta brainwaves;

process the composite brainwave value to identify a user mental state, wherein the user mental state is identified by the composite brainwave value exceeding a threshold value;

determine a camera capture condition based on the identified user mental state; and

transmit a command to a camera device to perform a capture of imaging data with the camera device, the command corresponding to the camera capture condition.

2. The computing device of claim 1, the computing device further comprising:

a wireless transceiver, operable with the processing circuitry, to;

wirelessly receive the imaging data from the camera device, wherein the imaging data is received in response to the command to perform the capture of imaging data.

3. The computing device of claim 2, further comprising:

a wearable image capture device, wherein the imaging data includes data for multiple images, wherein the imaging data is received with the wireless transceiver via a wireless communication from the wearable image capture device, the wireless communication occurring according to a wireless personal area network or wireless local area network communication protocol.

4. The computing device of claim 3, the camera command processing component to create a presentation of the multiple images collected over a defined period of time.

5. The computing device of claim 2, further comprising:

a wearable video capture device, wherein the imaging data includes data for a video, wherein the imaging data is received with the wireless transceiver via a wireless communication from the wearable video capture device, the wireless communication occurring according to a wireless personal area network or wireless local area network communication protocol.

6. The computing device of claim 5, the camera command processing component to associate a first time marker of the video for a start of a video clip, based on brainwave activity, and associate a second time marker of the video for an end of the video clip, based on brainwave activity.

7. The computing device of claim 6, the camera command processing component to create a presentation of the video collected over a defined period of time, the presentation of the video based on the first time marker and the second time marker.

22. The computing device of claim 1, the camera command processing component to process the composite brainwave value to determine respective commands to transmit to the camera device, wherein the respective commands, triggered based on associated composite brainwave values, include capturing an image or begin recording of a video.

23. The computing device of claim 5, the camera command processing component to generate a composite video comprising of a series of video clips taken from the video based on the brainwave data, wherein the video clips are selected based on the brainwave data at a time of a video capture condition.

24. The computing device of claim 1, wherein the command causes the camera device to capture an image, and wherein transmission of the command is determined based on brainwave data associated with a user defined interest indicator.

8. At least one non-transitory machine-readable medium comprising instructions for operation of a computer system, which when executed by the computer system, cause the computer system to perform electronic operations that:

receive brainwave data from an electroencephalography (EEG) headset, the brainwave data including a composite brainwave value that represents a combination of raw brainwave measurements of multiple brainwaves, the multiple brainwaves including two or more of;

gamma, beta, alpha, theta, or delta brainwaves;

process the composite brainwave value to identify a user mental state, wherein the user mental state is identified by the composite brainwave value exceeding a threshold value;

determine a camera capture condition based on the identified user mental state; and

transmit a command to a camera device to perform a capture of imaging data with the camera device, the command corresponding to the camera capture condition.

9. The machine-readable medium of claim 8 wherein the brainwave data further includes a value for a raw brainwave measurement, the raw brainwave measurement representing a gamma, beta, alpha, theta, or delta brainwave, and wherein the user mental state is further identified by the raw brainwave measurement.

10. The machine-readable medium of claim 8, comprising instructions that cause the computer system to perform electronic operations that:

indicate an image capture condition with the camera capture condition, wherein the camera device is operable to capture image data, and wherein the command causes the camera device to capture an image.

11. The machine-readable medium of claim 8, comprising instructions that cause the computer system to perform electronic operations that:

indicate a video capture condition with the camera capture condition, wherein the camera device is operable to record video data, and wherein the command causes the camera device to start capture or stop capture of a video.

12. The machine-readable medium of claim 8, comprising instructions that cause the computer system to perform electronic operations that:

perform training with a particular human user for brainwave activity levels of the particular human user, wherein the threshold value is set as a result of the training.

13. The machine-readable medium of claim 8, comprising instructions that cause the computer system to perform electronic operations that:

receive the imaging data from the camera device, wherein the imaging data is received in response to the command to perform the capture of imaging data.

25. The machine-readable medium of claim 8, comprising instructions that cause the computer system to perform electronic operations that:

process the composite brainwave value to determine respective commands to transmit to the camera device, wherein the respective commands, triggered based on associated composite brainwave values, include capturing an image or begin recording of a video.

26. The machine-readable medium of claim 11, comprising instructions that cause the computer system to perform electronic operations that:

generate a composite video comprising of a series of video clips taken from the video based on the brainwave data, wherein the video clips are selected based on the brainwave data at a time of the video capture condition.

27. The machine-readable medium of claim 8, wherein the command causes the camera device to capture an image, and wherein transmission of the command is determined based on brainwave data associated with a user defined interest indicator.

14. A method comprising electronic operations, which when performed by processor circuitry of a computing system, causes the computing system to perform the electronic operations including:

receiving brainwave data from an electroencephalography (EEG) headset, the brainwave data including a composite brainwave value that represents a combination of raw brainwave measurements of multiple brainwaves, the multiple brainwaves including two or more of;

gamma, beta, alpha, theta, or delta brainwaves;

processing the composite brainwave value to identify a user mental state, wherein the user mental state is identified by the composite brainwave value exceeding a threshold value;

determining a camera capture condition based on the identified user mental state; and

transmitting a command to a camera device to perform a capture of imaging data with the camera device, the command corresponding to the camera capture condition.

15. The method of claim 14, wherein the brainwave data also includes a value for a raw brainwave measurement, the raw brainwave measurement representing a gamma, beta, alpha, theta, or delta brainwave.

16. The method of claim 14, wherein the camera capture condition relates to an image capture condition, wherein the camera device is operable to capture image data, and wherein the command causes the camera device to capture an image.

17. The method of claim 14, wherein the camera capture condition relates to a video capture condition, wherein the camera device is operable to record video data, and wherein the command causes the camera device to start capture or stop capture of a video.

18. The method of claim 14, the electronic operations further including:

performing training with a particular human user for brainwave activity levels of the particular human user, wherein the threshold value is set as a result of the training.

19. The method of claim 14, the electronic operations further comprising:

receiving the imaging data from the camera device, wherein the imaging data is received in response to the command to perform the capture of imaging data.

20. The method of claim 14, the electronic operations further comprising:

receiving second brainwave data from the EEG headset, the second brainwave data including a second composite brainwave value that represents a combination of raw brainwave measurements of multiple brainwaves, the multiple brainwaves including two or more of;

gamma, beta, alpha, theta, or delta brainwaves;

processing the second composite brainwave value a identify a second user mental state, wherein the second user mental state is identified by the second composite brainwave value exceeding a second threshold value;

determining a second camera capture condition based on the identified second user mental state; and

transmitting a second command to the camera device to stop the capture of imaging data with the camera device, the command corresponding to the second camera capture condition;

wherein the camera capture condition is to begin recording of a video; and

wherein the second camera capture condition is to stop recording of the video.

21. The method of claim 20, the electronic operations further comprising:

receiving the imaging data from the camera device, the imaging data including data for the video, wherein the imaging data is received with a wireless communication from a wearable video capture device, the wireless communication occurring according to a wireless personal area network or wireless local area network communication protocol.

28. The method of claim 14, the electronic operations further comprising:

processing the composite brainwave value to determine respective commands to transmit to the camera device, wherein the respective commands, triggered based on associated composite brainwave values, include capturing an image or begin recording of a video.

29. The method of claim 17, the electronic operations further comprising:

generating a composite video comprising of a series of video clips taken from the video based on the brainwave data, wherein the video clips are selected based on the brainwave data at a time of the video capture condition.

30. Time method of claim 14, wherein the command is transmitted to the camera device to capture an image, wherein transmission of the command is determined based on brainwave data associated with a user defined interest indicator.