SYSTEM AND METHOD FOR ENHANCING CONTENT USING BRAIN-STATE DATA

• US 20140223462A1
• Filed: 12/04/2013
• Published: 08/07/2014
• Est. Priority Date: 12/04/2012
• Status: Active Grant

• Current Assignee: InteraXon Inc.
• Original Assignee: InteraXon Inc.
• Inventors: Aimone, Christopher Allen, Garten, Ariel Stephanie, Coleman, Trevor Ce, Pino, Locillo (Lou) Giuseppe, Vidyarthi, Kapil Jay Mishra, Baranowski, Paul Harrison, Rupsingh, Raul Rajiv, Chong, Tracy Nicole
• Granted Patent: US 10,009,644 B2
• Time in Patent Office: Days
• US Class Current: 725/10
• CPC Class Codes: A61B 5/0006 ECG or EEG signals
• CPC Class Codes: A61B 5/0022 Monitoring a patient using a global network, e.g. telephone networks, internet
• CPC Class Codes: A61B 5/0205 Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/369 Electroencephalography [EEG] devices for psychotechnics A61B5/16
• CPC Class Codes: A61B 5/7405 using sound
• CPC Class Codes: A61B 5/744 Displaying an avatar, e.g. an animated cartoon character
• CPC Class Codes: A61B 5/7455 characterised by tactile indication, e.g. vibration or electrical stimulation
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: G16Z 99/00 Subject matter not provided for in other main groups of this subclass
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 21/4307 Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/44204 Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched monitoring of user activities for profile generation for accessing a video database G06F16/739; protecting generic digital content where the protection is independent of the precise nature of the content G06F21/10; arrangements for monitoring the use made of the broadcast services in broadcast systems H04H60/31
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104

Abstract

A computer system or method may be provided for modulating content based on a person'"'"'s brainwave data, including modifying presentation of digital content at at least one computing device. The content may also be modulated based on a set of rules maintained by or accessible to the computer system. The content may also be modulated based on user input, including through receipt of a presentation control command that may be processed by the computer system of the present invention to modify presentation of content. Content may also be shared with associated brain state information.

Claims

1. A system comprising:

at least one computing device;

at least one bio-signal sensor in communication with the at least one computing device;

at least one user input device in communication with the at least one computing device;

the at least one computing device configured to;

present digital content at the at least one computing device for presentation to at least one user;

receive bio-signal data of the at least one user from the at least one bio-signal sensor, at least one of the at least one bio-signal sensor comprising a brainwave sensor, and the received bio-signal data comprising at least brainwave data of the at least one user; and

modify presentation of the digital content at the at least one computing device based at least partly on the received bio-signal data, at least one presentation modification rule associated with the presented digital content, and at least one presentation control command received from the at least one user input device.

2. The system of claim 1 wherein the presentation modifying comprises presenting at least a subset of the received bio-signal data based at least partly on the received bio-signal data.

3. The system of claim 1 wherein the presentation modifying comprises presenting at least one representation of the user'"'"'s brain state based at least partly on the received bio-signal data, the at least one presentation modification rule, and the at least one presentation control command.

4. The system of claim 1 wherein the received bio-signal data comprises time-coded bio-signal data, and the digital content presentation comprises time-coded presentation data, the at least one computing device configured to synchronize the time-coded bio-signal data to the time-coded presentation data at least partly by synchronizing time stamps between the time-coded bio-signal data and the time-coded presentation data, wherein the time-coded presentation data may be used by the at least one computing device to determine at least one presentation state of the presented digital content at a respective time stamp.

5. The system of claim 4 wherein the presentation modifying comprises modifying presentation of the digital content based at least partly on a correspondence between the time-coded bio-signal data at at least one time stamp with the time-coded presentation data at the at least one time stamp.

6. The system of claim 1 wherein the presentation modifying comprises modifying presentation of the digital content based at least partly on a bio-signal interaction classification profile.

7. The system of claim 6 wherein the bio-signal interaction classification profile is associated with the at least one user.

8. The system of claim 6 wherein the at least one computing device is configured to update the bio-signal interaction classification profile based at least partly on the presentation control command.

9. The system of claim 6 wherein the at least one computing device is configured to update the bio-signal interaction classification profile based at least partly on bio-signal interaction classification data received from at least one computer server over a communications network.

10. The system of claim 1 wherein the at least one computing device is configured to update the at least one presentation modification rule based at least partly on presentation modification rule data received from at least one computer server over a communications network.

11. The system of claim 1 wherein the at least one presentation control command indicates a target brain state, and the presentation modification comprises presenting digital content that is associated with the target brain state at the at least one computing device.

12. The system of claim 1 wherein the presentation modification comprises the at least one computing device sharing at least a part of the presented digital content, or a link thereto, with at least one other user on a content sharing server.

13. The system of claim 12 wherein the sharing comprises associated the received bio-signal data with the shared presented digital content, and sharing the associated received bio-signal data with the at least one other user on the content sharing server.

14. A system comprising:

at least one computing device;

at least one bio-signal sensor in communication with the at least one computing device;

at least one user input device in communication with the at least one computing device;

the at least one computing device configured to;

present digital content at the at least one computing device for presentation to at least one user;

receive bio-signal data of the at least one user from the at least one bio-signal sensor, at least one of the at least one bio-signal sensor comprising a brainwave sensor, and the received bio-signal data comprising at least brainwave data of the at least one user;

determine at least one brain state of the user in response to the presented digital content, the brain state determining based at least partly on received bio-signal data; and

associate the determined brain state with the presented digital content.

15. The system of claim 14 wherein the received bio-signal data comprises time-coded bio-signal data, and the digital content presentation comprises time-coded presentation data, the at least one computing device configured to synchronize the time-coded bio-signal data to the time-coded presentation data at least partly by synchronizing time stamps between the time-coded bio-signal data and the time-coded presentation data, wherein the time-coded presentation data may be used by the at least one computing device to determine at least one presentation state of the presented digital content at a respective time stamp.

16. The system of claim 14 wherein the determined brain state comprises at least one user emotion quantified by the at least one computing device in accordance with at least one bio-signal analysis rule.

17. The system of claim 16 wherein the digital content comprises advertising content, and wherein the at least one computing device is configured to flag the respective advertising content as effective based at least partly on the quantified emotion.

18. The system of claim 17 wherein the quantified emotion comprises a determined emotion intensity, and wherein the at least one computing device is configured to flag the respective advertising content as effective based at least partly on a determined correspondence between the determined emotion intensity and an emotion response threshold associated with the determined brain state for the respective at least one user.

19. The system of claim 14 wherein the at least one brain state determining is determined in real-time.

20. The system of claim 14 wherein the at least one computing device is configured to modify presentation of the digital content at the at least one client computing device based at least partly on the at least one determined brain state and at least one presentation modification rule associated with the presented digital content.

21. The system of claim 20 wherein the at least one computing device is configured to modify presentation of the digital content at the at least one client computing device based at least partly on at least one presentation control command received from the at least one user input device.

22. The system of claim 20 wherein the at least one computing device is configured to present a representation of the associated determined brain state.

23. The system of claim 14 wherein the brain state determining is based at least partly on a bio-signal interaction classification profile.

24. The system of claim 14 wherein the at least one computing device is configured to receive communication content during a communication session established over a communications network with at least one remote computing device;

wherein the digital content presenting comprises presenting the received communication content at the at least one computing device for presentation to at least one user; and

the determined brain state associating comprises associating the determined brain state with the received communication content.

25. The system of claim 24 wherein the at least one computing device is configured to transmit the brain state associated with the received communication content to the at least one remote computing device over the communications network.

26. The system of claim 24 wherein the communication session comprises a videoconferencing communication session and the communication content comprises at least one video stream.

27. The system of claim 24 wherein the at least one computing device is configured to receive brain state data from the at least one remote computing device, the received brain state data representing at least one brain state of at least one remote user of the at least one remote computing device.

28. The system of claim 27 wherein the received brain state data comprises time-coded brain state data, and the received communication content comprises time-coded communication content, the at least one computing device configured to synchronize the received time-coded brain state data to the time-coded communication content at least partly by synchronizing time stamps between the received time-coded brain state data and the time-coded communication content, wherein the time-coded communication content may be used by the at least one computing device to determine the brain state of the remote user at a respective time stamp of the received communication content.

29. The system of claim 24 wherein the at least one computing device is configured to modify presentation of the digital content at the at least one client computing device based at least partly on the at least one determined brain state and at least one presentation modification rule associated with the presented digital content.

30. The system of claim 24 wherein the at least one computing device is configured to modify presentation of the digital content at the at least one client computing device based at least partly on the at least one received brain state and at least one presentation modification rule associated with the presented digital content.

31. The system of claim 24 wherein the presentation modification comprises modifying appearance of a user avatar displayed at the at least one computing device.

32. A system comprising:

at least one computing device;

at least one bio-signal sensor in communication with the at least one computing device;

the at least one computing device configured to;

receive bio-signal data of at least one user from the at least one bio-signal sensor, at least one of the at least one bio-signal sensor comprising a brainwave sensor, and the received bio-signal data comprising at least brainwave data of the at least one user;

determine at least one brain state of the user, the brain state determining based at least partly on received bio-signal data; and

select digital content for presentation to the at least one user based on the determined at least one brain state of the user;

present the selected digital content at the at least one computing device.

33. The system of claim 32 wherein the digital content selecting comprises selecting advertising content, and the determined at least one brain state comprises at least one user emotion quantified by the at least one computing device in accordance with at least one bio-signal analysis rule.

34. The system of claim 33 wherein the quantified emotion comprises a determined emotion intensity, and wherein the at least one computing device is configured to flag the respective advertising content as effective based at least partly on a determined correspondence between the determined emotion intensity and an emotion response threshold associated with the determined brain state for the respective at least one user.

35. A system comprising:

at least one computing device;

at least one bio-signal sensor in communication with the at least one computing device;

at least one user input device in communication with the at least one computing device;

the at least one computing device configured to;

receive bio-signal data of at least one user from the at least one bio-signal sensor, at least one of the at least one bio-signal sensor comprising a brainwave sensor, and the received bio-signal data comprising at least time-coded brainwave data of the at least one user;

determine at least one brain state of the user, the brain state determining based at least partly on received bio-signal data, the determined at least one brain state comprising time-coded brain state data;

recording time-coded user activity data representing at least one user interaction with the at least one computing device;

synchronize the time-coded brain state data to the time-coded user activity data at least partly by synchronizing time stamps between the time-coded brain state data and the time-coded user activity data; and

determine the brain state of the at least one user at a respective time stamp of the respective user interaction based at least partly on the time-coded user activity data.

36. The system of claim 35 wherein the at least one user interaction comprises at least one content creation activity by the user, and the recorded time-coded user activity data represents the status of the at least one content creation activity at respective time stamps.

37. The system of claim 35 wherein the at least one computing device is configured to modify presentation of digital content associated with the at least one user interaction based at least partly on a correspondence between the time-coded brain state data at at least one time stamp with the time-coded user activity data at the at least one time stamp.

38. The system of claim 37 wherein a target brain state is associated at the at least one computing device with encouraging at least one content creation activity, and wherein the modifying presentation of digital content comprises presenting digital content that is associated at the at least one computing device with the target brain state.

39. The system of claim 38 wherein the system comprises at least one user input device in communication with the at least one computing device;

and wherein the target brain state is based at least partly on at least one presentation control command received from the at least one user input device.

40. A method performed by at least one computing device in communication with at least one bio-signal sensor, and at least one user input device, the method comprising:

presenting digital content at the at least one computing device for presentation to at least one user;

receiving bio-signal data of the at least one user from the at least one bio-signal sensor, at least one of the at least one bio-signal sensor comprising a brainwave sensor, and the received bio-signal data comprising at least brainwave data of the at least one user; and

modifying presentation of the digital content at the at least one computing device based at least partly on the received bio-signal data, at least one presentation modification rule associated with the presented digital content, and at least one presentation control command received from the at least one user input device.