Method and apparatus for monitoring emotion in an interactive network

• US 8,700,009 B2
• Filed: 06/02/2011
• Issued: 04/15/2014
• Est. Priority Date: 06/02/2010
• Status: Active Grant

• Current Assignee: The Vista Group LLC
• Original Assignee: Q-Tec Systems LLC
• Inventors: Quy, Roger J.
• Primary Examiner(s): KIM, WESLEY LEO
• Application Number:
  US13/151,711
• Publication Number:
  US 20110300847A1
• Time in Patent Office: 1,048 Days
• Field of Search: 455/414.1, 600/300, 600/301
• US Class Current: 455/414.1
• CPC Class Codes: A61B 5/02405 Determining heart rate variability
• CPC Class Codes: A61B 5/02416 using photoplethysmograph signals, e.g. generated by infrared radiation A61B5/14552 takes precedence
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/681 Wristwatch-type devices
• CPC Class Codes: A61B 5/6898 Portable consumer electronic devices, e.g. music players, telephones, tablet computers
• CPC Class Codes: A61B 5/7257 using Fourier transforms
• CPC Class Codes: A61B 5/7264 Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems neural networks per se G06N3/00; expert systems per se G06N5/00
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04W 4/00 Services specially adapted for wireless communication networks; Facilities therefor
• CPC Class Codes: H04W 4/50 Service provisioning or reconfiguring

Abstract

Embodiments of the invention provide a method, devices, and system for monitoring and sharing emotion-related data from one or more persons connected via the internet. An emotion monitoring device (EMD) measures physiological signals obtained from biosensors and computes emotion states relating to emotional arousal and valence. Various signal processing methods are employed to reduce artifact and improve the detection of emotional states. The EMD communicates the emotion data to an internet server via a wireless network. The internet server transmits the emotion data to other persons equipped with an EMD. Their emotion data similarly is obtained and shared with others. The networked emotion data can used to enrich online, community experiences such as games and social networks. An implementation of an EMD based on a smart phone enables emotion data to be monitored in wide area, mobile environment. The biosensors can be integrated into the casing or a cover for the mobile phone.

Claims

1. A method for monitoring emotion data in a network using a mobile phone, comprising:

a. downloading an application to a mobile phone from an internet server, the application configured to receive a physiological signal from a biosensor and process the signal to reduce the presence of artifacts;

b. running the application in the mobile phone, and receiving a physiological signal;

c. computing emotion data from the received physiological signals using the downloaded application, the computed emotion data including a component of emotional arousal or a component of emotional valence or both;

d. displaying the computed emotion data using the downloaded application;

e. transmitting the emotion data to an internet server using a wireless network;

f. receiving a response from the internet server; and

g. displaying the response on the mobile phone on a user interface associated with the downloaded application.

2. A non-transitory computer readable medium, comprising instructions for causing a computer device to perform the method of claim 1.

3. A method for monitoring emotion data in a network from a mobile device, comprising:

a. upon request, downloading an application to a mobile device, the application including instructions to configure the mobile device to receive a signal from one or more biosensors;

b. receiving emotion data from the downloaded application from one or more mobile devices, the emotion data including a component of emotional arousal or a component of emotional valence or both; and

c. transmitting data corresponding to the received emotion data to one or more other mobile devices running the downloaded application, including data corresponding to the component of emotional arousal or the component of emotional valence or both.

4. A non-transitory computer readable medium, comprising instructions for causing a computer device to perform the method of claim 3.

5. An emotion monitoring device in the form of a mobile phone connected in a wired or wireless fashion to a biosensor, the device including a non-transitory computer readable medium comprising instructions for causing the device to perform the following steps:

a. receive physiological signals from a biosensor, the biosensor structured and configured to facilitate finger contact, and process the signals to reduce artifacts;

b. instantiate an application in the mobile phone;

c. compute emotion data from the received physiological signals, the emotion data including a component of emotional arousal or a component of emotional valence or both;

d. display the emotion data;

e. transmit the emotion data to an internet server using a wireless network;

f. receive a response from the internet server; and

g. display the response on the mobile phone.

6. The device of claim 5, wherein the received response includes emotion data from other users.

7. The device of claim 5, wherein the instantiated application performs the steps of receiving physiological signals from a biosensor, and processing the signals to reduce artifacts.

8. An emotion monitoring device in the form of a mobile phone with biosensors integrated in a casing, the device including a non-transitory computer readable medium comprising instructions for causing the device to perform the following steps:

a. receive physiological signals from a biosensor, the biosensor integrated in a casing of a mobile phone, the biosensor structured and configured to facilitate finger contact, and process the signals to reduce artifact;

b. instantiate an application in the mobile phone;

c. compute emotion data from the received physiological signals, the emotion data including a component of emotional arousal or a component of emotional valence or both;

d. display the emotion data;

e. transmit the emotion data to an internet server using a wireless network;

f. receive a response from the internet server; and

g. display the response on the mobile phone.

9. The device of claim 8, wherein the received response includes emotion data from other users.

10. The device of claim 8, wherein the instantiated application performs the steps of receiving physiological signals from a biosensor, and processing the signals to reduce artifact.

11. An emotion monitoring device in the form of a cover, sleeve, or attachment and configured to fit a mobile phone, the cover, sleeve, or attachment incorporating a biosensor and configured to be in signal communication with the mobile phone, the device or the mobile phone or both including a non-transitory computer readable medium comprising instructions for causing the combination device and mobile phone to perform the following steps:

a. receive physiological signals from a biosensor via a direct wired or radio frequency connection, the biosensor incorporated within a cover, sleeve, or attachment configured to fit a mobile phone, the biosensor structured and configured to facilitate finger contact, and process the signals to reduce artifact;

b. instantiate an application in the mobile phone;

c. compute emotion data from the received physiological signals, the emotion data including a component of emotional arousal or a component of emotional valence or both;

d. display the emotion data;

e. transmit the emotion data to an internet server using a wireless network;

f. receive a response from the internet server; and

g. display the response on the mobile phone.

12. The device of claim 11, wherein the received response includes emotion data from other users.

13. The device of claim 11, wherein the instantiated application performs the steps of receiving physiological signals from a biosensor, and processing the signals to reduce artifact.

14. A non-transitory computer readable medium, comprising instructions for causing a processor in a mobile phone to perform a method of processing data relating to emotion, comprising:

a. receiving data relating to emotion, the emotion data including a component of emotional arousal or a component of emotional valence or both;

b. displaying the emotion data;

c. transmitting the emotion data to an internet server using a wireless network;

d. receiving a response from internet server; and

e. displaying the response on the mobile phone,

f. wherein the displaying the received response and at least one of the receiving data, displaying data, or transmitting data are performed by an application running on the mobile phone, the application downloaded from an internet server.

15. A method for monitoring emotion data in a network from a computing device, comprising:

a. upon request, downloading an application to a computing device, the application including instructions to configure the computing device to receive a signal from a sensor;

b. receiving emotion data from the downloaded application running on one or more computing devices, the emotion data including a component of emotional arousal or a component of emotional valence or both;

c. and

d. transmitting data corresponding to the received emotion data to one or more other computing devices running the downloaded application, including data corresponding to the component of emotional arousal or the component of emotional valence or both;

e. wherein the computing device is a personal computer, a game console, a wearable mobile device, or a hardware appliance programmed for this use.

16. An emotion monitoring device in the form of a computing device connected in a wired or wireless fashion to a sensor, the device including a non-transitory computer readable medium comprising instructions for causing the device to perform the following steps:

a. receive signals from a sensor;

b. instantiate an application in the computing device;

c. compute emotion data from the received signals, the emotion data including a component of emotional arousal or a component of emotional valence or both;

d. display the emotion data;

e. transmit the emotion data to an internet server using a wireless network;

f. receive a response from the internet server; and

g. display the response,

h. wherein the computing device is a personal computer, a game console, a wearable device, or a hardware appliance programmed for this use.