Affective control of information systems

• US 7,181,693 B1
• Filed: 03/17/2000
• Issued: 02/20/2007
• Est. Priority Date: 03/17/2000
• Status: Expired due to Term

• Current Assignee: Gateway Incorporated (Acer, Inc.)
• Original Assignee: Gateway Incorporated (Acer, Inc.)
• Inventors: McKnight, Russell F., Anderson, Glen John
• Primary Examiner(s): SAX, STEVEN PAUL
• Application Number:
  US09/528,254
• Time in Patent Office: 2,531 Days
• Field of Search: 345/701, 345/702, 345/703, 345/708, 345/710, 345/714, 345/745, 345/743, 345/863, 704/273, 704/272, 704/1, 704/270, 382/117, 382/173, 713/100, 713/47, 715/811, 715/745, 715/789, 715/861, 715/780, 715/744, 715746-747, 715/765, 715/767, 715/768, 715/703, 715/708, 715/84, 380/252
• US Class Current: 715/745
• CPC Class Codes: G06F 2203/011 Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 40/103 Formatting, i.e. changing of presentation of documents automatic justification G06F40/189; automatic line break hyphenation G06F40/191
• CPC Class Codes: G06F 40/284 Lexical analysis, e.g. tokenisation or collocates
• CPC Class Codes: G06N 3/004 Artificial life, i.e. computing arrangements simulating life
• CPC Class Codes: G06Q 10/107 Computer-aided management of electronic mailing [e-mailing]

Abstract

An information system that determines the apparent emotional state of the user and, based upon that determination, reacts appropriately. Appropriate reactions of the system include marking user text input to convey the apparent emotional state of the user to recipients. Other embodiments incorporate reactions of the system that warn or prompt a user, prior to system execution of a user directed operation, when the system has determined that the apparent emotional state of the user merits a warning or a prompt.

Claims

1. An information system under affective control, comprising:

an application program with which a user is actively engaged;

means for determining the apparent affective state of the user;

means for changing the output of the application program responsive to the apparent affective state of the user;

wherein said application program comprises means of user input;

wherein said user input is text; and

wherein said means for changing the operation of the application program comprises means for changing the appearance of text input by the user if the apparent affective state of the user indicates that text output by the application program should be marked.

2. An information system under affective control as in claim 1, wherein said means for determining the apparent affective state of the user comprises a means responsive to the facial expressions of the user.

3. An information system under affective control as in claim 1, wherein said means for determining the apparent affective state of the user comprises a means responsive to content of said user input.

4. An information system under affective control as in claim 1, wherein said application program is a program for transmission to others of text composed by the user.

5. An information system under affective control as in claim 1, wherein the means for determining the apparent affective state of the user comprises means for analyzing aspects of speech of the user.

6. An information system under affective control as in claim 5, wherein the means for analyzing aspects of speech includes means for measuring the timing of utterance of the voice of the user.

7. An information system under affective control as in claim 5, wherein the means for analyzing aspects of speech includes means for measuring the quality of the voice of the user.

8. An information system under affective control as in claim 5, wherein the means for analyzing aspects of speech includes means for measuring the utterance pitch contour of the voice of the user.

9. An information system under affective control as in claim 1, wherein the means for determining the apparent affective state of the user comprises means for measuring autonomic responses of the user.

10. An information system under affective control as in claim 9, wherein the means for measuring autonomic responses of the user comprises means for measuring characteristics of the skin of the user.

11. An information system under affective control as in claim 9, wherein the means for measuring autonomic responses of the user comprises means for measuring characteristics of the eye of the user.

12. An information system under affective control as in claim 11, wherein the means for measuring characteristics of the eye of the user measures dilation of the eye of the user.

13. An information system under affective control as in claim 11, wherein the means for measuring characteristics of the eye of the user measures a rate at which the user blinks the eye.

14. An information system under affective control as in claim 1, wherein the means for determining the apparent affective state of the user comprises means for analyzing facial expressions of the user.

15. An information system under affective control as in claim 14, wherein the means for analyzing facial expressions of the user comprises a video camera.

16. An information system under affective control as in claim 1, wherein the means for determining the apparent affective state of the user comprises means for analyzing gestures of the user.

17. An information system under affective control as in claim 1, wherein the means for determining the apparent affective state of the user comprises means for detecting marking by the user of text entered by the user.

18. An information system under affective control as in claim 1, wherein said application program comprises an email composition program, and said means for determining the apparent affective state of the user comprises means for analyzing a quantity of recipients of an email message being composed using said email composition program.

19. An information system under affective control as in claim 1, wherein said application program comprises an email composition program, and said means for determining the apparent affective state of the user comprises means for analyzing content of an email message being composed using said email composition program.

20. An information system under affective control as in claim 1, wherein said application program comprises an email composition program, and said means for determining the apparent affective state of the user comprises means for analyzing the time elapsed between presenting a received message to the user and receiving from the user a proposed response to the received message.

21. A method of processing text indicating the emotional state of the writer at the time of writing, comprising the steps of:

(a) accepting text input from the writer;

(b) determining the apparent emotional state of the writer;

(c) marking the appearance of at least a portion of the text accepted from the writer if the apparent emotional state of the writer indicates that the text should be marked; and

(d) outputting marked text, thereby indicating the apparent emotional state of the writer.

22. The method of processing text as set forth in claim 21, wherein said step of determining the apparent emotional state of the writer is performed by monitoring at least one of the writer'"'"'s text input characteristics, text content, writer autonomic indicators and the facial expressions of the writer.

23. The method of processing text as set forth in claim 21, wherein said step of accepting text input from the writer comprises receiving text manually input by the writer into a text input device and said step of determining the apparent emotional state of the writer is performed at least in part by determining the force used by the writer in manually inputting text into the input device.

24. An information system, comprising:

an application program for engaging by a user;

means for monitoring factors relating to an emotional state of the user; and

means for changing the operation of the application program responsive to the emotional state of the user;

wherein said means for changing the operation of the application program comprises means for changing the appearance of text input by the user if the apparent affective state of the user indicates that the text input by the user should be marked.

25. The information system of claim 24 wherein the means for monitoring the factors relating to the emotional state of the user includes means for monitoring characteristics of text inputted into the application program by the user.

26. The information system of claim 25 wherein the means for monitoring characteristics of text inputted includes means for monitoring appearance characteristics of the inputted text indicating the emotional state of the user.

27. The information system of claim 24 wherein the means for monitoring the factors relating to the emotional state of the user includes means for monitoring characteristics of creation of a document by the text inputted by the user.

28. The information system of claim 24 wherein the means for monitoring the factors relating to the emotional state of the user includes means for monitoring characteristics of the user as the user inputs text into the application program.

29. The information system of claim 28 wherein the means for monitoring characteristics of the user includes means for monitoring a degree of force exerted by the user on a manual input device as the user inputs text.

30. An information system under affective control comprising:

an application program with which a user is actively engaged;

means for determining the apparent affective state of the user; and

means for changing the operation of the application program responsive to the apparent affective state of the user;

wherein the means for determining the apparent affective state of the user comprises a manual input device capable of measuring a degree of force applied by the user to the manual input device;

wherein the manual input device comprises a keyboard capable of measuring a degree of force applied by the user to a key on the keyboard.

31. An information system under affective control comprising:

an application program with which a user is actively engaged;

means for determining the apparent affective state of the user; and

means for changing the operation of the application program responsive to the apparent affective state of the user;

wherein the means for determining the apparent affective state of the user comprises a manual input device capable of measuring degree of force applied by the user to the manual input device;

wherein the manual input device comprises a computer mouse capable of measuring a degree of force applied by the user to a button on the mouse.