Modifying software based on a user's emotional state

• US 8,683,348 B1
• Filed: 07/14/2010
• Issued: 03/25/2014
• Est. Priority Date: 07/14/2010
• Status: Active Grant

• Current Assignee: Intuit, Inc.
• Original Assignee: Intuit, Inc.
• Inventors: Blank, Bennett R., Snow, David J., McAlister, Michelle D.
• Primary Examiner(s): Abdul-Ali, Omar
• Application Number:
  US12/835,948
• Time in Patent Office: 1,350 Days
• Field of Search: 715/745, 715/709, 715/705, 715/708
• US Class Current: 715/745
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06Q 30/0271 Personalized advertisement

Abstract

A technique for modifying a user experience associated with a software product is described. During this modification technique, behavioral metrics that are associated with a user'"'"'s emotional state are collected while the user is using the software product. For example, the behavioral metrics may include: usage patterns, user gestures and/or user tactile inputs. Furthermore, using the collected behavioral metrics, the user'"'"'s emotional state is determined. Then, the user experience is modified based on the determined emotional state.

Claims

1. A computer-implemented method for modifying a user experience associated with a software product, comprising:

collecting behavioral metrics that are associated with a user'"'"'s emotional state while the user is using the software product;

determining, using a computer, the emotional state based on the collected behavioral metrics; and

modifying the user experience based on the determined emotional state by changing a path in a process associated with the software product, wherein said changing involves modifying a flow in the software product so that at least a different user interface is presented based on the emotional state, wherein the different user interface includes additional content in the software product that enables the user to provide user inputs to the document with ease.

2. The method of claim 1, wherein the behavioral metrics include at least one of:

a time duration that the user views a document provided by the software product;

user interest in help content associated with the software product;

an idle time when the user is viewing the document;

a time of day;

a speed with which the user answers questions in the document;

an elapsed time since a previous user session;

a user rating of the software product; and

a comparison of user outcomes with those of other users.

3. The method of claim 1, wherein the behavioral metrics include at least one of:

user facial expressions;

user tactile pressure when interacting with a user interface;

user gestures;

user posture; and

user errors when using the software product.

4. The method of claim 1, wherein the behavioral metrics are collected without interrupting normal activities of the user when using the software product.

5. The method of claim 1, wherein the behavioral metrics are collected via a game that the user plays.

6. The method of claim 5, wherein the game assesses current user cognitive processes.

7. The method of claim 5, wherein the game is played concurrently with use of the software product.

8. The method of claim 1, wherein determining the emotional state involves selecting one of a set of predefined emotional states.

9. The method of claim 1, wherein determining the emotional state involves calculating a weighted sum of the collected behavioral metrics.

10. The method of claim 9, wherein determining the emotional state involves comparing the weighted sum to a threshold.

11. The method of claim 1, wherein modifying the user experience involves changing a displayed information density in a document associated with the software product.

12. The method of claim 1, wherein modifying the user experience involves changing lexicography in a document associated with the software product.

13. The method of claim 1, wherein modifying the user experience involves changing a visual format of information in a document associated with the software product.

15. The method of claim 1, wherein changing the path in the process associated with the software product involves modifying a flow in the software product so that a personalized marketing offer, a different guidance, different functionality, or a different feature is presented based on the emotional state.

14. A non-transitory computer-program product for use in conjunction with a computer system, the computer-program product comprising a computer-readable storage medium and a computer-program mechanism embedded therein, to facilitate modifying a user experience associated with a software product, the computer-program mechanism including:

instructions for collecting behavioral metrics that are associated with a user'"'"'s emotional state while the user is using the software product;

instructions for determining the emotional state based on the collected behavioral metrics; and

instructions for modifying the user experience based on the determined emotional state by changing a path in a process associated with the software product, wherein said changing involves modifying a flow in the software product so that at least a different user interface is presented based on the emotional state, wherein the different user interface includes additional content in the software product that enables the user to provide user inputs to the document with ease.

16. The computer-program product of claim 14, wherein the behavioral metrics include at least one of:

a time duration that the user views a document provided by the software product;

user interest in help content associated with the software product;

an idle time when the user is viewing the document;

a time of day;

a speed with which the user answers questions in the document;

an elapsed time since a previous user session;

a user rating of the software product; and

a comparison of user outcomes with those of other users.

17. The computer-program product of claim 14, wherein the behavioral metrics include at least one of:

user facial expressions;

user tactile pressure when interacting with a user interface;

user gestures;

user posture; and

user errors when using the software product.

18. The computer-program product of claim 14, wherein determining the emotional state involves selecting one of a set of predefined emotional states.

19. The computer-program product of claim 14, wherein determining the emotional state involves calculating a weighted sum of the collected behavioral metrics.

20. The computer-program product of claim 14, wherein modifying the user experience involves changing a displayed information density in a document associated with the software product.

21. The computer-program product of claim 14, wherein modifying the user experience involves changing lexicography in a document associated with the software product.

22. The computer-program product of claim 14, wherein modifying the user experience involves changing a visual format of information in a document associated with the software product.

23. A computer system, comprising:

a processor;

memory; and

a program module, wherein the program module is stored in the memory and configurable to be executed by the processor to facilitate modifying a user experience associated with a software product, the program module including;

instructions for collecting behavioral metrics that are associated with a user'"'"'s emotional state while the user is using the software product;

instructions for determining the emotional state based on the collected behavioral metrics; and

instructions for modifying the user experience based on the determined emotional state by changing a path in a process associated with the software product, wherein said changing involves modifying a flow in the software product so that at least a different user interface is presented based on the emotional state, wherein the different user interface includes additional content in the software product that enables the user to provide user inputs to the document with ease.