Acquisition and presentation of data indicative of an extent of congruence between inferred mental states of authoring users

• US 8,429,225 B2
• Filed: 07/05/2011
• Issued: 04/23/2013
• Est. Priority Date: 05/21/2008
• Status: Expired due to Fees

• Current Assignee: The Invention Science Fund I, L.L.C. (Intellectual Ventures LLC)
• Original Assignee: The Invention Science Fund I, L.L.C. (Intellectual Ventures LLC)
• Inventors: Jung, Edward K. Y., Leuthardt, Eric C., Levien, Royce A., Lord, Robert W., Malamud, Mark A., Rinaldo, John D. Jr., Wood, Lowell L. Jr.
• Primary Examiner(s): DINH, KHANH Q
• Application Number:
  US13/135,462
• Publication Number:
  US 20110270914A1
• Time in Patent Office: 658 Days
• Field of Search: 709/203, 709/220, 709/224, 709/232, 707/3, 707/10
• US Class Current: 709/203
• CPC Class Codes: A61B 5/0002 Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network A61B5/07 takes precedence; transmission systems for measured values G08C; transmission H04B; transmission of digital information H04L; wireless communication networks H04W
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising

Abstract

A computationally implemented method includes, but is not limited to: acquiring a first inference data indicative of an inferred mental state of a first authoring user in connection with a particular item of an electronic document, acquiring a second inference data indicative of an inferred mental state of a second authoring user in connection with the particular item of the electronic document; comparing the first inference data with the second inference data; and presenting data indicative of an extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user based, at least in part, on said comparing. In addition to the foregoing, other method aspects are described in the claims, drawings, and text forming a part of the present disclosure.

Claims

1. A system comprising:

one or more processors;

memory coupled to the one or more processors;

an inference data acquisition module configured to acquire inference data including at least a first inference data that indicates an inferred mental state of a first authoring user in connection with a particular item of an electronic document and a second inference data that indicates an inferred mental state of a second authoring user in connection with the particular item of the electronic document;

a comparison module configured to compare the first inference data with the second inference data; and

a presentation module configured to present congruence data indicative of an extent of congruity between the inferred mental state of the first authoring user in connection with one or more first actions, that were performed at least in part by the first authoring user in connection with the particular item, and the inferred mental state of the second authoring user in connection with one or more second actions, that were performed at least in part by the second authoring user in connection with the particular item, based, at least in part, on the comparison of the first inference data with the second inference data.

2. The system of claim 1, wherein said inference data acquisition module configured to acquire inference data including at least a first inference data that indicates an inferred mental state of a first authoring user in connection with a particular item of an electronic document and a second inference data that indicates an inferred mental state of a second authoring user in connection with the particular item of the electronic document comprises:

an inference data reception module configured to receive at least the first inference data and the second inference data.

3. The system of claim 2, wherein said inference data reception module configured to receive at least the first inference data and the second inference data comprises:

an inference data reception module configured to receive at least the first inference data and the second inference data via a network communication interface.

4. The system of claim 2, wherein said inference data reception module configured to receive at least the first inference data and the second inference data comprises:

an inference data reception module configured to receive an indication of an action executed in connection with the particular item and performed, at least in part, by the first authoring user.

5. The system of claim 4, wherein said inference data reception module configured to receive an indication of an action executed in connection with the particular item and performed, at least in part, by the first authoring user comprises:

an inference data reception module configured to receive an indication of another action executed in connection with the particular item and performed, at least in part, by the second authoring user.

6. The system of claim 1, wherein said inference data acquisition module configured to acquire inference data including at least a first inference data that indicates an inferred mental state of a first authoring user in connection with a particular item of an electronic document and a second inference data that indicates an inferred mental state of a second authoring user in connection with the particular item of the electronic document comprises:

an inference data determination module configured to determine the first inference data based, at least in part, on one or more observed physical characteristics of the first authoring user and to determine the second inference data based, at least in part, on one or more observed physical characteristics of the second authoring user.

7. The system of claim 6, wherein said inference data determination module configured to determine the first inference data based, at least in part, on one or more observed physical characteristics of the first authoring user and to determine the second inference data based, at least in part, on one or more observed physical characteristics of the second authoring user comprises:

a physical characteristic observation module configured to observe the one or more physical characteristics of the first authoring user during or proximate to a first action executed in connection with the particular item and performed, at least in part, by the first authoring user, and to observe the one or more physical characteristics of the second authoring user during or proximate to a second action executed in connection with the particular item and performed, at least in part, by the second authoring user.

8. The system of claim 1, wherein said inference data acquisition module configured to acquire inference data including at least a first inference data that indicates an inferred mental state of a first authoring user in connection with a particular item of an electronic document and a second inference data that indicates an inferred mental state of a second authoring user in connection with the particular item of the electronic document comprises:

a mental state inference module configured to infer a mental state of the first authoring user based, at least in part, on a result of an observation made of one or more physical characteristics of the first authoring user, and to infer a mental state of the second authoring user based, at least in part, on a result of an observation made of one or more physical characteristics of the second authoring user.

9. The system of claim 8, wherein said mental state inference module configured to infer a mental state of the first authoring user based, at least in part, on a result of an observation made of one or more physical characteristics of the first authoring user, and to infer a mental state of the second authoring user based, at least in part, on a result of an observation made of one or more physical characteristics of the second authoring user comprises:

a mental state inference module configured to infer mental states of the first authoring user and the second authoring user that indicates that at least on one of the first authoring user or the second authoring user was in a state of anger, a state of distress, or a state of pain during or proximate to an action executed in connection with the particular item and performed, at least in part, by the at least one of the first authoring user or the second authoring user.

10. The system of claim 8, wherein said mental state inference module configured to infer a mental state of the first authoring user based, at least in part, on a result of an observation made of one or more physical characteristics of the first authoring user, and to infer a mental state of the second authoring user based, at least in part, on a result of an observation made of one or more physical characteristics of the second authoring user comprises:

a mental state inference module configured to infer mental states of the first authoring user and the second authoring user that indicates that at least on one of the first authoring user or the second authoring user was in one of a state of frustration, a state of approval or disapproval, a state of trust, a state of fear, a state of happiness, a state of surprise, a state of inattention, a state of arousal, a state of impatience, a state of confusion, a state of distraction, a state of overall mental activity, a state of alertness, or a state of acuity during or proximate to an action executed in connection with the particular item and performed, at least in part, by the at least one of the first authoring user or the second authoring user.

11. The system of claim 1, wherein said comparison module configured to compare the first inference data with the second inference data comprises:

a mental state difference determination module configured to determine a difference between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user.

12. The system of claim 1, wherein said presentation module configured to present congruence data indicative of an extent of congruity between the inferred mental state of the first authoring user in connection with one or more first actions, that were performed at least in part by the first authoring user in connection with the particular item, and the inferred mental state of the second authoring user in connection with one or more second actions, that were performed at least in part by the second authoring user in connection with the particular item, based, at least in part, on the comparison of the first inference data with the second inference data comprises:

a transmission module configured to transmit the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user.

13. The system of claim 12, wherein said transmission module configured to transmit congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user comprises:

a transmission module configured to transmit the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user via the electronic document.

14. The system of claim 12, wherein said transmission module configured to transmit the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user comprises:

a transmission module configured to transmit the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user via a network communication interface.

15. The system of claim 14, wherein said transmission module configured to transmit the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user via a network communication interface comprises:

a transmission module configured to transmit the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user to at least one of the first authoring user or the second authoring user via a communication network interface.

16. The system of claim 12, wherein said transmission module configured to transmit the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user comprises:

a transmission module configured to transmit an indication of the one or more first actions that were executed in connection with the particular item and that were performed, at least in part, by the first authoring user.

17. The system of claim 12, wherein said transmission module configured to transmit the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user comprises:

a transmission module configured to transmit an indication of the one or more second actions that were executed in connection with the particular item and that were performed, at least in part, by the second authoring user.

18. The system of claim 1, wherein said presentation module configured to present congruence data indicative of an extent of congruity between the inferred mental state of the first authoring user in connection with one or more first actions, that were performed at least in part by the first authoring user in connection with the particular item, and the inferred mental state of the second authoring user in connection with one or more second actions, that were performed at least in part by the second authoring user in connection with the particular item, based, at least in part, on the comparison of the first inference data with the second inference data comprises:

a display module configured to display the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user via a user interface.

19. The system of claim 18, wherein said display module configured to display the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user via a user interface comprises:

a display module configured to display the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user via a display monitor.

20. The system of claim 18, wherein said display module configured to display the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user via a user interface comprises:

a display module configured to display the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user via a user touch screen.

21. The system of claim 18, wherein said display module configured to display the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user via a user interface comprises:

a display module configured to display the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user via a speaker system.

22. The system of claim 1, wherein said presentation module configured to present congruence data indicative of an extent of congruity between the inferred mental state of the first authoring user in connection with one or more first actions, performed at least in part by the first authoring user, in connection with the particular item and the inferred mental state of the second authoring user in connection with one or more second actions, performed at least in part by the second authoring user, in connection with the particular item based, at least in part, on the comparison of the first inference data with the second inference data comprises:

a display module configured to display the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user via at least one application.

23. The system of claim 22, wherein said display module configured to display the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user via at least one application comprises:

a display module configured to display the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user via at least one of a word processing application, an email application, a text messaging application, an instant messaging (IM) application, an audio application, or a video application.

24. The system of claim 1, wherein said presentation module configured to present congruence data indicative of an extent of congruity between the inferred mental state of the first authoring user in connection with one or more first actions, that were performed at least in part by the first authoring user in connection with the particular item, and the inferred mental state of the second authoring user in connection with one or more second actions, that were performed at least in part by the second authoring user in connection with the particular item, based, at least in part, on the comparison of the first inference data with the second inference data comprises:

a display module configured to display an indication of the one or more first actions that were executed in connection with the particular item and that were performed, at least in part, by the first authoring user.

25. The system of claim 1, wherein said presentation module configured to present congruence data indicative of an extent of congruity between the inferred mental state of the first authoring user in connection with one or more first actions, that were performed at least in part by the first authoring user in connection with the particular item, and the inferred mental state of the second authoring user in connection with one or more second actions, that were performed at least in part by the second authoring user in connection with the particular item, based, at least in part, on the comparison of the first inference data with the second inference data comprises:

a display module configured to display an indication of the one or more second actions that were executed in connection with the particular item and that were performed, at least in part, by the second authoring user.

26. The system of claim 1, wherein said presentation module configured to present congruence data indicative of an extent of congruity between the inferred mental state of the first authoring user in connection with one or more first actions, that were performed at least in part by the first authoring user in connection with the particular item, and the inferred mental state of the second authoring user in connection with one or more second actions, that were performed at least in part by the second authoring user in connection with the particular item, based, at least in part, on the comparison of the first inference data with the second inference data comprises:

a presentation module configured to present a symbolic representation representing the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user.

27. The system of claim 1, wherein said presentation module configured to present congruence data indicative of an extent of congruity between the inferred mental state of the first authoring user in connection with one or more first actions, that were performed at least in part by the first authoring user in connection with the particular item, and the inferred mental state of the second authoring user in connection with one or more second actions, that were performed at least in part by the second authoring user in connection with the particular item, based, at least in part, on the comparison of the first inference data with the second inference data comprises:

a presentation module configured to present a first icon representing an inferred mental state of the first authoring user in proximity with a second icon representing an inferred mental state of the second authoring user.

28. The system of claim 1, wherein said presentation module configured to present congruence data indicative of an extent of congruity between the inferred mental state of the first authoring user in connection with one or more first actions, that were performed at least in part by the first authoring user in connection with the particular item, and the inferred mental state of the second authoring user in connection with one or more second actions, that were performed at least in part by the second authoring user in connection with the particular item, based, at least in part, on the comparison of the first inference data with the second inference data comprises:

a presentation module configured to present a first number representing an inferred mental state of the first authoring user in proximity with a second number representing an inferred mental state of the second authoring user.

29. The system of claim 1, wherein said presentation module configured to present congruence data indicative of an extent of congruity between the inferred mental state of the first authoring user in connection with one or more first actions, that were performed at least in part by the first authoring user in connection with the particular item, and the inferred mental state of the second authoring user in connection with one or more second actions, that were performed at least in part by the second authoring user in connection with the particular item, based, at least in part, on the comparison of the first inference data with the second inference data comprises:

a presentation module configured to present at least one number or icon representing a matching between an inferred mental state of the first authoring user and an inferred mental state of the second authoring user.

30. The system of claim 1, wherein said presentation module configured to present congruence data indicative of an extent of congruity between the inferred mental state of the first authoring user in connection with one or more first actions, that were performed at least in part by the first authoring user in connection with the particular item, and the inferred mental state of the second authoring user in connection with one or more second actions, that were performed at least in part by the second authoring user in connection with the particular item, based, at least in part, on the comparison of the first inference data with the second inference data comprises:

a presentation module configured to present, prior to a transmission of the data indicative of the inferred mental state of the first authoring user or the data indicative of the inferred mental state of the second authoring user, the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user.

31. The system of claim 30, wherein said presentation module configured to present, prior to a transmission of the data indicative of the inferred mental state of the first authoring user or the data indicative of the inferred mental state of the second authoring user, the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user comprises:

a presentation module configured to present to the first authoring user an option to transmit the data indicative of the inferred mental state of the first authoring user or an option not to transmit the data indicative of the inferred mental state of the first authoring user.

32. The system of claim 30, wherein said presentation module configured to present, prior to a transmission of the data indicative of the inferred mental state of the first authoring user or the data indicative of the inferred mental state of the second authoring user, the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user comprises:

a presentation module configured to present to the first authoring user an option to transmit the data indicative of the inferred mental state of the first authoring user or an option to select and transmit data indicative of an alternative mental state for the first authoring user.

33. The system of claim 30, wherein said presentation module configured to present, prior to a transmission of the data indicative of the inferred mental state of the first authoring user or the data indicative of the inferred mental state of the second authoring user, the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user comprises:

a presentation module configured to present to the first authoring user an option to transmit the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user or an option not to transmit the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user.

34. The system of claim 30, wherein said presentation module configured to present, prior to a transmission of the data indicative of the inferred mental state of the first authoring user or the data indicative of the inferred mental state of the second authoring user, the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user comprises:

a presentation module configured to present to the second authoring user an option to transmit the data indicative of the inferred mental state of the second authoring user or an option not to transmit the data indicative of the inferred mental state of the second authoring user.

35. The system of claim 30, wherein said presentation module configured to present, prior to a transmission of the data indicative of the inferred mental state of the first authoring user or the data indicative of the inferred mental state of the second authoring user, the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user comprises:

a presentation module configured to present to the second authoring user an option to transmit the data indicative of the inferred mental state of the second authoring user or an option to select and transmit data indicative of an alternative mental state for the second authoring user.

36. The system of claim 30, wherein said presentation module configured to present, prior to a transmission of the data indicative of the inferred mental state of the first authoring user or the data indicative of the inferred mental state of the second authoring user, the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user comprises:

a presentation module configured to present to the second authoring user an option to transmit the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user or an option not to transmit the congruence data indicative of the extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user.

37. The system of claim 1, further comprising:

an inference data association module configured to associate the first inference data and the second inference data with the particular item.

38. The system of claim 37, wherein said inference data association module configured to associate the first inference data and the second inference data with the particular item comprises:

an inference data inclusion module configured to include into the electronic document the first inference data and the second inference data.

39. The system of claim 38, wherein said inference data inclusion module configured to include into the electronic document the first inference data and the second inference data comprises:

an inference data inclusion module configured to include into the electronic document a first inference data that was obtained based, at least in part, on one or more physical characteristics of the first authoring user sensed during or proximate to an action executed in connection with the particular item and performed, at least in part, by the first authoring user.

40. The system of claim 1, further comprising:

one or more sensors.

41. The system of claim 40, wherein said one or more sensors comprises:

a functional magnetic resonance imaging (fMRI) device.

42. The system of claim 40, wherein said one or more sensors comprises:

a functional near infrared (fNIR) device.

43. The system of claim 40, wherein said one or more sensors comprises:

a magnetoencephalography (MEG) device.

44. The system of claim 40, wherein said one or more sensors comprises:

an electroencephalography (EEG) device.

45. A system, comprising:

circuitry for acquiring inference data including at least a first inference data that indicates an inferred mental state of a first authoring user in connection with a particular item of an electronic document and a second inference data that indicates an inferred mental state of a second authoring user in connection with the particular item of the electronic document;

circuitry for comparing the first inference data with the second inference data; and

circuitry for presenting congruence data indicative of an extent of congruity between the inferred mental state of the first authoring user in connection with one or more first actions that were performed at least in part by the first authoring user in connection with the particular item and the inferred mental state of the second authoring user in connection with one or more second actions that were performed at least in part by the second authoring user in connection with the particular item based, at least in part, on the comparison of the first inference data with the second inference data.

46. An article of manufacture, comprising:

a non-transitory computer storage medium bearing;

one or more instructions for acquiring inference data including at least a first inference data that indicates an inferred mental state of a first authoring user in connection with a particular item of an electronic document and a second inference data that indicates an inferred mental state of a second authoring user in connection with the particular item of the electronic document;

one or more instructions for comparing the first inference data with the second inference data; and

one or more instructions for presenting congruence data indicative of an extent of congruity between the inferred mental state of the first authoring user in connection with one or more first actions that were performed at least in part by the first authoring user in connection with the particular item and the inferred mental state of the second authoring user in connection with one or more second actions that were performed at least in part by the second authoring user in connection with the particular item based, at least in part, on the comparison of the first inference data with the second inference data.

47. A system comprising:

one or more processors;

memory coupled to the one or more processors;

an inference data acquisition module configured to acquire inference data including at least a first inference data that indicates an inferred mental state of a first authoring user in connection with a particular item of an electronic document, the acquired first inference data having been derived at least in part with one or more first sensing devices that sensed one or more characteristics of the first authoring user during and/or proximate to one or more first actions that were performed at least in part by the first authoring user in connection with the particular item, and a second inference data that indicates an inferred mental state of a second authoring user in connection with the particular item of the electronic document, the acquired second inference data having been derived at least in part with one or more second sensing devices that sensed one or more characteristics of the second authoring user during and/or proximate to one or more second actions that were performed at least in part by the second authoring user in connection with the particular item;

a comparison module configured to compare the first inference data with the second inference data; and

a presentation module configured to present data indicative of an extent of congruity between the inferred mental state of the first authoring user and the inferred mental state of the second authoring user based, at least in part, on the comparison of the first inference data with the second inference data.