System and method for analyzing and improving a discourse engaged in by a number of interacting agents

• US 20050246165A1
• Filed: 12/06/2004
• Published: 11/03/2005
• Est. Priority Date: 04/29/2004
• Status: Abandoned Application

• Current Assignee: Qualia, Inc.
• Original Assignee: Qualia, Inc.
• Inventors: Alexander, Daniel, Pettinelli, Eugene E.
• Application Number:
  US11/005,872
• Publication Number:
  US 20050246165A1
• Time in Patent Office: Days
• US Class Current: 704/207
• CPC Class Codes: G10L 15/1807 using prosody or stress

Abstract

A computerized method of analyzing a discourse engaged in by a plurality of interacting agents includes measuring a first set of prosodic features associated with the discourse and, at least partially based on the first set of measured prosodic features, determining a target set of prosodic features that are likelier to be associated with a target state and/or characteristic of the discourse than the first set of prosodic features. The method optionally includes providing the agents with feedback aimed at steering the discourse toward a desirable outcome. Optionally, the method includes imposing a constraint on a subset of the agents to force a behavioral modification upon the subset of the agents to increase the likelihood of the desirable outcome.

Claims

1. A computerized method of analyzing a discourse engaged in by a plurality of interacting agents, comprising:

a. during a first time interval, measuring a first set of prosodic features associated with the discourse; and

b. at least partially based on the first set, determining a target set of prosodic features, wherein the target set is likelier to be associated with a target state of the discourse than the first set.

2. The method of claim 1, including suggesting to a subset of the agents a behavior for increasing a likelihood of producing the target state.

3. The method of claim 2, wherein the suggesting includes at least one of recommending content, emphasizing a subject for the discourse, interacting according to a particular style, level and nature of detail.

4. The method of claim 2, wherein the behavior includes a prosodic behavior.

5. The method of claim 4, including determining a difference between the suggested prosodic behavior and a prosodic behavior implemented at least partially in response to the suggested prosodic behavior by the subset of the agents.

6. The method of claim 5, including suggesting to the subset of the agents, and based at least partially on the difference between the suggested prosodic behavior and the prosodic behavior implemented by the subset of the agents, a modification to the implemented behavior for increasing the likelihood of producing the target state.

7. The method of claim 1, including predicting a state of the discourse based at least partially on the first set of prosodic features.

8. The method of claim 7, including, based at least partially on the predicted state, suggesting to a subset of the agents a prosodic behavior for increasing a likelihood of producing the target state.

9. The method of claim 1, including applying a stimulus to a subset of the agents for modifying a prosodic behavior of the subset of the agents, to at least approximately produce a subset of the target set of prosodic features, thereby increasing the likelihood of producing the target state.

10. The method of claim 9, including predicting a reaction of the subset of the agents to the stimulus.

11. The method of claim 9, wherein applying the stimulus includes conveying feedback to a subset of the agents.

12. The method of claim 11, wherein the feedback includes information associated with a combination of a subset of the first set of prosodic features, a subset of the target set of prosodic features, a difference between the first set of prosodic features and the target set of prosodic features, a prosodic modification sufficient for producing the target state, a prosodic modification necessary for producing the target state, and a prosodic modification for increasing a likelihood of producing the target state.

13. The method of claim 11, wherein the feedback includes a subset of auditive feedback, visual feedback, tactile feedback, olfactory feedback, gustatory feedback, synthetically-generated feedback, mechanical feedback, physical feedback, and electrical feedback.

14. The method of claim 1, including imposing, at least partially in response to the first set of prosodic features, a constraint on the discourse to at least approximately produce the target set of prosodic features, thereby increasing the likelihood of producing the target state.

15. The method of claim 14, wherein imposing the constraint includes changing an environmental characteristic associated with the discourse.

16. The method of claim 1, including determining from the first set of prosodic features at least one characteristic of the discourse associated with a combination of an emotional state, attitude, a physical state, truthfulness, cooperation, deference, affection, compatibility, trust, interactive dominance, a measure of success, a measure of failure, enthusiasm, interest, influence, agreement, respect, empathy, compliance, and a mental state.

17. The method of claim 1, including measuring, during at least one other time interval, at least one other set of prosodic features associated with the discourse.

18. The method of claim 17, including determining, based on the first set of prosodic features and the at least one other set of prosodic features, a trend in at least one characteristic of the discourse.

19. The method of claim 17, including updating, based on the first set of prosodic features and the at least one other set of prosodic features, an estimate of a prosodic behavior associated with a subset of the agents.

20. The method of claim 1, including compiling information associated with a correlation between the target state and a benchmark prosodic feature.

21. The method of claim 20, wherein the correlation includes a statistical correlation.

22. The method of claim 21, wherein the compiled information includes information about a likelihood that the benchmark prosodic feature produces the target state.

23. The method of claim 1, including determining at least one set of intermediate prosodic features likelier to be associated with the target state than the first set, but at most as likely to be associated with the target state as the target set.

24. The method of claim 1, wherein a subset of at least one of the first set of prosodic features and the target set of prosodic features includes an auditive prosodic feature.

25. The method of claim 24, wherein the auditive prosodic feature includes a discourse characteristic associated with a combination of turn-taking, interruptions, percent airtime, voice shakiness, mutual prosodic harmony, voice pitch, voice energy, voice volume, speaking rate, voiced speech statistics, unvoiced speech statistics, response time, accent, speech intonations, voice fundamental frequency, voice phonemes, vocal stress, voice nasalization, suprasegmental voice features, and subsegmental voice features.

26. The method of claim 1, wherein a subset of at least one of the first set of prosodic features and the target set of prosodic features includes a visual prosodic feature.

27. The method of claim 26, wherein the visual prosodic feature includes a discourse characteristic associated with a combination of a facial expression, a head movement, a gaze, a body gesture, and a posture.

28. The method of claim 1, wherein a subset of at least one of the first set of prosodic features and the target set of prosodic features includes an audiovisual prosodic feature.

29. The method of claim 1, wherein the target state is determined at least partially based on a desirable outcome for the discourse.

30. The method of claim 1, wherein the target state is determined at least partially based on an undesirable outcome for the discourse.

31. A computerized method of analyzing a discourse engaged in by a plurality of interacting agents, comprising:

a. during a first time interval, measuring a first set of prosodic features associated with the discourse; and

b. at least partially based on the first set, suggesting to a subset of the agents a behavior for increasing a likelihood of producing a target state of the discourse.

32. The method of claim 31, wherein the suggesting includes at least one of recommending content, emphasizing a subject, interacting according to a particular style, level and nature of detail.

33. The method of claim 31, wherein the behavior includes a prosodic behavior.

34. The method of claim 33, wherein the prosodic behavior causes a change in a subset of the prosodic features.

35. The method of claim 33, wherein the prosodic behavior includes addition, to the first set of prosodic features, of an additional prosodic feature.

36. The method of claim 33, wherein the prosodic behavior includes a deletion of a subset of the prosodic features.

37. A computerized method of analyzing a discourse engaged in by a plurality of interacting agents, comprising:

a. during a first time interval, measuring a first set of prosodic features associated with the discourse;

b. at least partially based on the first set, determining a first state of the discourse associated with the first set; and

c. determining a change in the first set likely to incline the discourse away from the first state and toward a target state.

38. The method of claim 37, including conveying the change in the first set to a subset of the agents.

39. The method of claim 37, wherein determining the first state includes estimating the first state.

40. The method of claim 37, wherein determining the first state includes classifying the discourse by matching the first set of prosodic features to a subset of predetermined classes of prosodic behaviors.

41. The method of claim 40, wherein the classes of prosodic behaviors includes a previous prosodic behavior of a subset of the agents.

42. The method of claim 40, including determining a variation in a subset of the first set of prosodic features, the variation likely to change the matching.

43. The method of claim 37, including conveying to at least one of the agents information associated with the first state.

44. The method of claim 37, including conveying to at least one of the agents information associated with the target state.

45. The method of claim 37, including conveying to at least one of the agents information associated with at least a portion of the determined change in the subset of prosodic features.

46. The method of claim 37, including determining a variation in a subset of the prosodic features, the variation likely to change the first state.

47. A computerized method of selecting a subset of agents to participate in a discourse, comprising:

a. profiling a prosodic behavior of the agents based on at least one previous discourse engaged in by at least one of the agents; and

b. based at least partially on the profiling, selecting the subset of the agents having an associated prosodic behavior likely to produce a target state of the discourse.