System and method for dynamically determining the attitude of an author of a natural language document

• US 7,369,985 B2
• Filed: 02/11/2003
• Issued: 05/06/2008
• Est. Priority Date: 02/11/2003
• Status: Expired due to Fees

• Current Assignee: Fuji Xerox Company Limited (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Xerox Company Limited (Fujifilm Holdings Corporation)
• Inventors: Polanyi, Livia, Zaenen, Annie
• Primary Examiner(s): Dorvil; Richemond
• Assistant Examiner(s): SAINT CYR, LEONARD
• Application Number:
  US10/364,208
• Publication Number:
  US 20040158454A1
• Time in Patent Office: 1,911 Days
• Field of Search: None
• US Class Current: 704/8
• CPC Class Codes: G06F 40/253 Grammatical analysis; Style critique

Abstract

A method for adaptively analyzing a natural language document containing at least one lexical item, said analysis to determine an attitude of an author towards an entity, comprising determining at least one actual valence for the at least one lexical item by analyzing the at least one lexical item in context, determining the attitude based on the at least one actual valence, associating the author, the entity and the attitude, and wherein the at least one lexical item encodes attitude information about the entity.

Claims

1. A method for adaptively analyzing a natural language document containing at least one lexical item, said analysis to determine an attitude of an author towards an entity, comprising:

determining at least one actual valence for the at least one lexical item by analyzing the at least one lexical item in context;

determining the attitude based on the at least one actual valence;

associating the author, the entity and the attitude;

wherein the at least one lexical item encodes attitude information about the entity;

determining at least one base valence for the at least one lexical item; and

wherein analyzing the at least one lexical item includes adjusting the at least one base valence based on a contextual valence shifter (CVS) which can have a negative impact on the at least one base valence if the consequences of a not born-out expectation are negative and can have a positive impact on the at least one base valence if the consequences of the not born-out expectation are positive.

2. The method of claim 1 further comprising determining:

at least one additional CVS, where the additional CVS is different from the CVS identified in claim 1, where the additional CVS is one of;

a negator, an intensifier, a connector, a modal, reported speech/thought, an elaboration, and a genre.

3. The method of claim 2 wherein:

the additional negator CVS is a word or phrase that can negate the at least one base valence.

4. The method of claim 2 wherein:

The additional intensifier CVS is a word or phrase used for emphasis or de-emphasis that can strengthen or weaken the at least one base valence, respectively.

5. The method of claim 2 wherein:

the additional connector CVS is a word or phrase that indicates a different point of view and can neutralize or negate the at least one base valence.

6. The method of claim 2 wherein:

the additional modal CVS is a word or phrase that establishes a condition wherein the condition can neutralize or negate the at least one base valence.

7. The method of claim 2 wherein:

the additional reported speech/thought or other linguistic device CVS describes a context in which attitude is ascribed to a second entity rather than the author and can neutralize the at least one base valence with respect to the author.

8. The method of claim 7 wherein:

the additional reported speech/thought CVS does not neutralize the at least one base valence if the author adopts the attitude ascribed to the document entity.

9. The method of claim 2 wherein:

the additional elaboration CVS adjusts the at least one base valence to reflect the valence of at least one elaborating lexical item that elaborates on the lexical item.

10. The method of claim 9 wherein:

a contradiction between the lexical item and the at least one elaborating lexical item can indicate irony.

11. The method of claim 2 wherein:

the additional genre CVS adjusts the base valence using knowledge of expected genre content.

12. The method of claim 11 wherein:

the genre is a movie review.

13. The method of claim 1 wherein:

the at least one base valence represents positive or negative attitudinal information encoded in the lexical item.

14. The method of claim 1 wherein:

determining the at least one base valence is based on taking into account the domain in which the at least one lexical item occurs.

15. The method of claim 1 wherein:

the at least one lexical item can be a contextual valence shifter.

16. A method for adaptively analyzing a natural language document containing at least one lexical item, said analysis to determine an attitude of an author towards an entity, comprising:

determining at least one base valence for the at least one lexical item,

determining at least one actual valence for the at least one lexical item by adjusting the at least one base valence based on at least one contextual valence shifter (CVS) which can have a negative impact on the base valence if the consequences of a not born-out expectation are negative and can have a positive impact on the base valence if the consequences of the not born-out expectation are positive;

determining the attitude based on the at least one actual valence;

associating the author, the entity and the attitude; and

wherein the at least one lexical item encodes attitude information about the entity.

17. The method of claim 16 further comprising determining:

at least one additional CVS, where the additional CVS is different from the CVS identified in claim 16, where the additional CVS is one of;

a negator, an intensifier, a presupposition, a connector, a modal, reported speech/thought, an elaboration, and a genre.

18. The method of claim 17 wherein:

the additional negator CVS is a word or phrase that can negate the at least one base valence.

19. The method of claim 17 wherein:

the additional intensifier CVS is a word or phrase used for emphasis or de-emphasis that can strengthen or weaken the at least one base valence, respectively.

20. The method of claim 17 wherein:

the additional connector CVS is a word or phrase that indicates a different point of view and can neutralize or negate the at least one base valence.

21. The method of claim 17 wherein:

the additional modal CVS is a word or phrase that establishes a condition wherein the condition can neutralize or negate the at least one base valence.

22. The method of claim 17 wherein:

the additional reported speech/thought or other linguistic device CVS describes a context in which attitude is ascribed to a second entity rather than the author and can neutralize the at least one base valence with respect to the author.

23. The method of claim 22 wherein:

the additional reported speech/thought CVS does not neutralize the at least one base valence if the author adopts the attitude ascribed to the document entity.

24. The method of claim 17 wherein:

the additional elaboration CVS adjusts the at least one base valence to reflect the valence of at least one elaborating lexical item that elaborates on the lexical item.

25. The method of claim 24 wherein:

a contradiction between the lexical item and the at least one elaborating lexical item can indicate irony.

26. The method of claim 17 wherein:

the additional genre CVS adjusts the base valence using knowledge of expected genre content.

27. The method of claim 26 wherein:

the genre is a movie review.

28. The method of claim 16 wherein:

the at least one base valence represents positive or negative attitudinal information encoded in the lexical item.

29. The method of claim 16 wherein:

determining the at least one base valence is based on taking into account the domain in which the lexical item occurs.

30. The method of claim 16 wherein:

the at least one lexical item can be a contextual valence shifter.

31. A system for adaptively analyzing a natural language document containing at least one lexical item, said analysis to determine an attitude of an author towards an entity, comprising:

a base valence calculator to determine at least one base valence of the at least one lexical item;

a contextual valence adjuster coupled to the base valence calculator, the contextual valence adjuster to adjust the at least one base valence based on at least one contextual valence shifter (CVS) which can have a negative impact on the base valence if the consequences of a not born-out expectation are negative and can have a positive impact on the base valence if the consequences of the not born-out expectation are positive;

an entity identifier to identity the entity;

an attitude mapper coupled to the entity identifier and the contextual valence adjuster, the attitude mapper to determine the attitude based on the at least one adjusted valence and to associate the author, the entity, and an attitude.

32. The system of claim 31 wherein:

the base valence calculator utilizes a lexical resource; and

wherein the lexical resource provides the at least one base valence of the at least one lexical item.

33. The system of claim 32 wherein:

the lexical resource uses domain information to determine the at least one base valence.

34. The system of claim 31 wherein:

the base valence calculator utilizes domain information to determine a domain for the at least one lexical item.

35. The system of claim 31 further comprising determining:

at least one additional CVS, where the additional CVS is different from the CVS identified in claim 31, where the additional CVS is one of;

a negator, an intensifier, a connector, a modal, reported speech/thought, an elaboration, and a genre.

36. The system of claim 35 wherein:

the additional negator CVS is a word or phrase that can negate the at least one base valence.

37. The system of claim 35 wherein:

the additional intensifier CVS is a word or phrase used for emphasis or de-emphasis that can strengthen or weaken the at least one base valence, respectively.

38. The system of claim 35 wherein:

the additional connector CVS is a word or phrase that indicates a different point of view and can neutralize or negate the at least one base valence.

39. The system of claim 35 wherein:

the additional modal CVS is a word or phrase that establishes a condition wherein the condition can neutralize or negate the at least one base valence.

40. The system of claim 35 wherein:

the additional reported speech/thought or other linguistic device CVS describes a context in which attitude is ascribed to a second entity rather than the author and can neutralize the at least one base valence with respect to the author.

41. The system of claim 40 wherein:

the additional reported speech/thought CVS does not neutralize the at least one base valence if the author adopts the attitude ascribed to the document entity.

42. The system of claim 35 wherein:

the additional elaboration CVS adjusts the at least one base valence to reflect the valence of at least one elaborating lexical item that elaborates on the lexical item.

43. The system of claim 42 wherein:

a contradiction between the lexical item and the at least one elaborating lexical item can indicate irony.

44. The system of claim 35 wherein:

the additional genre CVS adjusts the base valence using knowledge of expected genre content.

45. The system of claim 44 wherein:

the genre is a movie review.

46. The system of claim 31 wherein:

the at least one base valence represents positive or negative attitudinal information encoded in the lexical item.

47. The system of claim 31 wherein:

the at least one lexical item can be a contextual valence shifter.

48. A machine readable medium having instructions stored thereon that when executed by a processor cause a system to:

determine at least one actual valence for the at least one lexical item by analyzing the at least one lexical item in context;

determine the attitude based on the at least one actual valence;

associate the author, the entity and the attitude;

wherein the at least one lexical item encodes attitude information about the entity determining at least one base valence for the at least one lexical item; and

wherein analyzing the at least one lexical item includes adjusting the at least one base valence based on a contextual valence shifter (CVS) which can have a negative impact on the base valence if the consequences of a not born-out expectation are negative and can have a positive impact on the base valence if the consequences of the not born-out expectation are positive.

49. The machine readable medium of claim 48 further comprising instructions for determining:

at least one additional CVS, where the additional CVS is different from the CVS identified in claim 48, where the additional CVS is one of;

a negator, an intensifier, a connector, a modal, reported speech/thought, an elaboration, and a genre.

50. The machine readable medium of claim 49 wherein:

the additional negator CVS is a word or phrase that can negate the at least one base valence.

51. The machine readable medium of claim 49 wherein:

the additional intensifier CVS is a word or phrase used for emphasis or de-emphasis that can strengthen or weaken the at least one base valence, respectively.

52. The machine readable medium of claim 49 wherein:

the additional connector CVS is a word or phrase that indicates a different point of view and can neutralize or negate the at least one base valence.

53. The machine readable medium of claim 49 wherein:

the additional modal CVS is a word or phrase that establishes a condition wherein the condition can neutralize or negate the at least one base valence.

54. The machine readable medium of claim 49 wherein:

the additional reported speech/thought or other linguistic device CVS describes a context in which attitude is ascribed to a second entity rather than the author and can neutralize the at least one base valence with respect to the author.

55. The machine readable medium of claim 54 wherein:

the additional reported speech/thought CVS does not neutralize the at least one base valence if the author adopts the attitude ascribed to the document entity.

56. The machine readable medium of claim 49 wherein:

the additional elaboration CVS adjusts the at least one base valence to reflect the valence of at least one elaborating lexical item that elaborates on the lexical item.

57. The machine readable medium of claim 56 wherein:

a contradiction between the lexical item and the at least one elaborating lexical item can indicate irony.

58. The machine readable medium of claim 49 wherein:

the additional genre CVS can adjust the base valence using knowledge of expected genre content.

59. The machine readable medium of claim 58 wherein:

the genre can be a movie review.

60. The machine readable medium of claim 48 wherein:

the at least one base valence represents positive or negative attitudinal information encoded in the lexical item.

61. The machine readable medium of claim 48 wherein:

determining the at least one base valence is based on taking into account the domain in which the at least one lexical item occurs.

62. The machine readable medium of claim 48 wherein:

the at least one lexical item can be a contextual valence shifter.