Joint disambiguation of the meaning of a natural language expression

• US 20110119047A1
• Filed: 11/19/2009
• Published: 05/19/2011
• Est. Priority Date: 11/19/2009
• Status: Abandoned Application

• Current Assignee: Clausal Computing Oy (Tatu Juhani Ylönen)
• Original Assignee: TATU Ylonen OY Limited
• Inventors: Ylonen, Tatu J.
• Application Number:
  US12/622,272
• Publication Number:
  US 20110119047A1
• Time in Patent Office: Days
• US Class Current: 704/9
• CPC Class Codes: G06F 40/30 Semantic analysis

Abstract

At least two ambiguous aspects of the meaning of a natural language expression are disambiguated jointly. In the preferred embodiment, word sense ambiguity, reference ambiguity, and relation ambiguity are resolved simultaneously, finding the disambiguation result(s) that simultaneously optimize the weight of the solution, taking into account semantic information, constraints, and common sense knowledge. Choices are enumerated for each constituent being disambiguated, combinations of choices are constructed and evaluated according to semantic information on which meanings are sensible, and the choices with the best weights are selected, with the enumeration pruned aggressively to reduce computational cost.

Claims

1. A method comprising:

jointly disambiguating, by a computer, more than one ambiguous aspect of the meaning of a natural language expression;

wherein at least one of the ambiguous aspects relates to determining the referent of a constituent of the natural language expression.

2. The method of claim 1, wherein the computer comprises a joint meaning disambiguator and a reference enumerator, and the disambiguator and the enumerator are used in performing the disambiguating.

3. The method of claim 2, wherein the joint disambiguation comprises simultaneously disambiguating:

the referent of at least one constituent having reference ambiguity; and

at least one other ambiguous constituent;

wherein semantic information is used to find the jointly best interpretation for these ambiguities.

4. The method of claim 2, wherein the meaning representation of a reference to an individual comprises a pointer to an object in the knowledge base, and at least one ambiguous aspect relates to the selection of the object.

5. The method of claim 2, wherein at least one of the ambiguous aspects is the interpretation of a determiner.

6. The method of claim 2, wherein jointly disambiguating comprises:

enumerating more than one choice for each of the ambiguous aspects;

computing a weight for a plurality of combinations of choices, each combination comprising one choice for each of the ambiguous aspects and representing an alternative interpretation of the meaning; and

selecting at least one combination with the best weight, and for each selected combination using the choices in the combination to resolve ambiguous aspects of the meaning of the natural language expression.

7. The method of claim 6, wherein the weight is computed in part by evaluating the compatibility of the choices in the combination using semantic information.

8. The method of claim 2, wherein, for at least one enumerator, only a subset of the available choices are enumerated during the joint disambiguation.

9. The method of claim 2, wherein one of the enumerators uses an inference method for finding potential referents for an ambiguous constituent.

10. The method of claim 1, further comprising:

before disambiguation, constructing at least one non-disambiguated semantic representation of the meaning of the natural language expression, said representations together indicating said ambiguous aspects; and

after disambiguation, constructing at least one disambiguated semantic representation of the meaning of the natural language expression based on the disambiguated choices for the ambiguous aspects.

11. The method of claim 10, wherein, in constructing at least one disambiguated representation of the meaning, a disjunctive expression is created for representing the alternative interpretations of a constituent that could not be fully disambiguated.

12. The method of claim 1, wherein jointly disambiguating comprises evaluating a weight for a plurality of combinations of disambiguation choices using a semantic evaluator, wherein:

each combination comprises choices for at least two of said ambiguous aspects;

each combination comprises exactly one choice for each of the at least two of said ambiguous aspects; and

the choices for each of the at least two of said ambiguous aspects have been produced by enumerating at least two choices for the aspect.

13. The method of claim 12, wherein each enumeration is performed using an enumerator selected from the group consisting of:

word sense enumerator, reference enumerator, and relation enumerator.

14. The method of claim 1, wherein the meaning includes an epistemic type for at least one entity, and at least one of the ambiguous aspects is the epistemic type of an entity referenced by a constituent of the natural language expression.

15. The method of claim 1, wherein at least one ambiguous aspect is the referent of an elliptic constituent.

16. The method of claim 1, wherein the meaning representation of an action comprises a pointer to an object representing the action, and at least one ambiguous aspect relates to selecting the object.

17. The method of claim 1, wherein two ambiguous aspects that have the same surface form in the natural language expression can be disambiguated to different meanings.

18. The method of claim 17, wherein each of the aspects corresponds to a constituent of the natural language expression, each constituent comprising at least one full word.

19. The method of claim 1, wherein at least one ambiguous aspect of the meaning relates to selecting of the proper argument for a logical predicate.

20. The method of claim 1, wherein at least one ambiguous aspect of the meaning relates to selecting the proper link type between nodes in a semantic network.

21. The method of claim 1, wherein at least one ambiguous aspect of the meaning relates to selecting the layout of a semantic network used to represent the meaning of the natural language expression or part thereof.

22. The method of claim 1, wherein at least one of the ambiguous aspects is the referent of a noun phrase.

23. The method of claim 1, wherein at least one of the ambiguous aspects is the referent of a verb phrase.

24. The method of claim 1, wherein at least one of the ambiguous aspects is a reference ambiguity, and selecting the appropriate referent uses a restrictive adjective, a prepositional phrase, or a restrictive relative clause to constrain the meaning of the ambiguous aspect.

25. The method of claim 1, wherein extralingual information is used in selecting the referent of a constituent which is one of the ambiguous aspects.

26. The method of claim 25, wherein the extralingual information comprises information obtained through vision about the direction or area pointed to by an agent.

27. The method of claim 1, wherein each of the ambiguous aspects belongs to a different category of ambiguous aspects selected from the group consisting of:

word sense ambiguity, reference ambiguity of noun phrases, reference ambiguity of verb phrases, reference ambiguity of pronouns, determiner interpretation ambiguity, and relation interpretation ambiguity.

28. The method of claim 1, wherein the joint disambiguation selects the best interpretation for the ambiguous aspects based on deep semantic information.

29. The method of claim 28, wherein the deep semantic information comprises information about the typical sequence of events in the kind of situation that is the topic of the natural language expression.

30. The method of claim 28, wherein the deep semantic information comprises information about the intellectual capabilities of the various agents and objects belonging to the context of the natural language expression.

31. The method of claim 28, wherein the deep semantic information comprises information about what the other party in the conversation that the natural language expression belongs to knows.

32. The method of claim 1, wherein the joint disambiguation selects the best interpretation for the ambiguous aspects in part by applying a semantic constraint to the choices for more than ambiguous aspect simultaneously.

33. The method of claim 32, wherein at least one semantic constraint specifies allowable thematic roles for a noun.

34. The method of claim 32, wherein at least one semantic constraint specifies what kind of nouns an adjective may characterize.

35. The method of claim 32, wherein at least one semantic constraint limits the combinations of verbs with adverbials.

38. The method of claim 1, wherein the application of joint disambiguation is controlled by the grammar.

36. The method of 1, wherein at least one ambiguous aspect is partially disambiguated.

37. The method of 36, wherein at least some choices for an ambiguous aspect are arranged into a hierarchy of choices, and intermediate nodes in the hierarchy are possible partial disambiguations for the ambiguous aspect.

39. The method of 38, wherein the grammar causes joint disambiguation to be performed in a nested fashion for parts of the same natural language expression.

40. The method of 1, wherein the joint disambiguation adjusts the weight of a combination of choices in more than one place.

41. The method of 1, further comprising:

pruning the generation of combinations in response to determining that the weight of any combination resulting from a branch of the generation process cannot become sufficient for it to be selected as one of the best combinations.

42. A method comprising:

reading and preprocessing, by a computer, a natural language expression from an input;

parsing, by the computer, the natural language expression or part thereof, creating a preliminary semantic representation of its meaning, said representation comprising more than one ambiguity;

disambiguating, by the computer, ambiguities in the preliminary semantic representation; and

constructing, by the computer, a semantic representation of the meaning of the natural language expression, wherein at least some of the ambiguities of the preliminary semantic representation have been resolved;

wherein the improvement comprises performing the disambiguation by jointly disambiguating more than one of the ambiguities.

43. The method of claim 42, wherein the computer comprises a joint meaning disambiguator used for the joint disambiguation.

44. The method of claim 43, wherein jointly disambiguating comprises resolving the reference of at least one constituent of the natural language expression using particular choices for other ambiguities and semantic information to constrain the possible referents.

45. The method of claim 42, wherein at least one of the ambiguities is the referent of a pronoun.

46. The method of claim 42, wherein jointly disambiguating more than one ambiguity comprises:

generating combinations of choices, each combination comprising one choice for each of the ambiguities; and

evaluating at least one of the combinations using semantic information such that the weight computed for a combination depends on more than one choice.

47. An apparatus comprising:

a joint meaning disambiguator (115) comprising;

at least one reference enumerator (117);

at least one combinator (119) coupled to at least one of the reference enumerators for receiving choices from the reference enumerator; and

at least one semantic evaluator (120) configured to compute a weight for at least one combination generated by at least one of the combinators.

48. The apparatus of claim 47, wherein the apparatus is a computer.

49. The apparatus of claim 48, wherein the joint meaning disambiguator comprises:

a relation enumerator; and

a word sense enumerator.

50. The apparatus of claim 47, wherein the apparatus is a robot equipped with a natural language interface implemented in part using the joint meaning disambiguator.

51. The apparatus of claim 47, wherein the apparatus is a home, business, or mobile appliance equipped with a natural language interface implemented in part using the joint meaning disambiguator.

52. A computer comprising:

a means for parsing a natural language expression; and

a means for jointly disambiguating at least two ambiguous aspects of the meaning of the parsed natural language expression.

53. The computer of claim 52, further comprising:

a means for enumerating choices for the referent of a constituent of the natural language expression for use in the means for jointly disambiguating.

54. The computer of claim 53, further comprising:

a means for semantically evaluating combinations of choices from different enumerations.

55. A computer program product stored on a tangible computer readable medium, operable to cause a computer to jointly disambiguate more than one ambiguous aspect of the meaning of a natural language expression, the product comprising:

a computer executable program code means for parsing a natural language expression; and

a computer executable program code means for jointly disambiguating more than one ambiguous aspect of the meaning of the parsed natural language expression.

56. The computer program product of claim 55, further comprising:

a computer executable program code means for enumerating choices for the referent of a constituent of a natural language expression, the referent being one of the ambiguous aspects.

57. The computer program product of claim 56, further comprising:

a computer executable program code means for semantically evaluating combinations of enumerated choices for the ambiguous aspects.