Context reactive hints mechanism for natural language user interface

• US 20060168335A1
• Filed: 03/30/2005
• Published: 07/27/2006
• Est. Priority Date: 06/15/1998
• Status: Active Grant

• Current Assignee: iAnywhere Solutions Incorporated (SAP SE)
• Original Assignee: iAnywhere Solutions Incorporated (SAP SE)
• Inventors: Hodjat, Babak, Treadgold, Nicholas K., Hodjat, Siamak
• Granted Patent: US 7,565,397 B2
• Time in Patent Office: Days
• US Class Current: 709/239
• CPC Class Codes: G06F 40/174 Form filling; Merging
• CPC Class Codes: G06F 40/30 Semantic analysis

Abstract

Roughly described, a context reactive user interface which offers user-selectable on-screen choices or hints to help the user follow up in the context of his or her previous interactions. Alternatively or additionally, the system can offer on-screen choices which, when selected by the user, can invoke one or more back-end applications with entry fields pre-filled from the user'"'"'s previous interactions or from other contextual information.

Claims

1. A user interface method, comprising the steps of:

providing a network of agents;

developing a first interpretation path through the network in dependence upon the content of user input, the first interpretation path including a first agent and a second agent immediately downchain from the first agent;

developing a first alternative path through the network, the first alternative path including the second agent and a third agent immediately upchain from the second agent and different from the first agent; and

offering the first alternative path to the user for potential follow-up.

2. A method according to claim 1, wherein the second agent is immediately downchain from the first agent, and wherein the third agent is immediately upchain from the second agent.

3. A method according to claim 1, further comprising the steps of:

developing a second alternative path through the network, the second alternative path including the second agent and a fourth agent immediately upchain from the second agent and different from both the first and third agents; and

offering the second alternative path to the user for potential follow-up.

4. A method according to claim 1, further comprising the step of developing a second interpretation path through the network in dependence upon the content of the user input, the second interpretation path including a fourth agent and a fifth agent downchain from the fourth agent,

wherein the first alternative path contains at least one agent not in the second interpretation path,

and wherein the second interpretation path contains at least one agent not in the first alternative path.

5. A method according to claim 1, further comprising the steps of:

developing a second alternative path through the network, the second alternative path including fourth and fifth agents, the fourth agent being downchain of the second agent, and the fifth agent being upchain from the fourth agent and different from the first agent, all of the first through fifth agents being different agents; and

offering the second alternative path to the user for potential follow-up.

6. A method according to claim 1, further comprising the steps of:

developing a second alternative path through the network, the second alternative path including fourth and fifth agents, the fourth agent being downchain of the second agent and the fifth agent being upchain from the fourth agent and different from the first, second and third agents; and

offering the second alternative path to the user for potential follow-up.

7. A method according to claim 6, wherein the fourth agent is immediately downchain of the second agent and the fifth agent is immediately upchain from the fourth agent.

8. A method according to claim 1, further comprising the steps of:

developing a second alternative path through the network, the second alternative path including fifth, sixth and seventh agents, the fifth agent being downchain from a fourth agent which is downchain of the second agent, the sixth agent being upchain from the fifth agent and the seventh agent being upchain from the sixth agent;

all of the first through seventh agents being different agents; and

offering the second alternative path to the user for potential follow-up.

9. A method according to claim 8, wherein the fourth agent is immediately downchain from the second agent, the fifth agent is immediately downchain from the fourth agent, the sixth agent is immediately upchain from the fifth agent, and the seventh agent is immediately upchain from the sixth agent.

10. A method according to claim 1, wherein the second agent has a group name associated with it, further comprising the steps of:

developing a second alternative path through the network, the second alternative path including fourth and fifth agents, the fourth agent having a group name associated with it which matches that of the second agent, and the fifth agent being upchain from the fourth agent, the first through fifth agents being different agents; and

offering the second alternative path to the user for potential follow-up.

11. A method according to claim 10, wherein the fifth agent is immediately upchain from the fourth agent.

12. A method according to claim 1, further comprising the steps of:

developing a second alternative path through the network, the second alternative path including fifth and sixth agents, the fifth agent sharing a common group name as a fourth agent which is downchain of the second agent, the sixth agent being upchain from the fifth agent, all of the first through sixth agents being different agents; and

offering the second alternative path to the user for potential follow-up.

13. A method according to claim 1, further comprising the steps of:

developing a second alternative path through the network, the second alternative path including fifth, sixth and seventh agents, the fifth agent sharing a common group name as a fourth agent which is downchain of the second agent, the sixth agent being upchain from the fifth agent and the seventh agent being upchain from the sixth agent;

all of the first through seventh agents being different agents; and

offering the second alternative path to the user for potential follow-up.

14. A method according to claim 1, wherein the first interpretation path includes no agents downchain of the second agent, further comprising the steps of:

developing a second alternative path through the network, the second alternative path including the first agent, the second agent and a fourth agent downchain from the second agent; and

offering the second alternative path to the user for potential follow-up.

15. A method according to claim 1, wherein the network comprises a plurality of agents including the first, second and third agents, each agent in the plurality having at least one interpretation policy having a policy condition, each of the interpretation policies making a claim on at least part of a message provided to the agent if the condition of the interpretation policy is satisfied, wherein each agent that has immediately downchain agents includes a reference in its policy conditions to any claims made by the immediately downchain agents, and wherein the step of developing a first interpretation path comprises the steps of:

providing a message identifying the user input to a particular one of the agents in the plurality;

each agent receiving the message forwarding it to each of its immediately downchain agents;

each agent receiving the message responding with any claims made by its interpretation policies; and

the particular agent determining a first winning claim from among all claims returned to it from its immediately downchain agents, the first interpretation path including all agents that contributed to the winning claim.

16. A method according to claim 15, wherein the user input comprises a plurality of tokens.

17. A method according to claim 16, wherein each of said tokens comprises text.

18. A method according to claim 15, wherein a given one of the interpretation policy conditions comprises a list of at least a given token,

and wherein the given interpretation policy makes a claim on the message in response to detection that the user input contains a token matching the given token.

22. A method according to claim 21, wherein each of the agents has a respective semantic domain,

wherein the semantic domains of the agents of the first type represent commands, the semantic domains of the agents of the second type represent objects, and the semantic domains of the agents of the third type represent object fields.

19. A user interface method, for use with an application that accepts commands which operate on objects containing fields, comprising the steps of:

developing a first interpretation of at least a first portion of user input, the first interpretation including a plurality of elements including a first command element and a first object element; and

in dependence upon the first interpretation, offering to the user a first follow-up which includes a member of the group consisting of;

(a) the first command element and a second object element different from the first object element, and (b) the first object element and a second command element different from the first command element.

20. A method according to claim 19, further comprising the step of developing a second interpretation of a second portion of the user input, the second interpretation including a plurality of elements including a command element and an object element;

and

offering to the user a second follow-up which includes an element of the second interpretation, but which differs from the second interpretation in exactly one of the group consisting of the command, the object and a field element of the second interpretation, and which differs from the first follow-up.

21. A user interface method, comprising the steps of:

providing a network of agents, the network including a root node, a plurality of agents of a first type each downchain from the root node, a plurality of agents of a second type each downchain from at least one of the agents of the first type, and a plurality of agents of a third type each downchain from at least one of the agents of the second type;

developing a set of at least one interpretation path through the network in dependence upon the content of user input, each of the paths in the set including at least one agent in the network;

in dependence upon the set of interpretation paths, developing a set of alternative paths through the network, each of the alternative paths differing from all the paths in the set of interpretation paths in at least one of the agent types; and

offering at least one of the alternative paths to the user for potential follow-up.

23. A method according to claim 21, wherein each of the agents has at least one interpretation policy, and is operable to return a claim on at least part of user input provided to it if one of the agent'"'"'s interpretation policies is satisfied, a least a particular one of the agents having a particular interpretation policy that depends on any claims made by an agent immediately downchain of the particular agent, the agents being operable such that each claim made by an agent identifies any further downchain agents upon which the claim depends, the chain of agents contributing to a claim defining a path through the network, and wherein the step of developing a set of at least one interpretation path through the network comprises the steps of:

the root node providing the user input to agents immediately downchain of the root agent in the network;

the root node receiving at least one claim returned from the agents immediately downchain of the root agent; and

selecting the set of interpretation paths from among all the claims received in the step of receiving.

24. A method according to claim 23, wherein agents of the first type claim portions of user input interpreted as commands and agents of the second type claim portions of user input interpreted as objects on which the commands can operate,

wherein one of the interpretation paths identifies a first agent of the first type,

and wherein the step of developing a set of alternative paths comprises the step of forming a path identifying the first agent and at least one agent of the second type which is downchain of the first agent and not included in the one interpretation path.

25. A method according to claim 24, wherein the step of developing a set of alternative paths comprises the step of forming a plurality of alternative paths which collectively include all agents of the second type which are immediately downchain from the first agent and not included in the one interpretation path.

26. A method according to claim 23, wherein agents of the second type claim portions of user input interpreted as objects on which commands can operate, and wherein agents of the third type claim portions of user input interpreted as fields of the objects,

wherein one of the interpretation paths identifies a second agent of the second type,

and wherein the step of developing a set of alternative paths comprises the step of forming a path identifying the second agent and at least one agent of the third type which is downchain of the second agent and not included in the one interpretation path.

27. A method according to claim 23, wherein agents of the first type claim portions of user input interpreted as commands and agents of the second type claim portions of user input interpreted as objects on which the commands can operate,

wherein one of the interpretation paths identifies a second agent of the second type, and wherein the step of developing a set of alternative paths comprises the step of forming a path identifying the second agent and at least one agent of the first type which is upchain of the second agent and not included in the one interpretation path.

28. A method according to claim 27, wherein the step of developing a set of alternative paths comprises the step of forming a plurality of alternative paths which collectively include all agents of the first type which are upchain from the second agent and not included in the one interpretation path.

29. A method according to claim 23, wherein agents of the first type claim portions of user input interpreted as commands and agents of the second type claim portions of user input interpreted as objects on which the commands can operate,

wherein one of the interpretation paths identifies a second agent of the second type,

and wherein the step of developing a set of alternative paths comprises the step of forming a path identifying a third agent of the second type, the third agent being downchain of the second agent, and a forth agent of the first type which is upchain of the third agent,

wherein at least one of the third and fourth agents is not included in the one interpretation path.

30. A method according to claim 23, wherein agents of the first type claim portions of user input interpreted as commands and agents of the second type claim portions of user input interpreted as objects on which the commands can operate,

wherein one of the interpretation paths identifies a second agent of the second type, and wherein the step of developing a set of alternative paths comprises the step of forming a path identifying:

a third agent of the second type, the third agent being downchain of the second agent;

a fourth agent of the second type, the fourth agent being upchain of the third agent; and

a fifth agent of the first type which is upchain of the fourth agent,

wherein at least one of the third, fourth and fifth agents is not included in the one interpretation path.

31. A method according to claim 23, wherein agents of the first type claim portions of user input interpreted as commands and agents of the second type claim portions of user input interpreted as objects on which the commands can operate,

wherein one of the interpretation paths identifies a second agent of the second type, and wherein the step of developing a set of alternative paths comprises the step of forming a path identifying a third agent of the second type and a fourth agent of the first type which is upchain of the third agent, the third agent being different from the second agent and sharing a common group attribute with the second agent,

wherein at least one of the third and fourth agents is not included in the one interpretation path.

32. A method according to claim 23, wherein agents of the first type claim portions of user input interpreted as commands and agents of the second type claim portions of user input interpreted as objects on which the commands can operate,

wherein one of the interpretation paths identifies a second agent of the second type, and a third agent of the second type downchain of the second agent,

and wherein the step of developing a set of alternative paths comprises the step of forming a path identifying a fourth agent of the second type, the fourth agent being different from and sharing a common group attribute with the third agent, and a fifth agent of the first type which is upchain of the fourth agent,

wherein at least one of the fourth and fifth agents is not included in the one interpretation path.

33. A method according to claim 23, wherein agents of the first type claim portions of user input interpreted as commands and agents of the second type claim portions of user input interpreted as objects on which the commands can operate,

wherein one of the interpretation paths identifies a second agent of the second type, and wherein the step of developing a set of alternative paths comprises the step of forming a path identifying:

a fourth agent of the second type, the fourth agent being different from and sharing a common group attribute with a third agent of the second type which is downchain from the second agent;

a fifth agent of the second type, the fifth agent being upchain of the fourth agent; and

a sixth agent of the first type which is upchain of the fifth agent,

wherein at least one of the fourth, fifth and sixth agents is not included in the one interpretation path.

34. A method according to claim 21, wherein the step of offering an alternative path to the user comprises the step of identifying to the user a keyword associated with the at least one agent identified in the alternative path and not in the one interpretation path.

35. A method according to claim 21, wherein the step of offering an alternative path to the user comprises the step of identifying to the user an icon associated with the at least one agent identified in the alternative path and not in the one interpretation path.

36. A method according to claim 21, wherein the step of offering an alternative path to the user comprises the step of identifying to the user potential user input including both an agent included in both the one interpretation path and the alternative path, and an agent included in the alternative path and not in the one interpretation path.

37. A user interface method, comprising the steps of:

providing a network of agents;

developing a first interpretation path through the network in dependence upon the content of user input, the first interpretation path including a first agent and a second agent downchain from the first agent;

developing a first alternative path through the network, the first alternative path including a third agent and a fourth agent, the third agent being different from and sharing a common group attribute with the second agent, and the fourth agent being upchain of the third agent, the first alternative path different by at least one agent from the first interpretation path; and

offering the first alternative path to the user for potential follow-up.

38. A user interface method, for use with an application that accepts commands, comprising the steps of:

providing a database identifying semantic relationships among user input semantic domains;

developing a first interpretation of at least a portion of first user input, in dependence upon the database; and

in dependence upon the first interpretation, and the semantic relationships identified in the database, offering to the user a first follow-up.

39. A method according to claim 38, further comprising the step of issuing a command toward the application in dependence upon the first interpretation.

40. A method according to claim 38, further comprising the steps of:

developing a second interpretation of at least a portion of second user input, received after the step of offering; and

issuing a command toward the application in dependence upon the second interpretation.

41. A method according to claim 38, wherein the semantic relationships identified in the database correspond to relationships among at least a subset of:

objects of the application, fields of the objects, and commands that can be performed on the objects by the application.