SYSTEMS AND METHODS FOR PLANNING
First Claim
1. A computer-implemented method of identifying a preferred plan, comprising:
- modeling one or more plans, each plan having a respective plurality of states and a respective plurality of transitions between the states;
generating a respective state transition probability matrix associated with each one of the one or more plans, each respective state transition probability matrix having respective state transition probability matrix values, each state transition probability matrix value corresponding to a respective probability that performing a respective action will result in a respective state transition;
generating a respective observation probability matrix associated with each one of the one or more plans, each respective observation probability matrix having respective observation probability matrix values, each observation probability matrix value corresponding to a respective probability of obtaining a respective observation in response to a respective action;
identifying a respective plurality of state histories associated with each one of the one or more plans, each state history having a respective plurality of states;
computing a respective quality value for each state history of the plurality of state histories;
computing a respective expected value for each plan of the one or more plans; and
identifying at least one of a preferred plan from among the one or more plans in accordance with the expected values of each plan of the one or more plans, or a preferred state history from among the respective plurality of state histories within the identified preferred plan, wherein the preferred state history is identified in accordance with the quality values.
1 Assignment
0 Petitions
Accused Products
Abstract
A computer-implemented method of identifying a preferred plan includes modeling one or more plans, each plan having a respective plurality of states and a respective plurality of transitions between the states, generating a respective state transition probability matrix associated with each one of the one or more plans, and generating a respective observation probability matrix associated with each one of the one or more plans. A respective plurality of state histories is identified and a respective quality value for is computed for each state history. A respective expected value is computed for each plan. A preferred plan is identified in accordance with the expected values. A preferred state history is identified in accordance with the quality values. A computer-readable storage medium and a system having a computer-readable storage medium are also provided, each of which is encoded with instructions for performing the method.
-
Citations
31 Claims
-
1. A computer-implemented method of identifying a preferred plan, comprising:
-
modeling one or more plans, each plan having a respective plurality of states and a respective plurality of transitions between the states; generating a respective state transition probability matrix associated with each one of the one or more plans, each respective state transition probability matrix having respective state transition probability matrix values, each state transition probability matrix value corresponding to a respective probability that performing a respective action will result in a respective state transition; generating a respective observation probability matrix associated with each one of the one or more plans, each respective observation probability matrix having respective observation probability matrix values, each observation probability matrix value corresponding to a respective probability of obtaining a respective observation in response to a respective action; identifying a respective plurality of state histories associated with each one of the one or more plans, each state history having a respective plurality of states; computing a respective quality value for each state history of the plurality of state histories; computing a respective expected value for each plan of the one or more plans; and identifying at least one of a preferred plan from among the one or more plans in accordance with the expected values of each plan of the one or more plans, or a preferred state history from among the respective plurality of state histories within the identified preferred plan, wherein the preferred state history is identified in accordance with the quality values. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A computer-readable storage medium encoded with computer-readable code, comprising instructions for:
-
modeling one or more plans, each plan having a respective plurality of states and a respective plurality of transitions between the states; generating a respective state transition probability matrix associated with each one of the one or more plans, each respective state transition probability matrix having respective state transition probability matrix values, each state transition probability matrix value corresponding to a respective probability that performing a respective action will result in a respective state transition; generating a respective observation probability matrix associated with each one of the one or more plans, each respective observation probability matrix having respective observation probability matrix values, each observation probability matrix value corresponding to a respective probability of obtaining a respective observation in response to a respective action; identifying a respective plurality of state histories associated with each one of the one or more plans, each state history having a respective plurality of states; computing a respective quality value for each state history of the plurality of state histories; computing a respective expected value for each plan of the one or more plans; and identifying at least one more of a preferred plan from among the one or more plans in accordance with the expected values of each plan of the one or more plans, or a preferred state history from among the respective plurality of state histories within the identified preferred plan, wherein the preferred state history is identified in accordance with the quality values. - View Dependent Claims (15, 16, 17, 18, 19, 20, 21, 22)
-
-
23. A system, comprising:
-
a computer processor; and a computer-readable memory coupled to the computer processor, wherein the computer-readable memory is encoded with computer-readable code, the computer-readable code comprising instructions for; modeling one or more plans, each plan having a respective plurality of states and a respective plurality of transitions between the states; generating a respective state transition probability matrix associated with each one of the one or more plans, each respective state transition probability matrix having respective state transition probability matrix values, each state transition probability matrix value corresponding to a respective probability that performing a respective action will result in a respective state transition; generating a respective observation probability matrix associated with each one of the one or more plans, each respective observation probability matrix having respective observation probability matrix values, each observation probability matrix value corresponding to a respective probability of obtaining a respective observation in response to a respective action; identifying a respective plurality of state histories associated with each one of the one or more plans, each state history having a respective plurality of states; computing a respective quality value for each state history of the plurality of state histories; computing a respective expected value for each plan of the one or more plans; and identifying at least one of a preferred plan from among the one or more plans in accordance with the expected values of each plan of the one or more plans, or a preferred state history from among the respective plurality of state histories within the identified preferred plan, wherein the preferred state history is identified in accordance with the quality values. - View Dependent Claims (24, 25, 26, 27, 28, 29, 30, 31)
-
Specification