SYSTEMS AND METHODS FOR PROVIDING INFORMATION INCORPORATING REINFORCEMENT-BASED LEARNING AND FEEDBACK
First Claim
1. A method, implemented by a computer, for feedback-driven provision of information in relation to a plurality of information resources, the method comprising:
- accessing the information resources from one or more information resource repositories to establish a mapping between each information resource and each of the other information resources;
maintaining a state table comprising a plurality of state-table records, each state-table record attributing a value to a state-action pair, the state-action pair comprising an indication of a series of one or more actions in relation to the information resources;
monitoring actions of a first user in relation to the information resources;
receiving a feedback metric related to interaction of the first user with the information resources;
using the feedback metric as a basis for updating the values of a subset of the state-table records, the subset of the state-table records comprising state-action pairs which correspond to the monitored actions of the first user in relation to the information resources;
providing output information related to the information resources based at least in part on one or more of the updated values of the state-table records.
4 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods are provided for feedback-driven provision of information in relation to a plurality of information resources. Some such methods involve: accessing information resources from one or more information resource repositories to establish a mapping between each information resource and each of the other information resources; maintaining a state table comprising a plurality of state-table records, each state-table record attributing a value to a state-action pair, the state-action pair comprising an indication of a series of one or more actions in relation to the information resources; monitoring actions of a first user in relation to the information resources; receiving a feedback metric related to interaction of the first user with the information resources; using the feedback metric as a basis for updating the values of a subset of the state-table records, the subset of the state-table records comprising state-action pairs which correspond to the monitored actions of the first user in relation to the information resources; and providing output information related to the information resources based at least in part on the updated values of the state-table records.
-
Citations
56 Claims
-
1. A method, implemented by a computer, for feedback-driven provision of information in relation to a plurality of information resources, the method comprising:
-
accessing the information resources from one or more information resource repositories to establish a mapping between each information resource and each of the other information resources; maintaining a state table comprising a plurality of state-table records, each state-table record attributing a value to a state-action pair, the state-action pair comprising an indication of a series of one or more actions in relation to the information resources; monitoring actions of a first user in relation to the information resources; receiving a feedback metric related to interaction of the first user with the information resources; using the feedback metric as a basis for updating the values of a subset of the state-table records, the subset of the state-table records comprising state-action pairs which correspond to the monitored actions of the first user in relation to the information resources; providing output information related to the information resources based at least in part on one or more of the updated values of the state-table records. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54)
-
-
55. A system for providing feedback-driven information in relation to a plurality of information resources, the system comprising:
-
an information resource interface for accessing the information resources from one or more information resource repositories to establish a mapping between each information resource and each of the other information resources; a ranking engine for maintaining a state table comprising a plurality of state-table records, each state-table record attributing a value to a state-action pair, the state-action pair comprising an indication of a series of one or more actions in relation to the information resources; an action interface for monitoring actions of a first user in relation to the information resources; a feedback interface for receiving a feedback metric related to interaction of the first user with the information resources; wherein the ranking engine is configured to use the feedback metric as a basis for updating the values of a subset of the state-table records, the subset of the state-table records comprising state-action pairs which correspond to the monitored actions of the first user in relation to the information resources; and a recommendation engine for providing output information related to the information resources based at least in part on one or more of the updated values of the state-table records.
-
-
56. A computer program product comprising computer-readable instructions carried on a computer readable medium which, when executed by the processor of a suitable computer, cause the computer to perform a method for feedback-driven provision of information in relation to a plurality of information resources, the method comprising:
-
accessing the information resources from one or more information resource repositories to establish a mapping between each information resource and each of the other information resources; maintaining a state table comprising a plurality of state-table records, each state-table record attributing a value to a state-action pair, the state-action pair comprising an indication of a series of one or more actions in relation to the information resources; monitoring actions of a first user in relation to the information resources; receiving a feedback metric related to interaction of the first user with the information resources; using the feedback metric as a basis for updating the values of a subset of the state-table records, the subset of the state-table records comprising state-action pairs which correspond to the monitored actions of the first user in relation to the information resources; providing output information related to the information resources based at least in part on one or more of the updated values of the state-table records.
-
Specification