Maintenance of information retrieval systems using global metrics
First Claim
1. A process for measuring the performance of an information retrieval system comprising a repository of content items associated with a search mechanism that returns a rank for retrieved content items, said process comprising:
- when a content item is accessed by a user, recording an appreciation assigned by the user to that content item, wherein the appreciation takes the form of a flag being capable of being set at least positive or not positive;
and using the recorded appreciations to calculate at least a first metric representative of, or derived from, a ratio of positive to non-positive appreciations for the repository and a second metric representing, or derived from, an average rank of the content items when each such content item receive positive appreciations.
1 Assignment
0 Petitions
Accused Products
Abstract
Process for measuring the performance of a information retrieval system comprising a repository of documents or files associated with a search engine; said process involving the steps of:
recording the individual appreciation or flags individually assigned by the users to the documents being output to the users;
computing at least a first and a second metrics respectively representative of the number of positive flags and the rank of the documents having received positive flags and monitoring changes to said at least first and second metrics;
displaying information to the user in response to the detection of changes brought to said first and second metrics. There is also provided an improved maintenance process of a repository of documents.
11 Citations
20 Claims
-
1. A process for measuring the performance of an information retrieval system comprising a repository of content items associated with a search mechanism that returns a rank for retrieved content items, said process comprising:
-
when a content item is accessed by a user, recording an appreciation assigned by the user to that content item, wherein the appreciation takes the form of a flag being capable of being set at least positive or not positive;
and using the recorded appreciations to calculate at least a first metric representative of, or derived from, a ratio of positive to non-positive appreciations for the repository and a second metric representing, or derived from, an average rank of the content items when each such content item receive positive appreciations. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A process for maintaining a repository of documents having a search engine for outputting lists of documents in response to a query, said process comprising the following steps:
-
recording the individual appreciation or flags individually assigned by the users;
repeatedly computing at least a first and a second metric representative of the relevance of said repository;
said first metric being computed from the number of documents having received positive flags from the users and said second metric being representative of the average rank of the documents having received positive flags;
controlling an action brought to said repository in response to a change in said first or said second metrics. - View Dependent Claims (8, 9, 10, 11)
-
-
12. An information retrieval system comprising:
-
a repository of content items associated with a search mechanism, wherein the search mechanism returns a rank for retrieved content items;
a user interface for presenting a content item to a user and for enabling the user to record an appreciation for that content item in relation to the access of the content item; and
a management element for using the recorded appreciations to calculate at least a first metric representative of, or derived from, a ratio of positive to non-positive appreciations for the repository and a second metric representing, or derived from, an average rank of the content items when each such content item received positive appreciations. - View Dependent Claims (13, 14, 15, 16, 17)
-
-
18. A process for measuring the performance of an information retrieval system comprising a repository of content items associated with a search mechanism that returns a rank for retrieved content items, said process comprising:
-
when a content item is accessed by a user, recording an appreciation assigned by the user to that content item, wherein the appreciation takes the form of a flag being capable of being set at least positive or not positive;
storing the appreciations and the ranks in a database;
and using the recorded appreciations to calculate at least a first metric representative of, or derived from, a ratio of positive to non-positive appreciations for the repository and a second metric representing, or derived from, an average rank of the content items when each such content item receive positive appreciations;
presenting at least one of the metrics to an administrator via a user interface;
detecting changes to at least one global metric and launching of a maintenance process of said repository in response to said detected changes. - View Dependent Claims (19)
-
-
20. A system for maintaining a repository of documents having a search engine for outputting lists of document in response to a query, said system comprising:
-
means for recording appreciations or flags individually assigned by the users;
means for computing at least a first and a second metrics representative of the relevance of said repository;
said first metrics being computed from the number of documents having received positive flags and said second metrics being representative of the average rank of the documents having received positive flags from the users;
means for controlling an action brought to said repository in response to a change brought to said first or said second metrics.
-
Specification