Computer-implemented method and system for collaborative product evaluation

• US 8,249,915 B2
• Filed: 08/04/2005
• Issued: 08/21/2012
• Est. Priority Date: 08/04/2005
• Status: Active Grant

• Current Assignee: Gartner, Inc.
• Original Assignee: Gartner, Inc.
• Inventors: Iams, Anthony L.
• Primary Examiner(s): Jasmin, Lynda
• Assistant Examiner(s): FEENEY, BRETT A
• Application Number:
  US11/197,255
• Publication Number:
  US 20070033092A1
• Time in Patent Office: 2,574 Days
• Field of Search: None
• US Class Current: 705/7.32
• CPC Class Codes: G06F 16/335 Filtering based on additional data, e.g. user or group profiles filtering in web context G06F16/9535, G06F16/9536
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06Q 10/0639 Performance analysis of employees; Performance analysis of enterprise or organisation operations
• CPC Class Codes: G06Q 30/0203 Market surveys; Market polls

Abstract

Computer-implemented methods and systems provide for user collaboration in evaluating complex products over a public network. Product capabilities are preferably represented as a hierarchical taxonomy of features. Users can assign ratings and comments to the features of a product. User-submitted ratings can be qualified (or moderated) by other users. Such moderation is accomplished on a per-rating basis by user selection of one label from a set of labels that represent different levels of perceived credibility of the user that submitted the rating. A moderation score for a rating/comment is derived from the user-selected moderation labels pertaining to the rating/comment. Registered users preferably can assign weights to features, the weights representing the importance of that feature to the particular user. The user-supplied ratings as well as the moderation scores and/or weights corresponding thereto are used to compute composite ratings for user-selected product features that are communicated to the users for evaluation of the user-selected product features. Preferably, a distributed moderation process is executed that automatically grants a select subset of the user community the opportunity to moderate the ratings of other users.

Claims

1. A computer-implemented method carried out by a computer processing system for user evaluation of at least one product that has a plurality of features whereby users operate user devices that are operably coupled to the computer processing system over network communication therebetween, the method comprising:

interacting with a plurality of users via the network communication between the user devices and the computer processing system to assign user-supplied ratings to features of a particular product, wherein the features of the at least one product are logically organized into a hierarchical structure of feature levels, and wherein each user supplied rating corresponds to a respective feature level and represents a user derived assessment of at least one feature of the corresponding feature level of the at least one product;

processing the user-supplied ratings at the computer processing system to associate moderation scores with the user-supplied ratings;

interacting with a given user via network communication between a given user device and the computer processing system to specify a threshold moderation score that defines a first range of acceptable moderation scores;

at the computer processing system, computing a composite rating for a given feature level of the at least one product based upon a set of the user-supplied ratings corresponding to the given feature level of the at least one product, wherein each user-supplied rating within the set is associated with a moderation score that falls within the first range of acceptable moderation scores, thereby omitting from the composite rating contributions of user-supplied ratings for the at least one product whose associated moderation scores fall outside the first range of acceptable moderation scores; and

at the computer processing system, outputting the composite rating for supply to the given user via network communication between the computer processing system and the given user device;

wherein the processing of the computer processing system selectively enables particular users to evaluate the user-supplied ratings and associated moderation scores with the user-supplied ratings whereby the particular users are selectively enabled based upon moderation points earned by the particular users, and wherein the moderation points are limited in number and distributed to a respective user by an automatic process that accounts for positive evaluation of the respective user'"'"'s own user-supplied ratings.

2. A computer-implemented method according to claim 1, further comprising:

processing user-supplied feedback at the computer processing system to derive a moderation score associated with a particular user-supplied rating.

3. A computer-implemented method according to claim 2, wherein:

the moderation score associated with a particular user-supplied rating is based upon a set of moderation scores each derived from user selection of a corresponding label from a plurality of labels that represent different levels of perceived credibility of the user that submitted the particular user-supplied rating.

4. A computer-implemented method according to claim 3, wherein:

the moderation score is generated by summing together the set of moderation scores and bounding the resultant sum by a predetermined maximum value and a predetermined minimum value.

5. A computer-implemented method according to claim 1, wherein:

the hierarchical structure of feature levels includes non-leaf feature levels and leaf feature levels, said non-leaf feature levels having at least one sub-feature level thereunder, and said leaf feature levels each do not have a single sub-feature level thereunder.

6. A computer-implemented method according to claim 5, wherein:

user interaction via network communication between user devices and the computer processing system is adapted to allow users to traverse the feature levels.

7. A computer-implemented method according to claim 5, wherein:

user interaction via network communication between user devices and the computer processing system is adapted to allow submission of ratings only for features corresponding to leaf feature levels, thereby omitting the submission of ratings for features corresponding to non-leaf feature levels.

8. A computer-implemented method according to claim 7, wherein:

the given feature level of the composite rating is selected by the user.

9. A computer-implemented method according to claim 7, wherein:

for the composite rating of a non-leaf feature level, the composite rating is based upon user-supplied ratings and weight factors associated with the sub-features of the non-leaf feature level.

10. A computer-implemented method according to claim 9, further comprising:

interacting with the given user via network communications between the given user device and the computer processing system to define the weight factors used in the computation of the composite rating for the non-leaf feature level.

11. A computer-implemented method according to claim 1, wherein:

the automatic process executed by the computer processing system distributes moderation points to the respective user based upon frequency that respective user had reviewed the user-supplied ratings of other users.

12. A computer-implemented method according to claim 1, wherein

the automatic process executed by the computer processing system distributes moderation points to the respective user based upon data representing the evaluation of the respective user'"'"'s own user-supplied ratings by other users.

13. A computer-implemented method according to claim 1, wherein:

the automatic process executed by the computer processing system distributes moderation points to the respective user based upon usage data that is indicative of the temporal regularity of access and level of detail of access by the respective user.

14. A computer-implemented method according to claim 1, wherein:

the automatic process executed by the computer processing system distributes moderation points based upon the user-supplied feedback.

15. A computer-implemented method according to claim 1, wherein:

the automatic process executed by the computer processing system distributes moderation points based upon a ranking of a set of users, the ranking of a given user in the set derived from the user-supplied feedback pertaining to ratings submitted by the given user.

16. A computer-implemented method according to claim 1, wherein:

the user devices each include a web browser and the computer processing system comprises a web server, the web browser manipulating web pages served by the web server.

17. A system for user evaluation of at least one product that has a plurality of features whereby users operate user devices that are operably coupled to the system over network communication therebetween, the system comprising:

a computer processing system which includes first software logic, second software logic, third software logic, fourth software logic, fifth software logic and sixth software logic, each operating on the computer processing system;

the first software logic for interacting with a plurality of users via network communication between the user devices and the computer processing system to assign user-supplied ratings, wherein the features of the at least one product are logically organized into a hierarchical structure of feature levels, and wherein each user supplied rating corresponds to a respective feature level and represents a user derived assessment of at least one feature of the corresponding feature level of the at least one product;

the second software logic for processing the user-supplied ratings to associate moderation scores to the user-supplied ratings;

the third software logic for interacting with a given user via network communication between a given user device and the system to specify a threshold moderation score that defines a first range of acceptable moderation scores;

the fourth software logic for computing a composite rating for a given feature level of the at least one product based upon a set of the user-supplied ratings corresponding to the given feature level of the at least one product, wherein each user-supplied rating within the set is associated with a moderation score that falls within the first range of acceptable moderation scores, thereby omitting from the composite rating contributions of user-supplied ratings for the at least one product whose associated moderation scores fall outside the first range of acceptable moderation scores;

the fifth software logic for outputting the composite rating for supply to the given user via network communication between the system and the given user device; and

the sixth software logic for selectively enabling particular users to evaluate the user-supplied ratings and associated moderation scores with the user-supplied ratings whereby the particular users are selectively enabled based upon moderation points earned by the particular users, and wherein the moderation points are limited in number and distributed to a respective user by an automatic process that accounts for positive evaluation of the respective user'"'"'s own user-supplied ratings.

18. A system according to claim 17, further comprising:

seventh software logic operating on the computer processing system for processing user-supplied feedback at the computer processing system to derive a moderation score associated with a particular user-supplied rating.

19. A system according to claim 18, wherein:

the moderation score associated with a particular user-supplied rating is based upon a set of moderation scores each derived from user selection of a corresponding label from a plurality of labels that represent different levels of perceived credibility of the user that submitted the particular user-supplied rating.

20. A system according to claim 19, wherein:

the moderation score is generated by summing together the set of moderation scores and bounding the resultant sum by a predetermined maximum value and a predetermined minimum value.

21. A system according to claim 17, wherein:

the hierarchical structure of feature levels includes non-leaf feature levels and leaf feature levels, said non-leaf feature levels having at least one sub-feature level thereunder, and said leaf feature levels each do not have a single sub-feature level thereunder.