Delegated authority to evaluate content

• US 8,321,419 B1
• Filed: 09/08/2011
• Issued: 11/27/2012
• Est. Priority Date: 12/12/2003
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Ferren, Bran, Hills, W. Daniel
• Primary Examiner(s): REYES, MARIELA D
• Application Number:
  US13/228,368
• Time in Patent Office: 446 Days
• Field of Search: 707/740, 707/748
• US Class Current: 707/740
• CPC Class Codes: G06Q 30/00 Commerce

Abstract

The invention provides an evaluation system for reliably evaluating large amounts of content. The evaluation system is managed by a primary authority that designates one or more contributing authorities by delegating to each a specific quantity of authority. Each contributing authority may in turn designate and delegate authority to one or more additional contributing authorities, subject to the restriction that the total quantity of authority delegated does not exceed the quantity of authority the contributing authority was itself delegated. Each contributing authority, and optionally the primary authority itself, may evaluate one or more portions of content by associating a rating with each evaluated portion of content. A composite rating for a particular portion of content may then be determined based upon the ratings associated with the portion of content.

Claims

1. A system, comprising:

a first data processing system comprising one or more computers and one or more storage devices, the one or more computers configured to perform first operations comprising;

receiving information identifying a first primary authority for a first evaluation system from among a plurality of rating authorities,

assigning the first primary authority a first amount of authority to rate content, the first amount of authority being equal to a first total amount of authority of the first evaluation system,

receiving information originating from the first primary authority delegating at least a portion of the first amount of authority to one or more first contributing authorities,

assigning each of the one or more first contributing authorities a respective portion of the first amount of authority, the respective portion of the first amount of authority being based on the portion of the first amount of authority delegated to the corresponding first contributing authority,

receiving information specifying content ratings for a first content item by at least one of the first primary authority or one or more of the first contributing authorities, and

determining a composite rating for the first content item based on the content ratings for the first content item, wherein the composite rating for the first content item is determined by combining the content ratings according to the portion of the first amount of authority that is held by each authority that rated the first content item; and

a second data processing system comprising one or more computers and one or more storage devices, the one or more computers configured to perform second operations comprising;

receiving information identifying a second, different primary authority for a second, different evaluation system from among the plurality of rating authorities,

assigning the second primary authority a second amount of authority to rate content, the second amount of authority being equal to a second total amount of authority of the second evaluation system,

receiving information originating from the second primary authority delegating at least a portion of the second amount of authority to one or more second contributing authorities, and

assigning each of the one or more second contributing authorities a respective portion of the second amount of authority, the respective portion of the second amount of authority being based on the portion of the second amount of authority delegated to the corresponding second contributing authority, wherein the first data processing system is further configured to receive information originating from the first primary authority delegating a particular portion of the first amount of authority to the second primary authority and to assign the particular portion of the first amount of authority to the second primary authority.

2. The system of claim 1, wherein the second evaluation system is a subsystem of the first evaluation system.

3. The system of claim 1, wherein at least a portion of the first amount of authority and the second amount of authority is specified numerically.

4. The system of claim 1, the first operations further comprising receiving information originating from an existing authority adding one or more new contributing authorities by delegating authority to the one or more new contributing authorities.

5. The system of claim 4, the first operations further comprising:

removing a contributing authority by withdrawing authority previously delegated to the one or more new contributing authorities.

6. The system of claim 1, the first operations further comprising receiving information originating from a delegating authority removing one or more of the one or more first contributing authorities by removing authority previously delegated to the one or more first contributing authorities by the first delegating authority.

7. The system of claim 1, the first operations further comprising adjusting a relative authority of any of the one or more first contributing authorities in response to any of:

information originating from the first primary authority delegating additional authority to at least one additional first contributing authority; and

information originating from the first primary authority withdrawing authority from at least one of the one or more first contributing authorities.

8. The system of claim 1, the first operations further comprising:

receiving information specifying content ratings for a second content item by at least one of the second primary authority or one or more of the second contributing authorities; and

determining a composite rating for the second content item based on the content ratings for the second content item, wherein the composite rating is determined by combining the content ratings according to the portion of the first amount of authority that is held by each authority that rated the second content item, and wherein the portion of the first amount of authority that is held by each authority is determined according to the portion of the second amount of authority held by the authority and the particular portion of the first amount of authority assigned to the second primary authority.

9. The system of claim 1, the first operations further comprising:

receiving information specifying content ratings for a third content item by at least one first contributing authority and at least one second contributing authority; and

determining a composite rating for the third content item based on the content ratings for the third content item, wherein the composite rating is determined by combining the content ratings according to the portion of the first amount of authority that is held by each authority that rated the third content item, and wherein the portion of the first amount of authority that is held by the at least one first contributing authority is determined according to the portion of the first amount of authority delegated to the first contributing authority by the first primary authority and the portion of the first amount of authority that is held by the at least one second contributing authority is determined according to the portion of the second amount of authority assigned to the second contributing authority by the second primary authority and the particular portion of the first amount of authority assigned to the second primary authority by the first primary authority.

10. A method performed by a system of one or more computers, the method comprising:

receiving information identifying a first primary authority for a first evaluation system from among a plurality of rating authorities;

assigning the first primary authority a first amount of authority to rate content, the first amount of authority being equal to a first total amount of authority of the first evaluation system;

receiving information originating from the first primary authority delegating at least a portion of the first amount of authority to one or more first contributing authorities;

assigning each of the one or more first contributing authorities a respective portion of the first amount of authority, the respective portion of the first amount of authority being based on the portion of the first amount of authority delegated to the corresponding first contributing authority;

receiving information specifying content ratings for a first content item by at least one of the first primary authority or one or more of the first contributing authorities;

determining a composite rating for the first content item based on the content ratings for the first content item, wherein the composite rating for the first content item is determined by combining the content ratings according to the portion of the first amount of authority that is held by each authority that rated the first content item;

receiving information identifying a second, different primary authority for a second, different evaluation system from among the plurality of rating authorities;

assigning the second primary authority a second amount of authority to rate content, the second amount of authority being equal to a second total amount of authority of the second evaluation system;

receiving information originating from the second primary authority delegating at least a portion of the second amount of authority to one or more second contributing authorities;

assigning each of the one or more second contributing authorities a respective portion of the second amount of authority, the respective portion of the second amount of authority being based on the portion of the second amount of authority delegated to the corresponding second contributing authority;

receiving information originating from the first primary authority delegating a particular portion of the first amount of authority to the second primary authority; and

assigning the particular portion of the first amount of authority to the second primary authority.

11. The method of claim 10, wherein the second evaluation system is a subsystem of the first evaluation system.

12. The method of claim 10, wherein at least a portion of the first amount of authority and the second amount of authority is specified numerically.

13. The method of claim 10, further comprising receiving information originating from an existing authority adding one or more new contributing authorities by delegating authority to the one or more new contributing authorities.

14. The method of claim 13, further comprising:

removing a contributing authority by withdrawing authority previously delegated to the one or more new contributing authorities.

15. The method of claim 10, further comprising receiving information originating from a delegating authority removing one or more of the one or more first contributing authorities by removing authority previously delegated to the one or more first contributing authorities by the first delegating authority.

16. The method of claim 10, further comprising adjusting a relative authority of any of the one or more first contributing authorities in response to any of:

information originating from the first primary authority delegating additional authority to at least one additional first contributing authority; and

information originating from the first primary authority withdrawing authority from at least one of the one or more first contributing authorities.

17. The method of claim 10, further comprising:

receiving information specifying content ratings for a second content item by at least one of the second primary authority or one or more of the second contributing authorities; and

determining a composite rating for the second content item based on the content ratings for the second content item, wherein the composite rating is determined by combining the content ratings according to the portion of the first amount of authority that is held by each authority that rated the second content item, and wherein the portion of the first amount of authority that is held by each authority is determined according to the portion of the second amount of authority held by the authority and the particular portion of the first amount of authority assigned to the second primary authority.

18. The method of claim 10, further comprising:

receiving information specifying content ratings for a third content item by at least one first contributing authority and at least one second contributing authority; and

determining a composite rating for the third content item based on the content ratings for the third content item, wherein the composite rating is determined by combining the content ratings according to the portion of the first amount of authority that is held by each authority that rated the third content item, and wherein the portion of the first amount of authority that is held by the at least one first contributing authority is determined according to the portion of the first amount of authority delegated to the first contributing authority by the first primary authority and the portion of the first amount of authority that is held by the at least one second contributing authority is determined according to the portion of the second amount of authority assigned to the second contributing authority by the second primary authority and the particular portion of the first amount of authority assigned to the second primary authority by the first primary authority.