REDUCED BIAS SUBMISSION REVIEW SYSTEM

• US 20190318397A1
• Filed: 04/16/2018
• Published: 10/17/2019
• Est. Priority Date: 04/16/2018
• Status: Active Grant

• Current Assignee: Bongo Learn Incorporated
• Original Assignee: Edupresent, LLC
• Inventors: Lewis, Jeffrey S.
• Granted Patent: US 10,891,665 B2
• Time in Patent Office: Days
• CPC Class Codes: G06Q 30/0282 Rating or review of business operators or products

Abstract

A reduced bias submission review system distributed on one or more servers operably coupled to one or more client computing devices over a network supports a program including computer executable instructions accessible by browser based on-line processing to enable one or more clients to submit a plurality of submissions for submission review and depending on the application repeatedly serves the plurality of submissions in a prioritized order to a plurality of reviewers until each of the plurality of submissions receives a pre-selected target number of submission reviews or until each of the plurality of reviewers performs the preselected target number of submission reviews.

Claims

1. A computer implemented system, comprising:

a processor communicatively coupled to a non-transitory memory containing a computer code executable to;

receive a plurality of submissions from a plurality of submitters;

associating each of said plurality of submissions to a submission group;

associate a preselected target number of submission reviews to each of said plurality of submissions in said submission group; and

repeatedly serve said plurality of submissions in said submission group to a plurality of reviewers until each of said plurality of submissions in said submission group receives said pre-selected target number of submission reviews.

2. The computer implemented system of claim 1, further comprising serve said plurality of submissions in said submission group to said plurality of reviewers in a prioritized order.

3. The computer implemented system of claim 2, further comprising:

determine number of submission reviews associated with each one of said plurality of submissions within said submission group; and

serve said plurality of submissions in said submission group to said plurality of reviewers based on having a fewest number of submission reviews within said submission group.

4. The computer implemented system of claim 3, further comprising:

determine submission date associated with each one said plurality of submissions within said submission group; and

serve said plurality of submissions in said submission group to said plurality of reviewers based on having an earliest submission date.

5. The computer implemented system of claim 1, wherein said target number of submission reviews comprises a sum of a plurality of submission review ranks, each of said plurality of submissions in said submission group receives a submission review in a preceding one of said plurality of submission review ranks prior to review of said plurality of submissions in said submission group in a subsequent one of said plurality of submission review ranks.

6. The computer implemented system of claim 5, further comprising:

determine number of reviews associated with each one of said plurality of reviewers; and

serve said plurality of submissions in said submission group to a reviewer within said plurality of reviewers having fewest submitted reviews.

7. The computer implemented system of claim 6, further comprising correspondingly associate each submission review with one reviewer in said plurality of reviewers having performed said submission review.

8. The computer implemented system of claim 7, further comprising associate edits of said submission reviews with one reviewer in said plurality of reviewers having performed said submission review.

9. The computer implemented system of claim 5, further comprising serve a user interface which depicts a submissions list against said plurality of submission review ranks, each one of said plurality of submission review ranks correspondingly including a submission review indicator field associated with one of said submission in said submissions list.

10. The computer implemented system of claim 9, further comprising depict, upon receiving a submission review, a submission review indicator in one of said submission review indicator field associated with reviewed said submission.

11. The computer implemented system of claim 1, wherein said plurality of submissions comprise electronic media content.

12. The computer implemented system of claim 11, wherein said electronic media content is selected from the group consisting of:

electronic text or graphics, video recordings, audio recordings, multimedia presentations, slide presentations, spreadsheets, or combinations thereof.

13. The computer implemented system of claim 1, further comprising associate each of said plurality of submitters to a submitter group.

14. The computer implemented system of claim 13, further comprising allocating said plurality of submissions received from a submitter group to one said submission group.

15. The computer implemented system of claim 14, further comprising associate each of said plurality of reviewers to a roster of reviewers, said roster of reviewers served said plurality of submissions included in said submission group.

16. The computer implemented system of claim 15, further comprising allocating said plurality of submitters in a submitter group to one said roster of reviewers.

17-48. -48. (canceled)