Claim evaluation system

• US 9,436,686 B1
• Filed: 08/07/2012
• Issued: 09/06/2016
• Est. Priority Date: 08/07/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Pasula, Hanna, Bugnon, Thomas, Bernstein, Yaniv, Postelnicu, Gheorghe
• Primary Examiner(s): Alam, Hosain
• Assistant Examiner(s): Ahmed, Saba
• Application Number:
  US13/569,042
• Time in Patent Office: 1,491 Days
• Field of Search: 707/769
• US Class Current: 1/1
• CPC Class Codes: G06F 16/3331 Query processing
• CPC Class Codes: G06F 16/433 using audio data

Abstract

A system and method for evaluating claims is disclosed. The system comprises a selection module, a query module, a communication module and a determination module. The selection module determines a review set including one or more claims based at least in part on claim data. The query module determines, based at least in part on the review set, an evaluation form including one or more queries associated with a first claim. The communication module receives answer data describing one or more answers responsive to the one or more queries included in the evaluation form. The determination module determines a validity decision associated with the first claim based at least in part on the answer data.

Claims

1. A method comprising:

determining a review set including one or more claims, each claim indicating an association between a respective asset media file and a respective reference media file, the review set determined based at least in part on claim data describing the one or more claims, the association between the respective asset media file and the respective reference media file indicating a similarity between the respective asset media file and the respective reference media file;

determining, based at least in part on the review set, an evaluation form including one or more queries associated with a first claim of the one or more claims, the first claim indicating a first association between a first asset media file and a first reference media file, the queries to determine whether the first association is accurate based on a comparison between media contents of the first asset media file and the first reference media file;

receiving answer data describing one or more answers responsive to the one or more queries included in the evaluation form; and

determining, by a processor, a validity decision associated with the first claim based at least in part on the answer data, the validity decision indicating whether the first association is accurate, the first association indicating a similarity between the first asset media file and the first reference media file.

2. The method of claim 1, further comprising:

determining a claim precision for the review set based at least in part on one or more validity decisions for the one or more claims of the review set.

3. The method of claim 2, wherein the claim precision includes data describing a percentage of incorrect claims in the review set.

4. The method of claim 1, wherein determining the evaluation form further comprises:

determining a content type of the first asset media file associated with the first claim; and

determining the evaluation form based at least in part on the content type.

5. The method of claim 1, wherein determining the validity decision of the first claim further comprises:

determining a second association between the first asset media file associated with the first claim and the first reference media file associated with the first claim based at least in part on the answer data;

determining whether the second association is matched to the first association provided by the first claim; and

responsive to a determination that the second association is matched to the first association, determining that the first claim is correct.

6. The method of claim 1, further comprising:

retrieving graphical form data associated with the evaluation form; and

generating graphical data for presenting the evaluation form to a user based at least in part on the graphical form data.

7. The method of claim 1, further comprising:

determining whether the answer data includes keyed text data; and

responsive to a determination that the answer data includes the keyed text data, providing the keyed text data to an administrator.

8. A system, comprising:

a memory; and

a processor, coupled to the memory to;

determine a review set including one or more claims, each claim indicating an association between a respective asset media file and a respective reference media file, the review set determined based at least in part on claim data describing the one or more claims, the association between the respective asset media file and the respective reference media file indicating a similarity between the respective asset media file and the respective reference media file;

determine, based at least in part on the review set, an evaluation form including one or more queries associated with a first claim of the one or more claims, the first claim indicating a first association between a first asset media file and a first reference media file, the queries to determine whether the first association is accurate based on a comparison between media contents of the first asset media file and the first reference media file;

receive answer data describing one or more answers responsive to the one or more queries included in the evaluation form; and

determine a validity decision associated with the first claim based at least in part on the answer data, the validity decision indicating whether the first association is accurate, the first association indicating a similarity between the first asset media file and the first reference media file.

9. The system of claim 8, the processor further to:

determine a claim precision for the review set based at least in part on one or more validity decisions for the one or more claims of the review set.

10. The system of claim 9, wherein the claim precision includes data describing a percentage of incorrect claims in the review set.

11. The system of claim 8, the processor further to:

determine a content type of the first asset media file associated with the first claim; and

determine the evaluation form based at least in part on the content type.

12. The system of claim 8, the processor further to:

determine a second association between the first asset media file associated with the first claim and the first reference media file associated with the first claim based at least in part on the answer data;

determine whether the second association is matched to the first association provided by the first claim; and

responsive to a determination that the second association is matched to the first association, determine that the first claim is correct.

13. The system of claim 8, further comprising:

a graphical user interface module communicatively coupled to the query module and the communication module, the graphical user interface module generating graphical data for presenting the evaluation form to a user based at least in part on graphical form data associated with the evaluation form; and

wherein the communication module retrieves the graphical form data associated with the evaluation form and sends the graphical form data to the graphical user interface module.

14. The system of claim 8, the processor further to:

determine whether the answer data includes keyed text data, the feedback module providing the keyed text data to an administrator responsive to a determination that the answer data includes the keyed text data.

15. A non-transitory computer-readable storage medium comprising executable instructions that, when executed by a computing device, cause the computing device to:

determine a review set including one or more claims, each claim indicating an association between a respective asset media file and a respective reference media file, the review set determined based at least in part on claim data describing the one or more claims, the association between the respective asset media file and the respective reference media file indicating a similarity between the respective asset media file and the respective reference media file;

determine, based at least in part on the review set, an evaluation form including one or more queries associated with a first claim of the one or more claims, the first claim indicating a first association between a first asset media file and a first reference media file, the queries to determine whether the first association is accurate based on a comparison between media contents of the first asset media file and the first reference media file;

receive answer data describing one or more answers responsive to the one or more queries included in the evaluation form; and

determine a validity decision associated with the first claim based at least in part on the answer data, the validity decision indicating whether the first association is accurate, the first association indicating a similarity between the first asset media file and the first reference media file.

16. The non-transitory computer-readable storage medium of claim 15, the executable instructions further to:

determine a claim precision for the review set based at least in part on one or more validity decisions for the one or more claims of the review set.

17. The non-transitory computer-readable storage medium of claim 16, wherein the claim precision includes data describing a percentage of incorrect claims in the review set.

18. The non-transitory computer-readable storage medium of claim 15, wherein determining the evaluation form further comprises:

determining a content type of the first asset media file associated with the first claim; and

determining the evaluation form based at least in part on the content type.

19. The non-transitory computer-readable storage medium of claim 15, wherein determining the validity decision of the first claim further comprises:

determining a second association between the first asset media file associated with the first claim and the first reference media file associated with the first claim based at least in part on the answer data;

determining whether the second association is matched to the first association provided by the first claim; and

responsive to a determination that the second association is matched to the first association, determining that the first claim is correct.

20. The non-transitory computer-readable storage medium of claim 15, wherein the instructions cause the computing device to perform operations further comprising:

determining whether the answer data includes keyed text data; and

responsive to a determination that the answer data includes the keyed text data, providing the keyed text data to an administrator.