Method of and system for validating a fact checking system

• US 9,087,048 B2
• Filed: 02/11/2013
• Issued: 07/21/2015
• Est. Priority Date: 06/10/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: LinkedIn Corporation (Microsoft Corporation)
• Inventors: Myslinski, Lucas J.
• Primary Examiner(s): Baker, Charlotte M
• Application Number:
  US13/763,831
• Publication Number:
  US 20130158984A1
• Time in Patent Office: 890 Days
• Field of Search: 704/9, 707/102, 707/1, 707/100, 715/505
• US Class Current: 1/1
• CPC Class Codes: A63F 13/46 Computing the game score
• CPC Class Codes: A63F 13/79 involving player-related data, e.g. identities, accounts, preferences or play histories
• CPC Class Codes: A63F 13/795 for finding other players; for building a team; for providing a buddy list
• CPC Class Codes: A63F 13/828 Managing virtual sport teams
• CPC Class Codes: A63F 13/95 Storage media specially adapted for storing game information, e.g. video game cartridges
• CPC Class Codes: G06F 11/3065 Monitoring arrangements determined by the means or processing involved in reporting the monitored data error or fault reporting or logging G06F11/0766
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/285 Clustering or classification
• CPC Class Codes: G06F 16/90328 using search space presentation or visualization, e.g. category or range presentation and selection
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 40/40 Processing or translation of natural language natural language analysis G06F40/20; semantic analysis G06F40/30
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0241 Advertisements
• CPC Class Codes: G06Q 30/0279 Fundraising management
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: H04L 51/52 for supporting social networking services
• CPC Class Codes: H04L 63/1408 : by monitoring network traffic monitoring network traffic per se H04L43/00

Abstract

A fact checking system is able to verify the correctness of information and/or characterize information by comparing the information with one or more sources. The fact checking system automatically monitors, processes, fact checks information and indicates a status of the information. Fact checking results are able to be validated by re-fact checking the fact check results.

Claims

1. A method programmed in a non-transitory memory of a device comprising:

fact checking a fact check result of information by comparing, by the device, the fact check result with information from a source to determine factual accuracy of the fact check result;

automatically indicating a status of the fact check result based on a re-fact check result from comparison of the fact check result with the information from the source;

wherein the status of the fact check result is indicated in real-time.

2. The method of claim 1 further comprising providing a reason why the fact check result was incorrect if the fact check result is disproved.

3. The method of claim 1 further comprising receiving flagging information flagging the fact check result.

4. The method of claim 3 wherein the fact check result is only fact checked if a number of users flagging the fact check result exceeds a threshold.

5. The method of claim 3 wherein the flagging information comprises a voice command made within a designated time frame.

6. The method of claim 1 wherein fact checking the fact check result utilizes information from a different source than used to generate the fact check result.

7. The method of claim 1 wherein the status of the fact check result indicates whether the fact check result is confirmed or disproved.

8. The method of claim 1 further comprising receiving additional source information to compare with the fact check result to determine the factual accuracy of the fact check result.

9. The method of claim 1 wherein the status of the fact check result is only indicated if the fact check result is disproved.

10. The method of claim 1 further comprising gathering statistics regarding fact check results and re-fact check results of a fact checking system.

11. The method of claim 10 wherein the statistics are gathered automatically.

12. The method of claim 10 further comprising indicating the statistics when the fact checking system is referenced.

13. The method of claim 10 further comprising indicating the statistics of the fact checking system and an entity'"'"'s statistics in a comparison format.

14. The method of claim 1 further comprising storing the fact check result and the re-fact check result in a user-searchable data structure.

15. The method of claim 1 further comprising displaying the status of the fact check result on a second device.

16. The method of claim 1 further comprising providing a correction if the fact check result is disproved.

17. The method of claim 1 further comprising displaying data including how often a fact checking system is challenged, proven incorrect, or proven correct.

18. A method programmed in a non-transitory memory of a device comprising:

fact checking a fact check result of information by comparing, by the device, the fact check result with information from a source to determine factual accuracy of the fact check result;

automatically indicating a status of the fact check result based on a re-fact check result from comparison of the fact check result with information from the source;

providing a reason why the fact check result was incorrect if the fact check result is disproved.

19. A method programmed in a non-transitory memory of a device comprising:

receiving flagging information flagging a fact check result, wherein the fact check result includes target information and a factual accuracy of the target information;

fact checking the fact check result of the target information by comparing, with the device, the fact check result with information from a source to determine the factual accuracy of the fact check result, wherein the fact check result is only fact checked if a number of users flagging the fact check result exceeds a threshold, further wherein the information from the source is from a different source than information from a previous source used to determine the fact check result;

automatically indicating a status of the fact check result based on a re-fact check result from comparison of the fact check result with the information from the source.

20. A device comprising:

a memory for storing an application for automatically performing;

receiving voice command flagging information flagging a fact check result of a previous fact check;

fact checking the fact check result of information by comparing the fact check result with information from a source to determine factual accuracy of the fact check result, wherein the fact check result is only fact checked if a number of users flagging the fact check result exceeds a threshold, further wherein the information from the source is from a different source than information from a previous source used to determine the fact check result, further wherein the information from the source includes a source received by a user;

indicating a status of the fact check result based on a re-fact check result from comparison of the fact check result with the information from the source;

a processor for processing the application.

21. A method programmed in a non-transitory memory of a device comprising:

fact checking a fact check result of information by comparing, by the device, the fact check result with information from a source to determine factual accuracy of the fact check result;

automatically indicating a status of the fact check result based on a re-fact check result from comparison of the fact check result with information from the source;

receiving flagging information flagging the fact check result;

wherein the fact check result is only fact checked if a number of users flagging the fact check result exceeds a threshold.

22. A method programmed in a non-transitory memory of a device comprising:

fact checking a fact check result of information by comparing, by the device, the fact check result with information from a source to determine factual accuracy of the fact check result;

automatically indicating a status of the fact check result based on a re-fact check result from comparison of the fact check result with information from the source;

receiving flagging information flagging the fact check result;

wherein the flagging information comprises a voice command made within a designated time frame.

23. A method programmed in a non-transitory memory of a device comprising:

fact checking a fact check result of information by comparing, by the device, the fact check result with information from a source to determine factual accuracy of the fact check result;

automatically indicating a status of the fact check result based on a re-fact check result from comparison of the fact check result with information from the source;

gathering statistics regarding fact check results and re-fact check results of a fact checking system.

24. A method programmed in a non-transitory memory of a device comprising:

fact checking a fact check result of information by comparing, by the device, the fact check result with information from a source to determine factual accuracy of the fact check result;

automatically indicating a status of the fact check result based on a re-fact check result from comparison of the fact check result with information from the source;

displaying data including how often a fact checking system is challenged, proven incorrect, or proven correct.