Optimized fact checking method and system

• US 9,189,514 B1
• Filed: 09/04/2014
• Issued: 11/17/2015
• Est. Priority Date: 09/04/2014
• Status: Active Grant

• Current Assignee: Lucas Myslinski
• Original Assignee: Lucas Myslinski
• Inventors: Myslinski, Lucas J.
• Primary Examiner(s): Huang, Miranda
• Application Number:
  US14/477,009
• Time in Patent Office: 439 Days
• Field of Search: 707/765, 707/769
• US Class Current: 1/1
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/244 Grouping and aggregation
• CPC Class Codes: G06F 16/3331 Query processing
• CPC Class Codes: G06F 16/3334 Selection or weighting of terms from queries, including natural language queries
• CPC Class Codes: G06F 16/335 Filtering based on additional data, e.g. user or group profiles filtering in web context G06F16/9535, G06F16/9536
• CPC Class Codes: G06F 16/345 Summarisation for human users
• CPC Class Codes: G06F 16/90332 Natural language query formulation or dialogue systems
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 40/226 Validation
• CPC Class Codes: G06F 40/237 Lexical tools
• CPC Class Codes: G06F 40/284 Lexical analysis, e.g. tokenisation or collocates
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: G06Q 30/0255 based on user history
• CPC Class Codes: G06Q 50/01 Social networking

Abstract

An optimized fact checking system analyzes and determines the factual accuracy of information and/or characterizes the information by comparing the information with source information. The optimized fact checking system automatically monitors information, processes the information, fact checks the information in an optimized manner and/or provides a status of the information. In some embodiments, the optimized fact checking system generates, aggregates, and/or summarizes content.

Claims

1. A method programmed in a non-transitory memory of a device comprising:

a. automatically generating narrative information by analyzing at least one first data source including extracting a first set of data from the at least one first data source and organizing the first set of data from the at least one first data source into a narrative, wherein the first set of data includes a plurality of different perspectives, wherein the plurality of different perspectives are based on a plurality of different languages, further wherein a first perspective is a first content in a first language, and a second perspective is a second content in a second language, wherein the first language and the second language are different;

b. automatically generating aggregate information by aggregating a second set of data from at least one second data source or the at least one first data source;

c. automatically analyzing target information, wherein the target information includes the narrative information, the aggregate information and additional information;

d. automatically summarizing the target information to generate a summary of the target information;

e. automatically fact checking, with the device, the summary of the target information by comparing the summary of the target information with source information to generate a result, wherein the summary of the target information includes a first summary content in the first language and a second summary content in the second language, wherein fact checking the first summary content comprises fact checking using sources in the second language, and fact checking the second summary content comprises fact checking using sources in the first language; and

f. automatically providing a status of the target information in real-time based on the result of the comparison of the summary of the target information with the source information.

2. The method of claim 1 wherein generating the narrative information utilizes social networking information of a user to determine a focus of the at least one first data source based on a keyword detected most frequently, wherein the user is being provided the status of the target information, and the focus is used to determine the at least one first data source.

3. The method of claim 1 wherein generating the narrative information utilizes data sources with opposing perspectives, wherein the at least one first data source has a data source with a first opposing perspective, and the at least one first data source has a second data source with a second opposing perspective, wherein generating the narrative information includes generating a plurality of summaries with opposing perspectives and combining the summaries to form the narrative information such that a first sentence from a first summary of the plurality of summaries is provided first, a first sentence from a second summary of the plurality of summaries is provided second, and continuing in order until a last sentence from a last summary of the plurality of summaries is provided last.

4. The method of claim 1 wherein the first set of data from the at least one first data source includes only factually accurate information.

5. The method of claim 1 wherein the aggregate information comprises a plurality of articles about a same topic determined by comparing dates and matching keywords within the plurality of articles, and after the aggregate information is fact checked, only the most accurate article of the plurality of articles determined by fact checking is summarized.

6. The method of claim 1 further comprising displaying the aggregate information, wherein only the aggregate information with a factual accuracy rating above a threshold is displayed.

7. The method of claim 1 wherein summarizing the target information is performed using lexical chaining and fact check results generated by fact checking the target information, including determining lexical chain strengths, wherein a total strength of a sentence is based on a lexical chain strength and a factual accuracy of the sentence, further wherein the total strength of the sentence is increased when the sentence is factually accurate and the total strength of the sentence is decreased when the sentence is factually inaccurate.

8. The method of claim 1 wherein summarizing the target information utilizes social networking information of a user to determine a focus of the target information, wherein the user is provided the status of the target information.

9. The method of claim 1 further comprising summarizing the source information using lexical chaining to generate summarized source information, and using the summarized source information for a preliminary comparison of the summary of the target information with the source information, and then using full source information corresponding to the summarized source information for the comparison to generate the result.

10. The method of claim 1 wherein generating the narrative information includes analyzing a validity rating of an entity, wherein the validity rating is based on factual accuracy of content provided by the entity, and only extracting data as the first set of data from the content provided by the entity when the validity rating of the entity is above a validity rating threshold, wherein generating the aggregate information includes analyzing the validity rating of the entity, wherein the validity rating is based on the factual accuracy of content provided by the entity, and only aggregating the data from the content provided by the entity when the validity rating of the entity is above the validity rating threshold.

11. The method of claim 1 wherein generating the narrative information includes analyzing a satisfaction rating of an entity, wherein the satisfaction rating is based on satisfaction analysis of content provided by the entity, and only extracting data as the first set of data from the content provided by the entity when the satisfaction rating of the entity is above a satisfaction rating threshold, wherein generating the aggregate information includes analyzing the satisfaction rating of the entity, wherein the satisfaction rating is based on the satisfaction analysis of content provided by the entity, and only aggregating data from the content provided by the entity when the satisfaction rating of the entity is above the satisfaction rating threshold.

12. The method of claim 1 wherein summarizing includes determining a set of most factually accurate sentences combined with lexical chaining to generate the summary.

13. The method of claim 1 wherein generating the narrative information by analyzing the at least one first data source includes matching user data with a template classification to select a template specific to the user, wherein the template specific to the user includes the at least one first data source specific to the user, wherein the template specific to the user is utilized in organizing the first set of data from the at least one first data source into the narrative.

14. The method of claim 1 further comprising generating advertisement information based on the summary of the target information.

15. The method of claim 1 wherein the at least one first data source includes augmented reality-acquired device information acquired using an augmented reality device, and wherein the status of the target information is displayed on the augmented reality device.

16. A method programmed in a non-transitory memory of a device comprising:

a. acquiring target information;

b. fact checking, with the device, the target information by comparing the target information with source information;

c. classifying factually accurate portions of the target information as factually accurate target information and factually inaccurate portions of the target information as factually inaccurate target information based on the fact checking;

d. summarizing the factually accurate target information to generate a factually accurate summary, wherein when the target information has not received a number of positive comments above a threshold, then a base number of sentences are utilized to generate the factually accurate summary, and when the target information has received the number of positive comments above the threshold, then the base number of sentences plus an additional number of sentences are utilized to generate the factually accurate summary;

e. summarizing the factually inaccurate target information to generate a factually inaccurate summary, wherein when the target information has not received the number of positive comments above the threshold, then the base number of sentences are utilized to generate the factually inaccurate summary, and when the target information has received the number of positive comments above the threshold, then the base number of sentences plus the additional number of sentences are utilized to generate the factually inaccurate summary;

f. displaying the factually accurate summary and the factually inaccurate summary on the device; and

g. sending the factually accurate summary and the factually inaccurate summary to be published.

17. A device comprising:

a. a camera device to acquire content;

b. a non-transitory memory for storing an application for automatically performing the following steps;

i. processing the content to determine target information;

ii. generating narrative information by analyzing at least one first data source including extracting a first set of data from the at least one first data source and organizing the first set of data from the at least one first data source into a narrative, wherein the at least one first data source is related to the target information, wherein generating the narrative information by analyzing the at least one first data source includes matching user data with a template classification to select a template specific to the user, wherein the template specific to the user includes the at least one first data source specific to the user, wherein the template specific to the user is utilized in organizing the first set of data from the at least one first data source into the narrative, wherein the first set of data includes a plurality of different perspectives, wherein the plurality of different perspectives are based on a plurality of different languages, further wherein a first perspective is a first content in a first language, and a second perspective is a second content in a second language, wherein the first language and the second language are different;

iii. generating aggregate information by aggregating a second set of data from at least one second data source or the at least one first data source;

iv. fact checking the aggregate information by comparing the aggregate information with source information to determine which of the aggregate information is above a factual accuracy threshold, wherein the aggregate information includes a first aggregate content in the first language and a second aggregate content in the second language, wherein fact checking the first aggregate content comprises fact checking using sources in the second language, and fact checking the second aggregate content comprises fact checking using sources in the first language;

v. summarizing the aggregate information above the factual accuracy threshold to generate a summary; and

vi. providing the narrative information and the summary in real-time, including translating the narrative information in the second language to the first language; and

c. a processor for processing the application.

18. The device of claim 17 further comprising modifying the aggregate information to generate modified aggregate information by deleting sentences containing factually inaccurate content in the aggregate information as determined by fact checking, wherein summarizing the aggregate information above the factual accuracy threshold to generate the summary utilizes the modified aggregate information.

19. The device of claim 17 wherein the aggregate information includes a plurality of articles and each article of the plurality of articles includes a plurality of sentences, wherein when a sentence is determined to be factually accurate based on fact checking and relevant to the summary based on lexical chaining, then the sentence is utilized when generating the summary, when the sentence is determined to be factually inaccurate based on fact checking and relevant to the summary based on lexical chaining, then the sentence is not utilized when generating the summary, when the sentence is determined to be factually accurate based on fact checking and not relevant to the summary based on lexical chaining, then the sentence is not utilized when generating the summary, when the sentence is determined to be factually inaccurate based on fact checking and not relevant to the summary based on lexical chaining, then the sentence is not utilized when generating the summary.

20. The device of claim 17 wherein the aggregate information includes a plurality of articles and each article of the plurality of articles receives a factual accuracy rating based on fact checking, further wherein an article of the plurality of articles with a lowest factual accuracy rating is summarized with a base number of sentences, and articles with higher factual accuracy ratings are summarized with the base number of sentences plus additional sentences such that the article with the highest factual accuracy rating is summarized with the base number of sentences plus a maximum number of additional sentences.