Systems and methods for key phrase characterization of documents

• US 10,162,887 B2
• Filed: 04/10/2017
• Issued: 12/25/2018
• Est. Priority Date: 06/30/2014
• Status: Active Grant

• Current Assignee: Palantir Technologies Incorporated
• Original Assignee: Palantir Technologies Incorporated
• Inventors: Kesin, Max, Wadhar, Hem
• Primary Examiner(s): Chbouki, Tarek
• Application Number:
  US15/483,731
• Publication Number:
  US 20170277780A1
• Time in Patent Office: 624 Days
• CPC Class Codes: G06F 16/345 Summarisation for human users

Abstract

Systems and methods are disclosed for key phrase characterization of documents. In accordance with one implementation, a method is provided for key phrase characterization of documents. The method includes obtaining a first plurality of documents based at least on a user input, obtaining a statistical model based at least on the user input, and obtaining, from content of the first plurality of documents, a plurality of segments. The method also includes determining statistical significance of the plurality of segments based at least on the statistical model and the content, and providing for display a representative segment from the plurality of segments, the representative segment being determined based at least on the statistical significance.

Claims

1. An electronic device comprising:

one or more computer-readable storage media configured to store instructions; and

one or more processors configured to execute the instructions to cause the electronic device to;

receive a user input indicative of an entity and a search query;

identify a statistical model associated with the entity, wherein the statistical model is determined based on a first plurality of documents associated with the entity, the statistical model indicative at least of frequencies of one or more words within the first plurality of documents;

identify, responsive to the user input, a second plurality of documents, at least partially different than the first plurality of documents, corresponding to the search query and the indicated entity;

identify, for each of the second plurality of documents, one or more segments;

apply the identified statistical model to each of the identified segments to determine, for each of the second plurality of documents, a statistical significance of segments identified in the documents, the statistical significance indicative of frequencies of the one or more words in the segment compared to the frequencies of the one or more words indicated in the statistical model;

and provide for display at least a representative segment having a highest statistical significance and a link to the document containing the representative segment.

2. The electronic device of claim 1, wherein the second plurality of documents is a subset of the first plurality of documents.

3. The electronic device of claim 1, wherein the entity identifies a company, and the first plurality of documents are associated with an industry associated with the company.

4. The electronic device of claim 1, wherein the user input comprises user'"'"'s selection of an area on a stock chart, and wherein the first plurality of documents have publication dates corresponding to a date range that corresponds to the area on the stock chart.

5. The electronic device of claim 1, wherein providing the representative segment for display comprises providing for display a phrase from the representative segment.

6. The electronic device of claim 1, wherein the one or more processors are further configured to execute the instructions to cause the electronic device to:

after providing the representative segment for display, receive a selection input associated with the representative segment; and

responsive to the selection input, provide for display the contents of one or more of the second plurality of documents.

7. The electronic device of claim 1, wherein statistical significance of segments is further based on a comparison of the statistical model and content of the second plurality of documents.

8. A method comprising:

by a computing system comprising a hardware computer processor and non-transitory storage medium storing software instructions,

receive a user input indicative of an entity and a search query;

identify a statistical model associated with the entity, wherein the statistical model is determined based on a first plurality of documents associated with the entity, the statistical model indicative at least of frequencies of one or more words within the first plurality of documents;

identify a second plurality of documents, at least partially different than the first plurality of documents, corresponding to the search query and the indicated entity;

identify, for each of the second plurality of documents, one or more segments;

apply the identified statistical model to each of the identified segments to determine, for each of the second plurality of documents, a statistical significance of segments identified in the documents, the statistical significance indicative of frequencies of the one or more words in the segment compared to the frequencies of the one or more words indicated in the statistical model; and

provide for display at least a representative segment having a highest statistical significance and a link to the document containing the representative segment.

9. The method of claim 8, wherein the second plurality of documents is a subset of the first plurality of documents.

10. The method of claim 8, wherein the entity identifies a company, and the first plurality of documents are associated with an industry associated with the company.

11. The method of claim 8, further comprising:

after providing the representative segment for display, receiving a selection input associated with the representative segment; and

responsive to the selection input, providing for display the contents of one or more of the second plurality of documents.

12. The method of claim 8, wherein statistical significance of segments is further based on comparing the statistical model and content of the second plurality of documents.

13. A non-transitory computer-readable medium storing a set of instructions that are executable by one or more electronic devices, each having one or more processors, to cause the one or more electronic devices to perform a method, the method comprising:

receiving a user input indicative of an entity and a search query;

identifying a statistical model associated with the entity, wherein the statistical model is determined based on a first plurality of documents associated with the entity, the statistical model indicative at least of frequencies of one or more words within the first plurality of documents;

identifying a second plurality of documents, at least partially different than the first plurality of documents, corresponding to the search query and the indicated entity;

identifying, for each of the second plurality of documents, one or more segments;

applying the identified statistical model to each of the identified segments to determine, for each of the second plurality of documents, a statistical significance of segments identified in the documents, the statistical significance indicative of frequencies of the one or more words in the segment compared to the frequencies of the one or more words indicated in the statistical model; and

providing for display at least a representative segment having a highest statistical significance and a link to the document containing the representative segment.

14. The non-transitory computer-readable medium of claim 13, wherein the second plurality of documents is a subset of the first plurality of documents.

15. The non-transitory computer-readable medium of claim 13, wherein the entity identifies a company, and the first plurality of documents are associated with an industry associated with the company.

16. The non-transitory computer-readable medium of claim 13, wherein the user input comprises user'"'"'s selection of an area on a stock chart, and wherein the first plurality of documents have publication dates corresponding to a date range that corresponds to the area on the stock chart.

17. The non-transitory computer-readable medium of claim 13, wherein providing the representative segment for display comprises providing for display a phrase from the representative segment.