SYSTEMS AND METHODS FOR ENTERPRISE DATA SEARCH AND ANALYSIS

• US 20160125038A1
• Filed: 11/03/2015
• Published: 05/05/2016
• Est. Priority Date: 11/03/2014
• Status: Active Grant

• Current Assignee: SavantX
• Original Assignee: SavantX
• Inventors: Heinbockel, Edmond Audrey, Ostby, David Linus
• Granted Patent: US 10,372,718 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/24575 using context
• CPC Class Codes: G06F 16/2458 Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/285 Clustering or classification

Abstract

A system and method for enterprise searching of documents. The system comprises a computing system configured to receive one or more search terms, and responsively analyze a group of documents to return analysis results. A method for enterprise searching includes indexing the group of documents, determining relevant terms and measuring the context between terms. Relevant portions of documents, also called passages of interest, are determined as part of the analysis process. The analysis includes analyzing the passages of interest for words, repeating term sequences, non-consecutive repeating root term sequences, and non-word terms. The terms/sequences are scored and sorted, resulting in a set of high-importance items, allowing a user to quickly subselect search results without reading through the results.

Claims

1. A method of analyzing a search of a plurality of text documents by a search system comprising a plurality of computing nodes comprising at least a processor coupled to a non-transitory memory, at least one network-attached storage device coupled to the plurality of computing nodes, a system management module comprising at least a processor coupled to a non-transitory memory, the system management module coupled to the plurality of computing nodes and configured to run at least one system management software, and a network management module coupled to the system management module and configured to communicate with a network, the search resulting in a set of expanded search terms, a search document set, and a plurality of POI, wherein the plurality of POI are divided into a plurality of groups, comprising the steps of:

obtaining all POI generated by the search;

ranking of all of a plurality of ROI in each group in order of occurrence in the group, wherein each ROI is one of a term in the group and a root of the term in the group;

ranking of all of a plurality of RTS in each group in order of occurrence in the group, wherein each RTS includes more than one contiguous term;

ranking of all of a plurality of COI in order of occurrence in the group, wherein each COI comprises two non-contiguous term roots found within a context window, wherein the context window is a consecutive number of terms in a document; and

ranking of all of a plurality of GID in order of occurrence in the group, wherein the GID are non-word terms in the group.

2. The method of analyzing the search of the plurality of text documents by the search system of claim 1, further comprising the steps of:

scoring each of the ROI;

scoring each of the RTS;

scoring each of the COI; and

scoring each of the GID.

3. The method of analyzing the search of the plurality of text documents by the search system of claim 2, wherein the score for each ROI is a frequency of occurrence of the plurality of ROI in the group divided by an average frequency of occurrence of the ROI in the plurality of text documents.

4. The method of analyzing the search of the plurality of text documents by the search system of claim 2, wherein the score for each RTS is a frequency of occurrence of the terms in the plurality of RTS in the group divided by an average frequency of occurrence of the terms in the plurality of RTS in the plurality of text documents.

5. The method of analyzing the search of the plurality of text documents by the search system of claim 4, wherein the score for each RTS is reduced for each high-frequency term located at at least one of the group consisting of a first term in the RTS and a last term in the RTS.

6. The method of analyzing the search of the plurality of text documents by the search system of claim 5, wherein the score for each RTS is multiplied by a number of occurrences of the RTS in the group.

7. The method of analyzing the search of the plurality of text documents by the search system of claim 2, wherein the score for each COI is a frequency of occurrence of the terms in the COI in the group divided by an average frequency of occurrence of the terms of the COI in the plurality of text documents.

8. The method of analyzing the search of the plurality of text documents by the search system of claim 7, wherein the score for each COI is reduced for each high-frequency term located at at least one of the group consisting of a first term in the COI and a last term in the COI.

9. The method of analyzing the search of the plurality of text documents by the search system of claim 8, wherein the score for each COI is multiplied by a number of occurrences of the COI in the group.

10. The method of analyzing the search of the plurality of text documents by the search system of claim 2, wherein the score for each GID is a frequency of occurrence of the GID in the group divided by an average frequency of occurrence of the GID in the plurality of text documents.

11. The method of analyzing the search of the plurality of text documents by the search system of claim 2, further comprising the step of:

creating a partial file for each group, each partial file comprising a plurality of highest-scored ROI of the group, a plurality of highest-scored RTS of the group, a plurality of highest-scored COI of the group, and a plurality of highest-scored GID of the group.

12. The method of analyzing the search of the plurality of text documents by the search system of claim 11, further comprising the step of combining the partial files into a grand score file.

13. The method of analyzing the search of the plurality of text documents by the search system of claim 12, further comprising the step of sorting each of the plurality of ROI, the plurality of RTS, the plurality of COI, and the plurality of GID of the grand score file by score.

14. The method of analyzing the search of the plurality of text documents by the search system of claim 13, wherein the grand score file is displayed for a user of a computing device in communication with the search system.

15. The method of analyzing the search of the plurality of text documents by the search system of claim 14, wherein the grand score file is displayed in a tree format.

16. The method of analyzing the search of the plurality of text documents by the search system of claim 14, wherein the grand score file is displayed via an internet browser.

17. The method of analyzing the search of the plurality of text documents by the search system of claim 13, further comprising the step of determining a time chart comprising time chart data for at least one of the plurality of ROI, the plurality of COI, the plurality of RTS, and the plurality of GID, wherein each time chart indicates occurrence of at least one of the ROI, COI, RTS and GID over a period of time.

18. The method of analyzing the search of the plurality of text documents by the search system of claim 17, further comprising the step of running at least one statistical analysis on the time chart data.

19. The method of analyzing the search of the plurality of text documents by the search system of claim 17, further comprising the step of performing a commonality analysis on at least one term included in at least one of the plurality of ROI, the plurality of COI, the plurality of RTS and the plurality of GID, including an expected probability of frequency of occurrence of the term versus an actual frequency of occurrence of the term.