System and method for retrieving and organizing information from disparate computer network information sources

• US 7,567,953 B2
• Filed: 03/03/2003
• Issued: 07/28/2009
• Est. Priority Date: 03/01/2002
• Status: Active Grant

• Current Assignee: SAP America Incorporated (SAP SE)
• Original Assignee: Business Objects Americas (SAP SE)
• Inventors: Miller, William A., Kadayam, Sundar, Vora, Viral, Bishop, Gregory J.
• Primary Examiner(s): Corrielus; Jean M
• Application Number:
  US10/378,554
• Publication Number:
  US 20030212673A1
• Time in Patent Office: 2,339 Days
• Field of Search: 707/3, 707/4, 707/10
• US Class Current: 1/1
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9532 Query formulation
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99934 Query formulation, input preparation, or translation

Abstract

A system and method is provided for accessing information from a plurality of searchable information sources. The method includes the steps of: analyzing a user search query to determine a subject matter of the query; and selecting a sub-set of information from the plurality of information sources based upon the determined subject matter of the query. In further detailed embodiment, the analyzing step combines at least two methods of deriving the subject matter from the search query; and the method further includes the step of searching the information source(s) in the sub-set of information sources, substantially in parallel, for documents relevant to the search query. A system and method is also provided for searching a plurality of searchable information sources, where the information sources include at least one secure source. This method includes the steps of: (a) storing security credentials necessary for accessing the secure source; (b) accessing the secure source utilizing the stored security credentials; (c) accessing a non-secure source; (d) searching the accessed sources, substantially in parallel, for documents relevant to a search query; and (e) displaying results of the searching step.

Claims

1. A computer implemented method for accessing information from a plurality of searchable information sources comprising the steps of:

analyzing a user'"'"'s search query to determine a subject matter of the query;

selecting a subset of information sources from the plurality of information sources based upon the determined subject matter of the query, the subset of information sources associated with the determined subject matter of the query;

searching a standard information source for documents relevant to the search query;

displaying the results of searching the standard information source, a description of the subset of information sources, and an option to search the subset of information sources, the option identified by the determined subject matter of the query;

searching the subset of information sources for documents relevant to the search query in response to selection of the option; and

simultaneously displaying the results of searching the standard information source and of searching the subset of information sources, wherein the results of searching the subset of information sources are segregated for each of the information sources in the subset of information sources and from the results of searching the standard information source.

2. The computer implemented method of claim 1, wherein the standard information source is the World Wide Web.

3. The computer implemented method of claim 1, wherein the subset of information sources is maintained on a private computer network.

4. The computer implemented method of claim 1, wherein each information source in the subset of information sources is assigned a performance score pertaining to at least one of performance quality of the information source.

5. The computer implemented method of claim 4, wherein the results of searching the information sources in the subset of information sources are segregated according to the performance scores of the information sources in the subset of information sources.

6. The computer implemented method of claim 1, wherein the results of searching the standard information source and the results of searching the information sources in the subset of information sources are displayed in parallel in a screen display.

7. The computer implemented method of claim 1, wherein the subset of information sources comprise one or more secure sources and at least one non-secure source, and wherein searching the subset of information sources further comprises:

storing security credentials necessary for accessing the one or more secure sources;

accessing each of the secure sources substantially in parallel utilizing the security credentials, wherein the security credentials address security requirements specific to each of the secure sources;

accessing the at least one non-secure source; and

searching each of the accessed secure sources and the at least one non-secure source for documents relevant to the search query.

8. The computer implemented method of claim 7, wherein the security credentials are stored in a database, wherein the database includes a table for each user, and wherein each table includes a set of respective security credentials for accessing each of the secure sources by each respective user.

9. The computer implemented method of claim 7, wherein the step of storing security credentials includes the steps of recording each user'"'"'s security credentials as the user preliminarily enters the one or more secure sources and storing the recorded user'"'"'s security credentials for accessing the one or more secure sources.

10. The computer implemented method of claim 9, wherein recording each user'"'"'s security credentials as the user preliminarily enters the one or more secure sources and storing the recorded user'"'"'s security credentials for accessing the one or more secure sources includes providing a visual tool to the user that displays a log-in page for the one or more secure sources and has the user perform a step of logging into the one or more secure sources provided by the visual tool, wherein the visual tool records the user'"'"'s security credentials during the log-in step.

11. The computer implemented method of claim 1 further comprising generating a searchable source broker for defining patterns in the results of searching the subset of information sources, wherein the step of generating the searchable source broker further comprises the steps of:

accessing a searchable information source in the subset of information sources;

performing an example search on the searchable information source to produce search results by the searchable infonnation source;

identifying regular expressions from the search results, wherein identifying regular expressions includes extracting a desired portion of text from the search results; and

applying the regular expressions to the search results.

12. The computer implemented method of claim 11, further comprising the step of simultaneously displaying to the user, the search results and the output of applying the regular expressions to the search results.

13. The computer implemented method of claim 11, wherein the step of identifying regular expressions includes the steps of:

parsing the search results to distill a structure of the search results;

identifying repeating blocks of information from the parsed search results;

identifying essential search-result elements from the repeating blocks of information; and

generating the regular expressions for each element of the search results.

14. The computer implemented method of claim 11, wherein the accessing step includes the steps of:

providing a log-in fonm for the searchable information source;

logging into the searchable information source by entering the appropriate log-in information to the log-in form by the user;

recording security credential information provided by the user during the logging step; and

;

storing the security credential information with the searchable source broker for re-use by the searchable source broker in a federated search system.