Method and system for data retrieval from heterogeneous data sources

• US 7,707,168 B2
• Filed: 08/10/2004
• Issued: 04/27/2010
• Est. Priority Date: 01/14/2004
• Status: Expired due to Fees

• Current Assignee: Agency For Science Technology and Research
• Original Assignee: Agency For Science Technology and Research
• Inventors: Tan, Puay Siew, Cheng, Yushi, Valliappan, Ramasamy
• Primary Examiner(s): Breene; John E
• Assistant Examiner(s): LE, THU NGUYET T
• Application Number:
  US10/915,732
• Publication Number:
  US 20050165754A1
• Time in Patent Office: 2,086 Days
• Field of Search: None
• US Class Current: 707/602
• CPC Class Codes: G06F 16/2452 Query translation
• CPC Class Codes: G06F 16/25 Integrating or interfacing systems involving database management systems

Abstract

A system and a method for specifying and configuring, together with categorising and classifying, heterogeneous types of multiple data sources is disclosed. The system and method also retrieve search results in accordance with search requests and conditions from at least one of the multiple data sources, for example a relational database management system (RDBMS), a light-weight directory access protocol (LDAP), an extensible mark-up language database (XMLDB), extensible mark-up language (XML) files, hypertext mark-up language (HTML) files, or TEXT files, through an application programming interface (API), or a web service interface such as a simple object access protocol (SOAP).

Claims

1. A method for searching and retrieving data from a plurality of heterogeneous data sources, through a network interface, comprising:

configuring and selecting, at a configure element, at least one data source from which to retrieve data, from said plurality of heterogeneous data sources;

wherein the configure element is in communication with each data source;

each of said data sources is associated with at least one corresponding data source type or data source owner;

a data source owner of said at least one data source uses meta-data information to pre-configure data of said data source based on said data source type or data source owner;

said selection is based on said pre-configured data of said data source type or data source owner;

retrieving said data in accordance with a task request, using a search element in communication with the configure element and each selected data source;

wherein communication between the data sources and the configure element and the search element is via search translators;

wherein each of said search translators is associated with one of said data source type or data source owner;

wherein each of said search translators verifies that a search request syntax provided by said search element is appropriate to its corresponding data source type or data source owner; and

wherein said search translators are selected from a group consisting of SQL translators, X-QUERY translators, XPATH translators, and Directory SDK for Java translators.

2. A method according to claim 1, wherein a data source configurator of the configure element, in communication with each of the data sources, configures and selects the data sources, and wherein said data source types are selected from a group consisting of a database management system, a relational database management system, an extensible markup language database, a light-weight directory access protocol, an extensible markup language file, a hypertext markup language file, and a text file.

3. The method of claim 1, wherein said data comprises only a portion of a data record available within said at least one data source.

4. The method of claim 1, wherein said search element further comprises a search manager that formulates said task request and a search filter that filters the retrieved data based on said task request.

5. The method of claim 4, wherein said search manager formulates said task request based on at least one of a data source owner and said data source types.

6. The method of claim 1, wherein the configure element comprises a data source configurator operable to communicate with each of the data sources and an administrative element operable to communicate with the search element.

7. The method of claim 1, wherein said task request specifically includes said one or more data source types that are provided by a requester.

8. A computer system comprising:

a data storage medium;

a network interface for communicating between said data storage medium and said data sources;

a user interface in communication with said network interface and said data storage medium;

wherein said computer system implements a computer program for searching and retrieving data from said plurality of heterogeneous data sources, the program comprising;

a configure element for communicating with each data source, wherein each data source has at least one associated data source type or data source owner;

a data source owner of said at least one data source uses meta-data information to pre-configure data of said data source based on said data source type or data source owner;

said configure element is configured to configure and select at least one data source from which to retrieve data;

the selection is based on said pre-configured data of said data source type or data source owner;

a search element for communicating with the configure element and each selected data source, said search element configured to retrieve said data from at least one of the heterogeneous data sources in accordance with a task request;

a search translator for each data source, to communicate with both the configure element and the search element;

wherein said data storage medium stores at least the retrieved data;

said user interface is configured to allow a user to provide said request and view said retrieved data;

wherein each of said search translators is associated with one of said data source type or data source owner;

wherein each of said search translators verifies that a search request syntax provided by said search element is appropriate to its corresponding data source type or data source owner; and

wherein said search translators are selected from a group consisting of SQL translators, X-QUERY translators, XPATH translators, and Directory SDK for Java translators.

9. A system according to claim 8, wherein said data source types are selected from a group consisting of a database management system, a relational database management system, an extensible markup language database, a light-weight directory access protocol, an extensible markup language file, a hypertext markup language file, and a text file.

10. The system according to claim 8, wherein said data comprises only a portion of a data record available within said data source.

11. A system according to claim 8, wherein the configure element comprises a data source configurator operable to communicate with each of the data sources and an administrative element operable to communicate with the search element.

12. A system according claim 8, wherein the search element comprises a search manager operable to communicate with each selected data source and a search filter operable to communicate with the configure element.

13. The system according to claim 12, wherein said search manager formulates said task request and said search filter filters the retrieved data based on said task request.

14. The system according to claim 13, wherein said search manager formulates said task request based on at least one of said data source owner and said data source types.

15. The system according to claim 14, wherein said data source owner uses said configure element to configure said data source types.

16. A system according to claim 8, further comprising an index element in communication with the search element and the configure element for storing characteristics of information relating to the data sources.

17. The system of claim 8, wherein said search translators, said configure element and said search element are located on said data storage medium.

18. The system of claim 8, wherein at least one of said search translators is located on a server containing at least one of said heterogeneous data sources.

19. The system of claim 8, wherein said task request specifically includes said one or more data source types that are provided by a requester.