Multiple service bindings for a real time data integration service

• US 7,814,470 B2
• Filed: 02/24/2005
• Issued: 10/12/2010
• Est. Priority Date: 08/27/2003
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Cherel, Thomas, Tinnel, Brian, Mamou, Jean-Claude
• Primary Examiner(s): Kang; Insun
• Application Number:
  US11/064,773
• Publication Number:
  US 20050262188A1
• Time in Patent Office: 2,056 Days
• Field of Search: 717/105, 707/2, 707/101
• US Class Current: 717/162
• CPC Class Codes: G06F 16/254 Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
• CPC Class Codes: G06Q 10/10 Office automation; Time management

Abstract

Real time data integration jobs are deployed in a services oriented architecture as services that allow multiple service bindings. In one aspect, a method includes providing a code module executing a data integration job and a registry of services for storing the code module. When the code module is identified in the registry, access is provided to the code module in the registry of services, in real time wherein the code module may be accessed by more than one type of service binding such that different applications can utilize the real-time integration service using different protocols to invoke the real-time integration service. At least one of the types of service bindings may be an EJB binding, a SOAP binding, a JMS binding, and a web service binding. The data integration job may include an extraction job, a data transformation job, a loading job, a metadata management job, and a data quality job.

Claims

1. A method executed in a facility, the method comprising:

providing a data integration platform, in a service oriented architecture, comprising a code module for executing a data integration job, wherein the code module is stored in a registry of services;

defining a real-time integration service that exposes the data integration platform as a set of abstract services, wherein each abstract service is agnostic to a particular type of service binding and is accessible by more than one type of service binding; and

responsive to receiving a request, invoking the real-time integration service to perform the data integration job using the code module, wherein the real-time integration service is invoked in real time by more than one type of service binding such that different applications can utilize the real-time integration service using different protocols to invoke the real-time integration service, wherein the request is marked by a start-of-wave marker and an end-of-wave marker, and wherein the request is invoked as the request is received, wherein invoking the real-time integration service to perform the data integration job using the code module further comprises;

receiving the request for real time integration of data into a pipeline containing individual requests, by a real time integration agent of a computing facility, wherein each request in the pipeline is marked with the start-of-wave marker and the end-of-wave marker enabling the real time integration agent to recognize an initiation of the request and a completion of a data integration job instance associated with the request; and

responsive to existence of the start-of-wave marker, processing the request for real time integration of data by the real time integration agent of the computing facility from the plurality of data sources, accessible to the computing facility, wherein the request corresponds to a transaction in the pipeline, and wherein multiple transactions are in the pipeline simultaneously.

2. The method of claim 1 wherein the data integration job comprises an extraction job.

3. The method of claim 1 wherein the data integration job comprises a data transformation job.

4. The method of claim 1 wherein the data integration job comprises a loading job.

5. The method of claim 1 wherein the data integration job comprises a metadata management job.

6. The method of claim 1 wherein the data integration job comprises a data quality job.

7. The method of claim 1 wherein, of all types of service binding invoking the real-time integration service, at least one of the types of service binding is an EJB binding.

8. The method of claim 1 wherein, of all types of service binding invoking the real-time integration service, at least one of the types of service binding is a SOAP binding.

9. The method of claim 1 wherein, of all types of service binding invoking the real-time integration service, at least one of the types of service binding is a JMS binding.

10. The method of claim 1 wherein, of all types of service binding invoking the real-time integration service, at least two of the types of service bindings are a web service binding and a SOAP binding.

11. The method of claim 1 wherein, of all types of service binding invoking the real-time integration service, at least two of the types of service bindings are a EJB binding and a SOAP binding.

12. The method of claim 1 wherein, of all types of service binding invoking the real-time integration service, at least three of the types of service bindings are a EJB binding, a SOAP binding, and a JMS binding.

13. The method of claim 1 wherein the real-time integration service has a plurality of ports, and each port of the plurality of ports has a respective binding associated therewith, and wherein one of the different applications binds to a given one of the plurality of ports using a first type of binding and another of the different applications binds to another given one of the plurality of ports using a second type of binding that is a different type than the first type of binding.

14. The method of claim 13 wherein the first type of binding is a EJB binding and the second type of binding is a SOAP binding.

15. The method of claim 13 wherein, of all types of service binding invoking the real-time integration service, at least three of the types of service bindings are a EJB binding, a SOAP binding, and a JMS binding.

16. A data processing system having a processor comprising:

a data integration platform comprising a code module for executing a data integration job;

a real-time integration service that exposes the data integration platform as a set of abstract services, wherein each abstract service is agnostic to a particular type of service binding and is accessible by more than one type of service binding such that different applications can utilize the real-time integration service using different protocols to invoke the real-time integration service; and

a real time agent for processing a request for each transaction in the data integration job, wherein the request is processed as each request is received and each request is marked with a start-of-wave marker and an end-of-wave marker, wherein the real time agent is configured to receiving the request for real time integration of data into a pipeline containing individual requests, wherein each request in the pipeline is marked with the start-of-wave marker and the end-of-wave marker enabling the real time integration agent to recognize an initiation of the request and a completion of a data integration job instance associated with the request, the real time agent is further configured to process the request for real time integration of data in response to existence of the start-of-wave marker, wherein the request corresponds to a transaction in the pipeline, and wherein multiple transactions are in the pipeline simultaneously.

17. The data processing system of claim 16 wherein the real-time integration service has a plurality of ports, and each port of the plurality of ports has a respective binding associated therewith, and wherein one of the different applications binds to a given one of the plurality of ports using a first type of binding and another of the different applications binds to another given one of the plurality of ports using a second type of binding that is a different type than the first type of binding.