Methods and systems for using script files to obtain, format and transport data

• US 9,734,222 B1
• Filed: 02/03/2009
• Issued: 08/15/2017
• Est. Priority Date: 04/06/2004
• Status: Active Grant

• Current Assignee: JP Morgan Chase Bank, N.A. (JP Morgan Chase & Co)
• Original Assignee: JP Morgan Chase Bank, N.A. (JP Morgan Chase & Co)
• Inventors: Milne, Kenneth T.
• Primary Examiner(s): Bashore, William
• Assistant Examiner(s): Shrewsbury, Nathan
• Application Number:
  US12/364,632
• Time in Patent Office: 3,115 Days
• Field of Search: 715203, 715760, 715810
• CPC Class Codes: G06F 16/258 Data format conversion from or to a database
• CPC Class Codes: G06F 7/00 Methods or arrangements for processing data by operating upon the order or content of the data handled logic circuits H03K19/00

Abstract

Embodiments of the invention can include a system and method for managing a plurality of data feeds to be loaded into a database. The method includes obtaining a script which specifies a query. The method includes executing the query against a source to extract a result set and consulting the script to determine a format for the data feed. The method also includes converting the result set in accordance with the format to create the data feed and transporting the data feed to be loaded into the database.

Claims

1. A computer-implemented method for managing a plurality of data feeds to be loaded into a database using a processor comprising the steps of:

obtaining a script using a server, the script for specifying a source including a name of a file to be extracted and a query stored in a database server;

executing the query using a computerized commander module in said database server against the source containing the named file to extract a result set;

transferring the result set from the server to the database server, wherein the result set is in a user readable format requiring conversion;

consulting the script to determine a format for the data feed to be loaded into the database, the script comprising a series of commands in a text file and setting forth each of the parameters needed by the database server to extract, format, and deliver the result set as a file to be loaded into the database;

converting the result set using the computerized conversion module in accordance with the format to create the data feed; and

transporting the data feed to be loaded into the database specified by the script.

2. The method of claim 1 further comprising consulting the script if data in said result set is to be edited.

3. The method of claim 2 further comprising editing said data in the result set prior to the converting.

4. The method of claim 1, further comprising consulting said script to specify said source.

5. The method of claim 4, wherein the query is referenced as a stored procedure that executes SQL commands against the specified source.

6. The method of claim 1 wherein said source is a specific file in a file system.

7. The method of claim 1 wherein said source is a specific queue in a messaging system.

8. The method of claim 1, wherein the script is stored as a text file.

9. The method of claim 1, wherein the result set is one of a text file, a flat file, a spreadsheet file, an HTML file, an XML file, and a PDF file.

10. The method of claim 1, wherein the result set is extracted as a transport method of one of electronic mail (e-mail), FTP, and JVS.

11. The method of claim 1, wherein the format specifies one or more format type options required for loading the data feed into the database.

12. The method of claim 1 further comprising controlling at least a portion of said script.

13. The method of claim 12 wherein said controlling comprises executing said script at a specific schedule.

14. The method of claim 12 wherein said controlling comprises executing said script multiple times at a specified interval.

15. The method of claim 1 wherein said script comprise a first set of instructions.

16. The method of claim 15 wherein said first set of instructions comprises repeat steps (a) through (e) for said query at a later time.

17. The method of claim 15 wherein said first set of instructions comprises halting the transporting of the data feed upon detection of a failure.

18. The method of claim 15 wherein said first set of instructions comprises invoking a second set of instructions in said script.

19. A system for managing a plurality of data feeds to be loaded into a database comprising:

a processor;

a server coupled to a database server for obtaining a script, the script for specifying a source including a name of a file to be extracted and a query;

said server comprising a commander module for executing the query against the source containing the named file to extract a result set and transferring the result set from the server to the database server, wherein the result set is in a user readable format requiring conversion;

said database server consulting the script to determine a format for the data feed to be loaded into the database, the script comprising a series of commands in a text file and setting forth each of the parameters needed by the database server to extract, format, and deliver the result set as a file to be loaded into the database;

said database server comprising a conversion module for converting the result set in accordance with the format to create the data feed; and

said database server transporting the data feed to be loaded into the database specified by the script.