Method and apparatus for retrieving and processing data

• US 20060047724A1
• Filed: 08/22/2005
• Published: 03/02/2006
• Est. Priority Date: 01/03/2002
• Status: Active Grant

• Current Assignee: Checkfree Services Corporation (Fiserv Incorporated)
• Original Assignee: Jeremy N. Sokolic, Roy Messing, Sanjeev Dheer, Venkatachari Dilip
• Inventors: Dilip, Venkatachari, Messing, Roy, Dheer, Sanjeev, Sokolic, Jeremy N.
• Granted Patent: US 7,873,677 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/957 Browsing optimisation, e.g. caching or content distillation
• CPC Class Codes: Y10S 707/95 Financial
• CPC Class Codes: Y10S 707/99942 Manipulating data structure, e.g. compression, compaction, compilation
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface
• CPC Class Codes: Y10S 707/99944 Object-oriented database structure
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing

Abstract

Data is captured from a web site or other data source. Data is extracted from the web page using a data harvesting script or other data acquisition routine. The extracted data is then normalized and stored in a database. If data cannot be extracted from the web page, a copy of the captured web page is stored without personal information contained in the web page. The data harvesting script is then edited based on an analysis of the captured web page.

Claims

1. A method comprising:

capturing a web page from a web site;

extracting data from the web page using a data harvesting script;

normalizing the extracted data; and

storing the normalized data in a database.

2. A method as recited in claim 1 wherein the web site is associated with a financial institution.

3. A method as recited in claim 1 wherein the captured web page contains information regarding a customer'"'"'s account at the financial institution.

4. A method as recited in claim 1 wherein the web page is an HTML screen.

5. A method as recited in claim 1 further-comprising:

capturing a second web page from a second web site;

extracting data from the second web page using the data harvesting script;

normalizing the data extracted from the second web page; and

storing the normalized data from the second web page in the database.

6. A method as recited in claim 1 further comprising generating an error message if data cannot be extracted from the web page using the data harvesting script.

7. A method as recited in claim 1 further comprising storing a copy of the captured web page if data cannot be extracted from the web page using the data harvesting script.

8. One or more computer-readable memories containing a computer program that is executable by a processor to perform the method recited in claim 1.

9. A method comprising:

capturing a web page from a web site;

attempting to extract data from the web page using a data harvesting script;

removing personal information from the captured web page;

storing the captured web page without the personal information; and

if data cannot be extracted from the web page, analyzing the web page and the data harvesting script to determine why data could not be extracted from the web page.

10. A method as recited in claim 9 further comprising editing the data harvesting script based on an analysis of the captured web page.

11. A method as recited in claim 9 further comprising:

editing the data harvesting script based on an analysis of the captured web page;

capturing a new version of the web page from the web site; and

extracting data from the web page using the edited data harvesting script.

12. A method as recited in claim 11 further comprising:

normalizing the data extracted from the web page; and

storing the normalized data in a database.

13. One or more computer-readable memories containing a computer program that is executable by a processor to perform the method recited in claim 9.

14. An apparatus comprising:

a data capture module configured to capture a web page from a web site associated with a financial institution;

a data extraction module coupled to the data capture module and configured to extract data from the captured web page using a data harvesting script, the data extraction module further configured to normalize the extracted data; and

a database control module coupled to the data extraction module and configured to store the normalized data in a database.

15. An apparatus as recited in claim 14 wherein the data capture module is further configured to retrieve financial data associated with a user'"'"'s account from a data source.

16. An apparatus as recited in claim 14 wherein the data extraction module is further configured to generate an error message if data cannot be extracted from the web page using the data harvesting script.