System and method for extracting content elements from multiple Internet sources

• US 20110185273A1
• Filed: 01/13/2011
• Published: 07/28/2011
• Est. Priority Date: 12/18/1998
• Status: Abandoned Application

• Current Assignee: IP3 2017, Series 200 of Allied Security Trust I (Allied Security Trust)
• Original Assignee: IP3 2017, Series 200 of Allied Security Trust I (Allied Security Trust)
• Inventors: DaCosta, Gerson Francis, Bhide, Rahul, Ghaskadvi, Vijay
• Application Number:
  US13/005,699
• Publication Number:
  US 20110185273A1
• Time in Patent Office: Days
• US Class Current: 715/234
• CPC Class Codes: G06F 9/5038 considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration scheduling strategies G06F9/4881 and subgroups
• CPC Class Codes: G06Q 99/00 Subject matter not provided for in other groups of this subclass

Abstract

A system for automatically extracting data from at least one electronic document accessible through the Internet or other computer network. The system records a sequence of actions operable to electronically navigate to a target page of the electronic document, the target page including a plurality of elements each having contents and a structural definition wherein the structural definitions interrelate the plurality of elements to specify a target pattern for a select subset of the plurality of elements. After recording the navigation path and the target pattern, the system automatically accesses the target page according to the recorded sequence. When the target page is accessed, the system automatically identifies, copies and processes selections from the plurality of elements dependent upon the target pattern.

Claims

1. A system for automatically extracting data from a plurality of electronic documents, each electronic document being accessible over a computer network, the system comprising at least one micro-processor based device configured to:

access through the network a first electronic document using first specifications;

receive criteria for extracting a first set of content elements of the first electronic document;

extract the first set of content elements based on the criteria;

access through the network a second electronic document using second specifications, the second specifications varying from the first specifications;

extract a second set of content elements based on the criteria; and

store the first and second set of content elements in a database.

2. The system of claim 1, wherein at least one of said first and second electronic documents is a web page.

3. The system of claim 1, wherein at least one of said first and second electronic documents is in one of .txt, .pdf, Word®

, .ppt and XML format.

4. The system of claim 1, wherein said criteria is based at least in part on a structural definition of the first electronic document, wherein the structural definition interrelates a plurality of content elements contained within the first electronic document.

5. The system of claim 1, wherein said criteria is based at least in part on contents of the first electronic document.

6. The system of claim 1, wherein said criteria is sent by a user filling in forms and activating HTTP links.

7. The system of claim 1, wherein the first and second set of content elements is stored in the database as XML tagged data.

8. The system of claim 1, wherein the first and second specifications are sent through the network as specified parameters in a form.

9. The system of claim 1, wherein the first and second specifications are included in respective first and second URLs.

10. A method implemented in a system comprising a micro-processor based device coupled to a network, the method comprising:

accessing in the system through the network a first electronic document using first specifications;

receiving in the system criteria for extracting a first set of content elements of the first electronic document;

extracting in the system the first set of content elements based on the criteria;

accessing in the system through the network a second electronic document using second specifications, the second specifications varying from the first specifications;

extracting in the system a second set of content elements based on the criteria; and

storing the first and second set of content elements in a database of the system.

11. The method of claim 10, wherein at least one of said first and second electronic documents is a web page.

12. The method of claim 10, wherein at least one of said first and second electronic documents is in one of .txt, .pdf, Word®

, .ppt and XML format.

13. The method of claim 10, wherein said criteria is based at least in part on a structural definition of the first electronic document, wherein the structural definition interrelates a plurality of content elements contained within the first electronic document.

14. The method of claim 10, wherein said criteria is based at least in part on contents of the first electronic document.

15. The method of claim 10, wherein said criteria is sent by a user filling in forms and activating HTTP links.

16. The method of claim 10, wherein the first and second set of content elements is stored in the database as XML tagged data.

17. The method of claim 10, wherein the first and second specifications are sent through the network as specified parameters in a form.

18. The method of claim 10, wherein the first and second specifications are included in respective first and second URLs.

19. A method implemented in a system comprising a micro-processor based device coupled to a network, the method comprising:

accessing in the system through the network an electronic document, the electronic document comprising a plurality of content elements;

extracting in the system a subset of the plurality content elements based on predefined criteria;

storing the subset of the plurality content elements in a database of the system.

20. The method of claim 19, wherein the criteria is based at least in part on a structural definition of the electronic document, wherein the structural definition interrelates the plurality of content elements.

21. The method of claim 19, wherein the criteria is based at least in part on contents of the electronic document.