Systems and methods for providing a mixed data integration service

• US 20040167870A1
• Filed: 12/05/2003
• Published: 08/26/2004
• Est. Priority Date: 12/06/2002
• Status: Abandoned Application

• Current Assignee: Attensity Corporation (Attensity Group Incorporated)
• Original Assignee: Attensity Corporation (Attensity Group Incorporated)
• Inventors: Bean, David L., Wakefield, Todd D.
• Application Number:
  US10/729,888
• Publication Number:
  US 20040167870A1
• Time in Patent Office: Days
• US Class Current: 707/1
• CPC Class Codes: G06F 16/258 Data format conversion from or to a database
• CPC Class Codes: G06F 16/30 of unstructured textual data document management systems G06F16/93
• CPC Class Codes: G06F 16/313 Selection or weighting of terms for indexing

Abstract

Disclosed herein are systems, methods and products for interpreting and structuring free text records utilizing extractions of several types including syntactic, role, thematic and domain extractions. Also disclosed herein are systems, methods and products for integrating interpretive extractions with structured data into unified structures that can be analyzed with, among other tools, data mining and data visualization tools.

Claims

1. A system for providing a service to integrate structured and unstructured data, comprising:

a processing element;

one or more data access ports, said ports providing access to data by said processing element;

a set of one or more input devices readable by said processing element;

a storage device, said storage device containing instructions executable by said processing element to perform the functions of;

(i) reading a first access reference through said input device set, the first access reference referencing a customer'"'"'s database of structured data containing a set of data tuples;

(ii) reading a second access reference through said input device set, the second access reference referencing a customer'"'"'s source of unstructured data, the unstructured data including free text relatable to the data tuples of the structured data;

(iii) accessing the source of unstructured data through said second access reference;

(iv) interpreting the free text of the unstructured data to produce a set of construed data reflecting at least one relational fact conveyed in the free text, each construed datum relatable to a data tuple of the structured data;

(v) accessing the database of structured data; and

(vi) integrating the produced data with the data tuples of the structured data.

2. A system according to claim 1, wherein said accessing the source of unstructured data accesses text contained within the database of structured data.

3. A system according to claim 1, wherein said first access reference and said second access reference separate data sources.

4. A system according to claim 1, wherein said instructions are further executable to perform the function of applying caseframes while performing said interpreting the free text.

5. A system according to claim 1, wherein said instructions are further executable to perform the functions of:

(vii) reading a storage reference through said input device set, the storage reference providing a location for a product database;

(viii) producing a new database containing the integrated data produced by said integrating; and

(ix) storing the new database to the location reference by the storage reference.

6. A system according to claim 1, wherein said instructions are further executable to perform the function of inserting the produced data into the database of structured data referenced by the first access reference while performing said integrating the produced data.

7. A system according to claim 1, wherein said instructions are further executable to perform the function of creating a new database while performing said integrating the produced data.

8. A system according to claim 7, wherein the instructions are further executable to produce a new relational database containing the integrated data produced by said integrating.

9. A system according to claim 7, wherein the instructions are further executable to produce a file containing the integrated data produced by said integrating.

10. A system according to claim 9, wherein the instructions are further executable to produce a file having a format selected from the group of XML, character separated values, spreadsheet formats and file-based database structures.

11. A system according to claim 1, wherein said instructions are further executable to store an integrated database while performing said integrating the produced data.

12. A system according to claim 1, wherein the integrated data produced by the performance of said integrating the produced data includes reference information to the original free text for construed data.

13. A system according to claim 1, wherein said instructions are further executable to perform data mining on the integrated data.

14. A system according to claim 1, wherein said instructions are further executable to render a visual representation all or a part of the integrated data.

15. A method of providing a service to integrate structured and unstructured data, comprising the steps of:

reading a first access reference through said input device set, the first access reference referencing a customer'"'"'s database of structured data containing a set of data tuples;

reading a second access reference through said input device set, the second access reference referencing a customer'"'"'s source of unstructured data, the unstructured data including free text relatable to the data tuples of the structured data;

accessing the source of unstructured data through said second access reference;

interpreting the free text of the unstructured data to produce a set of construed data reflecting at least one relational fact conveyed in the free text, each construed datum relatable to a data tuple of the structured data;

accessing the database of structured data; and

integrating the produced data with the data tuples of the structured data.

16. A method according to claim 15, wherein said accessing the source of unstructured data accesses text contained within the database of structured data.

17. A method according to claim 15, wherein said first access reference and said second access reference reference separate data sources.

18. A method according to claim 15, further comprising the step of applying caseframes while performing said interpreting the free text.

19. A method according to claim 15, further comprising the steps of:

(vii) reading a storage reference through said input device set, the storage reference providing a location for a product database;

(viii) producing a new database containing the integrated data produced by said integrating; and

(ix) storing the new database to the location reference by the storage reference.

20. A method according to claim 15, further comprising the step of inserting the produced data into the database of structured data referenced by the first access reference while performing said integrating the produced data.

21. A method according to claim 15, further comprising the step of creating a new database while performing said integrating the produced data.

22. A method according to claim 21, further comprising the step of producing a new relational database containing the integrated data produced by said integrating.

23. A method according to claim 21, further comprising the step of producing a file containing the integrated data produced by said integrating.

24. A method according to claim 23, wherein the produced file has a format selected from the group of XML, character separated values, spreadsheet formats and file-based database structures.

25. A method according to claim 15, further comprising the step of storing an integrated database while performing said integrating the produced data.

26. A method according to claim 15, wherein the integrated data produced by the performance of said integrating the produced data includes reference information to the original free text for construed data.

27. A method according to claim 15, further comprising the step of data mining the integrated data.

28. A method according to claim 15, further comprising the step of rendering a visual representation all or a part of the integrated data.