System and method for classifying and normalizing structured data

• US 20050246350A1
• Filed: 04/30/2004
• Published: 11/03/2005
• Est. Priority Date: 04/30/2004
• Status: Abandoned Application

• Current Assignee: Convergys Cmg Utah
• Original Assignee: Opence, Inc.
• Inventors: Canaran, Vishvas T.
• Application Number:
  US10/834,880
• Publication Number:
  US 20050246350A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/86 Mapping to a database
• CPC Class Codes: G06F 40/221 Parsing markup language streams streaming G06F40/149

Abstract

Embodiments of the invention generally relate to a method of processing data. The method includes receiving at least one structured data item and applying at least one processing rule to said at least one structured data item. The method also includes determining an anomaly associated with the at least one structured data item in response to the at least one structured data item matching a condition in said at least one processing rule. The method also includes appending the anomaly to a database of anomalies.

Claims

1. A method of processing data, the method comprising:

receiving at least one structured data item;

applying at least one processing rule to said at least one structured data item;

determining an anomaly associated with said at least one structured data item in response to said at least one structured data item matching a condition in said at least one processing rule; and

appending the anomaly to a database of anomalies.

2. The method according to claim 1, further comprising:

analyzing said database of anomalies; and

modifying said at least one processing rule based on the analysis of said database of anomalies.

3. The method according to claim 2, further comprising:

instantiating a virtual assistant;

querying a user on a response to an anomaly by the user; and

creating a processing rule based on the query of the user.

4. The method according to claim 3, further comprising adding the processing rule to a database of processing rules.

5. The method according to claim 4, wherein the creation of the processing rule further comprises instantiating an XML document containing the processing rule.

6. The method according to claim 1, further comprising:

analyzing a plurality of data items;

developing a pattern for the plurality of data items; and

developing a processing rule based on the pattern for the plurality of data items.

7. The method according to claim 6, further comprising:

appending the processing rule to a database of processing rules.

8. The method according to claim 7, wherein the creation of the processing rule further comprises instantiating an XML document containing the processing rule.

9. The method according to claim 1, wherein said at least one structured data item is contained in an XML document.

10. The method according to claim 1, further comprising:

instantiating a virtual assistant;

detecting a second anomaly not matching any condition in the at least one processing rule; and

mimicking a user on a response to the second anomaly by the virtual assistant.

11. The method according to claim 10, further comprising creating a new processing rule based on the response of the user.

12. The method according to claim 11, wherein the creation of the processing rule further comprises instantiating a XML document containing the new processing rule.

33. The apparatus according to claim 1, further comprising:

means for analyzing said database of anomalies; and

means for modifying said at least one processing rule based on the analysis of said database of anomalies.

34. The apparatus according to claim 33, further comprising:

means for instantiating a virtual assistant;

means for querying a user on a response to an anomaly by the user; and

means for creating a processing rule based on the query of the user.

35. The apparatus according to claim 34, further comprising means for adding the processing rule to a database of processing rules.

13. A system for processing structured data, the system comprising:

a processing rule module configured to store at least one processing rule, each processing rule configured to detect an anomaly; and

an anomaly engine configured to receive at least one structured data element, wherein the anomaly engine is also configured to determine a nearness vector for the at least one structured data element and to select a subset of processing rules based on a comparison of the nearness vector for the at least one structured data element and the respective nearness vectors of the subset of processing rules being within a predetermined value.

14. The system according to claim 13, wherein the anomaly engine is further configured to apply the subset of processing rules to the at least one structured data element.

15. The system according to claim 14, wherein the anomaly engine is further configured to determine an anomaly based on the at least one structured data element matching a condition in the subset of processing rules.

16. The system according to claim 13, wherein the processing rule module is adapted to receive additional processing rules based on analysis of the plurality of structured data elements.

17. The system according to claim 13, further comprising a pattern-matching module configured to analyze a plurality of structured data elements for a pattern.

18. The system according to claim 17, wherein the pattern-matching module is further configured to develop a new processing rule based on the pattern and to append the new processing rule to the processing rules module.

19. The system according to claim 13, further comprising a virtual assistant configured to monitor an agent.

20. The system according to claim 19, wherein the virtual assistant is further configured to monitor a response of the agent to a detected anomaly.

21. The system according to claim 20, wherein the virtual assistant is further configured to develop a new processing rule based on the response of the agent.

22. The system according to claim 21, wherein the virtual assistant is further configured to append the new processing rule to the processing rules module.

23. The system according to claim 20, wherein the monitoring is mimicking the response of the agent.

24. The system according to claim 20, wherein the monitoring is querying the agent about the response of the agent.

25. A computer readable storage medium on which is embedded one or more computer programs, the one or more computer programs implementing a method of processing structured data, the one or more computer programs comprising a set of instructions for:

receiving at least one structured data element;

maintaining a plurality of nearness vector for a plurality of processing rules, each nearness vector associated with a respective processing rule;

determining a nearness vector for at least one structured data element; and

selecting a subset of processing rules based on the nearness vector for the at least one structure data element and the associated nearness vectors for the subset of processing rules being within a predetermined value.

26. The one or more computer programs according to claim 25 further comprising a set of instructions for:

applying the subset of processing rules to the at least one structured data element; and

determining an anomaly based on the at least one structured data element matching a condition in the subset of processing rules.

27. The one or more computer programs according to claim 25 further comprising a set of instructions for:

applying the subset of processing rules to the at least one structured data element; and

determining an anomaly based on the at least one structured data element not matching a condition in the subset of processing rules.

28. The one or more computer programs according to claim 25 further comprising a set of instructions for:

monitoring a plurality of related structured data elements;

determining a pattern in the plurality of related structured data elements; and

developing a rule based on the pattern.

29. The one or more computer programs according to claim 28 further comprising a set of instructions for appending the rule to the plurality of processing rules.

30. The one or more computer programs according to claim 25 further comprising a set of instructions for:

instantiating a virtual agent;

monitoring a response by an agent to an anomaly; and

developing a rule based on the response.

31. The one or more computer programs according to claim 30 further comprising a set of instructions for appending the rule to the plurality of processing rules.

36. The apparatus according to claim 31, further comprising:

means for analyzing a plurality of data items;

means for developing a pattern for the plurality of data items; and

means for developing a processing rule based on the pattern for the plurality of data items.

37. The method according to claim 36, further comprising means for appending the processing rule to a database of processing rules.

38. The apparatus according to claim 31, further comprising:

means for instantiating a virtual assistant;

means for detecting a second anomaly not matching any condition in the at least one processing rule; and

means for mimicking a user on a response to the second anomaly by the virtual assistant.

39. The apparatus according to claim 38, further comprising means for creating a new processing rule based on the response of the user.

32. A means for processing data, the apparatus comprising:

means for receiving at least one structured data item;

means for applying at least one processing rule to said at least one structured data item;

means for determining an anomaly associated with said at least one structured data item in response to said at least one structured data item matching a condition in said at least one processing rule; and

means for appending the anomaly to a database of anomalies.