System and method for filtering and alteration of digital data packets

• US 9,692,856 B2
• Filed: 07/25/2008
• Issued: 06/27/2017
• Est. Priority Date: 07/25/2008
• Status: Active Grant

• Current Assignee: CA, Inc. (d/b/a CA Technologies) (Broadcom, Inc.)
• Original Assignee: CA, Inc. (d/b/a CA Technologies) (Broadcom, Inc.)
• Inventors: Bryan, B. David
• Primary Examiner(s): Phillips, Hassan
• Assistant Examiner(s): Tsegaye, Saba
• Application Number:
  US12/180,348
• Publication Number:
  US 20100020801A1
• Time in Patent Office: 3,259 Days
• Field of Search: 370290, 370291, 370484, 370392, 370394, 375251, 375350, 701100
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching
• CPC Class Codes: H04L 69/08 Protocols for interworking; Protocol conversion

Abstract

A method comprises receiving data from a data source and converting the data, in approximately real time, into digital data packets, wherein the data packets have a common format. The method further comprises filtering the data packets using a user-defined metadata schema and storing the filtered data packets into a data storage medium.

Claims

1. A method, comprising:

receiving data from a data source;

converting the data using a user-defined metadata schema, in approximately real time, into digital data packets, wherein the data packets have a common format, the common format including elements defined by a markup language;

filtering the data packets using the user-defined metadata schema, the user-defined metadata schema not contained within the received data;

storing the filtered data packets into the database based at least in part on the metadata schema;

wherein the metadata schema defines the elements of the common format of the data packets according to the markup language, the types of data that the user does not wish to receive, one or more tables, one or more fields, and a plurality of relationships between the tables and fields of a database, and a mapping of a plurality of properties of the filtered data packets to the tables and fields of the database; and

wherein filtering the data packets comprises modifying one or more of the data packets.

2. The method of claim 1, wherein filtering the data packets comprises sequentially executing a plurality of filters on the data packets.

3. The method of claim 1, wherein modifying one or more of the data packets comprises replacing a data packet with information from a database table.

4. The method of claim 3, wherein filtering the data packets comprises dropping one or more of the data packets.

5. The method of claim 1, wherein filtering the data packets comprises dropping one or more of the data packets.

6. The method of claim 1, further comprising generating alerts when certain criteria defined in the metadata schema is detected in the data packets.

7. The method of claim 6, wherein generating alerts comprises sending an alert message to a user.

8. The method of claim 1, wherein the markup language is Extensible Markup Language (XML), the data packets are XML data packets, and the elements of the common format of the XML data packets are defined by the metadata schema.

9. A system, comprising:

an interface being operable to receive data from a data source;

a processor being operable to;

convert the data using a user-defined metadata schema, in approximately real time, into digital data packets, wherein the data packets have a common format, the common format including elements defined by a markup language; and

filter the data packets using the user-defined metadata schema, the user-defined metadata schema not contained within the received data;

a data storage medium being operable to store the filtered data in the database based at least in part on the metadata schema;

wherein the metadata schema defines elements of the common format of the data packets according to the markup language, the types of data that the user does not wish to receive, one or more tables, one or more fields, and a plurality of relationships between the tables and fields of a database, and a mapping of a plurality of properties of the filtered data packets to the tables and fields of the database; and

wherein the processor is further operable to modify one or more of the data packets.

10. The system of claim 9, wherein the processor is further operable to sequentially execute a plurality of filters on the data packets.

11. The system of claim 10, wherein the processor is further operable to replace a data packet with information from a database table.

12. The system of claim 9, wherein the processor is further operable to replace a data packet with information from a database table.

13. The system of claim 9, wherein the processor is further operable to drop one or more of the data packets.

14. The system of claim 9, wherein the processor is further operable to generate alerts when certain criteria defined in the metadata schema is detected in the data packets.

15. The system of claim 14, wherein the interface is further operable to send an alert message to a user.

16. The system of claim 9, wherein the markup language is Extensible Markup Language (XML), the data packets are XML data packets, and the elements of the common format of the XML data packets are defined by the metadata schema.

17. A non-transitory computer readable medium comprising logic operable, when executed on a processor, to:

receive data from a data source;

convert the data using a user-defined metadata schema, in approximately real time, into digital data packets, wherein the data packets have a common format, the common format including elements defined by a markup language;

filter the data packets using the user-defined metadata schema, the user-defined metadata schema not contained within the received data;

store the filtered data packets into the database based at least in part on the metadata schema;

wherein the metadata schema defines elements of the common format of the data packets according to the markup language, the types of data that the user does not wish to receive, one or more tables, one or more fields, and a plurality of relationships between the tables and fields of a database, and a mapping of a plurality of properties of the filtered data packets to the tables and fields of the database; and

wherein the logic is further operable to modify one or more of the data packets.

18. The computer readable medium of claim 17, wherein the logic is further operable to sequentially execute a plurality of filters on the data packets.

19. The computer readable medium of claim 17, wherein the logic is further operable to replace a data packet with information from a database table.

20. The computer readable medium of claim 19, wherein the logic is further operable to sequentially execute a plurality of filters on the data packets.

21. The computer readable medium of claim 17, wherein the logic is further operable to drop one or more of the data packets.

22. The computer readable medium of claim 17, wherein the logic is further operable to generate alerts when certain criteria defined in the metadata schema is detected in the data packets.

23. The computer readable medium of claim 22, wherein the logic is further operable to send an alert message to a user.

24. The computer readable medium of claim 17, wherein the markup language is Extensible Markup Language (XML), the data packets are XML data packets, and the elements of the common format of the XML data packets are defined by the metadata schema.