AUTOMATED DUPLICATE MESSAGE CONTENT DETECTION

• US 20100274857A1
• Filed: 04/27/2009
• Published: 10/28/2010
• Est. Priority Date: 04/27/2009
• Status: Active Grant

• Current Assignee: International Business Machines Corporation, ServiceNow Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Hobson, Stephen James, Garza, Jose Emir
• Granted Patent: US 8,572,187 B2
• Time in Patent Office: Days
• US Class Current: 709/206
• CPC Class Codes: G06F 11/08 Error detection or correction by redundancy in data representation, e.g. by using checking codes
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/142 Managing session states for stateless protocols; Signalling session states; State transitions; Keeping-state mechanisms
• CPC Class Codes: H04L 69/40 for recovering from a failure of a protocol instance or entity, e.g. service redundancy protocols, protocol state redundancy or protocol service redirection management of faults, events, alarms or notifications in data switching networks H04L41/06

Abstract

Message content associated with at least one message received by a message processing server is stored in association with the message processing server. The message content within an incoming message is compared with the stored message content. A determination is made as to whether the stored message content is duplicated by the message content associated with the incoming message. A duplicate message content management action is performed based upon the determination as to whether the stored message content is duplicated by the message content associated with the incoming message. This abstract is not to be considered limiting, since other embodiments may deviate from the features described in this abstract.

Claims

1. A method, comprising:

storing, in association with a message processing server, message content associated with at least one message received by the message processing server;

comparing the message content within at least one incoming message with the stored message content;

determining whether the stored message content is duplicated by the message content associated with the at least one incoming message; and

performing a duplicate message content management action based upon the determination as to whether the stored message content is duplicated by the message content associated with the at least one incoming message.

2. The method of claim 1, where storing, in association with the message processing server, the message content associated with the at least one received message further comprises:

calculating a message content integrity value comprising at least one of a checksum value and a cyclical redundancy check (CRC) value based upon the message content associated with the at least one received message; and

storing the message content associated with the at least one received message in a memory at a location referenced by the message content integrity value.

3. The method of claim 1, where storing, in association with the message processing server, the message content associated with the at least one received message further comprises time stamping the message content associated with the at least one received message with an arrival time and further comprising:

storing the arrival time with the message content associated with the at least one received message; and

discarding the stored message content upon expiration of a configured expiration event for storage of message content.

4. The method of claim 3, where discarding the stored message content upon expiration of the configured expiration event for the storage of message content further comprises at least one of:

discarding the stored message content upon expiration of a fixed storage time;

discarding the stored message content upon arrival of a fixed number of intervening messages;

discarding the stored message content upon expiration of a message inter-arrival time longer than a configured message inter-arrival storage interval;

discarding the stored message content upon storage of message content in excess of a configured storage capacity limitation threshold;

discarding the stored message content upon expiration of a configured message duplication protection duration;

discarding the stored message content based upon a least recently matched (LRM) message content storage strategy; and

discarding the stored message content based upon a determination that the stored message content is duplicated by the message content associated with the at least one incoming message.

5. The method of claim 1, where comparing the message content within the at least one incoming message with the stored message content further comprises:

identifying a message content payload area associated with the at least one incoming message; and

comparing data within the message content payload area associated with the at least one incoming message with the stored message content.

6. The method of claim 1, where the message content within the at least one incoming message further comprises at least one portion of an extensible markup language (XML) document and where comparing the message content within the at least one incoming message with the stored message content further comprises processing the at least one portion of the XML document using an extensible stylesheet language transformation (XSLT) and identifying a data portion within the document using a result of the XSLT processing.

7. The method of claim 1, where determining whether the stored message content is duplicated by the message content associated with the at least one incoming message further comprises determining whether a specific data pattern is present within the stored message content and the message content associated with the at least one incoming message.

8. The method of claim 1, where performing the duplicate message content management action based upon a configured duplicate content management protocol further comprises at least one of:

in response to a determination that the at least one incoming message comprises duplicated message content, at least one of;

discarding at least one of the at least one incoming message and the stored message content; and

reporting that the stored message content is duplicated by the message content associated with the at least one incoming message; and

in response to a determination that the at least one incoming message does not comprise duplicated message content, at least one of;

processing the message content within the at least one incoming message; and

forwarding the at least one incoming message to another device.

9. A system, comprising:

a memory; and

a processor programmed to;

store, in association with a message processing server, message content associated with at least one message received by the message processing server in the memory;

compare the message content within at least one incoming message with the stored message content;

determine whether the stored message content is duplicated by the message content associated with the at least one incoming message; and

perform a duplicate message content management action based upon the determination as to whether the stored message content is duplicated by the message content associated with the at least one incoming message.

10. The system of claim 9, where, in being programmed to store, in association with the message processing server, the message content associated with the at least one message received by the message processing server in the memory, the processor is further programmed to:

calculate a message content integrity value comprising at least one of a checksum value and a cyclical redundancy check (CRC) value based upon the message content associated with the at least one received message; and

store the message content associated with the at least one received message in the memory at a location referenced by the message content integrity value.

11. The system of claim 9:

where, in being programmed to store, in association with the message processing server, the message content associated with the at least one message received by the message processing server in the memory, the processor is further programmed to time stamp the message content associated with the at least one received message with an arrival time; and

where the processor is further programmed to;

store the arrival time with the message content associated with the at least one received message in the memory; and

discard the stored message content upon expiration of a configured expiration event for storage of message content.

12. The system of claim 11, where, in being programmed to discard the stored message content upon expiration of the configured expiration event for the storage of message content, the processor is further programmed to at least one of:

discard the stored message content upon expiration of a fixed storage time;

discard the stored message content upon arrival of a fixed number of intervening messages;

discard the stored message content upon expiration of a message inter-arrival time longer than a configured message inter-arrival storage interval;

discard the stored message content upon storage of message content in excess of a configured storage capacity limitation threshold;

discard the stored message content upon expiration of a configured message duplication protection duration;

discard the stored message content based upon a least recently matched (LRM) message content storage strategy; and

discard the stored message content based upon a determination that the stored message content is duplicated by the message content associated with the at least one incoming message.

13. The system of claim 9, where, in being programmed to compare the message content within the at least one incoming message with the stored message content, the processor is further programmed to:

identify a message content payload area associated with the at least one incoming message; and

compare data within the message content payload area associated with the at least one incoming message with the stored message content.

14. The system of claim 9, where the message content within the at least one incoming message further comprises at least one portion of an extensible markup language (XML) document and where, in being programmed to compare the message content within the at least one incoming message with the stored message content, the processor is further programmed to process the at least one portion of the XML document using an extensible stylesheet language transformation (XSLT) and to identify a data portion within the document using a result of the XSLT processing.

15. The system of claim 9, where, in being programmed to determine whether the stored message content is duplicated by the message content associated with the at least one incoming message, the processor is further programmed to determine whether a specific data pattern is present within the stored message content and the message content associated with the at least one incoming message.

16. The system of claim 9, where, in being programmed to perform the duplicate message content management action based upon a configured duplicate content management protocol, the processor is further programmed to at least one of:

in response to a determination that the at least one incoming message comprises duplicated message content, at least one of;

discard at least one of the at least one incoming message and the stored message content; and

report that the stored message content is duplicated by the message content associated with the at least one incoming message; and

in response to a determination that the at least one incoming message does not comprise duplicated message content, at least one of;

process the message content within the at least one incoming message; and

forward the at least one incoming message to another device.

17. A system, comprising:

a memory; and

a processor programmed to;

calculate a message content integrity value comprising at least one of a checksum value and a cyclical redundancy check (CRC) value based upon message content associated with the at least one message received by a message processing server;

time stamp the message content associated with the at least one received message with an arrival time;

store the arrival time with the message content associated with the at least one received message in the memory at a location referenced by the message content integrity value;

identify a message content payload area associated with the at least one incoming message;

compare data within the message content payload area associated with the at least one incoming message with the stored message content;

determine whether a specific data pattern associated with the stored message content is duplicated by the message content associated with the at least one incoming message;

in response to a determination that the at least one incoming message comprises duplicated message content, at least one of;

discard at least one of the at least one incoming message and the stored message content; and

report that the stored message content is duplicated by the message content associated with the at least one incoming message; and

in response to a determination that the at least one incoming message does not comprise duplicated message content, at least one of;

process the message content within the at least one incoming message; and

forward the at least one incoming message to another device; and

discard the stored message content upon expiration of a configured expiration event for storage of message content if the stored message content has not been discarded in response to a determination that the at least one incoming message comprises duplicated message content.

18. A computer program product comprising a computer useable storage medium including a computer readable program, wherein the computer readable program when executed on a computer causes the computer to:

store, in association with a message processing server, message content associated with at least one message received by the message processing server in a memory;

compare the message content within at least one incoming message with the stored message content;

determine whether the stored message content is duplicated by the message content associated with the at least one incoming message; and

perform a duplicate message content management action based upon the determination as to whether the stored message content is duplicated by the message content associated with the at least one incoming message.

19. The computer program product of claim 18, where, in causing the computer to store, in association with the message processing server, the message content associated with the at least one received message, the computer readable program when executed on the computer further causes the computer to:

calculate a message content integrity value comprising at least one of a checksum value and a cyclical redundancy check (CRC) value based upon the message content associated with the at least one received message; and

store the message content associated with the at least one received message in the memory at a location referenced by the message content integrity value.

20. The computer program product of claim 18:

where, in causing the computer to store, in association with the message processing server, the message content associated with the at least one received message, the computer readable program when executed on the computer further causes the computer to time stamp the message content associated with the at least one received message with an arrival time; and

where the computer readable program when executed on the computer further causes the computer to;

store the arrival time with the message content associated with the at least one received message in the memory; and

discard the stored message content upon expiration of a configured expiration event for storage of message content.

21. The computer program product of claim 20, where, in causing the computer to discard the stored message content upon expiration of the configured expiration event for the storage of message content, the computer readable program when executed on the computer further causes the computer to at least one of:

discard the stored message content upon expiration of a fixed storage time;

discard the stored message content upon arrival of a fixed number of intervening messages;

discard the stored message content upon expiration of a message inter-arrival time longer than a configured message inter-arrival storage interval;

discard the stored message content upon storage of message content in excess of a configured storage capacity limitation threshold;

discard the stored message content upon expiration of a configured message duplication protection duration;

discard the stored message content based upon a least recently matched (LRM) message content storage strategy; and

discard the stored message content based upon a determination that the stored message content is duplicated by the message content associated with the at least one incoming message.

22. The computer program product of claim 18, where, in causing the computer to compare the message content within the at least one incoming message with the stored message content, the computer readable program when executed on the computer further causes the computer to:

identify a message content payload area associated with the at least one incoming message; and

compare data within the message content payload area associated with the at least one incoming message with the stored message content.

23. The computer program product of claim 18, where the message content within the at least one incoming message further comprises at least one portion of an extensible markup language (XML) document and where, in causing the computer to compare the message content within the at least one incoming message with the stored message content, the computer readable program when executed on the computer further causes the computer to process the at least one portion of the XML document using an extensible stylesheet language transformation (XSLT) and to identify a data portion within the document using a result of the XSLT processing.

24. The computer program product of claim 18, where, in causing the computer to determine whether the stored message content is duplicated by the message content associated with the at least one incoming message, the computer readable program when executed on the computer further causes the computer to determine whether a specific data pattern is present within the stored message content and the message content associated with the at least one incoming message.

25. The computer program product of claim 18, where, in causing the computer to perform the duplicate message content management action based upon a configured duplicate content management protocol, the computer readable program when executed on the computer further causes the computer to at least one of:

in response to a determination that the at least one incoming message comprises duplicated message content, at least one of;

discard at least one of the at least one incoming message and the stored message content; and

report that the stored message content is duplicated by the message content associated with the at least one incoming message; and

in response to a determination that the at least one incoming message does not comprise duplicated message content, at least one of;

process the message content within the at least one incoming message; and

forward the at least one incoming message to another device.