Management of broadcast-distributed data entities

• US 8,849,920 B2
• Filed: 02/09/2007
• Issued: 09/30/2014
• Est. Priority Date: 02/09/2007
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Kirkland, Dustin C., Paranjape, Ameet M.
• Primary Examiner(s): Dharia, Rupal
• Assistant Examiner(s): Chacko, Joe
• Application Number:
  US11/673,093
• Publication Number:
  US 20080195708A1
• Time in Patent Office: 2,790 Days
• Field of Search: 709/206
• US Class Current: 709/206
• CPC Class Codes: G06Q 10/107 Computer-aided management of electronic mailing [e-mailing]
• CPC Class Codes: H04L 51/00 User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
• CPC Class Codes: H04L 51/42 Mailbox-related aspects, e.g. synchronisation of mailboxes

Abstract

A method, computer program product, and data processing system for reducing the storage needed for broadcast-distributed data entities, such as electronic mail messages from a mailing list, are disclosed. Locally stored data entities that are determined to have corresponding copies elsewhere are replaced with identifying information to allow the corresponding copies to be retrieved. In a preferred embodiment, locally-stored electronic mail messages in an electronic mail server that are determined to come from archived mailing lists are replaced periodically with one or more URLs (Uniform Resource Locator) of archived copies of the message. When a request from a mail client to download the electronic mail message is received, the message is reconstructed from the archived copy and returned to the client, rather than being retrieved from local storage.

Claims

1. A method in a data processing system having a local storage containing at least one electronic mailbox having one or more electronic mail messages, the method comprising:

initiating a storage compaction operation to reduce the size of the at least one electronic mailbox, wherein the storage compaction operation replaces the one or more electronic mail messages of the at least one electronic mailbox with identifying information for locating and retrieving the one or more electronic mail messages;

determining, for a particular message of the one or more electronic mail messages in a local mailbox of the at least one electronic mailbox maintained at the local storage, whether at least one copy of the particular message exists in a remote location outside of the local mailbox, wherein the remote location is not maintained by a mail server, wherein the determining further comprises;

the data processing system invoking an internet search engine to locate the at least one copy of the particular message on an Internet, using, as a search query in the internet search engine, one or more statistically improbable words from the particular message;

wherein the determining whether at least one copy of the particular message exists in a remote location further comprises;

invoking the internet search engine to locate the at least one copy of the particular message on the Internet, using, as a search query in the search engine, one or more phrases from the particular message;

identifying a potential copy of the particular message;

determining whether the potential copy is formatted differently than the particular message; and

in response to determining the potential copy is formatted differently than the particular message;

determining whether a human-intended portion of content within the potential copy is the same as a human-intended portion of content within the particular message; and

in response to determining the human-intended portion of content within the potential copy is the same as the human-intended portion of content within the particular message, identifying the potential copy as a copy of the particular message;

in response to a determination that the at least one copy of the particular message exists in the remote location, a processor of the data processing system replacing the particular message in the local mailbox with identifying information for locating and retrieving the at least one copy of the particular message from the remote location, wherein the identifying information comprises at least an address information of the remote location;

receiving a request for the particular message from a client system accessing the local mailbox;

in response to receiving the request for the particular message;

determining whether the particular message has been replaced in the local mailbox with the identifying information;

in response to determining that the particular message has been replaced in the local mailbox with the identifying information, retrieving a copy of the particular message by utilizing the identifying information to identify the remote location and retrieve the copy of the particular message from the remote location;

comparing the located at least one copy with the particular message to determine if the at least one copy is a match to the particular message by applying an algorithm on the at least one copy that enables the processor to verify an integrity of the at least one copy of the particular message during subsequent retrieval of the at least one copy of the particular message from the remote location; and

in response to receiving a request for the particular message and the identifying information comprising a Uniform Resource Locator (URL), accessing the URL on the Internet to retrieve the message content from a web page identified as located at the URL;

converting the copy of the particular message into an electronic mail message format; and

returning the retrieved copy of the particular message directly to the client system in fulfillment of the request.

2. The method of claim 1, wherein the at least one copy of the particular message is a web page that includes message content from the particular message, the method further comprising:

in response to a receiving a request at the local mailbox for the particular message;

retrieving the message content from the web page;

converting the message content from the web page into an electronic mail message format, wherein the converting further comprises appending mail protocol headers to the message content from the web page to enable processing of the message content as an ordinary electronic mail message; and

in response to converting the message content from the webpage into an electronic mail message format, returning an electronic mail message containing the message content to the local mailbox in fulfillment of the request.

3. The method of claim 1, wherein the local storage is an electronic mail storage of an electronic mail server that maintains a plurality of mailboxes corresponding to respective client systems, including the local mailbox.

4. The method of claim 1,

wherein the identifying information further comprises an identifier that is hashed from the at least one copy of the particular message.

5. The method of claim 1, wherein:

the local storage stores messages within a plurality of mailboxes for a plurality of recipients of the particular message;

the particular message for at least one of the plurality of recipients is replaced within a respective local mailbox with the identifying information; and

the identifying information is shared among the at least one of the plurality of recipients.

6. The method of claim 1, further comprising:

applying a hash function to the at least one copy of the particular message located at the remote location to obtain a local hash value;

storing the local hash value within the identifying information at the local mailbox; and

in response to a subsequent request from a client to retrieve the copy of the particular message from the remote location;

retrieving a present copy of the particular message from the remote location;

retrieving a hash value of the present copy from the remote location;

comparing the hash value of the present copy with the local hash value stored at the local mailbox; and

in response the comparison not resulting in a match, returning a message to the client indicating that the particular message is not available.

7. The method of claim 1, further comprising:

determining if the particular message was received via an electronic mail mailing list that maintains an archive of one or more messages of the electronic mail mailing list, including the particular message, at a particular location on the Internet;

wherein the replacing the particular message with identifying information further comprises replacing the locally-stored message with the location of one of (a) the archive and (b) the message as stored in the archive.

8. The method of claim 1, further comprising:

replacing the local mailbox with a compacted mailbox which contains identifying information for each of the one or more electronic mail messages having at least one copy in a remote location, wherein the identifying information is stored in the compacted mailbox; and

periodically performing the storage compaction operation on the at least one electronic mailbox.

9. A computer program product comprising a computer readable storage device having functional descriptive material stored thereon that, when executed by a computer having at least one electronic mailbox containing a plurality of electronic mail messages, causes the computer to perform actions that include:

initiating a storage compaction operation to reduce the size of the at least one electronic mailbox, wherein the storage compaction operation replaces the one or more electronic mail messages of the at least one electronic mailbox with identifying information for locating and retrieving the one or more electronic mail messages;

determining, for a particular message of the one or more electronic mail messages stored in a local mailbox of the at least one electronic mailbox, whether at least one copy of the particular message exists in a remote location outside of the local mailbox, wherein the remote location is not maintained by a mail server, wherein the determining further comprises;

invoking an internet search engine to locate the at least one copy of the particular message on an Internet, using, as a search query in the internet search engine, one or more statistically improbable words from the particular message;

identifying a potential copy of the particular message;

determining whether the potential copy is formatted differently than the particular message; and

in response to determining the potential copy is formatted differently than the particular message;

determining whether a human-intended portion of content within the potential copy is the same as a human-intended portion of content within the particular message; and

in response to determining the human-intended portion of content within the potential copy is the same as the human-intended portion of content within the particular message, identifying the potential copy as a copy of the particular message;

in response to a determination that the at least one copy of the particular message exists in the remote location, replacing the particular message within the local mailbox with identifying information for locating, confirming and retrieving the at least one copy of the particular message from the remote location, wherein the identifying information comprises at least address information of the remote location;

receiving a request for the particular message from a client system accessing the local mailbox;

in response to receiving the request for the particular message;

determining whether the particular message has been replaced in the local mailbox with the identifying information;

in response to determining that the particular message has been replaced in the local mailbox with the identifying information, retrieving a copy of the particular message by utilizing the identifying information to identify the remote location and retrieve the copy of the particular message from the remote location;

converting the copy of the particular message into an electronic mail message format;

returning the retrieved copy of the particular message directly to the client system in fulfillment of the request;

comparing the located at least one copy with the particular message to determine if the at least one copy is a match to the particular message by applying an algorithm on the at least one copy that enables the processor to verify an integrity of the at least one copy of the particular message during subsequent retrieval of the at least one copy of the particular message from the remote location; and

in response to receiving a request for the particular message and the identifying information comprising a Uniform Resource Locator (URL), accessing the URL on the Internet to retrieve the message content from a web page identified as located at the URL.

10. The computer program product of claim 9, wherein the at least one copy of the particular message is a web page that includes message content from the particular message, the computer program product further comprising additional functional descriptive material that causes the computer to perform the actions of:

in response to a request received at the local mailbox for the particular message;

retrieving the message content from the web page;

converting the message content from the web page into an electronic mail message format, wherein the converting further comprises appending mail protocol headers to the message content from the web page to enable processing of the message content as an ordinary electronic mail message; and

in response to converting the message content from the webpage into an electronic mail message format, returning an electronic mail message containing the message content to the local mailbox in fulfillment of the request.

11. The computer program product of claim 9, wherein the local storage is an electronic mail storage of an electronic mail server that maintains a plurality of mailboxes corresponding to respective client systems, including the local mailbox.

12. The computer program product of claim 9, wherein the determining includes:

invoking the internet search engine to locate the at least one copy of the particular message on the Internet, using, as a search query in the search engine, one or more phrases from the particular message; and

wherein the identifying information further comprises an identifier that is hashed from the at least one copy of the particular message;

wherein the local storage stores messages within a plurality of mailboxes for a plurality of recipients of the particular message;

wherein the particular message for at least one of the plurality of recipients is replaced within a respective local mailbox with the identifying information; and

wherein the identifying information is shared among the at least one of the plurality of recipients.

13. The computer program product of claim 11, further comprising additional functional descriptive material that, when executed by a computer, causes the computer to perform actions of:

applying a hash function to the at least one copy to obtain a local hash value;

storing the hash value within the identifying information; and

in response to a subsequent request from a client to retrieve the copy of the particular message from the remote location;

retrieving a present copy of the particular message from the remote location;

retrieving a hash value of the present copy from the remote location;

comparing the hash value of the present copy with the local hash value stored at the local mailbox; and

in response the comparison not resulting in a match, returning a message to the client indicating that the particular message is not available.

14. The computer program product of claim 11, comprising additional functional descriptive material that, when executed by a computer, causes the computer to perform actions of:

determining if the particular message was received via an electronic mail mailing list that maintains an archive of one or more messages of the electronic mail mailing list, including the particular message, at a particular location on the Internet;

wherein the functional descriptive material for replacing the particular message with identifying information further comprises functional descriptive material for the replacing the locally-stored message with the location of one of (a) the archive and (b) the message as stored in the archive.

15. The computer program product of claim 9, further comprising additional functional descriptive material that, when executed by a computer, causes the computer to perform actions of:

periodically performing the storage compaction operation on the at least one electronic mailbox; and

replacing the local mailbox with a compacted mailbox which contains identifying information for each of the one or more electronic mail messages having at least one copy in a remote location, wherein the identifying information is stored in the compacted mailbox.

16. A data processing system comprising:

at least one processor;

a memory coupled to the at least one processor;

data storage accessible to the at least one processor;

at least one electronic mailbox in the data storage, wherein the at least one electronic mailbox stores multiple electronic mail messages; and

a set of instructions in the data storage executing on the at least one processor that;

initiates a storage compaction operation to reduce the size of the at least one electronic mailbox, wherein the storage compaction operation replaces the one or more electronic mail messages of the at least one electronic mailbox with identifying information for locating and retrieving the one or more electronic mail messages;

determines, for a particular message of the one or more electronic mail messages contained within a local mailbox of the at least one electronic mailbox, whether at least one copy of the particular message exists at the remote location that is outside of the local mailbox, wherein the remote location is not maintained by a mail server; and

invokes an internet search engine to locate the at least one copy of the particular message on an Internet, using, as a search query in the internet search engine, one or more statistically improbable words from the particular message;

identifies a potential copy of a particular message;

determines whether the potential copy is formatted differently than the particular message;

in response to determining the potential copy is formatted differently than the particular message;

determines whether a human-intended portion of content within the potential copy is the same as a human-intended portion of content within the particular message; and

in response to determining the human-intended portion of content within the potential copy is the same as the human-intended portion of content within the particular message, identifies the potential copy as a copy of the particular message; and

in response to a determination that at least one copy of the particular message exists in the remote location, replaces the particular message within the local mailbox with identifying information for locating and retrieving the at least one copy of the particular message from the remote location, wherein the identifying information comprises at least an address information of the remote location;

receives a request for the particular message from a client system accessing the local mailbox;

in response to receiving the request for the particular message;

determines whether the particular message has been replaced in the local mailbox with the identifying information;

in response to determining that the particular message has been replaced in the local mailbox with the identifying information, retrieves a copy of the particular message by utilizing the identifying information to identify the remote location and retrieve the copy of the particular message from the remote location;

compares the located at least one copy with the particular message to determine if the at least one copy is a match to the particular message by applying an algorithm on the at least one copy that enables the processor to verify an integrity of the at least one copy of the particular message during subsequent retrieval of the at least one copy of the particular message from the remote location; and

in response to receiving a request for the particular message and the identifying information comprising a Uniform Resource Locator (URL), accesses the URL on the Internet to retrieve the message content from a web page identified as located at the URL.

17. The data processing system of claim 16, wherein:

the local storage is an electronic mail storage of an electronic mail server that maintains a plurality of mailboxes corresponding to respective mail clients, including the local mailbox, the identifying information comprises a Uniform Resource Locator (URL) corresponding to an address of the remote location, and the processor executes additional instructions that;

in response to receiving the request for the particular message;

converts the copy of the particular message into an electronic mail message format, wherein the converting further comprises appending mail protocol headers to the message content from the web page to enable processing of the message content as an ordinary electronic mail message; and

in response to converting the message content from the webpage into an electronic mail message format, returns an electronic mail message containing the message content in fulfillment of the request;

wherein the identifying information further comprises an identifier that is hashed from the at least one copy of the particular message;

wherein the local storage stores messages within a plurality of mailboxes for a plurality of recipients of the particular message;

wherein the particular message for at least one of the plurality of recipients is replaced within a respective local mailbox with the identifying information; and

wherein the identifying information is shared among the at least one of the plurality of recipients.

18. The data processing system of claim 17, wherein the at least one processor executes additional instructions that causes the data processing system to:

apply a hash function to the at least one copy to obtain a local hash value;

store the hash value within the identifying information; and

in response to a subsequent request from a client to retrieve the copy of the particular message from the remote location;

retrieve a present copy of the particular message from the remote location;

retrieve a hash value of the present copy from the remote location;

compare the hash value of the present copy with the local hash value stored at the local mailbox; and

in response the comparison not resulting in a match, returns a message to the client indicating that the particular message is not available.

19. The data processing system of claim 16, wherein the at least one processor executes additional instructions that:

periodically performs the storage compaction operation on the at least one electronic mailbox; and

replaces the local mailbox with a compacted mailbox which contains identifying information for each of the one or more electronic mail messages having at least one copy in a remote location, wherein the identifying information is stored in the compacted mailbox;

determining if the particular message originated from an electronic mail mailing list that maintains an archive of one or more messages of the electronic mail mailing list, including the particular message, at a particular location on the Internet; and

wherein replacing the particular message includes replacing the particular message with a location of one of (a) the archive and (b) the particular message as stored in the archive.