Reducing duplication of embedded resources on a network

• US 7,870,089 B1
• Filed: 05/31/2002
• Issued: 01/11/2011
• Est. Priority Date: 12/03/2001
• Status: Active Grant

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: AOL Inc. (Apollo Global Management, Inc.)
• Inventors: Despeaux, Craig E., Sutton, Lorin R. Jr., Hall, Walter Scott III
• Primary Examiner(s): Agwumezie; Charles C
• Application Number:
  US10/157,955
• Time in Patent Office: 3,147 Days
• Field of Search: 705/50, 705/65, 705/75, 707/200, 709/206
• US Class Current: 707/694
• CPC Class Codes: H04L 51/08 Annexed information, e.g. attachments

Abstract

Systems and techniques for improving the performance of a network system having one or more sending systems and one or more receiving systems may include determining the digital signature of a received embedded digital resource, comparing the digital signature against stored digital signatures of digital resources accessible to the receiving system, and determining whether to store the received embedded digital resource and/or a location identifier for the stored version of the received embedded digital resource based on a result of the comparison.

Claims

1. A method for reducing duplication of resources in an electronic messaging system, the method comprising:

receiving an electronic message addressed to a user, the electronic message including a header portion, a content portion, and an embedded digital resource;

storing a representation of the electronic message with at least the header portion in association with the user'"'"'s mailbox information;

determining a digital signature for the embedded digital resource included in the electronic message;

accessing, from electronic storage, multiple digital signatures, each of the multiple digital signatures corresponding to an embedded digital resource included in a previous electronic message received by the electronic messaging system prior to receiving the electronic message;

comparing the digital signature for the embedded digital resource included in the electronic message against the accessed multiple digital signatures;

based on comparison results, determining whether the digital signature for the embedded digital resource included in the electronic message relates to a digital signature included in the accessed multiple digital signatures;

conditioned on determining that the digital signature for the embedded digital resource included in the electronic message relates to a digital signature included in the accessed multiple digital signatures;

identifying the related digital signature, the related digital signature corresponding to the embedded digital resource;

accessing counter data associated with the related digital signature, the counter data being based on a number of times that the embedded digital resource has been included in electronic messages received by the electronic messaging system;

determining, based on the accessed counter data, whether the embedded digital resource has been included in electronic messages received by the electronic messaging system more than a threshold number of times;

conditioned on determining that the embedded digital resource has been included in electronic messages received by the electronic messaging system more than the threshold number of times;

accessing a location identifier associated with the related digital signature, the location identifier identifying a location of a shared digital resource corresponding to the embedded digital resource, and

configuring, based on the accessed location identifier, the representation of the electronic message to reference the shared digital resource corresponding to the embedded digital resource; and

conditioned on determining that the embedded digital resource has not been included in electronic messages received by the electronic messaging system more than the threshold number of times;

storing a user version of the embedded digital resource in electronic storage associated with the electronic messaging system, and

configuring the representation of the electronic message to access the user version of the embedded digital resource; and

conditioned on determining that the digital signature for the embedded digital resource included in the electronic message does not relate to any of the accessed multiple digital signatures;

storing, in the electronic storage among the accessed multiple digital signatures, the digital signature for the embedded digital resource included in the electronic message; and

setting, to an initial value, a counter associated with the stored digital signature for the embedded digital resource included in the electronic message.

2. The method of claim 1 further comprising incrementing the counter in response to receiving a second electronic message that includes a second embedded digital resource that has a second digital signature that relates to the digital signature for the embedded digital resource included in the electronic message.

3. The method of claim 1 further comprising decrementing the counter associated with the stored digital signature for the embedded digital resource included in the electronic message in response to a user deleting an electronic message that included, when received by the electronic messaging system, a digital resource having a digital signature that relates to the stored digital signature for the embedded digital resource included in the electronic message.

4. The method of claim 3 further comprising:

storing, in electronic storage, the embedded digital resource included in the electronic message as a shared digital resource;

determining whether the counter associated with the stored digital signature for the embedded digital resource included in the electronic message is below a resource deletion threshold, and

in response to determining that the counter associated with the stored digital signature for the embedded digital resource included in the electronic message is below the file deletion threshold;

deleting the shared digital resource corresponding to the embedded digital resource included in the electronic message, and

maintaining, in electronic storage, the stored digital signature for the embedded digital resource included in the electronic message among the multiple digital signatures accessed to compare to digital signatures of embedded digital resources included in received electronic messages.

5. The method of claim 3 further comprising:

determining whether the counter associated with the stored digital signature for the embedded digital resource included in the electronic message is below a signature deletion threshold, and

in response to determining that the counter associated with the stored digital signature for the embedded digital resource included in the electronic message is below the signature deletion threshold, removing the stored digital signature for the embedded digital resource included in the electronic message from the stored digital signatures accessed to compare to digital signatures of embedded digital resources included in received electronic messages.

6. The method of claim 3 further comprising:

storing, in the electronic storage, the embedded digital resource included in the electronic message as a shared digital resource,

determining a location identifier for the shared digital resource corresponding to the embedded digital resource included in the electronic message,

associating the location identifier for the shared digital resource corresponding to the embedded digital resource included in the electronic message with the stored digital signature for the embedded digital resource included in the electronic message,

determining whether the counter associated with the stored digital signature for the embedded digital resource included in the electronic message is below a location identifier deletion threshold, and

in response to determining that the counter associated with the stored digital signature for the embedded digital resource included in the electronic message is below the location identifier deletion threshold;

deleting the location identifier associated with the stored digital signature for the embedded digital resource included in the electronic message, and

maintaining, in electronic storage, the stored digital signature for the embedded digital resource included in the electronic message among the multiple digital signatures accessed to compare to digital signatures of embedded digital resources included in received electronic messages.

7. A method for reducing duplication of resources in an electronic messaging system, the method comprising:

receiving an electronic message addressed to a user, the electronic message including an embedded digital resource;

storing a representation of the electronic message;

determining a digital signature for the embedded digital resource included in the electronic message;

accessing, from electronic storage, multiple digital signatures, each of the multiple digital signatures corresponding to an embedded digital resource included in a previous electronic message received by the electronic messaging system prior to receiving the electronic message;

comparing the digital signature for the embedded digital resource included in the electronic message against the accessed multiple stored digital signatures;

based on comparison results, identifying a digital signature included in the accessed multiple digital signatures that relates to the digital signature for the embedded digital resource included in the electronic message;

accessing frequency data associated with the identified digital signature, the frequency data indicating the frequency with which electronic messages that include the embedded digital resource have been received by the electronic messaging system;

determining, based on the accessed frequency data, whether the frequency with which electronic messages that include the embedded digital resource have been received by the electronic messaging system is more than a threshold frequency; and

conditioned on determining that the frequency with which electronic messages that include the embedded digital resource have been received is more than the threshold frequency;

accessing a location identifier associated with the identified digital signature, the location identifier identifying a location of a shared digital resource corresponding to the embedded digital resource, and

configuring, based on the accessed location identifier, the representation of the electronic message to reference the shared digital resource corresponding to the embedded digital resource; and

conditioned on determining that the frequency with which electronic messages that include the embedded digital resource have been received is less than the threshold frequency;

storing a user version of the embedded digital resource in electronic storage associated with the electronic messaging system, and

configuring the representation of the electronic message to access the user version of the embedded digital resource.

8. The method of claim 7 wherein accessing frequency data associated with the identified digital signature, the frequency data indicating the frequency with which electronic messages that include the embedded digital resource have been received by the electronic messaging system includes accessing frequency data indicating a number of times electronic messages that include the embedded digital resource have been received by the electronic messaging system during a given period of time.

9. A method for reducing duplication of resources in an electronic messaging system, the method comprising:

receiving an electronic message addressed to a user, the electronic message including a header portion, a content portion, and an embedded digital resource;

storing a representation of the electronic message with at least the header portion in association with the user'"'"'s mailbox information;

determining a digital signature for the embedded digital resource included in the electronic message;

accessing, from electronic storage, multiple digital signatures, each of the multiple digital signatures corresponding to an embedded digital resource included in a previous electronic message received by the electronic messaging system prior to receiving the electronic message;

comparing the digital signature for the embedded digital resource included in the electronic message against the accessed multiple digital signatures;

based on comparison results, determining whether the digital signature for the embedded digital resource included in the electronic message relates to a digital signature included in the accessed multiple digital signatures;

conditioned on determining that the digital signature for the embedded digital resource included in the electronic message relates to a digital signature included in the accessed multiple digital signatures;

identifying the related digital signature, the related digital signature corresponding to the embedded digital resource;

accessing counter data associated with the related digital signature, the counter data being based on a number of times that the embedded digital resource has been included in electronic messages received by the electronic messaging system;

determining, based on the accessed counter data, whether the embedded digital resource has been included in electronic messages received by the electronic messaging system more than a threshold number of times;

conditioned on determining that the embedded digital resource has been included in electronic messages received by the electronic messaging system more than the threshold number of times;

accessing a location identifier associated with the related digital signature, the location identifier identifying a location of a shared digital resource corresponding to the embedded digital resource, and

configuring, based on the accessed location identifier, the representation of the electronic message to reference the shared digital resource corresponding to the embedded digital resource; and

conditioned on determining that the embedded digital resource has not been included in electronic messages received by the electronic messaging system more than the threshold number of times;

storing a user version of the embedded digital resource in electronic storage associated with the electronic messaging system, and

configuring the representation of the electronic message to access the user version of the embedded digital resource.

10. The method of claim 9 wherein the embedded digital resource comprises an embedded resource in an electronic mail message.

11. The method of claim 9 wherein:

accessing counter data associated with the related digital signature, the counter data being based on a number of times that the embedded digital resource has been included in electronic messages received by the electronic messaging system includes accessing a counter associated with the related digital signature, the counter being configured to count the number of times that the embedded digital resource has been included in electronic messages received by the electronic messaging system; and

determining, based on the accessed counter data, whether the embedded digital resource has been included in electronic messages received by the electronic messaging system more than the threshold number of times includes determining whether a value of the counter associated with the related digital signature is greater than the threshold number of times.

12. The method of claim 9 further comprising conditioned on determining that the digital signature for the embedded digital resource included in the electronic message does not relate to any of the accessed multiple digital signatures:

storing, in the electronic storage among the accessed multiple digital signatures, the digital signature for the embedded digital resource included in the electronic message.

13. The method of claim 9 further comprising storing a location identifier for a previously-stored digital resource corresponding to the related digital signature.

14. The method of claim 9 wherein determining the digital signature includes applying a hashing technique to all or part of all of the embedded digital resource.

15. The method of claim 9 wherein the digital signature is determined from part of the embedded digital resource.

16. The method of claim 9 wherein the digital signature is determined based on a name of the embedded digital resource.

17. The method of claim 9 wherein determining the digital signature is determined based on a size of the embedded digital resource.

18. The method of claim 9 further comprising verifying that the embedded digital resource included in the electronic message corresponds to the shared digital resource corresponding to the related digital signature.

19. The method of claim 9 wherein determining, based on the accessed counter data, whether the embedded digital resource has been included in electronic messages received by the electronic messaging system more than the threshold number of times includes determining, based on the accessed counter data, whether the embedded digital resource has been included in electronic messages received by the electronic messaging system more than the threshold number of times, the threshold number of times being greater than two.

20. The method of claim 9 further comprising processing the electronic message to separate the header portion, the content portion, and the embedded digital resource.

21. The method of claim 9 wherein the shared digital resources are stored in an intermediate storage portion of the electronic messaging system.

22. The method of claim 9 wherein the user'"'"'s storage portion of the electronic messaging system includes a portion for storing mailbox information, a portion for storing content included in electronic messages, and a portion for storing embedded digital resources.

23. The method of claim 10 wherein the embedded digital resource includes an attachment in an electronic mail message.

24. The method of claim 13 further comprising not redundantly storing the embedded digital resource included in the electronic message.

25. The method of claim 14 wherein applying the hashing technique includes applying an MD5 algorithm to the embedded digital resource.

26. The method of claim 14 wherein applying the hashing technique includes applying a version of an SHA algorithm to the embedded digital resource.

27. The method of claim 18 wherein verifying that the embedded digital resource included in the electronic message corresponds to the shared digital resource corresponding to the related digital signature includes verifying that at least a portion of a name of the embedded digital resource included in the electronic message corresponds to at least a portion of a name of the shared digital resource.

28. The method of claim 18 wherein verifying that the embedded digital resource included in the electronic message corresponds to the shared digital resource corresponding to the related digital signature includes verifying based on a size of the shared digital resource and a size of the embedded digital resource included in the electronic message.

29. The method of claim 18 wherein verifying that the embedded digital resource included in the electronic message corresponds to the shared digital resource corresponding to the related digital signature includes verifying based on a hash performed on the shared digital resource.

30. The method of claim 18 wherein verifying that the embedded digital resource included in the electronic message corresponds to the shared digital resource corresponding to the related digital signature includes verifying based on data in the shared digital resource.

31. The method of claim 23 wherein determining the digital signature for the digital resource includes determining the digital signature of the attachment.

32. A system comprising:

a processor; and

memory encoded with executable instructions that, when executed by the processor, operate to cause the processor to perform operations comprising;

receiving an electronic message addressed to a user, the electronic message including a header portion, a content portion, and an embedded digital resource;

storing a representation of the electronic message with at least the header portion in association with the user'"'"'s mailbox information;

determining a digital signature for the embedded digital resource included in the electronic message;

accessing, from electronic storage, multiple digital signatures, each of the multiple digital signatures corresponding to an embedded digital resource included in a previous electronic message received by the electronic messaging system prior to receiving the electronic message;

comparing the digital signature for the embedded digital resource included in the electronic message against the accessed multiple digital signatures;

based on comparison results, determining whether the digital signature for the embedded digital resource included in the electronic message relates to a digital signature included in the accessed multiple digital signatures;

conditioned on determining that the digital signature for the embedded digital resource included in the electronic message relates to a digital signature included in the accessed multiple digital signatures;

identifying the related digital signature, the related digital signature corresponding to the embedded digital resource;

accessing counter data associated with the related digital signature, the counter data being based on a number of times that the embedded digital resource has been included in electronic messages received by the electronic messaging system;

determining, based on the accessed counter data, whether the embedded digital resource has been included in electronic messages received by the electronic messaging system more than a threshold number of times;

conditioned on determining that the embedded digital resource has been included in electronic messages received by the electronic messaging system more than the threshold number of times;

accessing a location identifier associated with the related digital signature, the location identifier identifying a location of a shared digital resource corresponding to the embedded digital resource, and

configuring, based on the accessed location identifier, the representation of the electronic message to reference the shared digital resource corresponding to the embedded digital resource; and

conditioned on determining that the embedded digital resource has not been included in electronic messages received by the electronic messaging system more than the threshold number of times;

storing a user version of the embedded digital resource in electronic storage associated with the electronic messaging system, and

configuring the representation of the electronic message to access the user version of the embedded digital resource.

33. The system of claim 32 wherein the operations further comprise:

conditioned on determining that the digital signature for the embedded digital resource included in the electronic message does not relate to any of the accessed multiple digital signatures;

storing, in the electronic storage among the accessed multiple digital signatures, the digital signature for the embedded digital resource included in the electronic message; and

setting, to an initial value, a counter associated with the stored digital signature for the embedded digital resource included in the electronic message.

34. The system of claim 32 wherein determining, based on the accessed counter data, whether the embedded digital resource has been included in electronic messages received by the electronic messaging system more than the threshold number of times includes determining, based on the accessed counter data, whether the embedded digital resource has been included in electronic messages received by the electronic messaging system more than the threshold number of times, the threshold number of times being greater than two.

35. The system of claim 32 wherein:

accessing counter data associated with the related digital signature, the counter data being based on a number of times that the embedded digital resource has been included in electronic messages received by the electronic messaging system includes accessing a counter associated with the related digital signature, the counter being configured to count the number of times that the embedded digital resource has been included in electronic messages received by the electronic messaging system; and

determining, based on the accessed counter data, whether the embedded digital resource has been included in electronic messages received by the electronic messaging system more than the threshold number of times includes determining whether a value of the counter associated with the related digital signature is greater than the threshold number of times.

36. The system of claim 33 wherein the operations further comprise incrementing the counter in response to receiving a second electronic message that includes a second embedded digital resource that has a second digital signature that relates to the digital signature for the embedded digital resource included in the electronic message.

37. The system of claim 33 wherein the operations further comprise decrementing the counter associated with the stored digital signature for the embedded digital resource included in the electronic message in response to a user deleting an electronic message that included, when received by the electronic messaging system, a digital resource having a digital signature that relates to the stored digital signature for the embedded digital resource included in the electronic message.

38. The system of claim 37 wherein the operations further comprise:

storing, in electronic storage, the embedded digital resource included in the electronic message as a shared digital resource;

determining whether the counter associated with the stored digital signature for the embedded digital resource included in the electronic message is below a resource deletion threshold, and

in response to determining that the counter associated with the stored digital signature for the embedded digital resource included in the electronic message is below the file deletion threshold;

deleting the shared digital resource corresponding to the embedded digital resource included in the electronic message, and

maintaining, in electronic storage, the stored digital signature for the embedded digital resource included in the electronic message among the multiple digital signatures accessed to compare to digital signatures of embedded digital resources included in received electronic messages.

39. The system of claim 37 wherein the operations further comprise:

determining whether the counter associated with the stored digital signature for the embedded digital resource included in the electronic message is below a signature deletion threshold, and

in response to determining that the counter associated with the stored digital signature for the embedded digital resource included in the electronic message is below the signature deletion threshold, removing the stored digital signature for the embedded digital resource included in the electronic message from the stored digital signatures accessed to compare to digital signatures of embedded digital resources included in received electronic messages.

40. The system of claim 37 wherein the operations further comprise:

storing, in the electronic storage, the embedded digital resource included in the electronic message as a shared digital resource,

determining a location identifier for the shared digital resource corresponding to the embedded digital resource included in the electronic message,

associating the location identifier for the shared digital resource corresponding to the embedded digital resource included in the electronic message with the stored digital signature for the embedded digital resource included in the electronic message,

determining whether the counter associated with the stored digital signature for the embedded digital resource included in the electronic message is below a location identifier deletion threshold, and

in response to determining that the counter associated with the stored digital signature for the embedded digital resource included in the electronic message is below the location identifier deletion threshold;

deleting the location identifier associated with the stored digital signature for the embedded digital resource included in the electronic message, and

maintaining, in electronic storage, the stored digital signature for the embedded digital resource included in the electronic message among the multiple digital signatures accessed to compare to digital signatures of embedded digital resources included in received electronic messages.

41. A computer-readable storage medium encoded with executable instructions that, when executed, operate to cause a computer to perform operations comprising:

receiving an electronic message addressed to a user, the electronic message including a header portion, a content portion, and an embedded digital resource;

storing a representation of the electronic message with at least the header portion in association with the user'"'"'s mailbox information;

determining a digital signature for the embedded digital resource included in the electronic message;

accessing, from electronic storage, multiple digital signatures, each of the multiple digital signatures corresponding to an embedded digital resource included in a previous electronic message received by the electronic messaging system prior to receiving the electronic message;

comparing the digital signature for the embedded digital resource included in the electronic message against the accessed multiple digital signatures;

based on comparison results, determining whether the digital signature for the embedded digital resource included in the electronic message relates to a digital signature included in the accessed multiple digital signatures;

conditioned on determining that the digital signature for the embedded digital resource included in the electronic message relates to a digital signature included in the accessed multiple digital signatures;

identifying the related digital signature, the related digital signature corresponding to the embedded digital resource;

accessing counter data associated with the related digital signature, the counter data being based on a number of times that the embedded digital resource has been included in electronic messages received by the electronic messaging system;

determining, based on the accessed counter data, whether the embedded digital resource has been included in electronic messages received by the electronic messaging system more than a threshold number of times;

conditioned on determining that the embedded digital resource has been included in electronic messages received by the electronic messaging system more than the threshold number of times;

accessing a location identifier associated with the related digital signature, the location identifier identifying a location of a shared digital resource corresponding to the embedded digital resource, and

configuring, based on the accessed location identifier, the representation of the electronic message to reference the shared digital resource corresponding to the embedded digital resource; and

conditioned on determining that the embedded digital resource has not been included in electronic messages received by the electronic messaging system more than the threshold number of times;

storing a user version of the embedded digital resource in electronic storage associated with the electronic messaging system, and

configuring the representation of the electronic message to access the user version of the embedded digital resource.

42. The computer-readable storage medium of claim 41 wherein the operations further comprise:

conditioned on determining that the digital signature for the embedded digital resource included in the electronic message does not relate to any of the accessed multiple digital signatures;

storing, in the electronic storage among the accessed multiple digital signatures, the digital signature for the embedded digital resource included in the electronic message; and

setting, to an initial value, a counter associated with the stored digital signature for the embedded digital resource included in the electronic message.

43. The computer-readable storage medium of claim 41 wherein determining, based on the accessed counter data, whether the embedded digital resource has been included in electronic messages received by the electronic messaging system more than the threshold number of times includes determining, based on the accessed counter data, whether the embedded digital resource has been included in electronic messages received by the electronic messaging system more than the threshold number of times, the threshold number of times being greater than two.

44. The computer-readable storage medium of claim 41 wherein:

accessing counter data associated with the related digital signature, the counter data being based on a number of times that the embedded digital resource has been included in electronic messages received by the electronic messaging system includes accessing a counter associated with the related digital signature, the counter being configured to count the number of times that the embedded digital resource has been included in electronic messages received by the electronic messaging system; and

determining, based on the accessed counter data, whether the embedded digital resource has been included in electronic messages received by the electronic messaging system more than the threshold number of times includes determining whether a value of the counter associated with the related digital signature is greater than the threshold number of times.

45. The computer-readable storage medium of claim 42 wherein the operations further comprise incrementing the counter in response to receiving a second electronic message that includes a second embedded digital resource that has a second digital signature that relates to the digital signature for the embedded digital resource included in the electronic message.

46. The computer-readable storage medium of claim 42 wherein the operations further comprise decrementing the counter associated with the stored digital signature for the embedded digital resource included in the electronic message in response to a user deleting an electronic message that included, when received by the electronic messaging system, a digital resource having a digital signature that relates to the stored digital signature for the embedded digital resource included in the electronic message.

47. The computer-readable storage medium of claim 46 wherein the operations further comprise:

storing, in electronic storage, the embedded digital resource included in the electronic message as a shared digital resource;

determining whether the counter associated with the stored digital signature for the embedded digital resource included in the electronic message is below a resource deletion threshold, and

in response to determining that the counter associated with the stored digital signature for the embedded digital resource included in the electronic message is below the file deletion threshold;

deleting the shared digital resource corresponding to the embedded digital resource included in the electronic message, and

maintaining, in electronic storage, the stored digital signature for the embedded digital resource included in the electronic message among the multiple digital signatures accessed to compare to digital signatures of embedded digital resources included in received electronic messages.

48. The computer-readable storage medium of claim 46 wherein the operations further comprise:

determining whether the counter associated with the stored digital signature for the embedded digital resource included in the electronic message is below a signature deletion threshold, and

in response to determining that the counter associated with the stored digital signature for the embedded digital resource included in the electronic message is below the signature deletion threshold, removing the stored digital signature for the embedded digital resource included in the electronic message from the stored digital signatures accessed to compare to digital signatures of embedded digital resources included in received electronic messages.

49. The computer-readable storage medium of claim 46 wherein the operations further comprise:

storing, in the electronic storage, the embedded digital resource included in the electronic message as a shared digital resource,

determining a location identifier for the shared digital resource corresponding to the embedded digital resource included in the electronic message,

associating the location identifier for the shared digital resource corresponding to the embedded digital resource included in the electronic message with the stored digital signature for the embedded digital resource included in the electronic message,

determining whether the counter associated with the stored digital signature for the embedded digital resource included in the electronic message is below a location identifier deletion threshold, and

in response to determining that the counter associated with the stored digital signature for the embedded digital resource included in the electronic message is below the location identifier deletion threshold;

deleting the location identifier associated with the stored digital signature for the embedded digital resource included in the electronic message, and

maintaining, in electronic storage, the stored digital signature for the embedded digital resource included in the electronic message among the multiple digital signatures accessed to compare to digital signatures of embedded digital resources included in received electronic messages.