METHOD AND APPARATUS FOR UPLOADING MASS-DISTRIBUTED CONTENT TO A SERVER

• US 20080022135A1
• Filed: 08/13/2007
• Published: 01/24/2008
• Est. Priority Date: 08/27/2002
• Status: Abandoned Application

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Gaya, Bruce
• Application Number:
  US11/838,033
• Publication Number:
  US 20080022135A1
• Time in Patent Office: Days
• US Class Current: 713/193
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

One embodiment of the present invention provides a system that facilitates uploading content from a client to a server. Upon receiving content, the client divides the content into smaller data-blocks of a predetermined size. Once the content has been divided, the client computes a codeword for each data-bock. Next, the client computes a composite codeword for the set of codewords by computing a function of the set of codewords. The client also computes a content identifier for the content to differentiate the content from other content. Once this is done, the client sends the composite codeword and the content identifier to the server, and receives a response from the server indicating whether or not the content is present on the server. If the content is not present on the server, the client sends the content to the server.

Claims

1. A method for uploading content to a server from a client comprising:

dividing the content into data-blocks of a predetermined size;

computing a codeword for each data-block to form a set of codewords;

computing a composite codeword for the set of codewords by computing a function of the set of codewords, wherein the composite codeword can be used by the server to determine if the content is available on the server;

computing a content identifier for the content to differentiate the content from other content;

sending the composite codeword and the content identifier to the server;

receiving a response from the server indicating whether or not the content is present on the server; and

if the content is not present on the server, sending the content to the server.

2. The method of claim 1, further comprising:

receiving a request from the server to send one or more data-blocks from the content; and

in response to the request, sending one or more data-blocks to the server.

3. The method of claim 1, further comprising:

receiving a notification from the server that the codeword did not match the stored codeword on the server for the data-block;

dividing the data-block into smaller data-blocks of a smaller predetermined size;

computing a new codeword for each smaller data-block;

in response to a request from the server, sending the new codewords to the server;

receiving a request from the server for one or more smaller data-blocks; and

in response to a request from the server, sending one or more of the smaller data-blocks.

4. The method of claim 1, wherein the codewords and the composite codeword are computed using a hash function.

5. The method of claim 1, further comprising sending an account identifier to the server to facilitate identification of the client.

6. The method of claim 1, wherein dividing the content into data-blocks of the predetermined size further involves padding the content with zeros until it is a multiple of the predetermined size.

7. The method of claim 1, wherein prior to dividing the content into data-blocks of the predetermined size, the method further involves saving the content in an alternate format that occupies less physical space than the original format.

8. A method for receiving content at a server from a client comprising:

receiving a composite codeword and a content identifier for the content at the server, wherein the composite codeword is a function of a set of codewords, and wherein each codeword in the set of codewords is a function of a data-block of the content;

determining if the content already exists on the server by checking if the content identifier exists in a database of content identifiers;

if the content exists on the server, determining if the composite codeword matches a stored composite codeword for the content; and

if the composite codeword matches the stored composite codeword, notifying the client that the content is present on the server;

whereby only one copy of the content is maintained on the server regardless of the number of upload instances of the content.

9. The method of claim 8, wherein if the content is not present on the server, further comprising:

notifying the client that the content is not present on the server;

receiving the content from the client;

dividing the content into data-blocks of a predetermined size;

computing a codeword for each data-block;

computing the composite codeword for the set of codewords by computing a function of the set of codewords;

computing the content identifier for the content to differentiate the content from other content; and

storing the codewords, the composite codeword, and the content identifier in the database.

10. The method of claim 9, wherein the codewords and the composite codeword are computed using a hash function.

11. The method of claim 8, further comprising receiving an account identifier at the server to facilitate identification of the client.

12. The method of claim 9, wherein prior to sending the response to the client indicating the presence of the content, the server uses the codewords and the composite codeword to determine what portions of the content the server has.

13. The method of claim 8, wherein if the composite codeword does not match the stored composite codeword, the method further comprises:

sending a request to the client for the set of codewords;

receiving the set of codewords from the client;

determining if each codeword received from the client is different from the corresponding codeword stored on the server;

sending a request to the client for the data-block that corresponds to the codeword from the client that did not match the corresponding codeword from the server; and

receiving the data-block from the client.

14. The method of claim 13, wherein if the codeword for the data-block does not match the corresponding codeword stored on the server, the method further comprises:

sending a request to the server for one or more data-blocks that correspond to the codewords that did not match; and

in response to the request, receiving one or more data-blocks at the server.

15. The method of claim 13, wherein if the codeword for the data-block does not match the corresponding codeword stored on the server, the method further comprises:

notifying the client that the codeword did not match the stored codeword for the data-block;

dividing the data-block into smaller data-blocks of a predetermined size;

computing a new codeword for each smaller data-block;

sending a request to the client for the set of new codewords;

receiving the set of new codewords from the client;

determining if each new codeword received from the client is different from the corresponding new codeword stored on the server;

sending a request to the client for the smaller data-block that corresponds to the new codeword from the client that did not match the corresponding new codeword from the server; and

receiving the smaller data-block from the client.

16. A computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for uploading content to a server from a client, the method comprising:

dividing the content into data-blocks of a predetermined size;

computing a codeword for each data-block to form a set of codewords;

computing a composite codeword for the set of codewords by computing a function of the set of codewords, wherein the composite codeword can be used by the server to determine if the content is available on the server;

computing a content identifier for the content to differentiate the content from other content;

sending the composite codeword and the content identifier to the server;

receiving a response from the server indicating whether or not the content is present on the server; and

if the content is not present on the server, sending the content to the server.

17. The computer-readable storage medium of claim 16, wherein the method further comprises:

receiving a request from the server to send one or more data-blocks from the content; and

in response to the request;

sending one or more data-blocks to the server.

18. The computer-readable storage medium of claim 16, wherein the method further comprises:

receiving a notification from the server that the codeword did not match the stored codeword on the server for the data-block;

dividing the data-block into smaller data-blocks of a smaller predetermined size;

computing a new codeword for each smaller data-block;

in response to a request from the server, sending the new codewords to the server;

receiving a request from the server for one or more smaller data-blocks; and

in response to a request from the server, sending one or more of the smaller data-blocks.

19. The computer-readable storage medium of claim 16, wherein the codewords and the composite codeword are computed using a hash function.

20. The computer-readable storage medium of claim 16, wherein the method further comprises sending an account identifier to the server to facilitate identification of the client.

21. The computer-readable storage medium of claim 16, wherein dividing the content into data-blocks of the predetermined size further involves padding the content with zeros until it is a multiple of the predetermined size.

22. A computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for receiving content at a server from a client, the method comprising:

receiving a composite codeword and a content identifier for the content at the server, wherein the composite codeword is a function of a set of codewords, and wherein each codeword in the set of codewords is a function of a data-block of the content;

determining if the content already exists on the server by checking if the content identifier exists in a database of content identifiers;

if the content exists on the server, determining if the composite codeword matches a stored composite codeword for the content; and

if the composite codeword matches the stored composite codeword, notifying the client that the content is present on the server;

whereby only one copy of the content is maintained on the server regardless of the number of upload instances of the content.

23. The computer-readable storage medium of claim 22, wherein if the content is not present on the server, the method further comprises:

notifying the client that the content is not present on the server;

receiving the content from the client;

dividing the content into data-blocks of a predetermined size;

computing a codeword for each data-block;

computing the composite codeword for the set of codewords by computing a function of the set of codewords;

computing the content identifier for the content to differentiate the content from other content; and

storing the codewords, the composite codeword, and the content identifier in the database.

24. The computer-readable storage medium of claim 23, wherein the codewords and the composite codeword are computed using a hash function.

25. The computer-readable storage medium of claim 22, wherein the method further comprises receiving an account identifier at the server to facilitate identification of the client.

26. The computer-readable storage medium of claim 23, wherein prior to sending the response to the client indicating the presence of the content, the server uses the codewords and the composite codeword to determine what portions of the content the server has.

27. The computer-readable storage medium of claim 22, wherein if the composite codeword does not match the stored composite codeword, the method further comprises:

sending a request to the client for the set of codewords;

receiving the set of codewords from the client;

determining if each codeword received from the client is different from the corresponding codeword stored on the server;

sending a request to the client for the data-block that corresponds to the codeword from the client that did not match the corresponding codeword from the server; and

receiving the data-block from the client.

28. The computer-readable storage medium of claim 27, wherein if the codeword for the data-block does not match the corresponding codeword stored on the server, the method further comprises:

sending a request to the server for one or more data-blocks that correspond to the codewords that did not match; and

in response to the request, receiving one or more data-blocks at the server.

29. The computer-readable storage medium of claim 27, wherein if the codeword for the data-block does not match the corresponding codeword stored on the server, the method further comprises:

notifying the client that the codeword did not match the stored codeword for the data-block;

dividing the data-block into smaller data-blocks of a predetermined size;

computing a new codeword for each smaller data-block;

sending a request to the client for the set of new codewords;

receiving the set of new codewords from the client;

determining if each new codeword received from the client is different from the corresponding new codeword stored on the server;

sending a request to the client for the smaller data-block that corresponds to the new codeword from the client that did not match the corresponding new codeword from the server; and

receiving the smaller data-block from the client.

30. An apparatus for uploading content to a server from a client comprising:

a dividing mechanism configured to divide the content into data-blocks of a predetermined size;

a codeword mechanism configured to compute a codeword for each data-block to form a set of codewords;

a composite codeword mechanism configured to compute a composite codeword for the set of codewords by computing a function of the set of codewords, wherein the composite codeword can be used by the server to determine if the content is available on the server;

a content identifier mechanism configured to compute a content identifier for the content to differentiate the content from other content;

a sending mechanism configured to send the composite codeword and the content identifier to the server;

a receiving mechanism configured to receive a response from the server indicating whether or not the content is present on the server; and

an uploading mechanism configured to send the content to the server if the content is not present on the server.

31. The apparatus of claim 30, further comprising:

a secondary receiving mechanism configured to receive a request from the server to send one or more data-blocks from the content; and

a secondary uploading mechanism configured to send one or more data-blocks to the server in response to the request.

32. The apparatus of claim 30, further comprising:

a listening mechanism configured to receive a notification from the server that the codeword did not match the stored codeword on the server for the data-block;

a secondary dividing mechanism configured to divide the data-block into smaller data-blocks of a smaller predetermined size;

a secondary codeword mechanism configured to compute a new codeword for each smaller data-block;

a secondary sending mechanism configured to send the set of new codewords to the server in response to a request from the server;

a secondary receiving mechanism configured to receive a request from the server for one or more smaller data-blocks; and

a secondary uploading mechanism configured to send one or more of the smaller data-blocks in response to a request from the server.

33. The apparatus of claim 30, wherein the codewords and the composite codeword are computed using a hash function.

34. The apparatus of claim 30, further comprising an identifier mechanism configured to send an account identifier to the server to facilitate identification of the client.

35. The apparatus of claim 30, wherein the dividing mechanism is further configured to pad the content with zeros until it is a multiple of the predetermined size.

36. An apparatus for receiving content at a server from a client comprising:

a receiving mechanism configured to receive a composite codeword and a content identifier for the content at the server, wherein the composite codeword is a function of a set of codewords and wherein each codeword in the set of codewords is a function of a data-block of the content;

a determination mechanism configured to determine if the content already exists on the server by checking if the content identifier exists in a database of content identifiers;

a secondary determination mechanism configured to determine if the composite codeword matches a stored composite codeword for the content if the content exists on the server; and

a notification mechanism configured to notify the client that the content is present on the server if the composite codeword matches the stored composite codeword;

whereby only one copy of the content is maintained on the server regardless of the number of upload instances of the content.

37. The apparatus of claim 36, wherein if the content is not present on the server, further comprising:

a secondary notification mechanism configured to notify the client that the content is not present on the server;

a secondary receiving mechanism configured to receive the content from the client;

a secondary dividing mechanism configured to divide the content into data-blocks of a predetermined size;

a codeword mechanism configured to compute a codeword for each data-block;

a composite codeword mechanism configured to compute the composite codeword for the set of codewords by computing a function of the set of codewords;

a content identifier mechanism configured to compute the content identifier for the content to differentiate the content from other content; and

a storage mechanism configured to store the codewords, the composite codeword, and the content identifier in the database.

38. The apparatus of claim 37, wherein the codewords and the composite codeword are computed using a hash function.

39. The apparatus of claim 36, further comprising a receiving mechanism configured to receive an account identifier at the server to facilitate identification of the client.

40. The apparatus of claim 37, further comprising a content analysis mechanism, wherein prior to sending the response to the client indicating the presence of the content, the content analysis mechanism configured to use the codewords and the composite codeword to determine what portions of the content the server has.

41. The apparatus of claim 36, wherein if the composite codeword does not match the stored composite codeword, further comprising:

a sending mechanism configured to send a request to the client for the set of codewords;

a secondary receiving mechanism configured to receive the set of codewords from the client;

an analysis mechanism configured to determine if each codeword received from the client is different from the corresponding codeword stored on the server;

a secondary sending mechanism configured to send a request to the client for the data-block that corresponds to the codeword from the client that did not match the corresponding codeword from the server; and

an uploading mechanism configured to receive the data-block from the client.

42. The apparatus of claim 41, wherein if the codeword for the data-block does not match the corresponding codeword stored on the server, further comprising:

a requesting mechanism configured to send a request to the server for one or more data-blocks that correspond to the codewords that did not match; and

in response to the request, a secondary uploading mechanism configured to receive one or more data-blocks at the server.

43. The apparatus of claim 41, wherein if the codeword for the data-block does not match the corresponding codeword stored on the server, further comprising:

a secondary notification mechanism configured to notify the client that the codeword did not match the stored codeword for the data-block;

a dividing mechanism configured to divide the data-block into smaller data-blocks of a predetermined size;

a codeword mechanism configured to compute a new codeword for each smaller data-block;

a requesting mechanism configured to send a request to the client for the set of new codewords;

a response mechanism configured to receive the set of new codewords from the client;

a secondary analysis mechanism configured to determine if each new codeword received from the client is different from the corresponding new codeword stored on the server;

a secondary requesting mechanism configured to send a request to the client for the smaller data-block that corresponds to the new codeword from the client that did not match the corresponding new codeword from the server; and

a secondary uploading mechanism configured to receive the smaller data-block from the client.