Resumable upload for hosted storage systems

• US 8,375,124 B1
• Filed: 10/06/2011
• Issued: 02/12/2013
• Est. Priority Date: 10/06/2011
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Schwartz, Michael F.
• Primary Examiner(s): LIN, WEN TAI
• Application Number:
  US13/267,582
• Time in Patent Office: 495 Days
• Field of Search: None
• US Class Current: 709/224
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 69/28 Timers or timing mechanisms used in protocols

Abstract

An initial portion of an object is received at a hosted storage system. The initial portion of the object is stored at the hosted storage system. After receiving the initial portion of the object, a timer is started. Prior to the expiration of the timer, whether an additional portion of the object is received at the hosted storage system is determined. The initial portion is deleted upon the expiration of the timer if the additional portion is not received. The timer is reset if the additional portion is received.

Claims

1. A method comprising:

receiving, at a hosted storage system, an initial portion of an object;

storing, at the hosted storage system, the initial portion of the object;

after receiving the initial portion of the object, starting a timer;

prior to the expiration of the timer;

receiving an additional portion of the object at the hosted storage system, wherein the additional portion of the object does not complete the object;

determining that the additional portion of the object was received at the hosted storage system; and

in response to determining that the additional portion of the object was received at the hosted storage system, resetting the timer;

after resetting the timer and upon expiration of the reset timer;

determining that a second, additional portion of the object was not received at the hosted storage system; and

in response to determining that the second, additional portion of the object was not received at the hosted storage system, deleting the initial portion of the object and the additional portion of the object.

2. The method of claim 1, wherein resetting the timer comprises:

determining that a size of the received, additional portion exceeds a threshold size; and

in response to determining that the size of the additional portion exceeds the threshold size, resetting the timer.

3. The method of claim 2 wherein the threshold size is a percentage of the object'"'"'s size.

4. The method of claim 2 wherein the threshold size is a defined number of bytes.

5. The method of claim 1, wherein resetting the timer comprises:

determining that the received, additional portion does not complete the object;

in response to determining that the received, additional portion does not complete the object, resetting the timer.

6. The method of claim 1 wherein receiving the initial portion of the object comprises receiving the initial portion of the object as part of an interrupted upload of the object.

7. The method of claim 1 wherein receiving the initial portion of the object comprises:

receiving, at the hosted storage system and from a client system, an initial upload request that does not include the object;

in response to receiving the initial upload request, sending an object identifier to the client system; and

receiving, at the hosted storage system and from the client system, a revised upload request, the revised upload request including the object identifier and the object, wherein the revised upload request is interrupted such that only the initial portion of the object is received by the hosted storage system.

8. The method of claim 7 further comprising:

receiving, at the hosted storage system and from the client system, a resumed upload request, the resumed upload request including the object identifier;

in response to receiving the resumed upload request, determining, based on the object identifier, a range of bytes that correspond to the initial portion of the object;

sending, from the hosted storage system and to the client system, the range of bytes;

receiving, at the hosted storage system and from the client system, the additional portion of the object starting after the range of bytes.

9. A hosted storage system comprising:

a service interface configured to receive an initial portion of an object;

at least one data store configured to store the initial portion of the object;

a garbage collector configured to;

start a timer after the initial portion of the object is received;

prior to the expiration of the timer, determine that an additional portion of the object was received at the hosted storage system, wherein the additional portion of the object did not complete the object; and

in response to determining that the additional portion of the object was received at the hosted storage system, reset the timer;

after resetting, the timer and upon expiration of the reset timer;

determine that a second, additional portion of the object was not received at the hosted storage system; and

in response to determining that the second, additional portion of the object was not received at the hosted storage system, delete the initial portion of the object and the additional portion of the object.

10. The system of claim 9 wherein

the service interface is configured to receive the additional portion of the object at the hosted storage system;

and

the garbage collector is configured to;

determine that a size of the received, additional portion exceeds a threshold size; and

in response to determining that the size of the received, additional portion exceeds the threshold size, reset the timer.

11. The system of claim 10 wherein the threshold size is a percentage of the object'"'"'s size.

12. The system of claim 10 wherein the threshold size is a defined number of bytes.

13. The system of claim 9 wherein:

the service interface is configured to receive the additional portion of the object at the hosted storage system;

the garbage collector is configured to;

determine that the received, additional portion does not complete the object; and

in response to determining that the received, additional portion does not complete the object, reset the timer.

14. The system of claim 9 wherein the initial portion of the object is received as part of an interrupted upload of the object.

15. The system of claim 9 wherein, to receive the initial portion of the object, the service interface is configured to:

receive, from a client system, an initial upload request that does not include the object;

in response to receiving the initial upload request, send an object identifier to the client system; and

receive, from the client system, a revised upload request, the revised upload request including the object identifier and the object, wherein the revised upload request is interrupted such that only the initial portion of the object is received by the hosted storage system.

16. The system of claim 15 wherein the service interface is configured to:

receive, from the client system a resumed upload request, the resumed upload request including the object identifier;

in response to receiving the resumed upload request, determine, based on the object identifier, a range of bytes that correspond to the initial portion of the object;

send the range of bytes to the client system;

receive, form the client system, the additional portion of the object starting after the range of bytes.

17. A non-transitory computer readable medium storing instructions, which, when executed by one or more processing devices, causes the one or more processing devices to perform the operations of:

receiving, at a hosted storage system, an initial portion of an object;

storing, at the hosted storage system, the initial portion of the object;

after receiving the initial portion of the object, starting a timer;

prior to the expiration of the timer;

receiving an additional portion of the object at the hosted storage system, wherein the additional portion of the object does not complete the object;

determining that the additional portion of the object was received at the hosted storage system; and

in response to determining that the additional portion of the object was received at the hosted storage system, resetting the timer;

after resetting the timer and upon expiration of the reset timer;

determining that a second, additional portion of the object was not received at the hosted storage system; and

in response to determining that the second, additional portion of the object was not received at the hosted storage system, deleting the initial portion of the object and the additional portion of the object.

18. The computer readable medium of claim 17 wherein the instructions include instructions, which, when executed by the one or more processing devices, causes the one or more processing devices to perform the operations of:

determining that a size of the received, additional portion exceeds a threshold size; and

in response to determining that the size of the additional portion exceeds the threshold size, resetting the timer.

19. The computer readable medium of claim 18 wherein the threshold size is a percentage of the object'"'"'s size.

20. The computer readable medium of claim 18 wherein the threshold size is a defined number of bytes.

21. The computer readable medium of claim 17 wherein the instructions include instructions, which, when executed by the one or more processing devices, causes the one or more processing devices to perform the operations of:

determining that the received, additional portion does not complete the object;

in response to determining that the received, additional portion does not complete the object, resetting the timer.

22. The computer readable medium of claim 17 wherein, to receive the initial portion of the object, the instructions include instructions, which, when executed by the one or more processing devices, cause the one or more processing devices to perform the operation of receiving the initial portion of the object as part of an interrupted upload of the object.

23. The computer readable medium of claim 17 wherein, to receive the initial portion of the object, the instructions include instructions, which, when executed by the one or more processing devices, cause the one or more processing devices to perform the operations of:

receiving, at the hosted storage system and from a client system, an initial upload request that does not include the object;

in response to receiving the initial upload request, sending an object identifier to the client system; and

receiving, at the hosted storage system and from the client system, a revised upload request, the revised upload request including the object identifier and the object, wherein the revised upload request is interrupted such that only the initial portion of the object is received by the hosted storage system.

24. The computer readable medium of claim 23 wherein the instructions include instructions, which, when executed by the one or more processing devices, causes the one or more processing devices to perform the operations of:

receiving, at the hosted storage system and from the client system, a resumed upload request, the resumed upload request including the object identifier;

in response to receiving the resumed upload request, determining, based on the object identifier, a range of bytes that correspond to the initial portion of the object;

sending, from the hosted storage system and to the client system, the range of bytes;

receiving, at the hosted storage system and from the client system, the additional portion of the object starting after the range of bytes.

25. A method comprising:

receiving, at a hosted storage system and from a client system, an initial upload request for an object, wherein the initial upload request is an HTTP request;

in response to receiving the initial upload request, sending an object identifier from the hosted storage system to the client system;

receiving, at the hosted storage system and from the client system, a revised upload request, the revised upload request including the object identifier and the object, wherein the revised upload request is an HTTP request and is interrupted such that only an initial portion of the object is received by the hosted storage system;

after receiving the initial portion of the object, starting a timer;

prior to the expiration of the timer;

receiving, at the hosted storage system and from the client system, a resumed upload request, wherein the resumed upload request is an HTTP request and includes the object identifier, and wherein the resumed upload request is sent from the client system because the revised upload request was interrupted;

in response to receiving the resumed upload request, determining, based on the object identifier, a range of bytes that correspond to the initial portion of the object;

sending, from the hosted storage system and to the client system, the range of bytes;

receiving, at the hosted storage system and from the client system, an additional portion of the object starting after the range of bytes;

prior to the expiration of the timer;

determining that the received, additional portion of the object does not complete the object; and

in response to determining that the received, additional portion of the object does not complete the object, resetting the timer;

after resetting the timer and upon expiration of the reset timer;

determining that a second, additional portion of the object was not received at the hosted storage system; and

in response to determining that the second, additional portion of the object was not received at the hosted storage system, deleting the initial portion of the object and the additional portion of the object.

26. A method comprising:

receiving, at a hosted storage system, an initial portion of an object;

storing, at the hosted storage system, the initial portion of the object;

after receiving the initial portion of the object, starting a timer;

prior to the expiration of the timer;

receiving a first, additional portion of the object at the hosted storage system, wherein the first, additional portion of the object does not complete object;

determining that the first, additional portion of the object was received at the hosted storage system; and

in response to determining that the first, additional portion of the object was received at the hosted storage system, resetting the timer;

after resetting the timer but prior to a second expiration of the timer;

receiving a second, additional portion of the object at the hosted storage system, wherein the second, additional portion of the object does not complete object; and

determining that the second, additional portion of the object was received at the hosted storage system; and

in response to determining that the second, additional portion of the object was received at the hosted storage system, resetting the timer a second time;

after resetting the timer the second time and upon expiration of the reset timer;

determining that a third, additional portion of the object was not received at the hosted storage system; and

in response to determining that the third, additional portion of the object was not received at the hosted storage system, deleting the initial portion of the object, the additional portion of the object, and the second additional portion of the object.