Manipulating objects in hosted storage

• US 8,892,677 B1
• Filed: 01/29/2010
• Issued: 11/18/2014
• Est. Priority Date: 01/29/2010
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Bershad, Brian, Erb, David, Grove, Daniel D.
• Primary Examiner(s): Ibrahim, Mohamed
• Application Number:
  US12/696,522
• Time in Patent Office: 1,754 Days
• Field of Search: 709/213
• US Class Current: 709/213
• CPC Class Codes: G06F 16/21 Design, administration or maintenance of databases
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/25 Integrating or interfacing systems involving database management systems
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal

Abstract

In aspect an application may be configured to issue a request to store an object, with the request including an object reference. A delegate may be configured to receive the request to store the object, determine a hosted storage service, from among multiple hosted storage services, and a corresponding access protocol based on the object reference, and store the object in the hosted storage service using the corresponding protocol.

Claims

1. A computer implemented method for manipulating an object in hosted storage, the method comprising:

receiving, from a client application and at a storage delegate, a request to associate an object reference with a particular hosted storage service from among multiple hosted storage services, each of the multiple hosted storage services having a different corresponding access protocol;

associating, by the storage delegate based upon the received request to associate the object reference with the particular hosted storage service, the object reference with the particular hosted storage service from among the multiple hosted storage services;

receiving, from the client application at the storage delegate, a request to store an object, the request to store the object including the object reference;

determining, by the storage delegate, that the object reference has been associated with the particular hosted storage service from among the multiple hosted storage services;

selecting, by the storage delegate and based on the determination that the object reference has been associated with the particular hosted storage service, the particular hosted storage service from among the multiple hosted storage services; and

in response to selecting the particular hosted storage service, storing, by the storage delegate, the object at the particular hosted storage service using the access protocol corresponding to the particular hosted storage service.

2. The method of claim 1, wherein storing the object in the particular hosted storage service using the corresponding access protocol comprises:

generating an object identifier for the object, the object identifier conforming to an object namespace of the particular hosted storage service;

storing the object in the particular hosted storage service using the object identifier and the corresponding access protocol.

3. The method of claim 2, wherein the object reference comprises a storage group name such that associating the object reference with a particular hosted storage service comprises associating the storage group name with the particular hosted storage service.

4. The method of claim 3, wherein the object reference comprises an object name, the method further comprising associating the object identifier with the object name.

5. The method of claim 1, comprising:

receiving, from the client application, a request to retrieve the object, the request to retrieve the object including the object reference;

determining the particular hosted storage service, from among the multiple hosted storage services, and the corresponding access protocol based on the object reference;

retrieving the object from the determined particular hosted storage service using the corresponding access protocol; and

providing the retrieved object to the client application.

6. The method of claim 5, wherein retrieving the object from the determined particular hosted storage service using the corresponding access protocol comprises:

determining an object identifier based on the object reference, the object identifier conforming to an object namespace of the determined particular hosted storage service; and

retrieving the object from the determined particular hosted storage service using the corresponding access protocol and determined object identifier.

7. The method of claim 6, wherein the object reference comprises a storage group name and an object name such that:

determining the particular hosted storage service and corresponding access protocol based on the object reference comprises determining the particular hosted storage service and corresponding access protocol associated with the storage group name; and

determining the object identifier based on the object reference comprises determining the object identifier based on the object name.

8. The method of claim 1, further comprising:

receiving a request to select the particular hosted storage service from among multiple hosted storage services, the request including one or more storage parameters;

selecting the particular hosted storage service based on the storage parameters; and

in response to selecting the particular hosted storage service, providing an identifier of the particular hosted storage service to the client application,

wherein the request to associate the object reference with the particular hosted storage service includes the identifier of the particular hosted storage service.

9. The method of claim 8, wherein the storage parameters include one or more a size of the object, a minimum level of security, whether queries should be supported, a minimum latency, a maximum cost metric, or a minimum privacy protection.

10. The method of claim 8, wherein selecting the particular hosted storage service based on the storage parameters includes selecting the particular hosted storage service and one or multiple datastores in the particular hosted storage service based on the storage parameters.

11. The method of claim 1, wherein the storage delegate is implemented by the client device.

12. The method of claim 1, wherein the storage delegate is implemented as a web service by one or more server devices.

13. A system for manipulating an object in hosted storage, the system comprising:

one or more processing devices; and

a storage medium storing instructions that, when executed by the one or more processing devices, cause the one or more processing devices to implement the following;

a client application configured to;

issue a request to associate an object reference with a particular hosted storage service from among multiple hosted storage services, each of the multiple hosted storage services having a different corresponding access protocol; and

issue a request to store an object, the request including the object reference, and

a storage delegate configured to;

receive the request to associate the object reference with the particular hosted storage service;

associate, based upon the received request to associate the object reference with the particular hosted storage service, the object reference with the particular hosted storage service from among the multiple hosted storage services;

receive the request to store the object;

determine that the object reference has been associated with the particular hosted storage service from among the multiple hosted storage services;

select, based on the determination that the object reference has been associated with the particular hosted storage service, the particular hosted storage service from among the multiple hosted storage services; and

in response to selecting the particular hosted storage service, store the object at the particular hosted storage service using the access protocol corresponding to the particular hosted storage service.

14. The system of claim 13, wherein, to store the object at the particular hosted storage service using the access protocol corresponding to the particular hosted storage service, the storage delegate is further configured to:

generate an object identifier for the object, the object identifier conforming to an object namespace of the particular hosted storage service; and

store the object in the selected particular hosted storage service using the object identifier and the corresponding access protocol.

15. The system of claim 14, wherein the object reference comprises a storage group name such that, to associate the object reference with the particular hosted storage service from among the multiple hosted storage services, the storage delegate kis configured to associate the storage group name with the particular hosted storage service.

16. The system of claim 15, wherein the object reference comprises an object name and the storage delegate is configured to associate the object identifier with the object name.

17. The system of claim 13, wherein:

the client application is configured to issue a request to retrieve the object, the request to retrieve the object including the reference name; and

the storage delegate is configured to;

receive the request to retrieve the object,

determine the particular hosted storage service from among the multiple hosted storage services and the corresponding access protocol based on the object reference,

retrieve the object from the determined particular hosted storage service using the corresponding access protocol, and

provide the retrieved object to the client application.

18. The system of claim 17, wherein, to retrieve the object from the determined particular hosted storage service using the corresponding access protocol, the storage delegate is further configured to:

determine an object identifier based on the object reference, the object identifier conforming to an object namespace of the determined particular hosted storage service; and

retrieve the object from the determined particular hosted storage service using the corresponding access protocol and determined object identifier.

19. The system of claim 18, wherein the object reference comprises a storage group name and an object name such that:

to determine the particular hosted storage service and corresponding access protocol based on the object reference, the storage delegate is further configured to determine the particular hosted storage service and corresponding access protocol based on the storage group name; and

to determine the object identifier based on the object reference, the storage delegate is further configured to determine the object identifier based on the object name.

20. The system of claim 13, wherein the storage delegate is further configured to:

receive a request to select the particular hosted storage service from among the multiple hosted storage services, the request including one or more storage parameters;

select the particular hosted storage service based on the storage parameters; and

in response to selecting the hosted storage service, provide an identifier of the hosted storage service to the application,

wherein the request to associate the object reference with the particular hosted storage service includes the identifier of the particular hosted storage service.

21. A computer implemented method for manipulating an object in hosted storage, the method comprising:

receiving, from a client application and at a storage delegate, a request to associate a particular hosted storage service from among multiple hosted storage services, each of the multiple hosted storage services having a different corresponding access protocol, with an object reference;

in response to receiving the request to associate the particular hosted storage service with the object reference, associating the particular hosted storage service with the object reference;

receiving, from the client application, a request to store an object, the request including the object reference and an object name;

in response to receiving the request to store the object;

determining the particular hosted storage service from among the multiple hosted storage services and a corresponding access protocol based on the association between the object reference and the particular hosted storage service,

generating an object identifier for the object, the object identifier conforming to an object namespace of the particular hosted storage service,

associating the object identifier with the object name, and

storing the object in the particular hosted storage service using the object identifier and the corresponding access protocol;

receiving, from the client application, a request to retrieve the object from among the multiple hosted storage services, the request including the object reference and the object name; and

in response to receiving the request to retrieve the object;

determining the particular hosted storage service from among the multiple hosted storage services and a corresponding access protocol based on the association between the object reference and the particular hosted storage service,

determining the object identifier based on the association between the object name and the object identifier,

retrieving the object from the particular hosted storage service using the object identifier and the corresponding access protocol, and

providing the retrieved object to the client application.