Compute-centric object stores and methods of use

• US 9,582,327 B2
• Filed: 10/25/2013
• Issued: 02/28/2017
• Est. Priority Date: 03/14/2013
• Status: Active Grant

• Current Assignee: Joyent, Inc. (Samsung Electronics Co. Ltd.)
• Original Assignee: Joyent, Inc. (Samsung Electronics Co. Ltd.)
• Inventors: Cavage, Mark, Pacheco, David, Cantrill, Bryan
• Primary Examiner(s): NGUYEN, VAN H
• Application Number:
  US14/063,588
• Publication Number:
  US 20140282590A1
• Time in Patent Office: 1,222 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 9/45533 Hypervisors; Virtual machine monitors
• CPC Class Codes: G06F 9/5011 the resources being hardware resources other than CPUs, Servers and Terminals
• CPC Class Codes: G06F 9/5072 Grid computing

Abstract

Systems and methods for providing a compute-centric object store. An exemplary method may include receiving a request to perform a compute operation on at least a portion of an object store from a first user, the request identifying parameters of the compute operation, assigning virtual operating system containers to the objects of the object store from a pool of virtual operating system containers. The virtual operating system containers may perform the compute operation on the objects according to the identified parameters of the request. The method may also include clearing the virtual operating system containers and returning the virtual operating system containers to the pool.

Claims

1. A system, comprising:

one or more processors; and

logic encoded in one or more tangible media for execution by the one or more processors and when executed operable to perform operations comprising;

receiving a request to perform a compute operation on at least a portion of an object store from a first user, the request identifying parameters of the compute operation;

assigning virtual operating system containers to the objects of the object store from a pool of virtual operating system containers;

the virtual operating system containers performing the compute operation on the objects according to the identified parameters of the request; and

clearing the virtual operating system containers.

2. The system according to claim 1, wherein the processor further executes the logic to perform operations comprising storing outputs of the virtual operating system containers in the object store.

3. The system according to claim 1, wherein the processor further executes the logic to perform operations comprising:

receiving a request to perform a compute operation on at least a portion of the object store from a second user, the request identifying parameters of the compute operation, the objects of the second user included in the object store;

assigning virtual operating system containers to objects of the second user, from the pool of virtual operating system containers; and

the virtual operating system containers performing the compute operation on the objects of the second user according to the identified parameters of the request; and

clearing the virtual operating system container.

4. The system according to claim 1, wherein the computation is expressed as input to a command line interpreter, wherein the request is received by a network service.

5. The system according to claim 1, wherein the virtual operating system containers perform the compute operation on the objects in such a way that the objects remain in- situ within the object store.

6. The system according to claim 1, wherein the virtual operating system containers are selected from a pool of virtual operating system containers managed by a global virtual operating system.

7. The system according to claim 6, wherein the pool of virtual operating system containers are generated by the global virtual operating system.

8. The system according to claim 1, wherein the virtual operating system containers are terminated by the global virtual operating system.

9. The system according to claim 6, wherein the virtual operating system containers are returned to the pool of virtual operating system containers managed by the global virtual operating system after the virtual operating system containers have been cleared.

10. The system according to claim 1, wherein the processor further executes the logic to perform operations comprising mapping objects from the object store to the virtual operating system containers, based upon the request.

11. The method according to claim 1, wherein assigning comprises making a read-only instantiation of the object available to applications executing inside the virtual operating system container.

12. The system according to claim 1, wherein the compute operation comprises any operating system primitive operation, a user defined application, and any operation accessible to an operating system user.

13. A multitenant object storage

system, comprising:

a hardware layer

associated with;

one or more processors; and

one or more tangible media; and

a host operating system kernel encoded the one or more tangible media, the host operating system kernel being configured to;

provide a pool of virtual guest operating systems;

assign a virtual guest operating system of the pool of virtual guest operating systems to a first user of a plurality of users;

map a plurality of objects for the first user to the virtual guest operating system; and

perform a compute operation on the plurality of objects.

14. The system according to claim 13, wherein the virtual guest operating system includes virtual machine monitor that provides hardware emulation for the virtual guest operating system.

15. The system according to claim 14, wherein assignment of the virtual guest operating system comprises allocation of processing capacity of the one or more processors to the virtual guest operating system by the host operating system kernel.

16. The system according to claim 13, wherein the host operating system kernel is further configured to store an output of the compute operation in the object store.

17. The system according to claim 13, wherein the host operating system kernel is further configured to:

receive a request to perform a compute operation on at least a portion of the object store from a second user, the request identifying parameters of the compute operation and objects against which the compute operation is executed, the objects included in the object store;

assign a second virtual operating system container which is mapped to objects for the second user;

the second virtual operating system container performing the compute operation on the objects according to the identified parameters of the request;

clear the second virtual operating system container; and

return the second virtual operating system container to the pool.

18. The system according to claim 13, wherein the host operating system kernel is further configured to provide a command line interpreter that receives requests from a user.

19. The system according to claim 13, wherein the virtual guest operating system performs the compute operation on the objects in such a way that the objects are not moved from the object store.

20. The system according to claim 13, wherein the host operating system kernel maps objects from the object store to the virtual guest operating system.

21. The system according to claim 13, wherein the host operating system kernel assigns a virtual guest operating system by making a read-only instantiation of the object available to applications executing inside the virtual operating system container.

22. The system according to claim 13, wherein the compute operation comprises any of an operating system primitive operation, a user defined application, and any operation accessible to an operating system user.

23. A method, comprising:

receiving a request to perform a compute operation on an object of an object store from a first user, the request identifying parameters of the compute operation;

assigning a virtual operating system container for the object of the object store from the virtual operating system containers in a pool of empty virtual operating system containers maintained by a global operating system kernel;

the virtual operating system container being programed to perform the compute operation on the object according to the identified parameters of the request; and

terminating the virtual operating system container.

24. A method, comprising:

creating a pool of virtual operating system containers in the pool of virtual operating system containers;

assigning a virtual operating system container to a first user, the virtual operating system container being associated with an object of an object store;

receiving a request to perform a compute operation on the object of the object store, from a first user, the request identifying parameters of the compute operation;

executing an operating system process for the object identified in the request;

the operating system process performing the compute operation on the object according to the identified parameters of the request; and

terminating the operating system process.