Compute-centric object stores and methods of use

• US 8,677,359 B1
• Filed: 03/14/2013
• Issued: 03/18/2014
• Est. Priority Date: 03/14/2013
• Status: Active Grant

• Current Assignee: Joyent, Inc. (Samsung Electronics Co. Ltd.)
• Original Assignee: Joyent, Inc. (Samsung Electronics Co. Ltd.)
• Inventors: Pacheco, David, Cantrill, Bryan, Cavage, Mark
• Primary Examiner(s): NGUYEN, VAN H
• Application Number:
  US13/831,386
• Time in Patent Office: 369 Days
• Field of Search: None
• US Class Current: 718/1
• CPC Class Codes: G06F 9/45533 Hypervisors; Virtual machine monitors
• CPC Class Codes: G06F 9/5011 the resources being hardware resources other than CPUs, Servers and Terminals
• CPC Class Codes: G06F 9/5072 Grid computing

Abstract

Systems and methods for providing a compute-centric object store. An exemplary method may include receiving a request to perform a compute operation on at least a portion of an object store from a first user, the request identifying parameters of the compute operation, assigning virtual operating system containers to the objects of the object store from a pool of virtual operating system containers. The virtual operating system containers may perform the compute operation on the objects according to the identified parameters of the request. The method may also include clearing the virtual operating system containers and returning the virtual operating system containers to the pool.

Claims

1. A system, comprising:

one or more processors; and

logic encoded in one or more tangible media for execution by the one or more processors to perform operations comprising;

receiving a request to perform a compute operation on at least a portion of an object store from a first user, the request identifying parameters of the compute operation;

assigning virtual operating system containers to objects of the object store from a pool of virtual operating system containers;

the virtual operating system containers performing the compute operation on the objects according to the identified parameters of the request;

clearing the virtual operating system containers;

receiving a request to perform the compute operation on the at least a portion of the object store from a second user, the request identifying parameters of the compute operation, the objects of the second user included in the object store;

assigning virtual operating system containers to objects of the second user, from the pool of virtual operating system containers;

the virtual operating system containers performing the compute operation on the objects of the second user according to the identified parameters of the request; and

clearing the virtual operating system container,

wherein the virtual operating system containers are selected from the pool of virtual operating system containers managed by a global virtual operating system, and

wherein the virtual operating system containers are returned to the pool of virtual operating system containers managed by the global virtual operating system after the virtual operating system containers have been cleared.

2. The system according to claim 1, wherein the one or more processors further execute the logic to perform operations comprising storing outputs of the virtual operating system containers in the object store.

3. The system according to claim 1, wherein the computation is expressed as input to a command line interpreter, wherein the request is received by a network service.

4. The system according to claim 1, wherein the virtual operating system containers perform the compute operation on the objects in such a way that the objects remain in situ within the object store.

5. The system according to claim 1, wherein the pool of virtual operating system containers is generated by the global virtual operating system.

6. The system according to claim 1, wherein the virtual operating system containers are terminated by the global virtual operating system.

7. The system according to claim 1, wherein the one or more processors further execute the logic to perform operations comprising mapping objects from the object store to the virtual operating system containers, based upon the request.

8. The system according to claim 1, wherein assigning comprises making a read-only instantiation of the object available to applications executing inside the virtual operating system container.

9. The system according to claim 1, wherein the compute operation comprises any operating system primitive operation, a user defined application, and any operation accessible to an operating system user.

10. A multitenant object storage system, comprising:

a hardware layer associated with;

one or more processors; and

one or more tangible media; and

a host operating system kernel encoded in the one or more tangible media,

wherein the host operating system kernel performs;

providing a pool of virtual guest operating systems;

assigning a virtual guest operating system container of the pool of virtual guest operating systems to a first user of a plurality of users;

mapping a plurality of objects for the first user to the virtual guest operating system; and

performing a compute operation on the plurality of objects,

wherein the host operating system kernel further performs;

receiving a request to perform a compute operation on at least a portion of the object store from a second user, the request identifying parameters of the compute operation and objects against which the compute operation is executed, the objects included in the object store;

assigning a second virtual operating system container which is mapped to objects for the second user;

the second virtual operating system container performing the compute operation on the objects according to the identified parameters of the request;

clearing the second virtual operating system container; and

returning the second virtual operating system container to the pool of virtual guest operating systems.

11. The system according to claim 10, wherein the virtual guest operating system includes a virtual machine monitor that provides hardware emulation for the virtual guest operating system.

12. The system according to claim 11, wherein assignment of the virtual guest operating system comprises allocation of processing capacity of the one or more processors to the virtual guest operating system by the host operating system kernel.

13. The system according to claim 10, wherein the host operating system kernel is further configured to store an output of the compute operation in the object store.

14. The system according to claim 10, wherein the host operating system kernel is further configured to provide a command line interpreter that receives requests from a user.

15. The system according to claim 10, wherein the virtual guest operating system performs the compute operation on the objects in such a way that the objects are not moved from the object store.

16. The system according to claim 10, wherein the host operating system kernel maps objects from the object store to the virtual guest operating system.

17. The system according to claim 10, wherein the host operating system kernel assigns a virtual guest operating system by making a read-only instantiation of the object available to applications executing inside the virtual operating system container.

18. The system according to claim 10, wherein the compute operation comprises any of an operating system primitive operation, a user defined application, and any operation accessible to an operating system user.

19. A method, comprising:

receiving, by a processor, a request to perform a compute operation on an object of an object store from a first user, the request identifying parameters of the compute operation;

assigning, by the processor, virtual operating system containers to the objects of the object store from a pool of virtual operating system containers;

the virtual operating system containers performing the compute operation on the objects according to the identified parameters of the request;

clearing, by the processor, the virtual operating system containers;

receiving, by the processor, a request to perform the compute operation on the at least a portion of the object store from a second user, the request identifying parameters of the compute operation, the objects of the second user included in the object store;

assigning, by the processor, virtual operating system containers to objects of the second user, from the pool of virtual operating system containers;

the virtual operating system containers performing the compute operation on the objects of the second user according to the identified parameters of the request; and

clearing, by the processor, the virtual operating system containers,

wherein the virtual operating system containers are selected from the pool of virtual operating system containers managed by a global virtual operating system, and

wherein the virtual operating system containers are returned to the pool of virtual operating system containers managed by the global virtual operating system after the virtual operating system containers have been cleared.