×

Acquisition and maintenance of dedicated, reserved, and variable compute capacity

  • US 10,002,026 B1
  • Filed: 12/21/2015
  • Issued: 06/19/2018
  • Est. Priority Date: 12/21/2015
  • Status: Active Grant
First Claim
Patent Images

1. A system for providing low-latency computational capacity, the system comprising:

  • a virtual compute system comprising one or more hardware computing devices executing specific computer-executable instructions and configured to at least;

    maintain a plurality of virtual machine instances on one or more physical computing devices, wherein the plurality of virtual machine instances comprises;

    a first sub-pool of virtual machine instances waiting to be assigned to one of a plurality of user accounts of the virtual compute system;

    a second sub-pool of virtual machine instances assigned, before a request associated with a first user account of the plurality of user accounts is received by the virtual compute system, to the first user account and having one or more software components specific to the first user account loaded thereon; and

    an active pool comprising virtual machine instances executing one or more program codes thereon;

    receive the request to execute a first program code using compute capacity provided by one of the plurality of virtual machine instances, the request including an identity associated with the first user account and one or more parameters for executing the first program code;

    determine, based on the identity included in the request to execute the first program code, that the first program code is to be executed using compute capacity provided by one of the virtual machine instances in the second sub-pool;

    determine that the second sub-pool lacks compute capacity sufficient to execute the first program code;

    in response to determining that the second sub-pool lacks compute capacity sufficient to execute the first program code, determine that a policy associated with the second sub-pool allows the virtual compute system to wait for additional compute capacity sufficient to execute the first program code to become available;

    in response to determining that the policy allows the virtual compute system to wait, wait for additional compute capacity sufficient to execute the first program code to become available in the second sub-pool;

    cause a first virtual machine instance in the second sub-pool having compute capacity sufficient to execute the first program code to be added to the active pool; and

    cause the first program code to be executed, using the one or more parameters, in a container created on the first virtual machine instance.

View all claims
  • 1 Assignment
Timeline View
Assignment View
    ×
    ×