IDENTITY AND SEMAPHORE-BASED QUALITY OF SERVICE

• US 20120054765A1
• Filed: 08/27/2010
• Published: 03/01/2012
• Est. Priority Date: 08/27/2010
• Status: Active Grant

• Current Assignee: eBay Inc.
• Original Assignee: eBay Inc.
• Inventors: Lee, Sangjin, Saha, Debashis
• Granted Patent: US 9,886,315 B2
• Time in Patent Office: Days
• US Class Current: 718/104
• CPC Class Codes: G06F 2209/5018 Thread allocation
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals

Abstract

Various embodiments described herein include at least one of systems, methods, and software for identity-based thread pool assignment. The identity may identify a source of a request where the source is a user, human or logical, or a network location where the request originated. Some embodiments include receiving a resource request via a network and classifying the resource request into a processing thread pool of a plurality of processing thread pools. The classifying may be based at least in part on an identifying characteristic of a source of the resource request. Each processing thread pool may have an assigned maximum number of processing threads available at any one time for processing resource requests. When a processing thread of the processing thread pool the request is classified into is available, some embodiments then assign the resource request to the available processing thread.

Claims

1. A computerized method comprising:

receiving, via a network interface device, a resource request;

classifying, by executing instructions on at least one computer processor, the resource request into a first identity-oriented processing thread pool of a plurality of identity-oriented processing thread pools, the classifying based at least in part on an identifying characteristic of a source of the resource request, each identity-oriented processing thread pool having an assigned maximum number of processing threads available at any one time for processing resource requests on the at least one computer processor; and

when a processing thread of the first identity-oriented processing thread pool is available, assigning the resource request to the available processing thread.

2. The computerized method of claim 1, wherein when a processing thread of the first identity-oriented processing thread pool is not available, blocking the resource request until a processing thread of the first identity-oriented processing thread pool becomes available.

3. The computerized method of claim 2, wherein the resource request is blocked until either a processing thread of the first identity-oriented processing thread pool becomes available or until a timeout period passes.

4. The computerized method of claim 1, wherein the resource request includes data representative of an identifying characteristic of a source of the resource request.

5. The computerized method of claim 4, wherein the source of the resource request is represented in the resource request with data including a Globally Unique Identifier (GUID) of a user that submitted the resource request.

6. The computerized method of claim 5, wherein the GUID identifies a logical user.

7. The computerized method of claim 1, wherein the resource request is further subject to a resource-oriented thread pool of the resource of the resource request.

8. The computerized method of claim 1, wherein the assigned maximum number of available processing threads for each of the plurality of identity-oriented thread pools is defined in configuration data stored in a memory device.

9. The computerized method of claim 8, wherein at least one of the plurality of identity-oriented thread pools defined in the configuration data stored in the memory device includes at least one resource request classifying rule.

10. A system comprising:

at least one computer processor;

a memory device;

a network interface device;

a first instruction set stored in the memory device, the instruction set defining a container object that executes on the at least one computer processor to manage servlets and servlet data processing requests received via the network interface device;

a second instruction set stored in the memory device to extend functionality of the container object in managing the servlet data processing requests received via the network interface device, the second instruction set executable by the at least one processor to;

receive, via the network interface device, a servlet data processing request;

classify the servlet data processing request into a first identity-oriented processing thread pool of a plurality of identity-oriented processing thread pools, the classifying based at least in part on an identifying characteristic of a source of the servlet data processing request, each identity-oriented processing thread pool having an assigned maximum number of processing threads available at any one time for processing servlet data processing requests on the at least one computer processor; and

when a processing thread of the first identity-oriented processing thread pool is available, assigning the servlet data processing request to the available processing thread of the first identity-oriented processing thread pool.

11. The system of claim 10, wherein assigning the servlet data processing request to the available processing thread of the first identity-oriented processing thread pool includes incrementing, in the memory device, a thread counter of a number of threads of the first identity-oriented processing thread pool being utilized.

12. The system of claim 11, wherein upon processing completion of the servlet data processing request within the assigned thread, the second set of instructions is further executable by the at least one processor to:

decrement the thread counter of the number of threads of the first identity-oriented processing thread pool being utilized.

13. The system of claim 10, wherein:

the assigned maximum number of available processing threads for each of the plurality of identity-oriented thread pools is defined in configuration data stored in the memory device; and

at least one of the plurality of identity-oriented thread pools defined in the configuration data stored in the memory device includes at least one servlet data processing request classifying rule.

14. The system of claim 13, further comprising:

a third instruction set stored in the memory device, the third instruction set executable by the at least one processor to;

receive input to define an identity-oriented thread pool including input assigning a maximum number of threads available within the identity-oriented thread pool; and

store the received input to the memory device.

15. A computer-readable storage medium, with instructions stored thereon, which when executed by at least one processor of a computer, cause the computer to:

receive input defining an identity-oriented thread pool including;

input assigning a maximum number of threads available within the identity-oriented thread pool for processing of resource requests; and

input defining at least one resource request classifying rule to apply to classify a received resource requests based at least in part on an identifying characteristic of a source of the received resource request;

store the received input defining the identity-oriented thread pool in a memory device including data defining at least one other identity-oriented thread pool;

receive, via a network interface device, a resource request;

classify the resource request into a first identity-oriented processing thread pool of the identity-oriented processing thread pools stored in the memory device, the classifying based at least in part on application of a resource request classifying rule of at least one identity-oriented thread pool to an identifying characteristic of a source of the resource request; and

when a processing thread of the first identity-oriented processing thread pool is available, assigning the resource request to the available processing thread.

16. The computer-readable medium of claim 15, wherein when a processing thread of the first identity-oriented processing thread pool is not available, the instructions are further executable by the at least one processor to block the resource request until a processing thread of the first identity-oriented processing thread pool becomes available.

17. The computer-readable medium of claim 15, wherein the resource request includes data representative of an identifying characteristic of a source of the resource request.

18. The computer-readable medium of claim 17, wherein the source of the resource request is represented in a Universal Resource Identifier (URI) at which the resource request is received.

19. The computer-readable medium of claim 15, wherein the resource request is further subject to a resource-oriented thread pool of the resource of the resource request.

20. The computer-readable medium of claim 15, wherein a sum of the maximum number of threads available to the identity-oriented thread pools cannot exceed a maximum number of threads available on the computer.