SIP server architecture for improving latency in message processing
First Claim
1. A system for improving latency in message processing for a network environment, comprising:
- an engine tier distributed on a cluster network and adapted to maintain short lived data objects;
a state tier distributed on the cluster network and adapted to maintain long lived data objects; and
a message received to the cluster network and processed by the engine tier wherein the engine tier retrieves a set of long lived objects from the state tier and employs them as short lived objects on the engine tier while processing the message.
1 Assignment
0 Petitions
Accused Products
Abstract
The SIP server can be comprised of an engine tier and a state tier distributed on a cluster network environment. The engine tier can send and receive messages and execute various processes. The state tier can maintain in-memory state data associated with various SIP sessions. For example, the state tier can store various long lived data objects and the engine tier can contain short lived data objects. The state data can be maintained in partitions comprised of state replicas. A load balancer can receive incoming message traffic and distribute it to the engine tier for processing. When processing a message, the engine can pull state data objects from the state tier, use the objects and push them back to the state tier after processing is complete. If one state replica is unavailable, such as during garbage collection, the engine can retrieve the objects from another replica in the partition.
116 Citations
20 Claims
-
1. A system for improving latency in message processing for a network environment, comprising:
-
an engine tier distributed on a cluster network and adapted to maintain short lived data objects; a state tier distributed on the cluster network and adapted to maintain long lived data objects; and a message received to the cluster network and processed by the engine tier wherein the engine tier retrieves a set of long lived objects from the state tier and employs them as short lived objects on the engine tier while processing the message. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A computer implemented method for improving latency in message processing, comprising:
-
maintaining an engine tier on a network cluster, wherein the engine tier processes incoming messages and stores short lived objects; maintaining a state tier on the network cluster wherein the state tier stores long lived objects that are used in processing the incoming messages; receiving an incoming message; retrieving one or more long lived objects from the state tier into the engine tier and employing them as one or more short lived objects in the engine tier; processing the incoming message by an engine in the engine tier; and pushing the one or more long lived objects from the engine tier back to the state tier. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. A computer-readable medium having instructions stored thereon which when executed by one or more processors cause a system to:
-
maintain an engine tier on a network cluster, wherein the engine tier processes incoming messages and stores short lived objects; maintain a state tier on the network cluster wherein the state tier stores long lived objects that are employed in processing the incoming messages; receive an incoming message; retrieve one or more long lived objects from the state tier into the engine tier and use them as one or more short lived objects in the engine tier; process the incoming message by an engine in the engine tier; and push the one or more long lived objects from the engine tier back to the state tier.
-
Specification