Load balancing technique implemented in a data network device utilizing a data cache

• US 9,342,808 B2
• Filed: 03/18/2011
• Issued: 05/17/2016
• Est. Priority Date: 05/11/1999
• Status: Expired due to Term

• Current Assignee: JUNE RAY LIMITED
• Original Assignee: JUNE RAY LIMITED
• Inventors: Miller, Andrew Karl, Menendez, Jack Dee, Mayya, Ajit Ramachandra
• Primary Examiner(s): BURGESS, BARBARA N
• Application Number:
  US13/065,302
• Publication Number:
  US 20110173090A1
• Time in Patent Office: 1,887 Days
• Field of Search: 709/223, 709/224, 709/227, 709/229, 705/26, 705/27, 718/105
• US Class Current: 1/1
• CPC Class Codes: G06F 16/9574 of access to content, e.g. by caching
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G06Q 10/06311 Scheduling, planning or task assignment for a person or group
• CPC Class Codes: G06Q 10/06312 Adjustment or analysis of established resource schedule, e.g. resource or task levelling, or dynamic rescheduling
• CPC Class Codes: G06Q 10/06315 Needs-based resource requirements planning or analysis
• CPC Class Codes: G06Q 10/06316 Sequencing of tasks or work
• CPC Class Codes: G06Q 10/08 Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
• CPC Class Codes: G06Q 10/08355 Routing methods
• CPC Class Codes: G06Q 10/087 Inventory or stock management, e.g. order filling, procurement or balancing against orders
• CPC Class Codes: G06Q 20/203 Inventory monitoring
• CPC Class Codes: G06Q 30/0201 Market modelling; Market analysis; Collecting market data
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions
• CPC Class Codes: G06Q 30/0601 Electronic shopping [e-shopping]
• CPC Class Codes: G06Q 30/0633 Lists, e.g. purchase orders, compilation or processing
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

Techniques for implementing a load balanced server system are described which may be used for effecting electronic commerce over a data network. The system comprises a load balancing system and a plurality of servers in communication with the load balancing system. Each of the plurality of servers may include a respective data cache for storing state information relating to client session transactions conducted between the server and a particular client. The load balancing system can be configured to select, using a load balancing protocol, an available first server from the plurality of servers to process an initial packet received from a source device such as, for example, a client machine of a customer. The load balancing system can also configured to route subsequent packets received from the source device to the first server. Before generating its response, the first server may verify that the state information relating to a specific client session stored in the data cache is up-to-date. If the first server determines that the state information stored in the data cache is not up-to-date, then the first server may be configured to retrieve the desired up-to-date state information from a database which is configured to store all state information relating to client sessions which have been initiated with the server system.

Claims

1. A computer-implemented method for effecting electronic commerce over a data network, the method comprising:

receiving a block of data from a computing device, the block of data being related to a request from a user;

performing load balancing to assign the block of data from the computing device to a first server of a multi-server system, with a communication session established with the computing device, the multi-server system including at least a second server, with the first server configured to use a first data cache and a database, and with the second server configured to use a second data cache and the database;

storing state data information associated with the communication session in both the first data cache and the database, the state data information including information related to a session identifier for the communication session and request information related to the request;

generating a response to the block of data for responding to the request at the first server, with the response including information regarding the session identifier for the communication session;

transmitting the response to the computing device;

causing a subsequent block of data received from the computing device to be routed to the first server, the subsequent block of data being related to a subsequent request from the user, and including the information regarding the session identifier for the communication session;

detecting a failure at the first server to process the subsequent block of data, wherein the failure is related to a cache miss in the first data cache, with the first data cache not able to provide at least some of the state data information needed by the subsequent request; and

retrieving at least some of the state data information from the database in response to detecting the failure at the first server,

wherein accessing at least some of the state data information in the first data cache takes less time than accessing the at least some of the state data information from the database,

wherein the first data cache is in the first server, and the second data cache is in the second server,

wherein the database is a persistent memory database,

wherein the first server has information related to a plurality of products available for purchase from an on-line merchant, and

wherein at least one subsequent block of data is related to purchasing a product from the plurality of products via an electronic shopping cart.

2. The computer-implemented method for effecting electronic commerce over a data network as recited in claim 1,

wherein retrieving information from the database further comprises retrieving, based on the information regarding the session identifier, at least some of the state data information associated with the communication session from the database in response to detecting the failure at the first server,

wherein state data information in the subsequent block of data is configured to be stored in both the first data cache and the database, and with such state data information being stored also being associated with the communication session, and

wherein the method further comprises detecting for the failure periodically.

3. The computer-implemented method for effecting electronic commerce over a data network as recited in claim 2, wherein the failure is related to the first server being rebooted.

4. The computer-implemented method for effecting electronic commerce over a data network as recited in claim 2,

wherein the method further comprises detecting for the failure in view of responding to the subsequent request from the user, and

wherein the communication session is established between the first server and the computing device.

5. The computer-implemented method for effecting electronic commerce over a data network as recited in claim 1, wherein the method further comprises retrieving, based on the information regarding the session identifier, at least some of the state data information associated with the communication session from the first data cache in response to the failure not being detected.

6. The computer-implemented method for effecting electronic commerce over a data network as recited in claim 1 further comprising:

flushing at least a portion of the first data cache, and storing the retrieved state data information into the first data cache, in response to detecting the failure at the first server.

7. The computer-implemented method for effecting electronic commerce over a data network as recited in claim 6, wherein the failure is related to the first server being rebooted.

8. The computer-implemented method for effecting electronic commerce over a data network as recited in claim 1,

wherein the block of data is an HTTP request packet, and

wherein the response is an HTTP response.

9. The computer-implemented method for effecting electronic commerce over a data network as recited in claim 8, wherein the block of data is from a web browser of the computing device.

10. A non-transitory computer readable medium comprising a plurality of instructions for effecting electronic commerce over a data network, the plurality of instructions, when executed by a computing apparatus, result in the computing apparatus:

receiving a block of data from a computing device, the block of data being related to a request from a user;

performing load balancing to assign the block of data from the computing device to a first server of a multi-server system, with a communication session established with the computing device, the multi-server system including at least a second server, with the first server configured to use a first data cache and a database, and with the second server configured to use a second data cache and the database;

storing state data information associated with the communication session in both the first data cache and the database, the state data information including information related to a session identifier for the communication session and request information related to the request;

generating a response to the block of data for responding to the request at the first server, with the response including corresponding information regarding the session identifier for the communication session;

transmitting the response to the computing device;

causing a subsequent block of data received from the computing device to be routed to the first server, the subsequent block of data being related to a subsequent request from the user, and including the information regarding the session identifier for the communication session;

detecting a failure at the first server to process the subsequent block of data, wherein the failure is related to a cache miss in the first data cache, with the first data cache not able to provide at least some of the state data information needed by the subsequent request; and

retrieving at least some of the state data information from the database in response to detecting the failure at the first server,

wherein accessing the at least some of the state data information in the first data cache takes less time than accessing the at least some of the state data information from the database,

wherein the first data cache is in the first server, and the second data cache is in the second server,

wherein the database is a persistent memory database,

wherein the first server has information related to a plurality of products available for purchase from an on-line merchant, and

wherein at least one subsequent block of data is related to purchasing a product from the plurality of products via an electronic shopping cart.

11. The non-transitory computer readable medium as recited in claim 10,

wherein retrieving information from the database further comprises retrieving, based on the information regarding the session identifier, at least some of the state data information associated with the communication session from the database in response to the first server being detected to be unavailable,

wherein state data information in the subsequent block of data is configured to be stored in both the first data cache and the database, and with such state data information being stored also associated with the communication session, and

wherein the plurality of instructions, when executed by the computing apparatus, further result in the computing apparatus detecting for the first server'"'"'s availability periodically.

12. The non-transitory computer readable medium as recited in claim 10, wherein the plurality of instructions, when executed by the computing apparatus, further result in the computing apparatus flushing at least a portion of the first data cache, and storing state data the retrieved information into the first data cache in response to the first server being detected to be unavailable.

13. The non-transitory computer readable medium as recited in claim 11,

wherein the plurality of instructions, when executed by the computing apparatus, further result in the computing apparatus detecting for the first server'"'"'s availability in view of responding to the subsequent request from the user, and

wherein the communication session is established between the first server and the computing device.

14. The non-transitory computer readable medium as recited in claim 10, wherein the plurality of instructions, when executed by the computing apparatus, further result in the computing apparatus retrieving, based on information regarding the session identifier, the at least some of the state data information associated with the communication session from the first data cache in response to at least the first server being detected to be available.

15. The non-transitory computer readable medium as recited in claim 10,

wherein the block of data is an HTTP request packet, and

wherein the response is an HTTP response.

16. The non-transitory computer readable medium as recited in claim 15, wherein the block of data is from a web browser of the computing device.

17. A multi-server system for effecting electronic commerce over a network, the multi-server system comprising:

a load balancing component;

a plurality of servers including a first and a second server, both in communication with the load balancing component, with the first server including a first data cache, and with the second server including a second data cache; and

a persistent memory database configured to be coupled to, and used by, at least the first and the second server,

wherein the multi-server system is configured to;

receive a block of data from a computing device, the block of data being related to a request from a user;

perform load balancing to assign the block of data from the computing device to the first server, with a communication session established with the computing device;

store state data information associated with the communication session in both the first data cache and the database, the state data information including information related to a session identifier for the communication session and request information related to the request;

generate a response to the block of data for responding to the request at the first server, with the response including information regarding the session identifier for the communication session;

transmit the response to the computing device;

cause a subsequent block of data received from the computing device to be routed to the first server, the subsequent block of data being related to a subsequent request from the user, and including the information regarding the session identifier for the communication session;

detecting a failure at the first server, wherein the failure is related to a cache miss in the first data cache, with the first data cache not able to provide at least some of the state data information needed by the subsequent request; and

retrieve at least some of the state data information from the database in response to detecting the failure at the first server,

wherein accessing the at least some of the state data information in the first data cache takes less time than accessing the at least some of the state data information from the database,

wherein the first server has information related to a plurality of products available for purchase from an on-line merchant, and

wherein at least one subsequent block of data is related to purchasing a product from the plurality of products via an electronic shopping cart.

18. The multi-server system for effecting electronic commerce over a network as recited in claim 17,

wherein retrieving information from the database further comprises retrieving, based on information regarding the session identifier, at least some of the state data information associated with the communication session from the database in response to detecting the failure at the first server,

wherein state data information in the subsequent block of data is configured to be stored in both the first data cache and the database, and with such state data information being stored also associated with the communication session, and

wherein the multi-server system is further configured to detect for the failure periodically.

19. The multi-server system for effecting electronic commerce over a network as recited in claim 18, wherein the failure is related to the first server being rebooted.

20. The multi-server system for effecting electronic commerce over a network as recited in claim 18,

wherein the multi-server system is further configured to detect for the failure in view of responding to the subsequent request from the user, and

wherein the communication session is established between the first server and the computing device.

21. The multi-server system for effecting electronic commerce over a network as recited in claim 17, wherein the multi-server system is further configured to retrieve, based on information regarding the session identifier, the at least some of the state data information associated with the communication session from the first data cache in response to the failure not being detected.

22. The multi-server system for effecting electronic commerce over a network as recited in claim 17,

wherein the block of data is an HTTP request packet, and

wherein the response is an HTTP response.

23. The multi-server system for effecting electronic commerce over a network as recited in claim 17, wherein the block of data is from a web browser of the computing device.

24. The multi-server system for effecting electronic commerce over a network as recited in claim 23,

wherein the load balancing component includes a main load balancing device and a plurality of subordinate load balancing devices, each of the subordinate load balancing devices being associated with a different server farm of the multi-server system,

wherein each server of the plurality of servers is associated with a respective server farm system, and

wherein the plurality of server farms comprises:

a first server farm which includes a first subordinate load balancing device and the first server; and

a second server farm which includes a second subordinate load balancing device and the second server.

25. The multi-server system for effecting electronic commerce over a network as recited in claim 17,

wherein the load balancing component includes a main load balancing device and a plurality of subordinate load balancing devices, each of the subordinate load balancing devices being associated with a different server farm of the multi-server system,

wherein each server of the plurality of servers is associated with a respective server farm system, and

wherein the plurality of server farms comprises:

a first server farm which includes a first subordinate load balancing device and the first server; and

a second server farm which includes a second subordinate load balancing device and the second server.