SCALABLE AFFINITIZED STATE MANAGEMENT

• US 20110276884A1
• Filed: 05/04/2010
• Published: 11/10/2011
• Est. Priority Date: 05/04/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Newman, Todd D., Taniguchi, David S., Marcjan, Cezary
• Granted Patent: US 8,700,698 B2
• Time in Patent Office: Days
• US Class Current: 715/733
• CPC Class Codes: G06F 9/5033 considering data affinity

Abstract

A state affinitized system comprises worker computing devices uniquely affinitized with one or more states such that only those worker computing devices maintain local copies of the states with which they are affinitized. Requests and data relevant to a state are directed to the worker computing device affinitized with that state, such as by front-end computing devices. A centralized persistent storage can maintain a copy of each state and can modify the states in response to newly received information in the same manner as the worker computing devices. Such maintenance can be performed by coalescer computing devices, which can also derive second order data from the states in the centralized persistent storage, which can be further added to the state and also communicated to the worker computing device affinitized with that state. Crawler computing devices can obtain additional information for incorporation into states from network-based information repositories and services.

Claims

1. A state affinitized system comprising:

a centralized persistent storage comprising an up-to-date copy of each state maintained by the state affinitized system

one or more worker computing devices, each of the worker computing devices being uniquely affinitized with one or more states maintained by the state affinitized system and each of the worker computing devices maintaining a copy of the one or more states with which they are uniquely affinitized on storage local to the one or more worker computing devices;

one or more front-end computing devices providing a front-end interface to users of the state affinitized system, the one or more front-end computing devices performing steps comprising;

receiving a request comprising user-identifying information via the front-end interface;

determining a state, from among the one or more states maintained by the state affinitized system, that is associated with the request based on the user-identifying information of the request;

determining a worker computing device, from among the one or more worker computing devices, that is uniquely affinitized with the determined state; and

transmitting the request to the determined worker computing device.

3. The system of claim 1, further comprising:

one or more crawler computing devices obtaining data relevant to at least one of the one or more states maintained by the state affinitized system from network-based information repositories and services, the one or more crawler computing devices identifying the at least one state to which the obtained data is relevant and transmitting the obtained data to the centralized persistent storage and to a worker computing device, from among the one or more worker computing devices, affinitized with the identified at least one state.

4. The system of claim 1, further comprising:

a front-end load balancing computing device for balancing a communicational load among the one or more front-end computing devices.

5. The system of claim 1, further comprising:

a management computing device for monitoring the one or more worker computing devices and, based on the monitoring, changing the affinitization of a first state from a first worker computing device, of the one or more worker computing devices, with which it was originally affinitized to a second worker computing device, also of the one or more worker computing devices, to which it is to be subsequently affinitized, the changing comprising;

instructing the first worker computing device to discard a copy of the first state maintained on a first storage local to the first worker computing device; and

instructing the second worker computing device to obtain, from the centralized persistent storage, a copy of the first state on a second storage local to the second worker computing device.

6. The system of claim 5, wherein the management computing device further instructs, based on the monitoring, at least one worker computing device, from among the one or more worker computing devices, to discard data associated with a state that is no longer affinitized with the at least one worker computing device.

7. The system of claim 1, further comprising:

one or more coalescer computing devices for maintaining the up-to-date copy of each state in the centralized persistent storage, the maintaining comprising incorporating received information into a state associated with the received information in an equivalent manner to incorporation of received information performed by a worker computing device, from among the one or more worker computing devices, that is affinitized with the state associated with the received information and that also received a copy of the received information.

8. The system of claim 7, wherein the one or more coalescer computing devices further derive second order data from a state, of the one or more states maintained by the state affinitized system, in the centralized persistent storage and incorporate the derived second order data into the state in the centralized persistent storage.

9. The system of claim 8, wherein the one or more coalescer computing devices further transmit the derived second order data to a worker computing device, from among the one or more worker computing devices, that is affinitized with the state, the transmitting causing the worker computing device that is affinitized with the state to incorporate the derived second order data into the state local to the worker computing device in the same manner as the incorporating.

10. The system of claim 1, wherein at least one state maintained by the state affinitized system comprises both data and computer-executable instructions relevant to the processing of the data.

2. The system of claim 2, wherein the one or more worker computing devices respond to requests received from the one or more front-end computing devices only with reference to a state, associated with the request, with which the one or more worker computing devices are affinitized and which is maintained on storage local to the one or more worker computing devices.

11. One or more computer-readable media comprising computer-executable instructions for managing a state affinitized system, the computer-executable instructions directed to steps comprising:

monitoring one or more worker computing devices, each of the worker computing devices being uniquely affinitized with one or more states maintained by the state affinitized system and each of the worker computing devices maintaining a copy of the one or more states with which they are uniquely affinitized on storage local to the one or more worker computing device; and

based on the monitoring, changing the affinitization of a first state from a first worker computing device with which it was originally affinitized to a second worker computing device to which it is to be subsequently affinitized, the changing comprising;

instructing the first worker computing device to discard a copy of the first state maintained on a first storage local to the first worker computing device; and

instructing the second worker computing device to obtain, from a centralized persistent storage, a copy of the first state on a second storage local to the second worker computing device, the centralized persistent storage comprising an up-to-date copy of each state of the one or more states maintained by the state affinitized system.

12. The computer-readable media of claim 11, further comprising computer-executable instructions for instructing, based on the monitoring, at least one worker computing device, from among the one or more worker computing devices, to discard data associated with a state that is no longer affinitized with the at least one worker computing device.

13. The computer-readable media of claim 11, further comprising computer-executable instructions for:

providing a front-end interface to users of the state affinitized system;

receiving a request comprising user-identifying information via the front-end interface;

determining a state, from among the one or more states maintained by the state affinitized system, that is associated with the request based on the user-identifying information of the request;

determining a worker computing device, from among the one or more worker computing devices, that is uniquely affinitized with the determined state, the determined worker computing device comprising a copy of the determined state on storage local to the determined worker computing device; and

transmitting the request to the determined worker computing device.

14. The computer-readable media of claim 11, further comprising computer-executable instructions for:

maintaining, in the centralized persistent storage, the up-to-date copy of each state of the one or more states maintained by the state affinitized system, the maintaining comprising incorporating received information into a state associated with the received information in an equivalent manner to incorporation of received information performed by a worker computing device, from among the one or more worker computing devices, that is affinitized with the state associated with the received information and that also received a copy of the received information.

15. The computer-readable media of claim 11, further comprising computer-executable instructions for:

deriving second order data from a state, of the one or more states maintained by the state affinitized system, in the centralized persistent storage; and

incorporating the derived second order data into the state in the centralized persistent storage.

16. The computer-readable media of claim 15, further comprising computer-executable instructions for:

transmitting the derived second order data, to a worker computing device, from among the one or more worker computing devices, that is affinitized with the state and maintains a copy of the state local to the worker computing device, the transmitting causing the worker computing device that is affinitized with the state to incorporate the derived second order data into the state local to the worker computing device in the same manner as the incorporating.

17. One or more computer-readable media comprising computer-executable instructions for participating in a state affinitized system, the computer-executable instructions directed to steps comprising:

maintaining, in a centralized persistent storage, an up-to-date copy of one or more states of the state affinitized system, the maintaining comprising incorporating received information into an state associated with the received information in an equivalent manner to incorporation of received information performed by a worker computing device of the state affinitized system that is uniquely affinitized with the state associated with the received information and that also received a copy of the received information;

deriving second order data from a state, of the one or more states of the state affinitized system, in the centralized persistent storage; and

incorporating the derived second order data into the state in the centralized persistent storage.

18. The computer-readable media of claim 17, further comprising computer-executable instructions for:

transmitting the derived second order data, to a worker computing device that is affinitized with the state and maintains a copy of the state local to the worker computing device, the transmitting causing the worker computing device that is affinitized with the state to incorporate the derived second order data into the state local to the worker computing device in the same manner as the incorporating.

19. The computer-readable media of claim 17, further comprising computer-executable instructions for:

monitoring one or more worker computing devices, each of the worker computing devices being uniquely affinitized with one or more states maintained by the state affinitized system and each of the worker computing devices maintaining a copy of the one or more states with which they are uniquely affinitized on storage local to the one or more worker computing device; and

based on the monitoring, changing the affinitization of a first state from a first worker computing device with which it was originally affinitized to a second worker computing device to which it is to be subsequently affinitized, the changing comprising;

instructing the first worker computing device to discard a copy of the first state maintained on a first storage local to the first worker computing device; and

instructing the second worker computing device to obtain, from a centralized persistent storage, a copy of the first state on a second storage local to the second worker computing device, the centralized persistent storage comprising an up-to-date copy of each state of the one or more states maintained by the state affinitized system

20. The computer-readable media of claim 17, further comprising computer-executable instructions for:

providing a front-end interface to users of the state affinitized system;

receiving a request comprising user-identifying information via the front-end interface;

determining a state, from among the one or more states maintained by the state affinitized system, that is associated with the request based on the user-identifying information of the request;

determining a worker computing device, from among the one or more worker computing devices, that is uniquely affinitized with the determined state, the determined worker computing device comprising a copy of the determined state on storage local to the determined worker computing device; and

transmitting the request to the determined worker computing device.