Dynamic modeling for resource allocation in a file server

• US 6,230,200 B1
• Filed: 09/08/1997
• Issued: 05/08/2001
• Est. Priority Date: 09/08/1997
• Status: Expired due to Term

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Forecast, John, Duso, Wayne W.
• Primary Examiner(s): Harrell, Robert B.
• Assistant Examiner(s): VU, THONG H
• Application Number:
  US08/925,026
• Time in Patent Office: 1,338 Days
• Field of Search: 395/200.49, 395/200.56, 395/200.55, 395/200.61, 395/311, 395/154, 395/500, 709/225, 709/219, 709/238, 709/216, 707/3, 711/114, 711/118, 364/578, 364/514, 348/390, 348/419, 706/14
• US Class Current: 709/226
• CPC Class Codes: G06F 9/50 Allocation of resources, e.g. of the central processing unit [CPU]

Abstract

Resources in a file server are allocated by dynamically modeling a configuration of data handling components in the file server and routings of data streams through the data handling components. The dynamic model is a computer model maintained in memory by a controller of the file server. For example, the dynamic model is a directed acyclic graph in which nodes represent the data handling components and edges represent data stream paths. Each node has a list of resources and current allocations of the resources. Associated with each active data stream is a list of pointers to the nodes and current allocations for the data stream. The controller of the file server has programs for automatically creating the dynamic model, modifying the dynamic model in response to component changes such as component failures, enforcing a scheduling and admissions policy by allocating resources for a path for a data stream during a search through the dynamic model in response to a client request for data access, de-allocating resources in response to an end-of-stream condition, and balancing allocations of resources to data streams in order to free resources to allocate a path for a requested data stream. The dynamic model is created automatically by collecting information about what components are installed in the file server, the resources of the installed components, and connections between the installed components.

Claims

1. A method of allocating resources in a file server to handle a data stream in response to a client request, said method comprising the steps of:

a) maintaining in memory a dynamic model of data stream handling components of the file server, and

b) in response to the client request, routing the data stream through the dynamic model of the data stream handling components of the file server, and allocating to the data stream resources of the data stream handling components through which the data stream is routed.

2. The method as claimed in claim 1, wherein the dynamic model is maintained by a controller of the file server in memory of the controller of the file server.

3. The method as claimed in claim 1, wherein the routing of the data stream through the dynamic model includes investigating possible paths and backtracking when a possible path is found to be blocked.

4. The method as claimed in claim 1, wherein the resources of each data stream handling component allocated to the data stream are allocated to the data stream when the data stream is routed through a node in the dynamic model, said node representing said each data stream handling component.

5. The method as claimed in claim 1, wherein the dynamic model is maintained in the memory as a directed acyclic graph in which nodes represent the data handling components and edges represent data stream paths between the data handling components.

6. The method as claimed in claim 5, wherein each node has a list of resources associated with the node and current allocations of the resources.

7. The method as claimed in claim 5, wherein the dynamic model further includes, for each active data stream in the file server, a list of pointers to the nodes and edges and current allocations for said each active data stream.

8. The method as claimed in claim 1, wherein the dynamic model includes an object-oriented definition of classes of the data stream handling components.

9. The method as claimed in claim 1, which-includes creating the dynamic model by collecting from components of the file server information identifying the components that are installed in the file server and connections between the components installed in the file server.

10. The method as claimed in claim 1, which includes changing the dynamic model in response to changes in the data stream handling components.

11. The method as claimed in claim 10, which includes redirecting the data stream through the dynamic model in response to a failure of a stream handling component having resources allocated to the data stream.

12. The method as claimed in claim 1, which includes redirecting a pre-existing data stream through the model in order to free resources needed for allocating resources to satisfy the client request.

13. The method as claimed in claim 1, wherein the model includes available resources and allocated resources for the stream handling components, and wherein allocated resources are freed in response to an end-of-stream condition.

14. A method of allocating resources in a video file server to handle a video data stream in response to a client request, said method comprising the steps of:

a) maintaining, in memory of a controller of the video file server, a dynamic model of video data stream handling components of the file server, the dynamic model including connections between the video data stream handling components, and available resources and allocated resources of the video data stream handling components, and

b) in response to the client request, routing the video data stream through the dynamic model of the video data stream handling components of the file server, and allocating to the video data stream resources of the video data stream handling components through which the data stream is routed.

15. The method as claimed in claim 14, wherein the routing of the data stream through the dynamic model includes investigating possible paths and backtracking when a possible path is found to be blocked.

16. The method as claimed in claim 14, wherein the dynamic model is maintained in the memory as a directed acyclic graph in which nodes represent the video data stream handling components and edges represent data stream paths between the video data stream handling components.

17. The method as claimed in claim 16, wherein each node has a list of resources associated with the node and current allocations of the resources.

18. The method as claimed in claim 16, wherein the dynamic model further includes, for each active video data stream in the video file server, a list of pointers to the nodes and edges and current allocations for said each active video data stream.

19. The method as claimed in claim 14, wherein the dynamic model includes an object-oriented definition of classes of the video data stream handling components.

20. The method as claimed in claim 14, which includes automatically creating the dynamic model by collecting from components of the video file server information identifying the video data stream handling components that are installed in the video file server and connections between the video data stream handling components installed in the video file server.

21. The method as claimed in claim 14, which includes changing the dynamic model in response to changes in the video data stream handling components.

22. The method as claimed in claim 21, wherein the method includes redirecting the video data stream through the dynamic model in response to a failure of a video data stream handling component having resources allocated to the video data stream.

23. The method as claimed in claim 14, which includes redirecting a pre-existing video data stream through the model in order to free resources needed for allocating resources to satisfy the client request.

24. The method as claimed in claim 14, wherein the allocated resources for the stream handling components are freed in response to an end-of-stream condition.

25. A file server comprising, in combination:

data storage; and

a plurality of stream servers connecting clients to the data storage; and

a controller responsive to a request from a client for access to data stored in the data stroage for allocating resources in at least one of the stream server computers for streaming data specified by the request to the client, wherein the controller is programmed for maintaining in memory a dynamic model of data stream handling components of the file server, and for responding to the client request by routing the data stream through the dynamic model of the data stream handling components of the file server, and allocating to the data stream resources of the data stream handling components through which the data stream is routed.

26. The file server as claimed in claim 25, wherein the controller is programmed to route the data stream through the dynamic model of the data stream handling components by investigating possible paths and backtracking when a possible path is found to be blocked.

27. The file server as claimed in claim 25, wherein the controller is programmed to allocate resources of each data stream handling component to the data stream when the data stream is routed through a node in the dynamic model, said node representing said each data stream handling component.

28. The file server as claimed in claim 25, wherein the dynamic model is maintained in the memory as a directed acyclic graph in which nodes represent the data handling components and edges represent data stream paths between the data handling components.

29. The file server as claimed in claim 28, wherein each node has a list of resources associated with the node and current allocations of the resources.

30. The file server as claimed in claim 28, wherein the dynamic model further includes, for each active data stream in the file server, a list of pointers to the nodes and edges and current allocations for said each active data stream.

31. The file server as claimed in claim 25, wherein the controller is programmed to create the dynamic model by collecting from components of the file server information identifying the data stream handling components that are installed in the file server and connections between the data stream handling components installed in the file server.

32. The file server as claimed in claim 25, wherein the controller is programmed to change the dynamic model in response to changes in the data stream handling components.

33. The file server as claimed in claim 31, wherein the controller is programmed to redirect the data stream through the dynamic model in response to a failure of a stream handling component having resources allocated to the data stream.

34. The file server as claimed in claim 25, wherein the controller is programmed to redirect a pre-existing data stream through the model in order to free resources needed for allocating resources to satisfy the client request.

35. The file server as claimed in claim 25, wherein the model includes available resources and allocated resources for the stream handling components, and wherein the controller is programmed to free allocated resources in response to an end-of-stream condition.

36. A video file server comprising, in combination:

a cached disk storage subsystem; and

a plurality of stream server computers connecting clients to the cached disk storage subsystem; and

a controller responsive to a request from a client for access to data stored in the cached disk storage subsystem for allocating resources in at least one of the stream server computers for streaming video data specified by the request to the client, wherein the controller is programmed for maintaining in memory of the controller a dynamic model of video data stream handling components of the video file server, the dynamic model including available resources of the video data stream handling components, and for responding to the client request by routing the data stream through the dynamic model of the data stream handling components of the file server, and allocating to the data stream resources of the data stream handling components through which the data stream is routed.

37. The video file server as claimed in claim 36, wherein the controller is programmed to route the video data stream through the dynamic model by investigating possible paths and backtracking when a possible path is found to be blocked.

38. The video file server as claimed in claim 36, wherein the controller is programmed to maintain the dynamic model in memory as a directed acyclic graph in which nodes represent the video data stream handling components and edges represent video data stream paths between the video data stream handling components.

39. The video file server as claimed in claim 38, wherein each node has a list of resources associated with the node and current allocations of the resources.

40. The video file server as claimed in claim 38, wherein the dynamic model further includes, for each active video data stream in the video file server, a list of pointers to the nodes and edges and current allocations for said each active video data stream.

41. The video file server as claimed in claim 36, wherein the dynamic model includes an object-oriented definition of classes of the video data stream handling components.

42. The video file server as claimed in claim 36, wherein the controller is programmed to create the dynamic model by collecting from components of the video file server information identifying the video data stream handling components that are installed in the video file server and connections between the video data stream handling components installed in the video file server.

43. The video file server as claimed in claim 36, wherein the controller is programmed to change the dynamic model in response to changes in the video data stream handling components.

44. The video file server as claimed in claim 43, wherein the controller is programmed to redirect the video data stream through the dynamic model in response to a failure of a video data stream handling component having resources allocated to the video data stream.

45. The video file server as claimed in claim 36, wherein the controller is programmed to redirect a pre-existing video data stream through the model in order to free resources needed for allocating resources to satisfy the client request.

46. The video file server as claimed in claim 36, wherein the controller is programmed to free allocated resources for the stream handling components in response to an end-of-stream condition.