METHOD AND SYSTEM FOR WORK SCHEDULING IN A MULTI-CHIP SYSTEM

• US 20150254104A1
• Filed: 03/07/2014
• Published: 09/10/2015
• Est. Priority Date: 03/07/2014
• Status: Active Grant

• Current Assignee: Marvell Asia Pte Limited (Marvell Technology Group Limited)
• Original Assignee: Cavium, LLC (Marvell Technology Group Limited)
• Inventors: Kessler, Richard E., Snyder, Wilson P. II
• Granted Patent: US 9,411,644 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 12/023 Free address space management
• CPC Class Codes: G06F 2209/486 Scheduler internals
• CPC Class Codes: G06F 2212/1044 Space efficiency improvement
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0656 Data buffering arrangements
• CPC Class Codes: G06F 3/0673 Single storage device
• CPC Class Codes: G06F 9/4881 Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
• CPC Class Codes: G06F 9/5016 the resource being the memory
• CPC Class Codes: G06F 9/5072 Grid computing

Abstract

According to at least one example embodiment, a multi-chip system includes multiple chip devices configured to communicate to each other and share hardware resources. According to at least one example embodiment, a method of processing work item in the multi-chip system comprises designating, by a work source component associated with a chip device, referred to as the source chip device, of the multiple chip devices, a work item to a scheduler for scheduling. The scheduler then assigns the work item to a another chip device, referred to as the destination chip device, of the multiple chip devices for processing, the scheduler is one of one or more schedulers each associated with a corresponding chip device of the multiple chip devices.

Claims

1. A multi-chip system comprising:

multiple chip devices, at least one chip device includes a work source component, and one or more core processors; and

one or more schedulers each associated with a corresponding chip device of the multiple chip devices, a scheduler of the one or more schedulers configured to assign a work item to a destination chip device of the multiple chip devices for processing upon receiving the work item from a work source component associated with a source chip device of the multiple chip devices.

2. The multi-chip system as recited in claim 1, wherein the work source component includes a core processor or a coprocessor.

3. The multi-chip system as recited in claim 1, wherein the work source component is configured to:

receive a pointer to a work entry; and

send the pointer to the work entry to the scheduler of the one or more schedulers.

4. The multi-chip system as recited in claim 1, wherein the work source component is configured to:

create a work entry; and

send a pointer associated with the work entry to the scheduler of the one or more schedulers.

5. The multi-chip system as recited in claim 1, wherein in assigning the work item to a chip device of the multiple chip devices, the scheduler is configured to assign the work item to a core processor of the one or more core processors associated with the chip device.

6. The multi-chip system as recited in claim 1, wherein a single scheduler is configured to assign all work items from any work source component associated with a corresponding chip device, each work source component configured to send each corresponding work item to the single scheduler.

7. The multi-chip system as recited in claim 1, wherein the multi-chip system includes multiple schedulers configured to assign work items to chip devices, the work source component configured to select a scheduler of the multiple schedulers for scheduling a corresponding work item.

8. The multi-chip system as recited in claim 7, wherein in selecting a scheduler, the work source component is configured to select the same scheduler for scheduling work items associated with a common work flow.

9. The multi-chip system as recited in claim 7, wherein in assigning the work item to a chip device of the multiple chip devices, the scheduler is configured to assign the work item independently of other schedulers of the multiple schedulers.

10. The multi-chip system as recited in claim 1, wherein each scheduler includes multiple scheduling queues for scheduling work items and wherein the work source component is configured to select a scheduling queue for scheduling the work item.

11. The multi-chip system as recited in claim 10, wherein in selecting a scheduling queue, the work source component is further configured to maintain a list of scheduling queues associated with the one or more schedulers.

12. The multi-chip system as recited in claim 1, wherein in assigning a work item, the scheduler is configured to assign work items associated with a common work flow to the same first chip device.

13. The multi-chip system as recited in claim 1, wherein a work item includes a processing operation associated with a data packet.

14. The multi-chip system as recited in claim 1, wherein each chip device of the multiple chip devices includes a memory allocator configured to allocate memory for storing data associated with the work item in one of the multiple chip devices.

15. The multi-chip system as recited in claim 14, wherein in allocating memory, each memory allocator is further configured to allocate memory for storing the work item in the first chip device to which the work item is assigned.

16. The multi-chip system as recited in claim 14, wherein each memory allocator is further configured to maintain a list of buffers associated with the multiple chip devices for storing data associated with a work item.

17. The multi-chip system as recited in claim 1, wherein in assigning a work item to a destination chip device, a first scheduler residing in a first chip device is configured to forward the work item to a second scheduler located in the destination chip device, the destination chip device is different from the first chip device.

18. The multi-chip system as recited in claim 17, wherein forwarding the work item includes forwarding the work item through a communications channel designated to carry communications between coprocessors in the first chip device and coprocessors in the destination chip device.

19. A method of processing work items in a multi-chip system, the method comprising:

designating, by a work source component associated with a source chip device, a work item to a scheduler for scheduling, the source chip device being one of multiple chip devices of the multi-chip system;

assigning, by the scheduler, the work item to a destination chip device of the multiple chip devices for processing, the scheduler being one of one or more schedulers each associated with a corresponding chip device of the multiple chip devices.

20. The method as recited in claim 19, wherein the work source component includes a core processor or a coprocessor.

21. The method as recited in claim 19, wherein the method further includes:

receiving, by the work source, a pointer to a work entry; and

sending, by the work source, the pointer to the work entry to the scheduler of the one or more schedulers.

22. The method as recited in claim 19, wherein the method further includes:

creating, by the work source, a work entry; and

sending, by the work source, a pointer associated with the work entry to the scheduler of the one or more schedulers.

23. The method as recited in claim 19, wherein assigning the work item to the destination chip device of the multiple chip devices includes assigning the work item to a core processor of the one or more core processors associated with the chip device.

24. The method as recited in claim 19, wherein designating the work item includes designating all work items to a single scheduler configured to assign all work items from any work source component in the multi-chip system.

25. The method as recited in claim 19, wherein designating the work item includes selecting a scheduler of multiple schedulers associated with the multiple chip devices, each scheduler configured to assign work items to the multiple chip devices.

26. The method as recited in claim 25, wherein selecting a scheduler includes selecting a same scheduler for scheduling work items associated with a common work flow.

27. The method as recited in claim 25, wherein assigning the work item to a chip device of the multiple chip devices includes assigning the work item by the selected scheduler independently of other schedulers of the multiple schedulers.

28. The method as recited in claim 19, wherein the scheduler includes multiple scheduling queues for scheduling work items, and wherein designating the work item to a scheduler includes selecting a scheduling queue of the multiple scheduling queues for scheduling the work item.

29. The method as recited in claim 28, wherein selecting the scheduling queue includes:

maintaining a list of scheduling queues associated with the one or more schedulers; and

selecting the scheduling queue from the list maintained.

30. The method as recited in claim 19, wherein assigning a work item includes assigning work items associated with a common work flow to the same destination chip device.

31. The method as recited in claim 19, wherein the work item includes a processing operation associated with data packet.

32. The method as recited in claim 19, wherein each chip device of the multiple chip devices includes a memory allocator, the method further comprising allocating memory, by one of the memory allocators, for storing data associated with the work item in one of the multiple chip devices.

33. The method as recited in claim 32, wherein allocating the memory includes allocating the memory for storing the work item in the first chip device to which the work item is assigned.

34. The method as recited in claim 32, wherein allocating the memory includes:

maintaining a list of memory buffers associated with the multiple chip devices for storing data associated with a work item; and

allocating a memory buffer for storing the data associated with the work item based on the list maintained.

35. The method as recited in claim 19, wherein assigning a work item to a destination chip device includes forwarding by a first scheduler residing in a first chip device the work item to a second scheduler located in the destination chip device, the destination chip device is different from the first chip device.

36. The method as recited in claim 35, wherein forwarding the work item includes forwarding the work item through a communications channel designated to carry communications between coprocessors in the first chip device and coprocessors in the destination chip device.