Preemptible-RCU CPU hotplugging while maintaining real-time response

• US 9,720,836 B2
• Filed: 05/11/2015
• Issued: 08/01/2017
• Est. Priority Date: 05/11/2015
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: McKenney, Paul E.
• Primary Examiner(s): Thammavong, Prasith
• Application Number:
  US14/708,609
• Publication Number:
  US 20160335183A1
• Time in Patent Office: 813 Days
• Field of Search: 711122
• CPC Class Codes: G06F 12/0811 with multilevel cache hierarchies
• CPC Class Codes: G06F 12/0833 in combination with broadcast means (e.g. for invalidation or updating)
• CPC Class Codes: G06F 12/12 Replacement control
• CPC Class Codes: G06F 12/128 adapted to multidimensional cache systems, e.g. set-associative, multicache, multiset or multilevel
• CPC Class Codes: G06F 2209/521 Atomic
• CPC Class Codes: G06F 2212/283 Plural cache memories
• CPC Class Codes: G06F 2212/62 Details of cache specific to multiprocessor cache arrangements
• CPC Class Codes: G06F 9/5094 where the allocation takes into account power or heat criteria power management in computers in general G06F1/3203; thermal management in computers in general G06F1/206
• CPC Class Codes: G06F 9/522 Barrier synchronisation
• CPC Class Codes: G06F 9/526 Mutual exclusion algorithms
• CPC Class Codes: G06F 9/528 by using speculative mechanisms

Abstract

A grace period detection technique for a preemptible read-copy update (RCU) implementation that uses a combining tree for quiescent state tracking. When a leaf level bitmask indicating online/offline CPUs is fully cleared due to all of its assigned CPUs going offline as a result of hotplugging operations, the bitmask state is not immediately propagated to the root level of the combining tree as in prior art RCU implementations. Instead, propagation is deferred until all tasks are removed from an associated leaf level task list tracking tasks that were preempted inside an RCU read-side critical section. Deferring bitmask propagation obviates the need to migrate the task list to the combining tree root level in order to prevent premature grace period termination. The task list can remain at the leaf level. In this way, CPU hotplugging is accommodated while avoiding excessive degradation of real-time latency stemming from the now-eliminated task list migration.

Claims

1. A system, comprising:

a plurality of CPUs;

a memory coupled to said CPUs, said memory including a computer readable storage medium tangibly embodying at least one program of instructions executable by said CPUs to perform hierarchical read-copy update (RCU) grace period detection operations that accommodate CPU-hotplugging while avoiding degradation of real-time latency due to task list migration, said operations comprising;

providing a combining tree of two or more levels to track quiescent states, said levels including a leaf level and a root level;

determining whether a condition warrants adjusting hierarchical RCU grace period detection to account for CPUs that have gone offline due to hotplugging operations;

said condition being met if (1) a leaf level bitmask of said combining tree is fully cleared to indicate an offline state in which all of its assigned CPUs are offline, and (2) there are no tasks on a task list associated with said fully cleared bitmask;

if said condition is met, then propagating said offline state of said leaf level bitmask up said combining tree to a root level bitmask to thereby establish an adjusted grace period detection state in which said fully cleared bitmask'"'"'s assigned CPUs are ignored for purposes of grace period detection;

if said condition is partially met due to said leaf level bitmask being fully cleared to indicate an offline state in which all of its assigned CPUs are offline, but there are tasks remaining on said task list associated with said fully cleared bitmask, then (3) refraining from propagating said offline state up said combining tree to said root level bitmask and (4) maintaining said associated task list at said leaf level without migration to said root level, thereby ensuring that said tasks remaining on said task list will continue to have effect for purposes of grace period detection without having to migrate said task list; and

unless said condition is fully met, continuing existing grace period detection without propagating said offline state.

2. The system of claim 1, wherein said determining whether a condition warrants adjusting said hierarchical RCU grace period detection to account for CPUs that have gone offline due to a hotplugging operation is performed whenever said hotplugging operation results in one of said leaf level bitmasks being fully cleared to indicate said offline state.

3. The system of claim 1, wherein said determining whether a condition warrants adjusting said hierarchical RCU grace period detection to account for CPUs that have gone offline due to a hotplugging operation is performed whenever a last remaining task of said task list is removed from said task list.

4. The system of claim 1, wherein locking synchronization is provided between said periodically clearing fields of said leaf level bitmask and said propagating said offline state of said leaf level bitmask up said combining tree to said root level bitmask.

5. The system of claim 1, wherein said levels of said combining tree each comprise one or more data structures, each of which maintains a bitmask, said data structures at said leaf level each further maintain a task list.

6. The system of claim 1, wherein each of said leaf level bitmasks comprises one bit for each CPU assigned said leaf level bitmask, and wherein said root level bitmask comprises one bit for each lower level bitmask assigned to said root level bitmask.

7. The system of claim 1, wherein said tasks lists each comprise a first list portion containing tasks that are blocking a current grace period and second list portion containing tasks that are blocking a next grace period.

8. A computer program product, comprising:

one or more computer readable data storage media;

program instructions stored on said one or more computer readable data storage media for programming a data processing platform having a plurality of CPUs to perform hierarchical read-copy update (RCU) grace period detection operations that accommodate CPU-hotplugging while avoiding degradation of real-time latency due to task list migration, said operations comprising;

providing a combining tree of two or more levels to track quiescent states, said levels including a leaf level and a root level;

determining whether a condition warrants adjusting hierarchical RCU grace period detection to account for CPUs that have gone offline due to hotplugging operations;

said condition being met if (1) a leaf level bitmask of said combining tree is fully cleared to indicate an offline state in which all of its assigned CPUs are offline, and (2) there are no tasks on a task list associated with said fully cleared bitmask;

if said condition is met, then propagating said offline state of said leaf level bitmask up said combining tree to a root level bitmask to thereby establish an adjusted grace period detection state in which said fully cleared bitmask'"'"'s assigned CPUs are ignored for purposes of grace period detection;

if said condition is partially met due to said leaf level bitmask being fully cleared to indicate an offline state in which all of its assigned CPUs are offline, but there are tasks remaining on said task list associated with said fully cleared bitmask, then (3) refraining from propagating said offline state up said combining tree to said root level bitmask and (4) maintaining said associated task list at said leaf level without migration to said root level, thereby ensuring that said tasks remaining on said task list will continue to have effect for purposes of grace period detection without having to migrate said task list; and

unless said condition is fully met, continuing existing grace period detection without propagating said offline state.

9. The computer program product of claim 8, wherein said determining whether a condition warrants adjusting said hierarchical RCU grace period detection to account for CPUs that have gone offline due to a hotplugging operation is performed whenever said hotplugging operation results in one of said leaf level bitmasks being fully cleared to indicate said offline state.

10. The computer program product of claim 8, wherein said determining whether a condition warrants adjusting said hierarchical RCU grace period detection to account for CPUs that have gone offline due to a hotplugging operation is performed whenever a last remaining task of one said task lists is removed from said task list.

11. The computer program product of claim 8, wherein locking synchronization is provided between said periodically clearing fields of said leaf level bitmask and said propagating said offline state of said leaf level bitmask up said combining tree to said root level bitmask.

12. The computer program product of claim 8, wherein said levels of said combining tree each comprise one or more data structures, each of which maintains a bitmask, and said data structures at said leaf level each further maintain a task list.

13. The computer program product of claim 8, wherein each of said leaf level bitmasks comprises one bit for each CPU assigned said leaf level bitmask, and wherein said root level bitmask comprises one bit for each lower level bitmask assigned to said root level bitmask.