The patch titled
cpuset: top_cpuset tracks hotplug changes to node_online_map
has been added to the -mm tree. Its filename is
cpuset-top_cpuset-tracks-hotplug-changes-to-node_online_map.patch
See http://www.zip.com.au/~akpm/linux/patches/stuff/added-to-mm.txt to find
out what to do about this
------------------------------------------------------
Subject: cpuset: top_cpuset tracks hotplug changes to node_online_map
From: Paul Jackson <pj@xxxxxxx>
Change the list of memory nodes allowed to tasks in the top (root) nodeset
to dynamically track what cpus are online, using a call to a cpuset hook
from the memory hotplug code. Make this top cpus file read-only.
On systems that have cpusets configured in their kernel, but that aren't
actively using cpusets (for some distros, this covers the majority of
systems) all tasks end up in the top cpuset.
If that system does support memory hotplug, then these tasks cannot make
use of memory nodes that are added after system boot, because the memory
nodes are not allowed in the top cpuset. This is a surprising regression
over earlier kernels that didn't have cpusets enabled.
One key motivation for this change is to remain consistent with the
behaviour for the top_cpuset's 'cpus', which is also read-only, and which
automatically tracks the cpu_online_map.
This change also has the minor benefit that it fixes a long standing,
little noticed, minor bug in cpusets. The cpuset performance tweak to
short circuit the cpuset_zone_allowed() check on systems with just a single
cpuset (see 'number_of_cpusets', in linux/cpuset.h) meant that simply
changing the 'mems' of the top_cpuset had no affect, even though the change
(the write system call) appeared to succeed. With the following change,
that write to the 'mems' file fails -EACCES, and the 'mems' file stubbornly
refuses to be changed via user space writes. Thus no one should be mislead
into thinking they've changed the top_cpusets's 'mems' when in affect they
haven't.
In order to keep the behaviour of cpusets consistent between systems
actively making use of them and systems not using them, this patch changes
the behaviour of the 'mems' file in the top (root) cpuset, making it read
only, and making it automatically track the value of node_online_map. Thus
tasks in the top cpuset will have automatic use of hot plugged memory nodes
allowed by their cpuset.
Signed-off-by: Paul Jackson <pj@xxxxxxx>
Signed-off-by: Andrew Morton <akpm@xxxxxxxx>
---
Documentation/cpusets.txt | 10 +++++-----
include/linux/cpuset.h | 4 ++++
kernel/cpuset.c | 28 +++++++++++++++++++++++++---
mm/memory_hotplug.c | 2 ++
4 files changed, 36 insertions(+), 8 deletions(-)
diff -puN Documentation/cpusets.txt~cpuset-top_cpuset-tracks-hotplug-changes-to-node_online_map Documentation/cpusets.txt
--- a/Documentation/cpusets.txt~cpuset-top_cpuset-tracks-hotplug-changes-to-node_online_map
+++ a/Documentation/cpusets.txt
@@ -217,11 +217,11 @@ exclusive cpuset. Also, the use of a Li
to represent the cpuset hierarchy provides for a familiar permission
and name space for cpusets, with a minimum of additional kernel code.
-The cpus file in the root (top_cpuset) cpuset is read-only.
-It automatically tracks the value of cpu_online_map, using a CPU
-hotplug notifier. If and when memory nodes can be hotplugged,
-we expect to make the mems file in the root cpuset read-only
-as well, and have it track the value of node_online_map.
+The cpus and mems files in the root (top_cpuset) cpuset are
+read-only. The cpus file automatically tracks the value of
+cpu_online_map using a CPU hotplug notifier, and the mems file
+automatically tracks the value of node_online_map using the
+cpuset_track_online_nodes() hook.
1.4 What are exclusive cpusets ?
diff -puN include/linux/cpuset.h~cpuset-top_cpuset-tracks-hotplug-changes-to-node_online_map include/linux/cpuset.h
--- a/include/linux/cpuset.h~cpuset-top_cpuset-tracks-hotplug-changes-to-node_online_map
+++ a/include/linux/cpuset.h
@@ -63,6 +63,8 @@ static inline int cpuset_do_slab_mem_spr
return current->flags & PF_SPREAD_SLAB;
}
+extern void cpuset_track_online_nodes(void);
+
#else /* !CONFIG_CPUSETS */
static inline int cpuset_init_early(void) { return 0; }
@@ -126,6 +128,8 @@ static inline int cpuset_do_slab_mem_spr
return 0;
}
+static inline void cpuset_track_online_nodes() {}
+
#endif /* !CONFIG_CPUSETS */
#endif /* _LINUX_CPUSET_H */
diff -puN kernel/cpuset.c~cpuset-top_cpuset-tracks-hotplug-changes-to-node_online_map kernel/cpuset.c
--- a/kernel/cpuset.c~cpuset-top_cpuset-tracks-hotplug-changes-to-node_online_map
+++ a/kernel/cpuset.c
@@ -912,6 +912,10 @@ static int update_nodemask(struct cpuset
int fudge;
int retval;
+ /* top_cpuset.mems_allowed tracks node_online_map; it's read-only */
+ if (cs == &top_cpuset)
+ return -EACCES;
+
trialcs = *cs;
retval = nodelist_parse(buf, trialcs.mems_allowed);
if (retval < 0)
@@ -2042,9 +2046,8 @@ out:
* (of no affect) on systems that are actively using CPU hotplug
* but making no active use of cpusets.
*
- * This handles CPU hotplug (cpuhp) events. If someday Memory
- * Nodes can be hotplugged (dynamically changing node_online_map)
- * then we should handle that too, perhaps in a similar way.
+ * This routine ensures that top_cpuset.cpus_allowed tracks
+ * cpu_online_map on each CPU hotplug (cpuhp) event.
*/
#ifdef CONFIG_HOTPLUG_CPU
@@ -2063,6 +2066,25 @@ static int cpuset_handle_cpuhp(struct no
}
#endif
+/*
+ * Keep top_cpuset.mems_allowed tracking node_online_map.
+ * Call this routine anytime after you change node_online_map.
+ * See also the previous routine cpuset_handle_cpuhp().
+ */
+
+#ifdef CONFIG_MEMORY_HOTPLUG
+void cpuset_track_online_nodes()
+{
+ mutex_lock(&manage_mutex);
+ mutex_lock(&callback_mutex);
+
+ top_cpuset.mems_allowed = node_online_map;
+
+ mutex_unlock(&callback_mutex);
+ mutex_unlock(&manage_mutex);
+}
+#endif
+
/**
* cpuset_init_smp - initialize cpus_allowed
*
diff -puN mm/memory_hotplug.c~cpuset-top_cpuset-tracks-hotplug-changes-to-node_online_map mm/memory_hotplug.c
--- a/mm/memory_hotplug.c~cpuset-top_cpuset-tracks-hotplug-changes-to-node_online_map
+++ a/mm/memory_hotplug.c
@@ -281,6 +281,8 @@ int add_memory(int nid, u64 start, u64 s
/* we online node here. we can't roll back from here. */
node_set_online(nid);
+ cpuset_track_online_nodes();
+
if (new_pgdat) {
ret = register_one_node(nid);
/*
_
Patches currently in -mm which might be from pj@xxxxxxx are
cpuset-top_cpuset-tracks-hotplug-changes-to-cpu_online_map.patch
cpuset-oom-panic-fix.patch
ia64-panic-if-topology_init-kzalloc-fails.patch
apply-type-enum-zone_type-fix.patch
cpu-hotplug-compatible-alloc_percpu-fix.patch
cpu-hotplug-compatible-alloc_percpu-fix-2.patch
oom-cpuset-hint.patch
cpuset-top_cpuset-tracks-hotplug-changes-to-node_online_map.patch
sched-force-sbin-init-off-isolated-cpus.patch
sched-generic-sched_group-cpu-power-setup.patch
-
To unsubscribe from this list: send the line "unsubscribe mm-commits" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
