On Tue, 9 Sep 2014 17:47:23 -0700 Nishanth Aravamudan <nacc@xxxxxxxxxxxxxxxxxx> wrote:
> On 09.09.2014 [17:11:15 -0700], Andrew Morton wrote:
> > On Tue, 9 Sep 2014 12:03:27 -0700 Nishanth Aravamudan <nacc@xxxxxxxxxxxxxxxxxx> wrote:
> >
> > > From: Joonsoo Kim <iamjoonsoo.kim@xxxxxxx>
> > >
> > > We need to determine the fallback node in slub allocator if the
> > > allocation target node is memoryless node. Without it, the SLUB wrongly
> > > select the node which has no memory and can't use a partial slab,
> > > because of node mismatch. Introduced function, node_to_mem_node(X), will
> > > return a node Y with memory that has the nearest distance. If X is
> > > memoryless node, it will return nearest distance node, but, if X is
> > > normal node, it will return itself.
> > >
> > > We will use this function in following patch to determine the fallback
> > > node.
> > >
> > > ...
> > >
> > > --- a/include/linux/topology.h
> > > +++ b/include/linux/topology.h
> > > @@ -119,11 +119,20 @@ static inline int numa_node_id(void)
> > > * Use the accessor functions set_numa_mem(), numa_mem_id() and cpu_to_mem().
> >
> > This comment could be updated.
>
> Will do, do you prefer a follow-on patch or one that replaces this one?
Either is OK for me. I always turn replacement patches into
incrementals so I (and others) can see what changed.
> > > */
> > > DECLARE_PER_CPU(int, _numa_mem_);
> > > +extern int _node_numa_mem_[MAX_NUMNODES];
> > >
> > > #ifndef set_numa_mem
> > > static inline void set_numa_mem(int node)
> > > {
> > > this_cpu_write(_numa_mem_, node);
> > > + _node_numa_mem_[numa_node_id()] = node;
> > > +}
> > > +#endif
> > > +
> > > +#ifndef node_to_mem_node
> > > +static inline int node_to_mem_node(int node)
> > > +{
> > > + return _node_numa_mem_[node];
> > > }
> >
> > A wee bit of documentation wouldn't hurt.
This?
> > > --- a/mm/page_alloc.c
> > > +++ b/mm/page_alloc.c
> > > @@ -85,6 +85,7 @@ EXPORT_PER_CPU_SYMBOL(numa_node);
> > > */
> > > DEFINE_PER_CPU(int, _numa_mem_); /* Kernel "local memory" node */
> > > EXPORT_PER_CPU_SYMBOL(_numa_mem_);
> > > +int _node_numa_mem_[MAX_NUMNODES];
> >
> > How does this get updated as CPUs, memory and nodes are hot-added and
> > removed?
>
> As CPUs are added, the architecture code in the CPU bringup will update
> the NUMA topology. Memory and node hotplug are still open issues, I
> mentioned the former in the cover letter. I should have mentioned it in
> this commit message as well.
Please define "open issue". The computer will crash and catch fire?
If not that, then what?
> I do notice that Lee's commit message from 7aac78988551 ("numa:
> introduce numa_mem_id()- effective local memory node id"):
>
> "Generic initialization of 'numa_mem' occurs in __build_all_zonelists().
> This will initialize the boot cpu at boot time, and all cpus on change
> of numa_zonelist_order, or when node or memory hot-plug requires
> zonelist rebuild. Archs that support memoryless nodes will need to
> initialize 'numa_mem' for secondary cpus as they're brought on-line."
>
> And since we update the _node_numa_mem_ value on set_cpu_numa_mem()
> calls, which were already needed for numa_mem_id(), we might be covered.
> Testing these cases (hotplug) is next in my plans.
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@xxxxxxxxx. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@xxxxxxxxx";> email@xxxxxxxxx </a>