On Thu, Nov 12, 2020 at 4:19 PM Roman Gushchin <guro@xxxxxx> wrote: > [snip] > > From 8b28d91475d54c552e503e66f169e1e00475c856 Mon Sep 17 00:00:00 2001 > From: Roman Gushchin <guro@xxxxxx> > Date: Wed, 16 Sep 2020 15:43:48 -0700 > Subject: [PATCH v2 2/2] mm: memcg/slab: pre-allocate obj_cgroups for slab > caches with SLAB_ACCOUNT > > In general it's unknown in advance if a slab page will contain > accounted objects or not. In order to avoid memory waste, an > obj_cgroup vector is allocated dynamically when a need to account > of a new object arises. Such approach is memory efficient, but > requires an expensive cmpxchg() to set up the memcg/objcgs pointer, > because an allocation can race with a different allocation on another > cpu. > > But in some common cases it's known for sure that a slab page will > contain accounted objects: if the page belongs to a slab cache with a > SLAB_ACCOUNT flag set. It includes such popular objects like > vm_area_struct, anon_vma, task_struct, etc. > > In such cases we can pre-allocate the objcgs vector and simple assign > it to the page without any atomic operations, because at this early > stage the page is not visible to anyone else. > > v2: inline set_page_objcgs() and add some comments, by Johannes > > Signed-off-by: Roman Gushchin <guro@xxxxxx> [snip] > > static __always_inline void account_slab_page(struct page *page, int order, > - struct kmem_cache *s) > + struct kmem_cache *s, > + gfp_t gfp) > { > + if (memcg_kmem_enabled() && (s->flags & SLAB_ACCOUNT)) > + memcg_alloc_page_obj_cgroups(page, s, gfp, true); > + I was wondering why not add (gfp & __GFP_ACCOUNT) check as well but it seems like for that some additional plumbing is required. Anyways: Reviewed-by: Shakeel Butt <shakeelb@xxxxxxxxxx>