On Sat, Jul 3, 2021 at 4:07 AM Daniel Jordan <daniel.m.jordan@xxxxxxxxxx> wrote: > > Hello, > > On Fri, Jul 02, 2021 at 08:26:27AM -0000, Hao Lee wrote: > > memcg currently has a remote charging mechanism that can charge usage to other > > memcg instead of the one the task belongs to. > > > > In our environment, we need to account the cpu usage consumed by some kworkers > > to a specific cgroup. Thus, we want to introduce a remote-charging mechanism to > > cpu and cpuacct subsys in our kernel. > > I also want to see this upstream, and am actually working on it right > now, have been for some time. > > So far, this is needed to properly account multithreaded padata jobs, > memory reclaim, and net rx. Android folks have raised this issue in the > past too, though I'm not aware of the specific kthreads that are giving > them problems. > > So naturally, I'm curious about your use case and how it may be > different from these others. What kworkers would you like to account? Thanks. We use a workqueue to perform asynchronous reclaim for cgroups. The kworker may consume lots of CPU cycles if the cgroup memory pressure is extremely high, so we want to charge the cpu usage to the related cgroup for which the kworker works. Otherwise, the reclaim kworker will steal cpu time from the system level, which breaks the resource isolation. > > > I want to know if the community has a plan to do this? > > What will the community approach look like? > > There has been discussion about this here, > > https://lore.kernel.org/lkml/20200219214112.4kt573kyzbvmbvn3@xxxxxxxxxxxxxxxxxxxxxxxxxx/ > Yes, our work is very similar to Johannes'. > more recently here, > > https://lore.kernel.org/lkml/YGxjwKbec68sCcqo@xxxxxxxxxxxxxxx/ > > and we may talk about it at LPC: > > https://www.linuxplumbersconf.org/event/11/page/104-accepted-microconferences#cont-perform I also found that you posted a patchset in 2019 to introduce a cgroup-aware workqueue. In that discussion, back-charging is considered to be a suitable solution. https://lore.kernel.org/lkml/20190611195549.GL3341036@xxxxxxxxxxxxxxxxxxxxxxxxxxx/ I also have a question here. Are the back-charging and remote charging the same thing? > > > I think we need to move the active_memcg to a separated active_cgroup struct, > > and the latter will contain active_memcg, active_tg, and active_cpuacct. > > I'm not seeing how that could work for cases that don't know the cgroup > when the remote charging period begins. This is indeed a problem. Neither cgroup-aware kthread nor remote charging can address this. Maybe this is the biggest obstacle hindering fine-grained charging. > The only one I'm aware of > that's like that is net rx, where the work to process packets has to > start before their ultimate destination, and therefore cgroup, is known. Sorry. Is this a typo? It seems the word "known" should be "unknown"... Regards, Hao Lee > > thanks, > Daniel
