On Tue, 9 Aug 2011, Mahmood Naderan wrote: > >Do you have any kernel log panic/oops/Bug messages? > > Actually, that happened for one my diskless nodes 10 days ago. > What I saw on the screen (not the logs), was > "running out of memory.... kernel panic....." > The only similar message in the kernel is "Out of memory and no killable processes..." and that panics the machine when there are no eligible tasks to kill. If you're using cpusets or mempolicies, you must ensure that all tasks attached to either of them are not set to OOM_DISABLE. It seems unlikely that you're using those, so it seems like a system-wide oom condition. Do cat /proc/*/oom_score and make sure at least some threads have a non-zero badness score. Otherwise, you'll need to adjust their /proc/pid/oom_score_adj settings to not be -1000. Randy also added linux-mm@xxxxxxxxx to the cc, but you removed it; please don't do that.