weird issue with CentOS RT kernel, hangs hard under particular load.

[Chris Friesen <chris.friesen@xxxxxxxxxxxxx>]

Hi all,

Not sure who I should be talking to about this, but we're hitting a 
weird issue with kernel-rt-3.10.0-957.12.2.rt56.929.el7.src.rpm from CentOS.

Basically, while running containerized OpenStack on top of Kubernetes it 
just hangs after a while.  Without anything useful in the logs, and so 
hard that sysrq on the serial console doesn't work (and it does normally).

The equivalent non-RT kernel seems to work fine, does not show the same 
problem.

Also, reducing the number of OpenStack services running seems to 
increase stability even though the CPUs aren't super busy in the failure 
scenario.

Anyone got any suggestions on where to start debugging it?  Kernel 
options to enable, extra debug logging, events to monitor?

Thanks,
Chris