Pavel, thanks for the answer!Unfortunately unloading the button module did not make any difference. I also tried unloading iwlwifi since issues with Intel drivers seem to be pretty common. Also didn't make any difference.
How should I proceed debugging this? I'm really interesting in having this fixed -- if I can't solve the problem I'm probably better off using another operating system entirely.
Thanks Jonas
