I don't think it's a good idea to have alsa modules compiled into the kernel, at least it wasn't the last time I tried :-)
I've been running like that for quite a while. I don't seem to have any problems, save this card order thing, which as Lars pointed out could be solved if I was using modules.
