>> Any help on this? How to build 32-bit Apache httpd on a 64-bit server?
I am unsure of recommended workarounds as I usually have my package manager build httpd directly from that OSs package index. That said, a container or VM might be a possibility.
Does your distribution not provide 32 bit packages?
>> No, Rocky Linux does not have a 32-bit package.