Do you need this configuration to be portable to different systems with different modules available?
If not, remove all the <IfModule directives and only include the configuration that you really want to use.
This will make sure that you understand what your server is doing and will make sure you get the correct errors about what is missing.You need to choose mod_php or fpm. Don't load both. I personally usually use mod_php.
If you are using FPM, You need to verify that the php-fpm socket is really there and that FPM configuration is correct for your environment.You can also enable mod_info to see what modules are actually loaded and what configuration is being skipped.- Y