Why do you care that gcc remembers the --prefix with which it was configured? I don't see why that matters for your case. Sure, you can set --prefix to anything and use DESTDIR when you install, that should also work.
Yeah, apologies - it is Sunday and I am not in work mode yet! Sorry! MZ