The biggest MM2 problem which currently exists is that the crawler segfaults when running with more than 10 or 12 threads. The current configuration runs daily with 75 threads and crashes regularly: [740512.481002] mm2_crawler[18149]: segfault at 30 ip 00007ffdd8201557 sp 00007ffd787d5250 error 4 in libcurl.so.4.3.0[7ffdd81d8000+63000] [783445.620762] mm2_crawler[20500]: segfault at 30 ip 00007f87477ff557 sp 00007f86e7fd4250 error 4 in libcurl.so.4.3.0[7f87477d6000+63000] [826619.130431] mm2_crawler[24376]: segfault at 30 ip 00007f7cee7ac557 sp 00007f7c8cfde250 error 4 in libcurl.so.4.3.0[7f7cee783000+63000] [869846.873962] mm2_crawler[27771]: segfault at 30 ip 00007ffd3bc07557 sp 00007ffd11ff8250 error 4 in libcurl.so.4.3.0[7ffd3bbde000+63000] By preloading libcurl from F21 on the command-line seems to make the segfault go away. So somewhere between curl 7.29 (RHEL 7.1) and curl 7.37 (F21) something was fixed which would be needed on RHEL7.1 before switching to MM2. Additionally the 4GB of RAM on mm-crawler01 are not enough to crawl all the mirrors in a reasonable time. Even if only started with 20 crawler threads instead of 75 the 4GB are not enough. So a fix (or workaround) is needed for the libcurl problem and much more memory. Then the configuration needs to changed to make the crawler and umdl (and other cronjobs) not run as root. Most of the user changes should happen with a new release and new RPM of mirrormanger2. Adrian
Attachment:
pgpFVgk0t8Dqo.pgp
Description: PGP signature
_______________________________________________ infrastructure mailing list infrastructure@xxxxxxxxxxxxxxxxxxxxxxx https://admin.fedoraproject.org/mailman/listinfo/infrastructure
