Re: rpmbuild is very slow with large files

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Am 12.07.22 um 09:26 schrieb Florian Weimer:
* Marius Schwarz:

I have just create(d/ not finished yet, started 15 minutes ago) a ~2.5
GB rpm and found, that rpmbuild is an extrem bottleneck.

IMHO, this is caused by a fileread function which reads files in 32k
blocks, which is very slow and extrem IO intensive.  The result is a
task running at 1 core at 100% perma. With changes to larger chunks,
we can speed up so many build tasks on the farm.
That's unlikely.  32K is not a small buffer size.

It's more likely that time is spent during compression.

In this case, a pigz , pbiz2 or other parallel compression mode, would be helpful.

strace shouldn't see a system call here because clock_gettime should be
handled in the vDSO.  This suggests something is wrong with the system
(unless it's some obscure variant that really doesn't have vDSO support).

Thanks,
Florian

it's a "normal" ( desktopless ) F 35 on a Xeon E5-2620v4 .

best regards,
Marius Schwarz
_______________________________________________
devel mailing list -- devel@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe send an email to devel-leave@xxxxxxxxxxxxxxxxxxxxxxx
Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: https://lists.fedoraproject.org/archives/list/devel@xxxxxxxxxxxxxxxxxxxxxxx
Do not reply to spam on the list, report it: https://pagure.io/fedora-infrastructure




[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Index of Archives]     [Fedora Announce]     [Fedora Users]     [Fedora Kernel]     [Fedora Testing]     [Fedora Formulas]     [Fedora PHP Devel]     [Kernel Development]     [Fedora Legacy]     [Fedora Maintainers]     [Fedora Desktop]     [PAM]     [Red Hat Development]     [Gimp]     [Yosemite News]

  Powered by Linux