Re: ELN composes on mirrors

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hey folks, 

wanted to update on the current status here. On the ELN side, we've
agreed to reduce the compose frequency to make ELN easier to mirror;
this is being tracked in https://github.com/fedora-eln/eln/issues/39

On the infra side, as part of
https://pagure.io/fedora-infrastructure/issue/9730 we got an rsync
endpoint at rsync://dl.fedoraproject.org/fedora-eln to expose ELN
composes. However, this doesn't work properly due to the use of
symlinks pointing to a different NFS volume that's not part of the
rsync.

There's a few options to move forward:
- keep things as they are, and use something like lftp when mirroring
to fill in the missing files by fetching those over HTTP; this works,
but it will consume extra bandwidth and cause extra load
- switch ODCS to do "full composes"; this would solve the problem, but
it will take up a lot of extra disk space
- setup a batch job to upload each ODCS compose to a S3 bucket as it's
completed, which mirrors can then sync down; this solve the disk space
issue, at the cost of taking up some extra upload bandwidth after each
compose

None of these are ideal tbh, so if folks have better ideas I'm all
ears.

Cheers
Davide
_______________________________________________
devel mailing list -- devel@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe send an email to devel-leave@xxxxxxxxxxxxxxxxxxxxxxx
Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: https://lists.fedoraproject.org/archives/list/devel@xxxxxxxxxxxxxxxxxxxxxxx
Do not reply to spam on the list, report it: https://pagure.io/fedora-infrastructure




[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Index of Archives]     [Fedora Announce]     [Fedora Users]     [Fedora Kernel]     [Fedora Testing]     [Fedora Formulas]     [Fedora PHP Devel]     [Kernel Development]     [Fedora Legacy]     [Fedora Maintainers]     [Fedora Desktop]     [PAM]     [Red Hat Development]     [Gimp]     [Yosemite News]

  Powered by Linux