I looked into it and found out that this is not possible, but I was able
to make it run 5 times faster. So it should start catching up soon :-)
Michal
On 01. 11. 22 10:11, Michal Konecny wrote:
The messages are stored in a queue, but I'm not sure if we can work
with it as LIFO (last in first out) queue. But it's definitely an
interesting idea.
Michal
On 01. 11. 22 9:07, Vít Ondruch wrote:
Dne 31. 10. 22 v 22:02 Kevin Fenzi napsal(a):
On Mon, Oct 31, 2022 at 06:43:08PM +0100, Vít Ondruch wrote:
Dne 19. 10. 22 v 14:45 Michal Konecny napsal(a):
1) I noticed that the queue is still growing, so I added 3 more
workers.
Hopefully this will be enough to catch up.
Not really :( I am receiving 9 days old notifications now.
Yeah, we know. ;(
We have been trying to speed it up over the last week.
We bumped up the cpus/memory the vm has.
We started 24 worker threads instead of 6
Just a bit ago today we moved the workers to talking to redis via unix
sockets instead of tcp connections. We are hoping for about a ~20%
increase due to that.
It's currently right about 9 days delayed.
We will keep working on making it faster so it can catch up.
Thx for update and for all the effort.
I was just thinking if it was not possible to give a priority to the
recent messages and process the old messages later when resources
permits.
Vít
kevin
_______________________________________________
infrastructure mailing list -- infrastructure@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe send an email to
infrastructure-leave@xxxxxxxxxxxxxxxxxxxxxxx
Fedora Code of Conduct:
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives:
https://lists.fedoraproject.org/archives/list/infrastructure@xxxxxxxxxxxxxxxxxxxxxxx
Do not reply to spam, report it:
https://pagure.io/fedora-infrastructure/new_issue
_______________________________________________
infrastructure mailing list -- infrastructure@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe send an email to
infrastructure-leave@xxxxxxxxxxxxxxxxxxxxxxx
Fedora Code of Conduct:
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives:
https://lists.fedoraproject.org/archives/list/infrastructure@xxxxxxxxxxxxxxxxxxxxxxx
Do not reply to spam, report it:
https://pagure.io/fedora-infrastructure/new_issue
_______________________________________________
infrastructure mailing list -- infrastructure@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe send an email to infrastructure-leave@xxxxxxxxxxxxxxxxxxxxxxx
Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: https://lists.fedoraproject.org/archives/list/infrastructure@xxxxxxxxxxxxxxxxxxxxxxx
Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
