Re: Bodhi slow with 504 gateway timeouts

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 





On Tue, Jan 17, 2023 at 8:21 AM Stephen Smoogen <ssmoogen@xxxxxxxxxx> wrote:


On Tue, 17 Jan 2023 at 09:19, Arthur Bols <arthur@xxxxxxxx> wrote:
On 17/01/2023 14:57, Stephen Smoogen wrote:
> So bodhi and pagure are at different datacenters with hopefully different
> network paths. Could people do some mtr or traceroutes from their locations
> so we can see if this can be ironed out. Currently the limited tools we
> have in Fedora Infra for checking this all show 'green' so the
> 'interconnects' between the services are working.
>
Fedora infra is usually very slow for me, but Bodhi seemed much slower
than usual (taking a full minute to load).

After being really slow, I had a bunch of 503's (not 504) for a while,
but now it seems to work fine:
- /releases takes 10 seconds (and had a 500 error once)
- /updates seems fast with 2.2 seconds


Please note that from other announcements bodhi was updated today to 7.0.1. The slowdowns may have been due to that.

However I notice both you and Richard have large packet drops on twelve99.net ip addresses. I don't know yet if that is an additional problem or not.
 

Without packet loss at the endpoint the stuff in the middle doesn't much matter.  Based on the MTR and trace I'd say this is not network related.
 

$ mtr bodhi.fedoraproject.org -r -G
Start: 2023-01-17T15:14:31+0100
HOST: MarkV                       Loss%   Snt   Last   Avg  Best Wrst StDev
   1.|-- ptr-82pqtg1hqu6kedca1n3.1 90.0%    10    6.0   6.0   6.0 6.0   0.0
   2.|-- ptr-377wgf58htvrzp7oh0ch. 20.0%    10   13.7  15.3  12.7 20.1   2.7
   3.|-- ???                       100.0    10    0.0   0.0   0.0 0.0   0.0
   4.|-- ???                       100.0    10    0.0   0.0   0.0 0.0   0.0
   5.|-- ???                       100.0    10    0.0   0.0   0.0 0.0   0.0
   6.|-- 2001:730:2302::d52e:a209   0.0%    10   16.3  18.0  13.1 24.9   3.5
   7.|-- 2001:730:2302:1::d52e:a20  0.0%    10   17.9  17.4  13.4 20.4   2.7
   8.|-- prs-bb1-v6.ip.twelve99.ne 10.0%    10   61.1  31.3  16.4 62.1  17.8
   9.|-- ash-bb2-v6.ip.twelve99.ne  0.0%    10  105.2 108.7 104.0
118.7   5.0
  10.|-- lax-b22-v6.ip.twelve99.ne 90.0%    10  160.2 160.2 160.2
160.2   0.0
  11.|-- a100-ic325183-las-b24.ip.  0.0%    10  175.7 162.1 158.0
175.7   5.2
  12.|-- ???                       100.0    10    0.0   0.0   0.0 0.0   0.0
  13.|-- 2620:107:4000:8006::126    0.0%    10  182.8 187.3 177.4
199.7   7.1
  14.|-- ???                       100.0    10    0.0   0.0   0.0 0.0   0.0
  15.|-- ???                       100.0    10    0.0   0.0   0.0 0.0   0.0
  16.|-- ???                       100.0    10    0.0   0.0   0.0 0.0   0.0
  17.|-- 2620:107:4000:c5e0::f3fd:  0.0%    10  188.3 188.2 182.0
192.4   2.8
  18.|-- 2620:107:4000:a090::f000:  0.0%    10  185.3 185.5 182.5
187.6   1.6
  19.|-- 2620:107:4000:cfff::f200:  0.0%    10  183.1 185.7 181.9
192.2   3.3
  20.|-- ???                       100.0    10    0.0   0.0   0.0 0.0   0.0
  21.|-- ???                       100.0    10    0.0   0.0   0.0 0.0   0.0
  22.|-- 2620:107:4000:4205:8000:0  0.0%    10  182.8 188.9 182.0 220.5 
11.5
  23.|-- 2600:1f14:fad:5c02:7c8a:7  0.0%    10  188.2 187.1 180.4
210.5   8.5


$ traceroute bodhi.fedoraproject.org
traceroute to bodhi.fedoraproject.org (8.43.85.67), 30 hops max, 60 byte
packets
  1  _gateway (192.168.0.1)  6.347 ms  10.770 ms  11.768 ms
  2  d51A4C401.access.telenet.be (81.164.196.1)  20.244 ms  22.376 ms 
22.311 ms
  3  * * *
  4  * * *
  5  be-dgb01a-rb1-ae-19-0.aorta.net (213.46.162.9)  23.660 ms 23.584
ms  27.996 ms
  6  be-bru02a-ra1-vl-6.aorta.net (213.46.162.14)  29.026 ms 21.811 ms 
18.822 ms
  7  prs-bb1-link.ip.twelve99.net (62.115.116.238)  22.234 ms 19.546 ms 
25.043 ms
  8  ash-bb2-link.ip.twelve99.net (62.115.112.242)  116.324 ms 117.718
ms  114.206 ms
  9  ash-b2-link.ip.twelve99.net (62.115.123.125)  117.633 ms 117.595
ms  117.555 ms
10  viawest-svc073699-ic361683.ip.twelve99-cust.net (213.248.67.199) 
117.473 ms  117.424 ms  117.385 ms
11  be23.bbrt01.iad10.flexential.net (66.51.1.148)  129.400 ms 130.492
ms  130.451 ms
12  be209.bbrt02.ral01.flexential.net (66.51.5.117)  120.744 ms 120.705
ms  120.597 ms
13  * be32.crrt02.ral01.flexential.net (148.66.238.113)  119.944 ms 
122.230 ms
14  128.136.224.140 (128.136.224.140)  112.075 ms  111.922 ms 110.807 ms
15  8.43.84.1 (8.43.84.1)  176.779 ms  203.379 ms  205.480 ms
16  8.43.84.3 (8.43.84.3)  122.495 ms  120.608 ms  122.398 ms
17  8.43.84.4 (8.43.84.4)  215.289 ms  215.232 ms  211.599 ms
18  ip-8-43-86-126.foo.bar (8.43.86.126)  124.226 ms  126.584 ms 142.354 ms
19  proxy14.fedoraproject.org (8.43.85.67)  134.550 ms !X  116.964 ms
!X  121.806 ms !X


--
Arthur Bols
fas/irc: principis
_______________________________________________
devel mailing list -- devel@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe send an email to devel-leave@xxxxxxxxxxxxxxxxxxxxxxx
Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: https://lists.fedoraproject.org/archives/list/devel@xxxxxxxxxxxxxxxxxxxxxxx
Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue


--
Stephen Smoogen, Red Hat Automotive
Let us be kind to one another, for most of us are fighting a hard battle. -- Ian MacClaren
_______________________________________________
devel mailing list -- devel@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe send an email to devel-leave@xxxxxxxxxxxxxxxxxxxxxxx
Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: https://lists.fedoraproject.org/archives/list/devel@xxxxxxxxxxxxxxxxxxxxxxx
Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue


--
Jonathan Wright
AlmaLinux Foundation
Mattermost: chat
_______________________________________________
devel mailing list -- devel@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe send an email to devel-leave@xxxxxxxxxxxxxxxxxxxxxxx
Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: https://lists.fedoraproject.org/archives/list/devel@xxxxxxxxxxxxxxxxxxxxxxx
Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Index of Archives]     [Fedora Announce]     [Fedora Users]     [Fedora Kernel]     [Fedora Testing]     [Fedora Formulas]     [Fedora PHP Devel]     [Kernel Development]     [Fedora Legacy]     [Fedora Maintainers]     [Fedora Desktop]     [PAM]     [Red Hat Development]     [Gimp]     [Yosemite News]

  Powered by Linux