Dear Wenjia, Thanks for getting back to me. Some further details on the experiments are: - The tests had been conducted on a one-to-one connection between two Mellanox-powered (mlx5, ConnectX-5) PCs. - Attached you may find the client log of the qperf output. You may notice that for the majority of message size values, the bandwidth is around 3.2GB/s which matches the maximum throughput of the mellanox NICs. According to a periodic regular pattern though, with the first occurring at a message size of 473616 – 522192 (with a step of 12144kB), the 3.2GB/s throughput drops substantially. The corresponding commands for these drops are server: smc_run qperf client: smc_run qperf -v -uu -H worker1 -m 473616 tcp_bw - Our smc version (3E92E1460DA96BE2B2DDC2F, smc-tools-1.2.2) does not provide us with the smcr info, smc_rnics -a and smcr -d stats commands. As an alternative, you may also find attached the output of ibv_devinfo -v. - Buffer size: sudo sysctl -w net.ipv4.tcp_rmem="4096 1048576 6291456" sudo sysctl -w net.ipv4.tcp_wmem="4096 1048576 6291456" - MTU size: 9000 Should you require further information, please let me know. Thank you in advance for your time. Mit freundlichen Grüßen / Best regards Alexandros Nikolaou Bosch Service Solutions Magdeburg GmbH | Otto-von-Guericke-Str. 13 | 39104 Magdeburg | GERMANY | [www.boschservicesolutions.com]www.boschservicesolutions.com Alexandros.Nikolaou@xxxxxxxxxxxx ----------------------------------------------------------------------------------------------------------------------------- From: Wenjia Zhang <wenjia@xxxxxxxxxxxxx> Sent: Monday, December 4, 2023 17:09 To: Nikolaou Alexandros (SO/PAF1-Mb) <Alexandros.Nikolaou@xxxxxxxxxxxx>; linux-s390@xxxxxxxxxxxxxxx <linux-s390@xxxxxxxxxxxxxxx> Subject: Re: SMC-R throughput drops for specific message sizes On 01.12.23 14:33, Nikolaou Alexandros (SO/PAF1-Mb) wrote: > Dear SMC Maintainers and Contributors, > > I would like to bring to your attention some observations made during recent experiments conducted with the SMC-R on the following system: > > - SMC version: 3E92E1460DA96BE2B2DDC2F (version 1) > - Kernel: both v5.4 and v5.15 > - Ubuntu: 20.04 > - Benchmarking tool: ‘qperf’ > - The SMC-R vs TCP/IP throughput has been measured using the ‘qperf’ tool for various message sizes ranging from 0 to 8 MB. > > > Based on the attached plot, you may notice that the SMC-R throughput drops substantially according to a periodic regular pattern. > > A few configurations have been checked, but the pattern described above persists: > > - All the min/default/max values of ‘net.ipv4.tcp_rmem’ and ‘net.ipv4.tcp_wmem’ have been utilized. > - Experiments with the Linux kernel v5.4 and v5.15 have been conducted. > - The MTU size has been changed from 1500 up to 9000. > - Several message sizes have been tried. > > I was wondering whether you could help me understand a reason behind these drops, please? This behavior is not observed with the TCP/IP stack. Any insights or guidance would be highly appreciated. > > Thank you very much in advance. > > Mit freundlichen Grüßen / Best regards > > Alexandros Nikolaou > > Bosch Service Solutions Magdeburg GmbH | Otto-von-Guericke-Str. 13 | 39104 Magdeburg | GERMANY | [https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.boschservicesolutions.com%2F&data=05%7C01%7CAlexandros.Nikolaou%40de.bosch.com%7C2dcaf226fefb4fd63f5708dbf4e36f6f%7C0ae51e1907c84e4bbb6d648ee58410f4%7C0%7C0%7C638373029879445869%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=pyGMb30VLKD53orCruPEZaQtorMUUWI8w55Og%2BQIick%3D&reserved=0]https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.boschservicesolutions.com%2F&data=05%7C01%7CAlexandros.Nikolaou%40de.bosch.com%7C2dcaf226fefb4fd63f5708dbf4e36f6f%7C0ae51e1907c84e4bbb6d648ee58410f4%7C0%7C0%7C638373029879445869%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=pyGMb30VLKD53orCruPEZaQtorMUUWI8w55Og%2BQIick%3D&reserved=0 > Alexandros.Nikolaou@xxxxxxxxxxxx > > Sitz: Magdeburg, Registergericht: Amtsgericht Stendal, HRB 24039 > Geschäftsführung: Robert Mulatz, Daniel Meyer Hi Nikolaou, I'd like to help you. However, I need more details on your environment, setup, and test scenarios. e.g. which buffersize are you using and on which message sizes exactly you got the drops? How many connections you are using? etc. If possible, could you show me the output of the qperf tests with your commands and the output of following commands: smcr info smc_rnics -a smcr -d stats Thanks, Wenjia Zhang
Attachment:
ibv_devinfo
Description: ibv_devinfo
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 12144 tcp_bw
tcp_bw:
bw = 3129739536 bytes/sec
msg_rate = 257719 /sec
msg_size = 12144 bytes
send_cost = 276367425 ns/GB
recv_cost = 239636555 ns/GB
send_cpus_used = 86.5 % cpus
recv_cpus_used = 75 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 24288 tcp_bw
tcp_bw:
bw = 3223928400 bytes/sec
msg_rate = 132738 /sec
msg_size = 24288 bytes
send_cost = 144220935 ns/GB
recv_cost = 124072236 ns/GB
send_cpus_used = 46.5 % cpus
recv_cpus_used = 40 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 36432 tcp_bw
tcp_bw:
bw = 3229824312 bytes/sec
msg_rate = 88654 /sec
msg_size = 36432 bytes
send_cost = 156343789 ns/GB
recv_cost = 111461175 ns/GB
send_cpus_used = 50.5 % cpus
recv_cpus_used = 36 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 48576 tcp_bw
tcp_bw:
bw = 3236910336 bytes/sec
msg_rate = 66636 /sec
msg_size = 48576 bytes
send_cost = 155998924 ns/GB
recv_cost = 118940579 ns/GB
send_cpus_used = 50.5 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 60720 tcp_bw
tcp_bw:
bw = 3228543120 bytes/sec
msg_rate = 53171 /sec
msg_size = 60720 bytes
send_cost = 156399651 ns/GB
recv_cost = 136284380 ns/GB
send_cpus_used = 50.5 % cpus
recv_cpus_used = 44 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 72864 tcp_bw
tcp_bw:
bw = 3242994480 bytes/sec
msg_rate = 44508 /sec
msg_size = 72864 bytes
send_cost = 161880135 ns/GB
recv_cost = 135677073 ns/GB
send_cpus_used = 52.5 % cpus
recv_cpus_used = 44 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 85008 tcp_bw
tcp_bw:
bw = 3233194272 bytes/sec
msg_rate = 38034 /sec
msg_size = 85008 bytes
send_cost = 122154148 ns/GB
recv_cost = 129902490 ns/GB
send_cpus_used = 39.5 % cpus
recv_cpus_used = 42 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 97152 tcp_bw
tcp_bw:
bw = 3246236928 bytes/sec
msg_rate = 33414 /sec
msg_size = 97152 bytes
send_cost = 170944169 ns/GB
recv_cost = 147863511 ns/GB
send_cpus_used = 55.5 % cpus
recv_cpus_used = 48 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 109296 tcp_bw
tcp_bw:
bw = 3232975680 bytes/sec
msg_rate = 29580 /sec
msg_size = 109296 bytes
send_cost = 128349525 ns/GB
recv_cost = 139190651 ns/GB
send_cpus_used = 41.5 % cpus
recv_cpus_used = 45 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 121440 tcp_bw
tcp_bw:
bw = 3245180400 bytes/sec
msg_rate = 26722 /sec
msg_size = 121440 bytes
send_cost = 141732759 ns/GB
recv_cost = 114015235 ns/GB
send_cpus_used = 46 % cpus
recv_cpus_used = 37 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 133584 tcp_bw
tcp_bw:
bw = 3234736560 bytes/sec
msg_rate = 24215 /sec
msg_size = 133584 bytes
send_cost = 162280585 ns/GB
recv_cost = 157663532 ns/GB
send_cpus_used = 52.5 % cpus
recv_cpus_used = 51 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 145728 tcp_bw
tcp_bw:
bw = 3259352448 bytes/sec
msg_rate = 22366 /sec
msg_size = 145728 bytes
send_cost = 165662274 ns/GB
recv_cost = 144200422 ns/GB
send_cpus_used = 54 % cpus
recv_cpus_used = 47 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 157872 tcp_bw
tcp_bw:
bw = 3251452776 bytes/sec
msg_rate = 20596 /sec
msg_size = 157872 bytes
send_cost = 156837729 ns/GB
recv_cost = 138399669 ns/GB
send_cpus_used = 51 % cpus
recv_cpus_used = 45 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 170016 tcp_bw
tcp_bw:
bw = 3258101616 bytes/sec
msg_rate = 19164 /sec
msg_size = 170016 bytes
send_cost = 78256225 ns/GB
recv_cost = 99751336 ns/GB
send_cpus_used = 25.5 % cpus
recv_cpus_used = 32.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 182160 tcp_bw
tcp_bw:
bw = 3228057360 bytes/sec
msg_rate = 17721 /sec
msg_size = 182160 bytes
send_cost = 111506455 ns/GB
recv_cost = 159538672 ns/GB
send_cpus_used = 36 % cpus
recv_cpus_used = 51.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 194304 tcp_bw
tcp_bw:
bw = 3239533440 bytes/sec
msg_rate = 16672 /sec
msg_size = 194304 bytes
send_cost = 148147267 ns/GB
recv_cost = 125018003 ns/GB
send_cpus_used = 48 % cpus
recv_cpus_used = 40.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 206448 tcp_bw
tcp_bw:
bw = 3249285072 bytes/sec
msg_rate = 15739 /sec
msg_size = 206448 bytes
send_cost = 178472451 ns/GB
recv_cost = 103099605 ns/GB
send_cpus_used = 58 % cpus
recv_cpus_used = 33.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 218592 tcp_bw
tcp_bw:
bw = 3256146432 bytes/sec
msg_rate = 14896 /sec
msg_size = 218592 bytes
send_cost = 93662721 ns/GB
recv_cost = 138200169 ns/GB
send_cpus_used = 30.5 % cpus
recv_cpus_used = 45 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 230736 tcp_bw
tcp_bw:
bw = 3248993616 bytes/sec
msg_rate = 14081 /sec
msg_size = 230736 bytes
send_cost = 163121636 ns/GB
recv_cost = 95414162 ns/GB
send_cpus_used = 53 % cpus
recv_cpus_used = 31 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 242880 tcp_bw
tcp_bw:
bw = 3236740320 bytes/sec
msg_rate = 13326 /sec
msg_size = 242880 bytes
send_cost = 139013111 ns/GB
recv_cost = 83417261 ns/GB
send_cpus_used = 45 % cpus
recv_cpus_used = 27 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 255024 tcp_bw
tcp_bw:
bw = 3238804800 bytes/sec
msg_rate = 12700 /sec
msg_size = 255024 bytes
send_cost = 69459131 ns/GB
recv_cost = 75645190 ns/GB
send_cpus_used = 22.5 % cpus
recv_cpus_used = 24.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 267168 tcp_bw
tcp_bw:
bw = 3240614256 bytes/sec
msg_rate = 12130 /sec
msg_size = 267168 bytes
send_cost = 149650651 ns/GB
recv_cost = 132690895 ns/GB
send_cpus_used = 48.5 % cpus
recv_cpus_used = 43 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 279312 tcp_bw
tcp_bw:
bw = 3230522592 bytes/sec
msg_rate = 11566 /sec
msg_size = 279312 bytes
send_cost = 109870339 ns/GB
recv_cost = 164060135 ns/GB
send_cpus_used = 35.5 % cpus
recv_cpus_used = 53 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 291456 tcp_bw
tcp_bw:
bw = 3251774592 bytes/sec
msg_rate = 11157 /sec
msg_size = 291456 bytes
send_cost = 155271982 ns/GB
recv_cost = 139923602 ns/GB
send_cpus_used = 50.5 % cpus
recv_cpus_used = 45.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 303600 tcp_bw
tcp_bw:
bw = 3238349400 bytes/sec
msg_rate = 10666 /sec
msg_size = 303600 bytes
send_cost = 121964289 ns/GB
recv_cost = 120431719 ns/GB
send_cpus_used = 39.5 % cpus
recv_cpus_used = 39 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 315744 tcp_bw
tcp_bw:
bw = 3242690880 bytes/sec
msg_rate = 10270 /sec
msg_size = 315744 bytes
send_cost = 140295077 ns/GB
recv_cost = 151109072 ns/GB
send_cpus_used = 45.5 % cpus
recv_cpus_used = 49 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 327888 tcp_bw
tcp_bw:
bw = 3242320488 bytes/sec
msg_rate = 9888 /sec
msg_size = 327888 bytes
send_cost = 152660719 ns/GB
recv_cost = 132621068 ns/GB
send_cpus_used = 49.5 % cpus
recv_cpus_used = 43 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 340032 tcp_bw
tcp_bw:
bw = 3251385984 bytes/sec
msg_rate = 9562 /sec
msg_size = 340032 bytes
send_cost = 95333986 ns/GB
recv_cost = 95343956 ns/GB
send_cpus_used = 31 % cpus
recv_cpus_used = 31 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 352176 tcp_bw
tcp_bw:
bw = 3236321352 bytes/sec
msg_rate = 9190 /sec
msg_size = 352176 bytes
send_cost = 126673263 ns/GB
recv_cost = 126687047 ns/GB
send_cpus_used = 41 % cpus
recv_cpus_used = 41 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 364320 tcp_bw
tcp_bw:
bw = 3249187920 bytes/sec
msg_rate = 8918 /sec
msg_size = 364320 bytes
send_cost = 155406025 ns/GB
recv_cost = 83097690 ns/GB
send_cpus_used = 50.5 % cpus
recv_cpus_used = 27 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 376464 tcp_bw
tcp_bw:
bw = 3234390456 bytes/sec
msg_rate = 8592 /sec
msg_size = 376464 bytes
send_cost = 115927982 ns/GB
recv_cost = 129854448 ns/GB
send_cpus_used = 37.5 % cpus
recv_cpus_used = 42 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 388608 tcp_bw
tcp_bw:
bw = 3262752768 bytes/sec
msg_rate = 8396 /sec
msg_size = 388608 bytes
send_cost = 85801777 ns/GB
recv_cost = 98076690 ns/GB
send_cpus_used = 28 % cpus
recv_cpus_used = 32 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 400752 tcp_bw
tcp_bw:
bw = 3235270896 bytes/sec
msg_rate = 8073 /sec
msg_size = 400752 bytes
send_cost = 129803031 ns/GB
recv_cost = 139091904 ns/GB
send_cpus_used = 42 % cpus
recv_cpus_used = 45 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 412896 tcp_bw
tcp_bw:
bw = 3241852944 bytes/sec
msg_rate = 7852 /sec
msg_size = 412896 bytes
send_cost = 104858260 ns/GB
recv_cost = 100251305 ns/GB
send_cpus_used = 34 % cpus
recv_cpus_used = 32.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 425040 tcp_bw
tcp_bw:
bw = 3246880560 bytes/sec
msg_rate = 7639 /sec
msg_size = 425040 bytes
send_cost = 132417475 ns/GB
recv_cost = 113955533 ns/GB
send_cpus_used = 43 % cpus
recv_cpus_used = 37 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 437184 tcp_bw
tcp_bw:
bw = 3251993184 bytes/sec
msg_rate = 7438 /sec
msg_size = 437184 bytes
send_cost = 115298395 ns/GB
recv_cost = 126076524 ns/GB
send_cpus_used = 37.5 % cpus
recv_cpus_used = 41 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 449328 tcp_bw
tcp_bw:
bw = 3229769664 bytes/sec
msg_rate = 7188 /sec
msg_size = 449328 bytes
send_cost = 117639081 ns/GB
recv_cost = 126944036 ns/GB
send_cpus_used = 38 % cpus
recv_cpus_used = 41 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 461472 tcp_bw
tcp_bw:
bw = 3231688416 bytes/sec
msg_rate = 7003 /sec
msg_size = 461472 bytes
send_cost = 108294786 ns/GB
recv_cost = 112944060 ns/GB
send_cpus_used = 35 % cpus
recv_cpus_used = 36.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 473616 tcp_bw
tcp_bw:
bw = 2613649896 bytes/sec
msg_rate = 5518 /sec
msg_size = 473616 bytes
send_cost = 55472946 ns/GB
recv_cost = 66956174 ns/GB
send_cpus_used = 14.5 % cpus
recv_cpus_used = 17.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 485760 tcp_bw
tcp_bw:
bw = 2616789120 bytes/sec
msg_rate = 5387 /sec
msg_size = 485760 bytes
send_cost = 49674591 ns/GB
recv_cost = 59232897 ns/GB
send_cpus_used = 13 % cpus
recv_cpus_used = 15.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 497904 tcp_bw
tcp_bw:
bw = 2592337176 bytes/sec
msg_rate = 5206 /sec
msg_size = 497904 bytes
send_cost = 55928709 ns/GB
recv_cost = 59791605 ns/GB
send_cpus_used = 14.5 % cpus
recv_cpus_used = 15.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 510048 tcp_bw
tcp_bw:
bw = 2592573984 bytes/sec
msg_rate = 5083 /sec
msg_size = 510048 bytes
send_cost = 61702588 ns/GB
recv_cost = 59786144 ns/GB
send_cpus_used = 16 % cpus
recv_cpus_used = 15.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 522192 tcp_bw
tcp_bw:
bw = 2564484912 bytes/sec
msg_rate = 4911 /sec
msg_size = 522192 bytes
send_cost = 77972495 ns/GB
recv_cost = 66290116 ns/GB
send_cpus_used = 20 % cpus
recv_cpus_used = 17 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 534336 tcp_bw
tcp_bw:
bw = 3233801472 bytes/sec
msg_rate = 6052 /sec
msg_size = 534336 bytes
send_cost = 126764820 ns/GB
recv_cost = 129878099 ns/GB
send_cpus_used = 41 % cpus
recv_cpus_used = 42 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 546480 tcp_bw
tcp_bw:
bw = 3217674240 bytes/sec
msg_rate = 5888 /sec
msg_size = 546480 bytes
send_cost = 128953241 ns/GB
recv_cost = 128975142 ns/GB
send_cpus_used = 41.5 % cpus
recv_cpus_used = 41.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 558624 tcp_bw
tcp_bw:
bw = 3232757088 bytes/sec
msg_rate = 5787 /sec
msg_size = 558624 bytes
send_cost = 117536566 ns/GB
recv_cost = 116000055 ns/GB
send_cpus_used = 38 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 570768 tcp_bw
tcp_bw:
bw = 3235398408 bytes/sec
msg_rate = 5668 /sec
msg_size = 570768 bytes
send_cost = 100433586 ns/GB
recv_cost = 106632926 ns/GB
send_cpus_used = 32.5 % cpus
recv_cpus_used = 34.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 582912 tcp_bw
tcp_bw:
bw = 3200186880 bytes/sec
msg_rate = 5490 /sec
msg_size = 582912 bytes
send_cost = 128105850 ns/GB
recv_cost = 131242331 ns/GB
send_cpus_used = 41 % cpus
recv_cpus_used = 42 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 595056 tcp_bw
tcp_bw:
bw = 3227583744 bytes/sec
msg_rate = 5424 /sec
msg_size = 595056 bytes
send_cost = 122371295 ns/GB
recv_cost = 119284276 ns/GB
send_cpus_used = 39.5 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 607200 tcp_bw
tcp_bw:
bw = 3227268000 bytes/sec
msg_rate = 5315 /sec
msg_size = 607200 bytes
send_cost = 122371525 ns/GB
recv_cost = 206056647 ns/GB
send_cpus_used = 39.5 % cpus
recv_cpus_used = 66.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 619344 tcp_bw
tcp_bw:
bw = 3174757344 bytes/sec
msg_rate = 5126 /sec
msg_size = 619344 bytes
send_cost = 96060967 ns/GB
recv_cost = 141743113 ns/GB
send_cpus_used = 30.5 % cpus
recv_cpus_used = 45 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 631488 tcp_bw
tcp_bw:
bw = 3252478944 bytes/sec
msg_rate = 5150 /sec
msg_size = 631488 bytes
send_cost = 98376942 ns/GB
recv_cost = 152191609 ns/GB
send_cpus_used = 32 % cpus
recv_cpus_used = 49.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 643632 tcp_bw
tcp_bw:
bw = 3237468960 bytes/sec
msg_rate = 5030 /sec
msg_size = 643632 bytes
send_cost = 100367105 ns/GB
recv_cost = 114286811 ns/GB
send_cpus_used = 32.5 % cpus
recv_cpus_used = 37 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 655776 tcp_bw
tcp_bw:
bw = 3210679296 bytes/sec
msg_rate = 4896 /sec
msg_size = 655776 bytes
send_cost = 143257234 ns/GB
recv_cost = 123026928 ns/GB
send_cpus_used = 46 % cpus
recv_cpus_used = 39.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 667920 tcp_bw
tcp_bw:
bw = 3243085560 bytes/sec
msg_rate = 4856 /sec
msg_size = 667920 bytes
send_cost = 94036558 ns/GB
recv_cost = 157257643 ns/GB
send_cpus_used = 30.5 % cpus
recv_cpus_used = 51 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 680064 tcp_bw
tcp_bw:
bw = 3250025856 bytes/sec
msg_rate = 4779 /sec
msg_size = 680064 bytes
send_cost = 110745181 ns/GB
recv_cost = 118460593 ns/GB
send_cpus_used = 36 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 692208 tcp_bw
tcp_bw:
bw = 3239187336 bytes/sec
msg_rate = 4680 /sec
msg_size = 692208 bytes
send_cost = 83345338 ns/GB
recv_cost = 80267043 ns/GB
send_cpus_used = 27 % cpus
recv_cpus_used = 26 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 704352 tcp_bw
tcp_bw:
bw = 3238258320 bytes/sec
msg_rate = 4598 /sec
msg_size = 704352 bytes
send_cost = 118878140 ns/GB
recv_cost = 128155308 ns/GB
send_cpus_used = 38.5 % cpus
recv_cpus_used = 41.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 716496 tcp_bw
tcp_bw:
bw = 3234262944 bytes/sec
msg_rate = 4514 /sec
msg_size = 716496 bytes
send_cost = 98929666 ns/GB
recv_cost = 120583883 ns/GB
send_cpus_used = 32 % cpus
recv_cpus_used = 39 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 728640 tcp_bw
tcp_bw:
bw = 3233929075 bytes/sec
msg_rate = 4460 /sec
msg_size = 728640 bytes
send_cost = 103062242 ns/GB
recv_cost = 112304284 ns/GB
send_cpus_used = 33.5 % cpus
recv_cpus_used = 36.3 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 740784 tcp_bw
tcp_bw:
bw = 3225003144 bytes/sec
msg_rate = 4354 /sec
msg_size = 740784 bytes
send_cost = 111614984 ns/GB
recv_cost = 117829341 ns/GB
send_cpus_used = 36 % cpus
recv_cpus_used = 38 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 752928 tcp_bw
tcp_bw:
bw = 3227425872 bytes/sec
msg_rate = 4286 /sec
msg_size = 752928 bytes
send_cost = 108420263 ns/GB
recv_cost = 199849665 ns/GB
send_cpus_used = 35 % cpus
recv_cpus_used = 64.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 765072 tcp_bw
tcp_bw:
bw = 3241227528 bytes/sec
msg_rate = 4236 /sec
msg_size = 765072 bytes
send_cost = 90993418 ns/GB
recv_cost = 92557529 ns/GB
send_cpus_used = 29.5 % cpus
recv_cpus_used = 30 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 777216 tcp_bw
tcp_bw:
bw = 3231275520 bytes/sec
msg_rate = 4158 /sec
msg_size = 777216 bytes
send_cost = 61887620 ns/GB
recv_cost = 72726698 ns/GB
send_cpus_used = 20 % cpus
recv_cpus_used = 23.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 789360 tcp_bw
tcp_bw:
bw = 3229271760 bytes/sec
msg_rate = 4091 /sec
msg_size = 789360 bytes
send_cost = 69666635 ns/GB
recv_cost = 65030140 ns/GB
send_cpus_used = 22.5 % cpus
recv_cpus_used = 21 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 801504 tcp_bw
tcp_bw:
bw = 3218038560 bytes/sec
msg_rate = 4015 /sec
msg_size = 801504 bytes
send_cost = 121176741 ns/GB
recv_cost = 146051699 ns/GB
send_cpus_used = 39 % cpus
recv_cpus_used = 47 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 813648 tcp_bw
tcp_bw:
bw = 3230589384 bytes/sec
msg_rate = 3970 /sec
msg_size = 813648 bytes
send_cost = 140823444 ns/GB
recv_cost = 128459529 ns/GB
send_cpus_used = 45.5 % cpus
recv_cpus_used = 41.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 825792 tcp_bw
tcp_bw:
bw = 3253207584 bytes/sec
msg_rate = 3940 /sec
msg_size = 825792 bytes
send_cost = 107572471 ns/GB
recv_cost = 115270849 ns/GB
send_cpus_used = 35 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 837936 tcp_bw
tcp_bw:
bw = 3234013992 bytes/sec
msg_rate = 3860 /sec
msg_size = 837936 bytes
send_cost = 92751965 ns/GB
recv_cost = 236548137 ns/GB
send_cpus_used = 30 % cpus
recv_cpus_used = 76.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 850080 tcp_bw
tcp_bw:
bw = 3231154080 bytes/sec
msg_rate = 3801 /sec
msg_size = 850080 bytes
send_cost = 129950324 ns/GB
recv_cost = 153196038 ns/GB
send_cpus_used = 42 % cpus
recv_cpus_used = 49.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 862224 tcp_bw
tcp_bw:
bw = 3232908888 bytes/sec
msg_rate = 3750 /sec
msg_size = 862224 bytes
send_cost = 78865815 ns/GB
recv_cost = 145379909 ns/GB
send_cpus_used = 25.5 % cpus
recv_cpus_used = 47 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 874368 tcp_bw
tcp_bw:
bw = 3248277120 bytes/sec
msg_rate = 3715 /sec
msg_size = 874368 bytes
send_cost = 115430279 ns/GB
recv_cost = 133917146 ns/GB
send_cpus_used = 37.5 % cpus
recv_cpus_used = 43.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 886512 tcp_bw
tcp_bw:
bw = 3247293456 bytes/sec
msg_rate = 3663 /sec
msg_size = 886512 bytes
send_cost = 98543602 ns/GB
recv_cost = 115480786 ns/GB
send_cpus_used = 32 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 898656 tcp_bw
tcp_bw:
bw = 3238756224 bytes/sec
msg_rate = 3604 /sec
msg_size = 898656 bytes
send_cost = 129661419 ns/GB
recv_cost = 123504203 ns/GB
send_cpus_used = 42 % cpus
recv_cpus_used = 40 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 910800 tcp_bw
tcp_bw:
bw = 3231973800 bytes/sec
msg_rate = 3548 /sec
msg_size = 910800 bytes
send_cost = 85075338 ns/GB
recv_cost = 163986469 ns/GB
send_cpus_used = 27.5 % cpus
recv_cpus_used = 53 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 922944 tcp_bw
tcp_bw:
bw = 3246455520 bytes/sec
msg_rate = 3518 /sec
msg_size = 922944 bytes
send_cost = 93935265 ns/GB
recv_cost = 172495819 ns/GB
send_cpus_used = 30.5 % cpus
recv_cpus_used = 56 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 935088 tcp_bw
tcp_bw:
bw = 3232131672 bytes/sec
msg_rate = 3439 /sec
msg_size = 935088 bytes
send_cost = 103646770 ns/GB
recv_cost = 119116431 ns/GB
send_cpus_used = 33.3 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 947232 tcp_bw
tcp_bw:
bw = 3234797280 bytes/sec
msg_rate = 3415 /sec
msg_size = 947232 bytes
send_cost = 112818995 ns/GB
recv_cost = 125201045 ns/GB
send_cpus_used = 36.5 % cpus
recv_cpus_used = 40.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 959376 tcp_bw
tcp_bw:
bw = 3147232968 bytes/sec
msg_rate = 3280 /sec
msg_size = 959376 bytes
send_cost = 109603397 ns/GB
recv_cost = 108031406 ns/GB
send_cpus_used = 34.5 % cpus
recv_cpus_used = 34 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 971520 tcp_bw
tcp_bw:
bw = 3225932160 bytes/sec
msg_rate = 3320 /sec
msg_size = 971520 bytes
send_cost = 114695532 ns/GB
recv_cost = 120895284 ns/GB
send_cpus_used = 37 % cpus
recv_cpus_used = 39 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 983664 tcp_bw
tcp_bw:
bw = 3232811736 bytes/sec
msg_rate = 3286 /sec
msg_size = 983664 bytes
send_cost = 114434045 ns/GB
recv_cost = 120638013 ns/GB
send_cpus_used = 37 % cpus
recv_cpus_used = 39 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 995808 tcp_bw
tcp_bw:
bw = 3240359232 bytes/sec
msg_rate = 3254 /sec
msg_size = 995808 bytes
send_cost = 114184872 ns/GB
recv_cost = 246886211 ns/GB
send_cpus_used = 37 % cpus
recv_cpus_used = 80 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1007952 tcp_bw
tcp_bw:
bw = 2285531160 bytes/sec
msg_rate = 2268 /sec
msg_size = 1007952 bytes
send_cost = 59054213 ns/GB
recv_cost = 111571437 ns/GB
send_cpus_used = 13.5 % cpus
recv_cpus_used = 25.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1020096 tcp_bw
tcp_bw:
bw = 2367642816 bytes/sec
msg_rate = 2321 /sec
msg_size = 1020096 bytes
send_cost = 50672403 ns/GB
recv_cost = 183727038 ns/GB
send_cpus_used = 12 % cpus
recv_cpus_used = 43.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1032240 tcp_bw
tcp_bw:
bw = 2576987160 bytes/sec
msg_rate = 2496 /sec
msg_size = 1032240 bytes
send_cost = 60135714 ns/GB
recv_cost = 79550260 ns/GB
send_cpus_used = 15.5 % cpus
recv_cpus_used = 20.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1044384 tcp_bw
tcp_bw:
bw = 2399472240 bytes/sec
msg_rate = 2298 /sec
msg_size = 1044384 bytes
send_cost = 41666764 ns/GB
recv_cost = 77100289 ns/GB
send_cpus_used = 10 % cpus
recv_cpus_used = 18.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1056528 tcp_bw
tcp_bw:
bw = 3203392896 bytes/sec
msg_rate = 3032 /sec
msg_size = 1056528 bytes
send_cost = 129528778 ns/GB
recv_cost = 117063380 ns/GB
send_cpus_used = 41.5 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1068672 tcp_bw
tcp_bw:
bw = 2926023936 bytes/sec
msg_rate = 2738 /sec
msg_size = 1068672 bytes
send_cost = 111051945 ns/GB
recv_cost = 148665907 ns/GB
send_cpus_used = 32.5 % cpus
recv_cpus_used = 43.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1080816 tcp_bw
tcp_bw:
bw = 3134906808 bytes/sec
msg_rate = 2900 /sec
msg_size = 1080816 bytes
send_cost = 121194831 ns/GB
recv_cost = 129190444 ns/GB
send_cpus_used = 38 % cpus
recv_cpus_used = 40.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1092960 tcp_bw
tcp_bw:
bw = 3226964400 bytes/sec
msg_rate = 2952 /sec
msg_size = 1092960 bytes
send_cost = 108442700 ns/GB
recv_cost = 114658843 ns/GB
send_cpus_used = 35 % cpus
recv_cpus_used = 37 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1105104 tcp_bw
tcp_bw:
bw = 3196513320 bytes/sec
msg_rate = 2892 /sec
msg_size = 1105104 bytes
send_cost = 151701602 ns/GB
recv_cost = 128264755 ns/GB
send_cpus_used = 48.5 % cpus
recv_cpus_used = 41 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1117248 tcp_bw
tcp_bw:
bw = 3233874336 bytes/sec
msg_rate = 2894 /sec
msg_size = 1117248 bytes
send_cost = 111302358 ns/GB
recv_cost = 119052242 ns/GB
send_cpus_used = 36 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1129392 tcp_bw
tcp_bw:
bw = 3215943720 bytes/sec
msg_rate = 2848 /sec
msg_size = 1129392 bytes
send_cost = 99486758 ns/GB
recv_cost = 107277996 ns/GB
send_cpus_used = 32 % cpus
recv_cpus_used = 34.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1141536 tcp_bw
tcp_bw:
bw = 3042764208 bytes/sec
msg_rate = 2666 /sec
msg_size = 1141536 bytes
send_cost = 124863020 ns/GB
recv_cost = 96951314 ns/GB
send_cpus_used = 38 % cpus
recv_cpus_used = 29.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1153680 tcp_bw
tcp_bw:
bw = 3224535600 bytes/sec
msg_rate = 2795 /sec
msg_size = 1153680 bytes
send_cost = 117846426 ns/GB
recv_cost = 116295816 ns/GB
send_cpus_used = 38 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1165824 tcp_bw
tcp_bw:
bw = 3232247040 bytes/sec
msg_rate = 2772 /sec
msg_size = 1165824 bytes
send_cost = 115997440 ns/GB
recv_cost = 310929203 ns/GB
send_cpus_used = 37.5 % cpus
recv_cpus_used = 101 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1177968 tcp_bw
tcp_bw:
bw = 3242356920 bytes/sec
msg_rate = 2752 /sec
msg_size = 1177968 bytes
send_cost = 87899020 ns/GB
recv_cost = 94067376 ns/GB
send_cpus_used = 28.5 % cpus
recv_cpus_used = 30.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1190112 tcp_bw
tcp_bw:
bw = 3234129360 bytes/sec
msg_rate = 2718 /sec
msg_size = 1190112 bytes
send_cost = 109766787 ns/GB
recv_cost = 119042854 ns/GB
send_cpus_used = 35.5 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1202256 tcp_bw
tcp_bw:
bw = 3220242696 bytes/sec
msg_rate = 2678 /sec
msg_size = 1202256 bytes
send_cost = 147476879 ns/GB
recv_cost = 135082987 ns/GB
send_cpus_used = 47.5 % cpus
recv_cpus_used = 43.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1214400 tcp_bw
tcp_bw:
bw = 3255806400 bytes/sec
msg_rate = 2681 /sec
msg_size = 1214400 bytes
send_cost = 69094415 ns/GB
recv_cost = 116714555 ns/GB
send_cpus_used = 22.5 % cpus
recv_cpus_used = 38 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1226544 tcp_bw
tcp_bw:
bw = 3224584176 bytes/sec
msg_rate = 2629 /sec
msg_size = 1226544 bytes
send_cost = 136451702 ns/GB
recv_cost = 130249348 ns/GB
send_cpus_used = 44 % cpus
recv_cpus_used = 42 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1238688 tcp_bw
tcp_bw:
bw = 3237311088 bytes/sec
msg_rate = 2614 /sec
msg_size = 1238688 bytes
send_cost = 88019185 ns/GB
recv_cost = 132826286 ns/GB
send_cpus_used = 28.5 % cpus
recv_cpus_used = 43 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1250832 tcp_bw
tcp_bw:
bw = 3103939608 bytes/sec
msg_rate = 2482 /sec
msg_size = 1250832 bytes
send_cost = 112759924 ns/GB
recv_cost = 124035915 ns/GB
send_cpus_used = 35 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1262976 tcp_bw
tcp_bw:
bw = 3228798144 bytes/sec
msg_rate = 2556 /sec
msg_size = 1262976 bytes
send_cost = 102185231 ns/GB
recv_cost = 106850903 ns/GB
send_cpus_used = 33 % cpus
recv_cpus_used = 34.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1275120 tcp_bw
tcp_bw:
bw = 3233704320 bytes/sec
msg_rate = 2536 /sec
msg_size = 1275120 bytes
send_cost = 119058501 ns/GB
recv_cost = 103596364 ns/GB
send_cpus_used = 38.5 % cpus
recv_cpus_used = 33.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1287264 tcp_bw
tcp_bw:
bw = 3251628864 bytes/sec
msg_rate = 2526 /sec
msg_size = 1287264 bytes
send_cost = 73794553 ns/GB
recv_cost = 87648378 ns/GB
send_cpus_used = 24 % cpus
recv_cpus_used = 28.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1299408 tcp_bw
tcp_bw:
bw = 3245921184 bytes/sec
msg_rate = 2498 /sec
msg_size = 1299408 bytes
send_cost = 53913816 ns/GB
recv_cost = 67777369 ns/GB
send_cpus_used = 17.5 % cpus
recv_cpus_used = 22 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1311552 tcp_bw
tcp_bw:
bw = 3188382912 bytes/sec
msg_rate = 2431 /sec
msg_size = 1311552 bytes
send_cost = 97207978 ns/GB
recv_cost = 125455448 ns/GB
send_cpus_used = 31 % cpus
recv_cpus_used = 40 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1323696 tcp_bw
tcp_bw:
bw = 3237098568 bytes/sec
msg_rate = 2446 /sec
msg_size = 1323696 bytes
send_cost = 101943146 ns/GB
recv_cost = 109666104 ns/GB
send_cpus_used = 33 % cpus
recv_cpus_used = 35.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1335840 tcp_bw
tcp_bw:
bw = 3229393200 bytes/sec
msg_rate = 2418 /sec
msg_size = 1335840 bytes
send_cost = 92896713 ns/GB
recv_cost = 128507111 ns/GB
send_cpus_used = 30 % cpus
recv_cpus_used = 41.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1347984 tcp_bw
tcp_bw:
bw = 3229769664 bytes/sec
msg_rate = 2396 /sec
msg_size = 1347984 bytes
send_cost = 113011158 ns/GB
recv_cost = 109914956 ns/GB
send_cpus_used = 36.5 % cpus
recv_cpus_used = 35.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1360128 tcp_bw
tcp_bw:
bw = 3223503360 bytes/sec
msg_rate = 2370 /sec
msg_size = 1360128 bytes
send_cost = 94617555 ns/GB
recv_cost = 116333057 ns/GB
send_cpus_used = 30.5 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1372272 tcp_bw
tcp_bw:
bw = 3237875784 bytes/sec
msg_rate = 2360 /sec
msg_size = 1372272 bytes
send_cost = 95741784 ns/GB
recv_cost = 118905114 ns/GB
send_cpus_used = 31 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1384416 tcp_bw
tcp_bw:
bw = 3207574782 bytes/sec
msg_rate = 2328 /sec
msg_size = 1384416 bytes
send_cost = 74450630 ns/GB
recv_cost = 144248101 ns/GB
send_cpus_used = 24 % cpus
recv_cpus_used = 46.3 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1396560 tcp_bw
tcp_bw:
bw = 3242114040 bytes/sec
msg_rate = 2322 /sec
msg_size = 1396560 bytes
send_cost = 70926092 ns/GB
recv_cost = 80194585 ns/GB
send_cpus_used = 23 % cpus
recv_cpus_used = 26 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1408704 tcp_bw
tcp_bw:
bw = 3235088736 bytes/sec
msg_rate = 2296 /sec
msg_size = 1408704 bytes
send_cost = 115916449 ns/GB
recv_cost = 115916449 ns/GB
send_cpus_used = 37.5 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1420848 tcp_bw
tcp_bw:
bw = 3227456232 bytes/sec
msg_rate = 2272 /sec
msg_size = 1420848 bytes
send_cost = 122387410 ns/GB
recv_cost = 117739783 ns/GB
send_cpus_used = 39.5 % cpus
recv_cpus_used = 38 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1432992 tcp_bw
tcp_bw:
bw = 3245010384 bytes/sec
msg_rate = 2264 /sec
msg_size = 1432992 bytes
send_cost = 86267271 ns/GB
recv_cost = 120184511 ns/GB
send_cpus_used = 28 % cpus
recv_cpus_used = 39 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1445136 tcp_bw
tcp_bw:
bw = 3235659504 bytes/sec
msg_rate = 2239 /sec
msg_size = 1445136 bytes
send_cost = 115896002 ns/GB
recv_cost = 125167682 ns/GB
send_cpus_used = 37.5 % cpus
recv_cpus_used = 40.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1457280 tcp_bw
tcp_bw:
bw = 3264307200 bytes/sec
msg_rate = 2240 /sec
msg_size = 1457280 bytes
send_cost = 143981546 ns/GB
recv_cost = 117942328 ns/GB
send_cpus_used = 47 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1469424 tcp_bw
tcp_bw:
bw = 3220977408 bytes/sec
msg_rate = 2192 /sec
msg_size = 1469424 bytes
send_cost = 113293800 ns/GB
recv_cost = 113319643 ns/GB
send_cpus_used = 36.5 % cpus
recv_cpus_used = 36.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1481568 tcp_bw
tcp_bw:
bw = 3232781376 bytes/sec
msg_rate = 2182 /sec
msg_size = 1481568 bytes
send_cost = 103602200 ns/GB
recv_cost = 112905875 ns/GB
send_cpus_used = 33.5 % cpus
recv_cpus_used = 36.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1493712 tcp_bw
tcp_bw:
bw = 3236127048 bytes/sec
msg_rate = 2166 /sec
msg_size = 1493712 bytes
send_cost = 88068235 ns/GB
recv_cost = 108153972 ns/GB
send_cpus_used = 28.5 % cpus
recv_cpus_used = 35 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1505856 tcp_bw
tcp_bw:
bw = 3241355040 bytes/sec
msg_rate = 2152 /sec
msg_size = 1505856 bytes
send_cost = 117234919 ns/GB
recv_cost = 148086212 ns/GB
send_cpus_used = 38 % cpus
recv_cpus_used = 48 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1518000 tcp_bw
tcp_bw:
bw = 3233340000 bytes/sec
msg_rate = 2130 /sec
msg_size = 1518000 bytes
send_cost = 95853591 ns/GB
recv_cost = 123711087 ns/GB
send_cpus_used = 31 % cpus
recv_cpus_used = 40 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1530144 tcp_bw
tcp_bw:
bw = 2364837552 bytes/sec
msg_rate = 1546 /sec
msg_size = 1530144 bytes
send_cost = 57086376 ns/GB
recv_cost = 112058431 ns/GB
send_cpus_used = 13.5 % cpus
recv_cpus_used = 26.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1542288 tcp_bw
tcp_bw:
bw = 2542461768 bytes/sec
msg_rate = 1648 /sec
msg_size = 1542288 bytes
send_cost = 57031338 ns/GB
recv_cost = 66864330 ns/GB
send_cpus_used = 14.5 % cpus
recv_cpus_used = 17 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1554432 tcp_bw
tcp_bw:
bw = 3090988032 bytes/sec
msg_rate = 1988 /sec
msg_size = 1554432 bytes
send_cost = 92203526 ns/GB
recv_cost = 59851413 ns/GB
send_cpus_used = 28.5 % cpus
recv_cpus_used = 18.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1566576 tcp_bw
tcp_bw:
bw = 2445425136 bytes/sec
msg_rate = 1561 /sec
msg_size = 1566576 bytes
send_cost = 44981953 ns/GB
recv_cost = 118588783 ns/GB
send_cpus_used = 11 % cpus
recv_cpus_used = 29 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1578720 tcp_bw
tcp_bw:
bw = 3201644160 bytes/sec
msg_rate = 2028 /sec
msg_size = 1578720 bytes
send_cost = 129588948 ns/GB
recv_cost = 134305996 ns/GB
send_cpus_used = 41.5 % cpus
recv_cpus_used = 43 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1590864 tcp_bw
tcp_bw:
bw = 2966961360 bytes/sec
msg_rate = 1865 /sec
msg_size = 1590864 bytes
send_cost = 121303745 ns/GB
recv_cost = 149985099 ns/GB
send_cpus_used = 36 % cpus
recv_cpus_used = 44.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1603008 tcp_bw
tcp_bw:
bw = 3234068640 bytes/sec
msg_rate = 2018 /sec
msg_size = 1603008 bytes
send_cost = 117499051 ns/GB
recv_cost = 119045089 ns/GB
send_cpus_used = 38 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1615152 tcp_bw
tcp_bw:
bw = 3223843392 bytes/sec
msg_rate = 1996 /sec
msg_size = 1615152 bytes
send_cost = 111639994 ns/GB
recv_cost = 110117008 ns/GB
send_cpus_used = 36 % cpus
recv_cpus_used = 35.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1627296 tcp_bw
tcp_bw:
bw = 2819290320 bytes/sec
msg_rate = 1732 /sec
msg_size = 1627296 bytes
send_cost = 133012197 ns/GB
recv_cost = 177349596 ns/GB
send_cpus_used = 37.5 % cpus
recv_cpus_used = 50 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1639440 tcp_bw
tcp_bw:
bw = 3217401000 bytes/sec
msg_rate = 1962 /sec
msg_size = 1639440 bytes
send_cost = 118107751 ns/GB
recv_cost = 127432047 ns/GB
send_cpus_used = 38 % cpus
recv_cpus_used = 41 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1651584 tcp_bw
tcp_bw:
bw = 3249491520 bytes/sec
msg_rate = 1968 /sec
msg_size = 1651584 bytes
send_cost = 107681792 ns/GB
recv_cost = 115402671 ns/GB
send_cpus_used = 35 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1663728 tcp_bw
tcp_bw:
bw = 3235950960 bytes/sec
msg_rate = 1945 /sec
msg_size = 1663728 bytes
send_cost = 100408339 ns/GB
recv_cost = 103524439 ns/GB
send_cpus_used = 32.5 % cpus
recv_cpus_used = 33.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1675872 tcp_bw
tcp_bw:
bw = 3239460576 bytes/sec
msg_rate = 1933 /sec
msg_size = 1675872 bytes
send_cost = 92608014 ns/GB
recv_cost = 100325341 ns/GB
send_cpus_used = 30 % cpus
recv_cpus_used = 32.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1688016 tcp_bw
tcp_bw:
bw = 3156589920 bytes/sec
msg_rate = 1870 /sec
msg_size = 1688016 bytes
send_cost = 93455277 ns/GB
recv_cost = 264525960 ns/GB
send_cpus_used = 29.5 % cpus
recv_cpus_used = 83.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1700160 tcp_bw
tcp_bw:
bw = 3254956320 bytes/sec
msg_rate = 1914 /sec
msg_size = 1700160 bytes
send_cost = 82928767 ns/GB
recv_cost = 188942631 ns/GB
send_cpus_used = 27 % cpus
recv_cpus_used = 61.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1712304 tcp_bw
tcp_bw:
bw = 3217419216 bytes/sec
msg_rate = 1879 /sec
msg_size = 1712304 bytes
send_cost = 111861160 ns/GB
recv_cost = 113444965 ns/GB
send_cpus_used = 36 % cpus
recv_cpus_used = 36.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1724448 tcp_bw
tcp_bw:
bw = 3244548912 bytes/sec
msg_rate = 1882 /sec
msg_size = 1724448 bytes
send_cost = 130954136 ns/GB
recv_cost = 104791147 ns/GB
send_cpus_used = 42.5 % cpus
recv_cpus_used = 34 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1736592 tcp_bw
tcp_bw:
bw = 2745551952 bytes/sec
msg_rate = 1581 /sec
msg_size = 1736592 bytes
send_cost = 131079726 ns/GB
recv_cost = 91056372 ns/GB
send_cpus_used = 36 % cpus
recv_cpus_used = 25 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1748736 tcp_bw
tcp_bw:
bw = 3223794816 bytes/sec
msg_rate = 1844 /sec
msg_size = 1748736 bytes
send_cost = 119424471 ns/GB
recv_cost = 124077377 ns/GB
send_cpus_used = 38.5 % cpus
recv_cpus_used = 40 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1760880 tcp_bw
tcp_bw:
bw = 3230334360 bytes/sec
msg_rate = 1834 /sec
msg_size = 1760880 bytes
send_cost = 105252264 ns/GB
recv_cost = 116087054 ns/GB
send_cpus_used = 34 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1773024 tcp_bw
tcp_bw:
bw = 3221584608 bytes/sec
msg_rate = 1817 /sec
msg_size = 1773024 bytes
send_cost = 100882028 ns/GB
recv_cost = 116402344 ns/GB
send_cpus_used = 32.5 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1785168 tcp_bw
tcp_bw:
bw = 3228476328 bytes/sec
msg_rate = 1808 /sec
msg_size = 1785168 bytes
send_cost = 106832018 ns/GB
recv_cost = 114605147 ns/GB
send_cpus_used = 34.5 % cpus
recv_cpus_used = 37 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1797312 tcp_bw
tcp_bw:
bw = 3254932032 bytes/sec
msg_rate = 1811 /sec
msg_size = 1797312 bytes
send_cost = 142860127 ns/GB
recv_cost = 121354304 ns/GB
send_cpus_used = 46.5 % cpus
recv_cpus_used = 39.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1809456 tcp_bw
tcp_bw:
bw = 3217212768 bytes/sec
msg_rate = 1778 /sec
msg_size = 1809456 bytes
send_cost = 79261154 ns/GB
recv_cost = 136764345 ns/GB
send_cpus_used = 25.5 % cpus
recv_cpus_used = 44 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1821600 tcp_bw
tcp_bw:
bw = 3228786000 bytes/sec
msg_rate = 1772 /sec
msg_size = 1821600 bytes
send_cost = 61942787 ns/GB
recv_cost = 218348315 ns/GB
send_cpus_used = 20 % cpus
recv_cpus_used = 70.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1833744 tcp_bw
tcp_bw:
bw = 3231056928 bytes/sec
msg_rate = 1762 /sec
msg_size = 1833744 bytes
send_cost = 63428731 ns/GB
recv_cost = 72731618 ns/GB
send_cpus_used = 20.5 % cpus
recv_cpus_used = 23.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1845888 tcp_bw
tcp_bw:
bw = 3244148160 bytes/sec
msg_rate = 1758 /sec
msg_size = 1845888 bytes
send_cost = 129463873 ns/GB
recv_cost = 127922638 ns/GB
send_cpus_used = 42 % cpus
recv_cpus_used = 41.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1858032 tcp_bw
tcp_bw:
bw = 3235762728 bytes/sec
msg_rate = 1742 /sec
msg_size = 1858032 bytes
send_cost = 100411165 ns/GB
recv_cost = 106620920 ns/GB
send_cpus_used = 32.5 % cpus
recv_cpus_used = 34.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1870176 tcp_bw
tcp_bw:
bw = 3217637808 bytes/sec
msg_rate = 1720 /sec
msg_size = 1870176 bytes
send_cost = 110329382 ns/GB
recv_cost = 127422669 ns/GB
send_cpus_used = 35.5 % cpus
recv_cpus_used = 41 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1882320 tcp_bw
tcp_bw:
bw = 3229119960 bytes/sec
msg_rate = 1716 /sec
msg_size = 1882320 bytes
send_cost = 92877503 ns/GB
recv_cost = 96001389 ns/GB
send_cpus_used = 30 % cpus
recv_cpus_used = 31 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1894464 tcp_bw
tcp_bw:
bw = 3249005760 bytes/sec
msg_rate = 1715 /sec
msg_size = 1894464 bytes
send_cost = 96952736 ns/GB
recv_cost = 96952736 ns/GB
send_cpus_used = 31.5 % cpus
recv_cpus_used = 31.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1906608 tcp_bw
tcp_bw:
bw = 3230747256 bytes/sec
msg_rate = 1694 /sec
msg_size = 1906608 bytes
send_cost = 75833851 ns/GB
recv_cost = 102143556 ns/GB
send_cpus_used = 24.5 % cpus
recv_cpus_used = 33 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1918752 tcp_bw
tcp_bw:
bw = 3249406512 bytes/sec
msg_rate = 1694 /sec
msg_size = 1918752 bytes
send_cost = 70782158 ns/GB
recv_cost = 92324556 ns/GB
send_cpus_used = 23 % cpus
recv_cpus_used = 30 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1930896 tcp_bw
tcp_bw:
bw = 3236181696 bytes/sec
msg_rate = 1676 /sec
msg_size = 1930896 bytes
send_cost = 101972029 ns/GB
recv_cost = 131327611 ns/GB
send_cpus_used = 33 % cpus
recv_cpus_used = 42.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1943040 tcp_bw
tcp_bw:
bw = 3226417920 bytes/sec
msg_rate = 1660 /sec
msg_size = 1943040 bytes
send_cost = 113128559 ns/GB
recv_cost = 116227968 ns/GB
send_cpus_used = 36.5 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1955184 tcp_bw
tcp_bw:
bw = 3234851928 bytes/sec
msg_rate = 1654 /sec
msg_size = 1955184 bytes
send_cost = 92711934 ns/GB
recv_cost = 128290259 ns/GB
send_cpus_used = 30 % cpus
recv_cpus_used = 41.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1967328 tcp_bw
tcp_bw:
bw = 3215597616 bytes/sec
msg_rate = 1634 /sec
msg_size = 1967328 bytes
send_cost = 113509230 ns/GB
recv_cost = 129058434 ns/GB
send_cpus_used = 36.5 % cpus
recv_cpus_used = 41.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1979472 tcp_bw
tcp_bw:
bw = 3220600944 bytes/sec
msg_rate = 1627 /sec
msg_size = 1979472 bytes
send_cost = 147488001 ns/GB
recv_cost = 242190816 ns/GB
send_cpus_used = 47.5 % cpus
recv_cpus_used = 78 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 1991616 tcp_bw
tcp_bw:
bw = 3249321504 bytes/sec
msg_rate = 1632 /sec
msg_size = 1991616 bytes
send_cost = 96943315 ns/GB
recv_cost = 103098449 ns/GB
send_cpus_used = 31.5 % cpus
recv_cpus_used = 33.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2003760 tcp_bw
tcp_bw:
bw = 3220042320 bytes/sec
msg_rate = 1607 /sec
msg_size = 2003760 bytes
send_cost = 111799777 ns/GB
recv_cost = 110246995 ns/GB
send_cpus_used = 36 % cpus
recv_cpus_used = 35.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2015904 tcp_bw
tcp_bw:
bw = 3231494112 bytes/sec
msg_rate = 1603 /sec
msg_size = 2015904 bytes
send_cost = 88194497 ns/GB
recv_cost = 99025399 ns/GB
send_cpus_used = 28.5 % cpus
recv_cpus_used = 32 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2028048 tcp_bw
tcp_bw:
bw = 3222568272 bytes/sec
msg_rate = 1589 /sec
msg_size = 2028048 bytes
send_cost = 85308821 ns/GB
recv_cost = 105505912 ns/GB
send_cpus_used = 27.5 % cpus
recv_cpus_used = 34 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2040192 tcp_bw
tcp_bw:
bw = 3242885184 bytes/sec
msg_rate = 1590 /sec
msg_size = 2040192 bytes
send_cost = 106386745 ns/GB
recv_cost = 117179602 ns/GB
send_cpus_used = 34.5 % cpus
recv_cpus_used = 38 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2052336 tcp_bw
tcp_bw:
bw = 2568498504 bytes/sec
msg_rate = 1252 /sec
msg_size = 2052336 bytes
send_cost = 56453214 ns/GB
recv_cost = 77866506 ns/GB
send_cpus_used = 14.5 % cpus
recv_cpus_used = 20 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2064480 tcp_bw
tcp_bw:
bw = 2566148640 bytes/sec
msg_rate = 1243 /sec
msg_size = 2064480 bytes
send_cost = 66247137 ns/GB
recv_cost = 190947633 ns/GB
send_cpus_used = 17 % cpus
recv_cpus_used = 49 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2076624 tcp_bw
tcp_bw:
bw = 1896996024 bytes/sec
msg_rate = 914 /sec
msg_size = 2076624 bytes
send_cost = 65893654 ns/GB
recv_cost = 424355137 ns/GB
send_cpus_used = 12.5 % cpus
recv_cpus_used = 80.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2088768 tcp_bw
tcp_bw:
bw = 2565007104 bytes/sec
msg_rate = 1228 /sec
msg_size = 2088768 bytes
send_cost = 50682119 ns/GB
recv_cost = 62377993 ns/GB
send_cpus_used = 13 % cpus
recv_cpus_used = 16 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2100912 tcp_bw
tcp_bw:
bw = 3147166176 bytes/sec
msg_rate = 1498 /sec
msg_size = 2100912 bytes
send_cost = 115977355 ns/GB
recv_cost = 127098470 ns/GB
send_cpus_used = 36.5 % cpus
recv_cpus_used = 40 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2113056 tcp_bw
tcp_bw:
bw = 3203392896 bytes/sec
msg_rate = 1516 /sec
msg_size = 2113056 bytes
send_cost = 113904126 ns/GB
recv_cost = 134232678 ns/GB
send_cpus_used = 36.5 % cpus
recv_cpus_used = 43 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2125200 tcp_bw
tcp_bw:
bw = 1536519600 bytes/sec
msg_rate = 723 /sec
msg_size = 2125200 bytes
send_cost = 78044606 ns/GB
recv_cost = 364460045 ns/GB
send_cpus_used = 12 % cpus
recv_cpus_used = 56 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2137344 tcp_bw
tcp_bw:
bw = 2727506149 bytes/sec
msg_rate = 1282 /sec
msg_size = 2137344 bytes
send_cost = 93026862 ns/GB
recv_cost = 140452320 ns/GB
send_cpus_used = 25.5 % cpus
recv_cpus_used = 38.3 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2149488 tcp_bw
tcp_bw:
bw = 3232829952 bytes/sec
msg_rate = 1504 /sec
msg_size = 2149488 bytes
send_cost = 120637334 ns/GB
recv_cost = 100531111 ns/GB
send_cpus_used = 39 % cpus
recv_cpus_used = 32.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2161632 tcp_bw
tcp_bw:
bw = 3222993312 bytes/sec
msg_rate = 1491 /sec
msg_size = 2161632 bytes
send_cost = 119454170 ns/GB
recv_cost = 176854228 ns/GB
send_cpus_used = 38.5 % cpus
recv_cpus_used = 57 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2173776 tcp_bw
tcp_bw:
bw = 3216101592 bytes/sec
msg_rate = 1480 /sec
msg_size = 2173776 bytes
send_cost = 110382082 ns/GB
recv_cost = 111936767 ns/GB
send_cpus_used = 35.5 % cpus
recv_cpus_used = 36 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2185920 tcp_bw
tcp_bw:
bw = 3226417920 bytes/sec
msg_rate = 1476 /sec
msg_size = 2185920 bytes
send_cost = 97631493 ns/GB
recv_cost = 111578854 ns/GB
send_cpus_used = 31.5 % cpus
recv_cpus_used = 36 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2198064 tcp_bw
tcp_bw:
bw = 3227856984 bytes/sec
msg_rate = 1468 /sec
msg_size = 2198064 bytes
send_cost = 94457777 ns/GB
recv_cost = 99136980 ns/GB
send_cpus_used = 30.5 % cpus
recv_cpus_used = 32 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2210208 tcp_bw
tcp_bw:
bw = 3216957744 bytes/sec
msg_rate = 1456 /sec
msg_size = 2210208 bytes
send_cost = 96364338 ns/GB
recv_cost = 101027124 ns/GB
send_cpus_used = 31 % cpus
recv_cpus_used = 32.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2222352 tcp_bw
tcp_bw:
bw = 3203520408 bytes/sec
msg_rate = 1442 /sec
msg_size = 2222352 bytes
send_cost = 82721491 ns/GB
recv_cost = 96768543 ns/GB
send_cpus_used = 26.5 % cpus
recv_cpus_used = 31 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2234496 tcp_bw
tcp_bw:
bw = 3027742080 bytes/sec
msg_rate = 1355 /sec
msg_size = 2234496 bytes
send_cost = 112294903 ns/GB
recv_cost = 100735135 ns/GB
send_cpus_used = 34 % cpus
recv_cpus_used = 30.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2246640 tcp_bw
tcp_bw:
bw = 3219435120 bytes/sec
msg_rate = 1433 /sec
msg_size = 2246640 bytes
send_cost = 110229327 ns/GB
recv_cost = 136669938 ns/GB
send_cpus_used = 35.5 % cpus
recv_cpus_used = 44 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2258784 tcp_bw
tcp_bw:
bw = 2902537440 bytes/sec
msg_rate = 1285 /sec
msg_size = 2258784 bytes
send_cost = 91299420 ns/GB
recv_cost = 79241012 ns/GB
send_cpus_used = 26.5 % cpus
recv_cpus_used = 23 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2270928 tcp_bw
tcp_bw:
bw = 3240614256 bytes/sec
msg_rate = 1427 /sec
msg_size = 2270928 bytes
send_cost = 77145868 ns/GB
recv_cost = 141948400 ns/GB
send_cpus_used = 25 % cpus
recv_cpus_used = 46 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2283072 tcp_bw
tcp_bw:
bw = 3229405344 bytes/sec
msg_rate = 1414 /sec
msg_size = 2283072 bytes
send_cost = 103734271 ns/GB
recv_cost = 218306440 ns/GB
send_cpus_used = 33.5 % cpus
recv_cpus_used = 70.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2295216 tcp_bw
tcp_bw:
bw = 3214450008 bytes/sec
msg_rate = 1400 /sec
msg_size = 2295216 bytes
send_cost = 107289543 ns/GB
recv_cost = 290874022 ns/GB
send_cpus_used = 34.5 % cpus
recv_cpus_used = 93.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2307360 tcp_bw
tcp_bw:
bw = 3238379760 bytes/sec
msg_rate = 1404 /sec
msg_size = 2307360 bytes
send_cost = 109622717 ns/GB
recv_cost = 172925983 ns/GB
send_cpus_used = 35.5 % cpus
recv_cpus_used = 56 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2319504 tcp_bw
tcp_bw:
bw = 3215992296 bytes/sec
msg_rate = 1386 /sec
msg_size = 2319504 bytes
send_cost = 175684500 ns/GB
recv_cost = 107276376 ns/GB
send_cpus_used = 56.5 % cpus
recv_cpus_used = 34.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2331648 tcp_bw
tcp_bw:
bw = 3233995776 bytes/sec
msg_rate = 1387 /sec
msg_size = 2331648 bytes
send_cost = 117501698 ns/GB
recv_cost = 123686001 ns/GB
send_cpus_used = 38 % cpus
recv_cpus_used = 40 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2343792 tcp_bw
tcp_bw:
bw = 3242636232 bytes/sec
msg_rate = 1384 /sec
msg_size = 2343792 bytes
send_cost = 58594299 ns/GB
recv_cost = 74013851 ns/GB
send_cpus_used = 19 % cpus
recv_cpus_used = 24 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2355936 tcp_bw
tcp_bw:
bw = 3238234032 bytes/sec
msg_rate = 1374 /sec
msg_size = 2355936 bytes
send_cost = 58673955 ns/GB
recv_cost = 69482314 ns/GB
send_cpus_used = 19 % cpus
recv_cpus_used = 22.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2368080 tcp_bw
tcp_bw:
bw = 3224140920 bytes/sec
msg_rate = 1362 /sec
msg_size = 2368080 bytes
send_cost = 60481225 ns/GB
recv_cost = 79090834 ns/GB
send_cpus_used = 19.5 % cpus
recv_cpus_used = 25.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2380224 tcp_bw
tcp_bw:
bw = 3225203520 bytes/sec
msg_rate = 1355 /sec
msg_size = 2380224 bytes
send_cost = 100768831 ns/GB
recv_cost = 110070570 ns/GB
send_cpus_used = 32.5 % cpus
recv_cpus_used = 35.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2392368 tcp_bw
tcp_bw:
bw = 3221323512 bytes/sec
msg_rate = 1346 /sec
msg_size = 2392368 bytes
send_cost = 111755312 ns/GB
recv_cost = 166080813 ns/GB
send_cpus_used = 36 % cpus
recv_cpus_used = 53.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2404512 tcp_bw
tcp_bw:
bw = 3218439312 bytes/sec
msg_rate = 1338 /sec
msg_size = 2404512 bytes
send_cost = 100942910 ns/GB
recv_cost = 107194813 ns/GB
send_cpus_used = 32.5 % cpus
recv_cpus_used = 34.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2416656 tcp_bw
tcp_bw:
bw = 3229860744 bytes/sec
msg_rate = 1336 /sec
msg_size = 2416656 bytes
send_cost = 95979371 ns/GB
recv_cost = 258525071 ns/GB
send_cpus_used = 31 % cpus
recv_cpus_used = 83.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2428800 tcp_bw
tcp_bw:
bw = 3242448000 bytes/sec
msg_rate = 1335 /sec
msg_size = 2428800 bytes
send_cost = 111027228 ns/GB
recv_cost = 114111315 ns/GB
send_cpus_used = 36 % cpus
recv_cpus_used = 37 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2440944 tcp_bw
tcp_bw:
bw = 3213502776 bytes/sec
msg_rate = 1316 /sec
msg_size = 2440944 bytes
send_cost = 77767192 ns/GB
recv_cost = 110471350 ns/GB
send_cpus_used = 25 % cpus
recv_cpus_used = 35.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2453088 tcp_bw
tcp_bw:
bw = 3162030432 bytes/sec
msg_rate = 1289 /sec
msg_size = 2453088 bytes
send_cost = 116968051 ns/GB
recv_cost = 117013423 ns/GB
send_cpus_used = 37 % cpus
recv_cpus_used = 37 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2465232 tcp_bw
tcp_bw:
bw = 3029770128 bytes/sec
msg_rate = 1229 /sec
msg_size = 2465232 bytes
send_cost = 115473335 ns/GB
recv_cost = 108919159 ns/GB
send_cpus_used = 35 % cpus
recv_cpus_used = 33 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2477376 tcp_bw
tcp_bw:
bw = 3244123872 bytes/sec
msg_rate = 1310 /sec
msg_size = 2477376 bytes
send_cost = 89392392 ns/GB
recv_cost = 94016141 ns/GB
send_cpus_used = 29 % cpus
recv_cpus_used = 30.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2489520 tcp_bw
tcp_bw:
bw = 3221438880 bytes/sec
msg_rate = 1288 /sec
msg_size = 2489520 bytes
send_cost = 80709273 ns/GB
recv_cost = 97782391 ns/GB
send_cpus_used = 25.9 % cpus
recv_cpus_used = 31.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2501664 tcp_bw
tcp_bw:
bw = 3213387408 bytes/sec
msg_rate = 1284 /sec
msg_size = 2501664 bytes
send_cost = 108876946 ns/GB
recv_cost = 129147202 ns/GB
send_cpus_used = 35 % cpus
recv_cpus_used = 41.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2513808 tcp_bw
tcp_bw:
bw = 3223958760 bytes/sec
msg_rate = 1282 /sec
msg_size = 2513808 bytes
send_cost = 88400633 ns/GB
recv_cost = 111663964 ns/GB
send_cpus_used = 28.5 % cpus
recv_cpus_used = 36 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2525952 tcp_bw
tcp_bw:
bw = 3200381184 bytes/sec
msg_rate = 1267 /sec
msg_size = 2525952 bytes
send_cost = 85927266 ns/GB
recv_cost = 95301150 ns/GB
send_cpus_used = 27.5 % cpus
recv_cpus_used = 30.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2538096 tcp_bw
tcp_bw:
bw = 3142162848 bytes/sec
msg_rate = 1238 /sec
msg_size = 2538096 bytes
send_cost = 109796982 ns/GB
recv_cost = 108205723 ns/GB
send_cpus_used = 34.5 % cpus
recv_cpus_used = 34 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2550240 tcp_bw
tcp_bw:
bw = 3238804800 bytes/sec
msg_rate = 1270 /sec
msg_size = 2550240 bytes
send_cost = 86451645 ns/GB
recv_cost = 97258099 ns/GB
send_cpus_used = 28 % cpus
recv_cpus_used = 31.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2562384 tcp_bw
tcp_bw:
bw = 3218354304 bytes/sec
msg_rate = 1256 /sec
msg_size = 2562384 bytes
send_cost = 100983284 ns/GB
recv_cost = 114965591 ns/GB
send_cpus_used = 32.5 % cpus
recv_cpus_used = 37 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2574528 tcp_bw
tcp_bw:
bw = 2501153952 bytes/sec
msg_rate = 972 /sec
msg_size = 2574528 bytes
send_cost = 57973239 ns/GB
recv_cost = 77964010 ns/GB
send_cpus_used = 14.5 % cpus
recv_cpus_used = 19.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2586672 tcp_bw
tcp_bw:
bw = 2568565296 bytes/sec
msg_rate = 993 /sec
msg_size = 2586672 bytes
send_cost = 62291582 ns/GB
recv_cost = 73971255 ns/GB
send_cpus_used = 16 % cpus
recv_cpus_used = 19 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2598816 tcp_bw
tcp_bw:
bw = 2555935536 bytes/sec
msg_rate = 984 /sec
msg_size = 2598816 bytes
send_cost = 66511850 ns/GB
recv_cost = 74336772 ns/GB
send_cpus_used = 17 % cpus
recv_cpus_used = 19 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2610960 tcp_bw
tcp_bw:
bw = 2325059880 bytes/sec
msg_rate = 890 /sec
msg_size = 2610960 bytes
send_cost = 40836233 ns/GB
recv_cost = 94621218 ns/GB
send_cpus_used = 9.5 % cpus
recv_cpus_used = 22 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2623104 tcp_bw
tcp_bw:
bw = 3222483264 bytes/sec
msg_rate = 1228 /sec
msg_size = 2623104 bytes
send_cost = 94609001 ns/GB
recv_cost = 107060292 ns/GB
send_cpus_used = 30.5 % cpus
recv_cpus_used = 34.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2635248 tcp_bw
tcp_bw:
bw = 3199191072 bytes/sec
msg_rate = 1214 /sec
msg_size = 2635248 bytes
send_cost = 125031609 ns/GB
recv_cost = 121905812 ns/GB
send_cpus_used = 40 % cpus
recv_cpus_used = 39 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2647392 tcp_bw
tcp_bw:
bw = 3216581280 bytes/sec
msg_rate = 1215 /sec
msg_size = 2647392 bytes
send_cost = 107256733 ns/GB
recv_cost = 119692293 ns/GB
send_cpus_used = 34.5 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2659536 tcp_bw
tcp_bw:
bw = 3216708792 bytes/sec
msg_rate = 1210 /sec
msg_size = 2659536 bytes
send_cost = 111915637 ns/GB
recv_cost = 119687549 ns/GB
send_cpus_used = 36 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2671680 tcp_bw
tcp_bw:
bw = 3231396960 bytes/sec
msg_rate = 1210 /sec
msg_size = 2671680 bytes
send_cost = 95933742 ns/GB
recv_cost = 111406930 ns/GB
send_cpus_used = 31 % cpus
recv_cpus_used = 36 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2683824 tcp_bw
tcp_bw:
bw = 3211195416 bytes/sec
msg_rate = 1196 /sec
msg_size = 2683824 bytes
send_cost = 124564206 ns/GB
recv_cost = 123007155 ns/GB
send_cpus_used = 40 % cpus
recv_cpus_used = 39.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2695968 tcp_bw
tcp_bw:
bw = 3227073696 bytes/sec
msg_rate = 1197 /sec
msg_size = 2695968 bytes
send_cost = 103765877 ns/GB
recv_cost = 111556180 ns/GB
send_cpus_used = 33.5 % cpus
recv_cpus_used = 36 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2708112 tcp_bw
tcp_bw:
bw = 2989755648 bytes/sec
msg_rate = 1104 /sec
msg_size = 2708112 bytes
send_cost = 98670267 ns/GB
recv_cost = 314406964 ns/GB
send_cpus_used = 29.5 % cpus
recv_cpus_used = 94 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2720256 tcp_bw
tcp_bw:
bw = 3243905280 bytes/sec
msg_rate = 1192 /sec
msg_size = 2720256 bytes
send_cost = 94022476 ns/GB
recv_cost = 109435991 ns/GB
send_cpus_used = 30.5 % cpus
recv_cpus_used = 35.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2732400 tcp_bw
tcp_bw:
bw = 3239260200 bytes/sec
msg_rate = 1186 /sec
msg_size = 2732400 bytes
send_cost = 98787986 ns/GB
recv_cost = 100331547 ns/GB
send_cpus_used = 32 % cpus
recv_cpus_used = 32.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2744544 tcp_bw
tcp_bw:
bw = 3231700560 bytes/sec
msg_rate = 1178 /sec
msg_size = 2744544 bytes
send_cost = 97471901 ns/GB
recv_cost = 108302111 ns/GB
send_cpus_used = 31.5 % cpus
recv_cpus_used = 35 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2756688 tcp_bw
tcp_bw:
bw = 3225324960 bytes/sec
msg_rate = 1170 /sec
msg_size = 2756688 bytes
send_cost = 100721993 ns/GB
recv_cost = 128669203 ns/GB
send_cpus_used = 32.5 % cpus
recv_cpus_used = 41.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2768832 tcp_bw
tcp_bw:
bw = 3231226944 bytes/sec
msg_rate = 1167 /sec
msg_size = 2768832 bytes
send_cost = 117602385 ns/GB
recv_cost = 117602385 ns/GB
send_cpus_used = 38 % cpus
recv_cpus_used = 38 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2780976 tcp_bw
tcp_bw:
bw = 3242618016 bytes/sec
msg_rate = 1166 /sec
msg_size = 2780976 bytes
send_cost = 73982542 ns/GB
recv_cost = 84808018 ns/GB
send_cpus_used = 24 % cpus
recv_cpus_used = 27.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2793120 tcp_bw
tcp_bw:
bw = 3238622640 bytes/sec
msg_rate = 1160 /sec
msg_size = 2793120 bytes
send_cost = 69473977 ns/GB
recv_cost = 115789964 ns/GB
send_cpus_used = 22.5 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2805264 tcp_bw
tcp_bw:
bw = 3205014120 bytes/sec
msg_rate = 1142 /sec
msg_size = 2805264 bytes
send_cost = 134164778 ns/GB
recv_cost = 132604724 ns/GB
send_cpus_used = 43 % cpus
recv_cpus_used = 42.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2817408 tcp_bw
tcp_bw:
bw = 3221706048 bytes/sec
msg_rate = 1144 /sec
msg_size = 2817408 bytes
send_cost = 117949928 ns/GB
recv_cost = 125709793 ns/GB
send_cpus_used = 38 % cpus
recv_cpus_used = 40.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2829552 tcp_bw
tcp_bw:
bw = 3229933608 bytes/sec
msg_rate = 1142 /sec
msg_size = 2829552 bytes
send_cost = 91333143 ns/GB
recv_cost = 187310358 ns/GB
send_cpus_used = 29.5 % cpus
recv_cpus_used = 60.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2841696 tcp_bw
tcp_bw:
bw = 3124444752 bytes/sec
msg_rate = 1100 /sec
msg_size = 2841696 bytes
send_cost = 118421043 ns/GB
recv_cost = 112019902 ns/GB
send_cpus_used = 37 % cpus
recv_cpus_used = 35 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2853840 tcp_bw
tcp_bw:
bw = 3219131520 bytes/sec
msg_rate = 1128 /sec
msg_size = 2853840 bytes
send_cost = 150595005 ns/GB
recv_cost = 141342474 ns/GB
send_cpus_used = 48.5 % cpus
recv_cpus_used = 45.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2865984 tcp_bw
tcp_bw:
bw = 3244293888 bytes/sec
msg_rate = 1132 /sec
msg_size = 2865984 bytes
send_cost = 57023195 ns/GB
recv_cost = 72434868 ns/GB
send_cpus_used = 18.5 % cpus
recv_cpus_used = 23.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2878128 tcp_bw
tcp_bw:
bw = 3227820552 bytes/sec
msg_rate = 1122 /sec
msg_size = 2878128 bytes
send_cost = 60412278 ns/GB
recv_cost = 75902610 ns/GB
send_cpus_used = 19.5 % cpus
recv_cpus_used = 24.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2890272 tcp_bw
tcp_bw:
bw = 3200976240 bytes/sec
msg_rate = 1108 /sec
msg_size = 2890272 bytes
send_cost = 109341641 ns/GB
recv_cost = 134334020 ns/GB
send_cpus_used = 35 % cpus
recv_cpus_used = 43 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2902416 tcp_bw
tcp_bw:
bw = 3211523304 bytes/sec
msg_rate = 1106 /sec
msg_size = 2902416 bytes
send_cost = 113653234 ns/GB
recv_cost = 130779056 ns/GB
send_cpus_used = 36.5 % cpus
recv_cpus_used = 42 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2914560 tcp_bw
tcp_bw:
bw = 3239533440 bytes/sec
msg_rate = 1112 /sec
msg_size = 2914560 bytes
send_cost = 111127118 ns/GB
recv_cost = 141995759 ns/GB
send_cpus_used = 36 % cpus
recv_cpus_used = 46 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2926704 tcp_bw
tcp_bw:
bw = 3231081216 bytes/sec
msg_rate = 1104 /sec
msg_size = 2926704 bytes
send_cost = 99038053 ns/GB
recv_cost = 139272262 ns/GB
send_cpus_used = 32 % cpus
recv_cpus_used = 45 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2938848 tcp_bw
tcp_bw:
bw = 3228324528 bytes/sec
msg_rate = 1098 /sec
msg_size = 2938848 bytes
send_cost = 116106478 ns/GB
recv_cost = 117708115 ns/GB
send_cpus_used = 37.5 % cpus
recv_cpus_used = 38 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2950992 tcp_bw
tcp_bw:
bw = 3212154792 bytes/sec
msg_rate = 1088 /sec
msg_size = 2950992 bytes
send_cost = 104291365 ns/GB
recv_cost = 118300649 ns/GB
send_cpus_used = 33.5 % cpus
recv_cpus_used = 38 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2963136 tcp_bw
tcp_bw:
bw = 2875723488 bytes/sec
msg_rate = 970 /sec
msg_size = 2963136 bytes
send_cost = 111276343 ns/GB
recv_cost = 74763796 ns/GB
send_cpus_used = 32 % cpus
recv_cpus_used = 21.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2975280 tcp_bw
tcp_bw:
bw = 3214790040 bytes/sec
msg_rate = 1080 /sec
msg_size = 2975280 bytes
send_cost = 101095245 ns/GB
recv_cost = 113537744 ns/GB
send_cpus_used = 32.5 % cpus
recv_cpus_used = 36.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2987424 tcp_bw
tcp_bw:
bw = 3224924208 bytes/sec
msg_rate = 1080 /sec
msg_size = 2987424 bytes
send_cost = 88374169 ns/GB
recv_cost = 114731380 ns/GB
send_cpus_used = 28.5 % cpus
recv_cpus_used = 37 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 2999568 tcp_bw
tcp_bw:
bw = 3229034952 bytes/sec
msg_rate = 1076 /sec
msg_size = 2999568 bytes
send_cost = 105294619 ns/GB
recv_cost = 109939965 ns/GB
send_cpus_used = 34 % cpus
recv_cpus_used = 35.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3011712 tcp_bw
tcp_bw:
bw = 3260178240 bytes/sec
msg_rate = 1082 /sec
msg_size = 3011712 bytes
send_cost = 76682924 ns/GB
recv_cost = 87418532 ns/GB
send_cpus_used = 25 % cpus
recv_cpus_used = 28.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3023856 tcp_bw
tcp_bw:
bw = 3212847000 bytes/sec
msg_rate = 1062 /sec
msg_size = 3023856 bytes
send_cost = 88706371 ns/GB
recv_cost = 157181464 ns/GB
send_cpus_used = 28.5 % cpus
recv_cpus_used = 50.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3036000 tcp_bw
tcp_bw:
bw = 3236376000 bytes/sec
msg_rate = 1066 /sec
msg_size = 3036000 bytes
send_cost = 95786152 ns/GB
recv_cost = 101965907 ns/GB
send_cpus_used = 31 % cpus
recv_cpus_used = 33 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3048144 tcp_bw
tcp_bw:
bw = 3212743776 bytes/sec
msg_rate = 1054 /sec
msg_size = 3048144 bytes
send_cost = 102715945 ns/GB
recv_cost = 121391562 ns/GB
send_cpus_used = 33 % cpus
recv_cpus_used = 39 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3060288 tcp_bw
tcp_bw:
bw = 3182699520 bytes/sec
msg_rate = 1040 /sec
msg_size = 3060288 bytes
send_cost = 103685570 ns/GB
recv_cost = 100543577 ns/GB
send_cpus_used = 33 % cpus
recv_cpus_used = 32 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3072432 tcp_bw
tcp_bw:
bw = 3212227656 bytes/sec
msg_rate = 1046 /sec
msg_size = 3072432 bytes
send_cost = 112071762 ns/GB
recv_cost = 105845550 ns/GB
send_cpus_used = 36 % cpus
recv_cpus_used = 34 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3084576 tcp_bw
tcp_bw:
bw = 3235720224 bytes/sec
msg_rate = 1049 /sec
msg_size = 3084576 bytes
send_cost = 105027010 ns/GB
recv_cost = 100441313 ns/GB
send_cpus_used = 34 % cpus
recv_cpus_used = 32.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3096720 tcp_bw
tcp_bw:
bw = 2514536640 bytes/sec
msg_rate = 812 /sec
msg_size = 3096720 bytes
send_cost = 53687826 ns/GB
recv_cost = 83514390 ns/GB
send_cpus_used = 13.5 % cpus
recv_cpus_used = 21 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3108864 tcp_bw
tcp_bw:
bw = 2530615296 bytes/sec
msg_rate = 814 /sec
msg_size = 3108864 bytes
send_cost = 51370904 ns/GB
recv_cost = 57298316 ns/GB
send_cpus_used = 13 % cpus
recv_cpus_used = 14.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3121008 tcp_bw
tcp_bw:
bw = 2545182024 bytes/sec
msg_rate = 816 /sec
msg_size = 3121008 bytes
send_cost = 45183410 ns/GB
recv_cost = 64828372 ns/GB
send_cpus_used = 11.5 % cpus
recv_cpus_used = 16.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3133152 tcp_bw
tcp_bw:
bw = 2559785184 bytes/sec
msg_rate = 817 /sec
msg_size = 3133152 bytes
send_cost = 42972356 ns/GB
recv_cost = 105477605 ns/GB
send_cpus_used = 11 % cpus
recv_cpus_used = 27 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3145296 tcp_bw
tcp_bw:
bw = 2563416240 bytes/sec
msg_rate = 815 /sec
msg_size = 3145296 bytes
send_cost = 40960963 ns/GB
recv_cost = 64367232 ns/GB
send_cpus_used = 10.5 % cpus
recv_cpus_used = 16.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3157440 tcp_bw
tcp_bw:
bw = 3204801600 bytes/sec
msg_rate = 1015 /sec
msg_size = 3157440 bytes
send_cost = 120132239 ns/GB
recv_cost = 124812720 ns/GB
send_cpus_used = 38.5 % cpus
recv_cpus_used = 40 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3169584 tcp_bw
tcp_bw:
bw = 3088759608 bytes/sec
msg_rate = 974 /sec
msg_size = 3169584 bytes
send_cost = 95507590 ns/GB
recv_cost = 113314093 ns/GB
send_cpus_used = 29.5 % cpus
recv_cpus_used = 35 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3181728 tcp_bw
tcp_bw:
bw = 3199227504 bytes/sec
msg_rate = 1006 /sec
msg_size = 3181728 bytes
send_cost = 109347034 ns/GB
recv_cost = 118778672 ns/GB
send_cpus_used = 35 % cpus
recv_cpus_used = 38 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3193872 tcp_bw
tcp_bw:
bw = 3216229104 bytes/sec
msg_rate = 1007 /sec
msg_size = 3193872 bytes
send_cost = 99495397 ns/GB
recv_cost = 178780793 ns/GB
send_cpus_used = 32 % cpus
recv_cpus_used = 57.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3206016 tcp_bw
tcp_bw:
bw = 3210825024 bytes/sec
msg_rate = 1002 /sec
msg_size = 3206016 bytes
send_cost = 119906874 ns/GB
recv_cost = 121464104 ns/GB
send_cpus_used = 38.5 % cpus
recv_cpus_used = 39 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3218160 tcp_bw
tcp_bw:
bw = 3010588680 bytes/sec
msg_rate = 936 /sec
msg_size = 3218160 bytes
send_cost = 112934725 ns/GB
recv_cost = 137846792 ns/GB
send_cpus_used = 34 % cpus
recv_cpus_used = 41.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3230304 tcp_bw
tcp_bw:
bw = 3238379760 bytes/sec
msg_rate = 1002 /sec
msg_size = 3230304 bytes
send_cost = 98814845 ns/GB
recv_cost = 115798649 ns/GB
send_cpus_used = 32 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3242448 tcp_bw
tcp_bw:
bw = 3214887192 bytes/sec
msg_rate = 992 /sec
msg_size = 3242448 bytes
send_cost = 87050915 ns/GB
recv_cost = 101092190 ns/GB
send_cpus_used = 28 % cpus
recv_cpus_used = 32.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3254592 tcp_bw
tcp_bw:
bw = 3235064448 bytes/sec
msg_rate = 994 /sec
msg_size = 3254592 bytes
send_cost = 94279422 ns/GB
recv_cost = 120554008 ns/GB
send_cpus_used = 30.5 % cpus
recv_cpus_used = 39 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3266736 tcp_bw
tcp_bw:
bw = 2680356888 bytes/sec
msg_rate = 820 /sec
msg_size = 3266736 bytes
send_cost = 110059966 ns/GB
recv_cost = 190273166 ns/GB
send_cpus_used = 29.5 % cpus
recv_cpus_used = 51 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3278880 tcp_bw
tcp_bw:
bw = 3210023520 bytes/sec
msg_rate = 979 /sec
msg_size = 3278880 bytes
send_cost = 115205116 ns/GB
recv_cost = 161992577 ns/GB
send_cpus_used = 37 % cpus
recv_cpus_used = 52 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3291024 tcp_bw
tcp_bw:
bw = 3220266984 bytes/sec
msg_rate = 978 /sec
msg_size = 3291024 bytes
send_cost = 118002637 ns/GB
recv_cost = 113344642 ns/GB
send_cpus_used = 38 % cpus
recv_cpus_used = 36.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3303168 tcp_bw
tcp_bw:
bw = 3240407808 bytes/sec
msg_rate = 981 /sec
msg_size = 3303168 bytes
send_cost = 81779826 ns/GB
recv_cost = 95666972 ns/GB
send_cpus_used = 26.5 % cpus
recv_cpus_used = 31 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3315312 tcp_bw
tcp_bw:
bw = 2307457152 bytes/sec
msg_rate = 696 /sec
msg_size = 3315312 bytes
send_cost = 173351001 ns/GB
recv_cost = 108344374 ns/GB
send_cpus_used = 40 % cpus
recv_cpus_used = 25 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3327456 tcp_bw
tcp_bw:
bw = 3219313680 bytes/sec
msg_rate = 968 /sec
msg_size = 3327456 bytes
send_cost = 116484455 ns/GB
recv_cost = 133568844 ns/GB
send_cpus_used = 37.5 % cpus
recv_cpus_used = 43 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3339600 tcp_bw
tcp_bw:
bw = 3211025400 bytes/sec
msg_rate = 962 /sec
msg_size = 3339600 bytes
send_cost = 116785124 ns/GB
recv_cost = 129242201 ns/GB
send_cpus_used = 37.5 % cpus
recv_cpus_used = 41.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3351744 tcp_bw
tcp_bw:
bw = 3246164064 bytes/sec
msg_rate = 968 /sec
msg_size = 3351744 bytes
send_cost = 90876487 ns/GB
recv_cost = 103198730 ns/GB
send_cpus_used = 29.5 % cpus
recv_cpus_used = 33.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3363888 tcp_bw
tcp_bw:
bw = 3237742200 bytes/sec
msg_rate = 962 /sec
msg_size = 3363888 bytes
send_cost = 84935733 ns/GB
recv_cost = 98834303 ns/GB
send_cpus_used = 27.5 % cpus
recv_cpus_used = 32 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3376032 tcp_bw
tcp_bw:
bw = 3225798576 bytes/sec
msg_rate = 956 /sec
msg_size = 3376032 bytes
send_cost = 106894324 ns/GB
recv_cost = 105400258 ns/GB
send_cpus_used = 34.5 % cpus
recv_cpus_used = 34 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3388176 tcp_bw
tcp_bw:
bw = 3228931728 bytes/sec
msg_rate = 953 /sec
msg_size = 3388176 bytes
send_cost = 72779488 ns/GB
recv_cost = 92909989 ns/GB
send_cpus_used = 23.5 % cpus
recv_cpus_used = 30 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3400320 tcp_bw
tcp_bw:
bw = 3257506560 bytes/sec
msg_rate = 958 /sec
msg_size = 3400320 bytes
send_cost = 61396654 ns/GB
recv_cost = 73675982 ns/GB
send_cpus_used = 20 % cpus
recv_cpus_used = 24 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3412464 tcp_bw
tcp_bw:
bw = 3223072248 bytes/sec
msg_rate = 944 /sec
msg_size = 3412464 bytes
send_cost = 69809169 ns/GB
recv_cost = 136515710 ns/GB
send_cpus_used = 22.5 % cpus
recv_cpus_used = 44 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3424608 tcp_bw
tcp_bw:
bw = 3225980736 bytes/sec
msg_rate = 942 /sec
msg_size = 3424608 bytes
send_cost = 113143890 ns/GB
recv_cost = 117793634 ns/GB
send_cpus_used = 36.5 % cpus
recv_cpus_used = 38 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3436752 tcp_bw
tcp_bw:
bw = 3187587480 bytes/sec
msg_rate = 928 /sec
msg_size = 3436752 bytes
send_cost = 141172592 ns/GB
recv_cost = 128623920 ns/GB
send_cpus_used = 45 % cpus
recv_cpus_used = 41 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3448896 tcp_bw
tcp_bw:
bw = 3238513344 bytes/sec
msg_rate = 939 /sec
msg_size = 3448896 bytes
send_cost = 101898612 ns/GB
recv_cost = 117337789 ns/GB
send_cpus_used = 33 % cpus
recv_cpus_used = 38 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3461040 tcp_bw
tcp_bw:
bw = 3227419800 bytes/sec
msg_rate = 932 /sec
msg_size = 3461040 bytes
send_cost = 99150409 ns/GB
recv_cost = 108445760 ns/GB
send_cpus_used = 32 % cpus
recv_cpus_used = 35 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3473184 tcp_bw
tcp_bw:
bw = 3188382912 bytes/sec
msg_rate = 918 /sec
msg_size = 3473184 bytes
send_cost = 127023639 ns/GB
recv_cost = 241501727 ns/GB
send_cpus_used = 40.5 % cpus
recv_cpus_used = 77 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3485328 tcp_bw
tcp_bw:
bw = 3229156392 bytes/sec
msg_rate = 926 /sec
msg_size = 3485328 bytes
send_cost = 80516382 ns/GB
recv_cost = 92903525 ns/GB
send_cpus_used = 26 % cpus
recv_cpus_used = 30 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3497472 tcp_bw
tcp_bw:
bw = 3231664128 bytes/sec
msg_rate = 924 /sec
msg_size = 3497472 bytes
send_cost = 112944909 ns/GB
recv_cost = 119133665 ns/GB
send_cpus_used = 36.5 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3509616 tcp_bw
tcp_bw:
bw = 3232356336 bytes/sec
msg_rate = 921 /sec
msg_size = 3509616 bytes
send_cost = 98998984 ns/GB
recv_cost = 105186424 ns/GB
send_cpus_used = 32 % cpus
recv_cpus_used = 34 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3521760 tcp_bw
tcp_bw:
bw = 3225932160 bytes/sec
msg_rate = 916 /sec
msg_size = 3521760 bytes
send_cost = 108436580 ns/GB
recv_cost = 119345346 ns/GB
send_cpus_used = 35 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3533904 tcp_bw
tcp_bw:
bw = 3214085688 bytes/sec
msg_rate = 910 /sec
msg_size = 3533904 bytes
send_cost = 79294677 ns/GB
recv_cost = 88672184 ns/GB
send_cpus_used = 25.5 % cpus
recv_cpus_used = 28.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3546048 tcp_bw
tcp_bw:
bw = 3242860896 bytes/sec
msg_rate = 914 /sec
msg_size = 3546048 bytes
send_cost = 112554939 ns/GB
recv_cost = 118722327 ns/GB
send_cpus_used = 36.5 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3558192 tcp_bw
tcp_bw:
bw = 3232617432 bytes/sec
msg_rate = 908 /sec
msg_size = 3558192 bytes
send_cost = 89710582 ns/GB
recv_cost = 103631195 ns/GB
send_cpus_used = 29 % cpus
recv_cpus_used = 33.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3570336 tcp_bw
tcp_bw:
bw = 3231154080 bytes/sec
msg_rate = 905 /sec
msg_size = 3570336 bytes
send_cost = 92794819 ns/GB
recv_cost = 100583253 ns/GB
send_cpus_used = 30 % cpus
recv_cpus_used = 32.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3582480 tcp_bw
tcp_bw:
bw = 3227814480 bytes/sec
msg_rate = 901 /sec
msg_size = 3582480 bytes
send_cost = 94491183 ns/GB
recv_cost = 108432500 ns/GB
send_cpus_used = 30.5 % cpus
recv_cpus_used = 35 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3594624 tcp_bw
tcp_bw:
bw = 3245945472 bytes/sec
msg_rate = 903 /sec
msg_size = 3594624 bytes
send_cost = 117069125 ns/GB
recv_cost = 115528743 ns/GB
send_cpus_used = 38 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3606768 tcp_bw
tcp_bw:
bw = 3208220136 bytes/sec
msg_rate = 890 /sec
msg_size = 3606768 bytes
send_cost = 95068292 ns/GB
recv_cost = 105977766 ns/GB
send_cpus_used = 30.5 % cpus
recv_cpus_used = 34 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3618912 tcp_bw
tcp_bw:
bw = 2421052128 bytes/sec
msg_rate = 669 /sec
msg_size = 3618912 bytes
send_cost = 55760883 ns/GB
recv_cost = 103260891 ns/GB
send_cpus_used = 13.5 % cpus
recv_cpus_used = 25 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3631056 tcp_bw
tcp_bw:
bw = 2563525536 bytes/sec
msg_rate = 706 /sec
msg_size = 3631056 bytes
send_cost = 42909656 ns/GB
recv_cost = 60463607 ns/GB
send_cpus_used = 11 % cpus
recv_cpus_used = 15.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3643200 tcp_bw
tcp_bw:
bw = 2537488800 bytes/sec
msg_rate = 696 /sec
msg_size = 3643200 bytes
send_cost = 55172658 ns/GB
recv_cost = 92611246 ns/GB
send_cpus_used = 14 % cpus
recv_cpus_used = 23.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3655344 tcp_bw
tcp_bw:
bw = 2549602440 bytes/sec
msg_rate = 698 /sec
msg_size = 3655344 bytes
send_cost = 49027251 ns/GB
recv_cost = 70599245 ns/GB
send_cpus_used = 12.5 % cpus
recv_cpus_used = 18 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3667488 tcp_bw
tcp_bw:
bw = 2554405392 bytes/sec
msg_rate = 696 /sec
msg_size = 3667488 bytes
send_cost = 46977664 ns/GB
recv_cost = 64594292 ns/GB
send_cpus_used = 12 % cpus
recv_cpus_used = 16.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3679632 tcp_bw
tcp_bw:
bw = 3203119656 bytes/sec
msg_rate = 870 /sec
msg_size = 3679632 bytes
send_cost = 113951413 ns/GB
recv_cost = 124878259 ns/GB
send_cpus_used = 36.5 % cpus
recv_cpus_used = 40 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3691776 tcp_bw
tcp_bw:
bw = 3200769792 bytes/sec
msg_rate = 867 /sec
msg_size = 3691776 bytes
send_cost = 126532062 ns/GB
recv_cost = 126532062 ns/GB
send_cpus_used = 40.5 % cpus
recv_cpus_used = 40.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3703920 tcp_bw
tcp_bw:
bw = 3200186880 bytes/sec
msg_rate = 864 /sec
msg_size = 3703920 bytes
send_cost = 110931018 ns/GB
recv_cost = 109368611 ns/GB
send_cpus_used = 35.5 % cpus
recv_cpus_used = 35 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3716064 tcp_bw
tcp_bw:
bw = 3188382912 bytes/sec
msg_rate = 858 /sec
msg_size = 3716064 bytes
send_cost = 108205322 ns/GB
recv_cost = 120750864 ns/GB
send_cpus_used = 34.5 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3728208 tcp_bw
tcp_bw:
bw = 2857671432 bytes/sec
msg_rate = 766 /sec
msg_size = 3728208 bytes
send_cost = 160970223 ns/GB
recv_cost = 111979281 ns/GB
send_cpus_used = 46 % cpus
recv_cpus_used = 32 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3740352 tcp_bw
tcp_bw:
bw = 3229793952 bytes/sec
msg_rate = 864 /sec
msg_size = 3740352 bytes
send_cost = 100625610 ns/GB
recv_cost = 123846912 ns/GB
send_cpus_used = 32.5 % cpus
recv_cpus_used = 40 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3752496 tcp_bw
tcp_bw:
bw = 3223394064 bytes/sec
msg_rate = 859 /sec
msg_size = 3752496 bytes
send_cost = 110068290 ns/GB
recv_cost = 235776320 ns/GB
send_cpus_used = 35.5 % cpus
recv_cpus_used = 76 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3764640 tcp_bw
tcp_bw:
bw = 3062534640 bytes/sec
msg_rate = 814 /sec
msg_size = 3764640 bytes
send_cost = 89794905 ns/GB
recv_cost = 109386521 ns/GB
send_cpus_used = 27.5 % cpus
recv_cpus_used = 33.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3776784 tcp_bw
tcp_bw:
bw = 3174386952 bytes/sec
msg_rate = 840 /sec
msg_size = 3776784 bytes
send_cost = 118133046 ns/GB
recv_cost = 129158796 ns/GB
send_cpus_used = 37.5 % cpus
recv_cpus_used = 41 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3788928 tcp_bw
tcp_bw:
bw = 3254689152 bytes/sec
msg_rate = 859 /sec
msg_size = 3788928 bytes
send_cost = 90638452 ns/GB
recv_cost = 90638452 ns/GB
send_cpus_used = 29.5 % cpus
recv_cpus_used = 29.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3801072 tcp_bw
tcp_bw:
bw = 3221408520 bytes/sec
msg_rate = 848 /sec
msg_size = 3801072 bytes
send_cost = 79157919 ns/GB
recv_cost = 172284888 ns/GB
send_cpus_used = 25.5 % cpus
recv_cpus_used = 55.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3813216 tcp_bw
tcp_bw:
bw = 3233607168 bytes/sec
msg_rate = 848 /sec
msg_size = 3813216 bytes
send_cost = 83498086 ns/GB
recv_cost = 125247125 ns/GB
send_cpus_used = 27 % cpus
recv_cpus_used = 40.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3825360 tcp_bw
tcp_bw:
bw = 3211389720 bytes/sec
msg_rate = 840 /sec
msg_size = 3825360 bytes
send_cost = 107430125 ns/GB
recv_cost = 107430125 ns/GB
send_cpus_used = 34.5 % cpus
recv_cpus_used = 34.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3837504 tcp_bw
tcp_bw:
bw = 3254203392 bytes/sec
msg_rate = 848 /sec
msg_size = 3837504 bytes
send_cost = 76823717 ns/GB
recv_cost = 82969618 ns/GB
send_cpus_used = 25 % cpus
recv_cpus_used = 27 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3849648 tcp_bw
tcp_bw:
bw = 3164410656 bytes/sec
msg_rate = 822 /sec
msg_size = 3849648 bytes
send_cost = 120085550 ns/GB
recv_cost = 107444969 ns/GB
send_cpus_used = 38 % cpus
recv_cpus_used = 34 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3861792 tcp_bw
tcp_bw:
bw = 3228458112 bytes/sec
msg_rate = 836 /sec
msg_size = 3861792 bytes
send_cost = 89826159 ns/GB
recv_cost = 97569795 ns/GB
send_cpus_used = 29 % cpus
recv_cpus_used = 31.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3873936 tcp_bw
tcp_bw:
bw = 3124329384 bytes/sec
msg_rate = 806 /sec
msg_size = 3873936 bytes
send_cost = 116825073 ns/GB
recv_cost = 110423696 ns/GB
send_cpus_used = 36.5 % cpus
recv_cpus_used = 34.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3886080 tcp_bw
tcp_bw:
bw = 3240990720 bytes/sec
msg_rate = 834 /sec
msg_size = 3886080 bytes
send_cost = 106385151 ns/GB
recv_cost = 117248097 ns/GB
send_cpus_used = 34.5 % cpus
recv_cpus_used = 38 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3898224 tcp_bw
tcp_bw:
bw = 3214085688 bytes/sec
msg_rate = 824 /sec
msg_size = 3898224 bytes
send_cost = 118157924 ns/GB
recv_cost = 115118276 ns/GB
send_cpus_used = 38 % cpus
recv_cpus_used = 37 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3910368 tcp_bw
tcp_bw:
bw = 3231919152 bytes/sec
msg_rate = 826 /sec
msg_size = 3910368 bytes
send_cost = 58788599 ns/GB
recv_cost = 69618076 ns/GB
send_cpus_used = 19 % cpus
recv_cpus_used = 22.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3922512 tcp_bw
tcp_bw:
bw = 3222343608 bytes/sec
msg_rate = 822 /sec
msg_size = 3922512 bytes
send_cost = 72928287 ns/GB
recv_cost = 71376623 ns/GB
send_cpus_used = 23.5 % cpus
recv_cpus_used = 23 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3934656 tcp_bw
tcp_bw:
bw = 3226417920 bytes/sec
msg_rate = 820 /sec
msg_size = 3934656 bytes
send_cost = 63537955 ns/GB
recv_cost = 71286489 ns/GB
send_cpus_used = 20.5 % cpus
recv_cpus_used = 23 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3946800 tcp_bw
tcp_bw:
bw = 3194748060 bytes/sec
msg_rate = 814 /sec
msg_size = 3946800 bytes
send_cost = 115168101 ns/GB
recv_cost = 124582580 ns/GB
send_cpus_used = 37 % cpus
recv_cpus_used = 39.8 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3958944 tcp_bw
tcp_bw:
bw = 3186949920 bytes/sec
msg_rate = 805 /sec
msg_size = 3958944 bytes
send_cost = 142681119 ns/GB
recv_cost = 134925248 ns/GB
send_cpus_used = 45.5 % cpus
recv_cpus_used = 43 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3971088 tcp_bw
tcp_bw:
bw = 3208639104 bytes/sec
msg_rate = 808 /sec
msg_size = 3971088 bytes
send_cost = 112197104 ns/GB
recv_cost = 119988562 ns/GB
send_cpus_used = 36 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3983232 tcp_bw
tcp_bw:
bw = 3236376000 bytes/sec
msg_rate = 812 /sec
msg_size = 3983232 bytes
send_cost = 94241215 ns/GB
recv_cost = 106600716 ns/GB
send_cpus_used = 30.5 % cpus
recv_cpus_used = 34.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 3995376 tcp_bw
tcp_bw:
bw = 3210284616 bytes/sec
msg_rate = 804 /sec
msg_size = 3995376 bytes
send_cost = 112139594 ns/GB
recv_cost = 132387019 ns/GB
send_cpus_used = 36 % cpus
recv_cpus_used = 42.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4007520 tcp_bw
tcp_bw:
bw = 3234068640 bytes/sec
msg_rate = 807 /sec
msg_size = 4007520 bytes
send_cost = 88124288 ns/GB
recv_cost = 91216365 ns/GB
send_cpus_used = 28.5 % cpus
recv_cpus_used = 29.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4019664 tcp_bw
tcp_bw:
bw = 3211731534 bytes/sec
msg_rate = 803 /sec
msg_size = 4019664 bytes
send_cost = 83648563 ns/GB
recv_cost = 97589985 ns/GB
send_cpus_used = 27 % cpus
recv_cpus_used = 31.3 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4031808 tcp_bw
tcp_bw:
bw = 3205287360 bytes/sec
msg_rate = 795 /sec
msg_size = 4031808 bytes
send_cost = 101394961 ns/GB
recv_cost = 131033489 ns/GB
send_cpus_used = 32.5 % cpus
recv_cpus_used = 42 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4043952 tcp_bw
tcp_bw:
bw = 3212919864 bytes/sec
msg_rate = 794 /sec
msg_size = 4043952 bytes
send_cost = 126053564 ns/GB
recv_cost = 133834651 ns/GB
send_cpus_used = 40.5 % cpus
recv_cpus_used = 43 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4056096 tcp_bw
tcp_bw:
bw = 3238792656 bytes/sec
msg_rate = 798 /sec
msg_size = 4056096 bytes
send_cost = 80276825 ns/GB
recv_cost = 149747164 ns/GB
send_cpus_used = 26 % cpus
recv_cpus_used = 48.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4068240 tcp_bw
tcp_bw:
bw = 3215943720 bytes/sec
msg_rate = 790 /sec
msg_size = 4068240 bytes
send_cost = 113497014 ns/GB
recv_cost = 113497014 ns/GB
send_cpus_used = 36.5 % cpus
recv_cpus_used = 36.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4080384 tcp_bw
tcp_bw:
bw = 3082730112 bytes/sec
msg_rate = 756 /sec
msg_size = 4080384 bytes
send_cost = 107047974 ns/GB
recv_cost = 105426027 ns/GB
send_cpus_used = 33 % cpus
recv_cpus_used = 32.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4092528 tcp_bw
tcp_bw:
bw = 3222865800 bytes/sec
msg_rate = 788 /sec
msg_size = 4092528 bytes
send_cost = 121010309 ns/GB
recv_cost = 117907483 ns/GB
send_cpus_used = 39 % cpus
recv_cpus_used = 38 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4104672 tcp_bw
tcp_bw:
bw = 3213958176 bytes/sec
msg_rate = 783 /sec
msg_size = 4104672 bytes
send_cost = 99565699 ns/GB
recv_cost = 110455697 ns/GB
send_cpus_used = 32 % cpus
recv_cpus_used = 35.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4116816 tcp_bw
tcp_bw:
bw = 3217291704 bytes/sec
msg_rate = 782 /sec
msg_size = 4116816 bytes
send_cost = 111895360 ns/GB
recv_cost = 116557662 ns/GB
send_cpus_used = 36 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4128960 tcp_bw
tcp_bw:
bw = 3138009600 bytes/sec
msg_rate = 760 /sec
msg_size = 4128960 bytes
send_cost = 111535667 ns/GB
recv_cost = 132249433 ns/GB
send_cpus_used = 35 % cpus
recv_cpus_used = 41.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4141104 tcp_bw
tcp_bw:
bw = 3199002840 bytes/sec
msg_rate = 772 /sec
msg_size = 4141104 bytes
send_cost = 103157149 ns/GB
recv_cost = 117224028 ns/GB
send_cpus_used = 33 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4153248 tcp_bw
tcp_bw:
bw = 2552170896 bytes/sec
msg_rate = 614 /sec
msg_size = 4153248 bytes
send_cost = 43100562 ns/GB
recv_cost = 64650846 ns/GB
send_cpus_used = 11 % cpus
recv_cpus_used = 16.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4165392 tcp_bw
tcp_bw:
bw = 2159755752 bytes/sec
msg_rate = 518 /sec
msg_size = 4165392 bytes
send_cost = 43986455 ns/GB
recv_cost = 141219676 ns/GB
send_cpus_used = 9.5 % cpus
recv_cpus_used = 30.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4177536 tcp_bw
tcp_bw:
bw = 2548296960 bytes/sec
msg_rate = 610 /sec
msg_size = 4177536 bytes
send_cost = 52976559 ns/GB
recv_cost = 68673314 ns/GB
send_cpus_used = 13.5 % cpus
recv_cpus_used = 17.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4189680 tcp_bw
tcp_bw:
bw = 2480290560 bytes/sec
msg_rate = 592 /sec
msg_size = 4189680 bytes
send_cost = 46365536 ns/GB
recv_cost = 66524467 ns/GB
send_cpus_used = 11.5 % cpus
recv_cpus_used = 16.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4201824 tcp_bw
tcp_bw:
bw = 2918166768 bytes/sec
msg_rate = 694 /sec
msg_size = 4201824 bytes
send_cost = 95950651 ns/GB
recv_cost = 140499166 ns/GB
send_cpus_used = 28 % cpus
recv_cpus_used = 41 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4213968 tcp_bw
tcp_bw:
bw = 3156262032 bytes/sec
msg_rate = 749 /sec
msg_size = 4213968 bytes
send_cost = 125148041 ns/GB
recv_cost = 120395579 ns/GB
send_cpus_used = 39.5 % cpus
recv_cpus_used = 38 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4226112 tcp_bw
tcp_bw:
bw = 3197053728 bytes/sec
msg_rate = 756 /sec
msg_size = 4226112 bytes
send_cost = 121987310 ns/GB
recv_cost = 117295495 ns/GB
send_cpus_used = 39 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4238256 tcp_bw
tcp_bw:
bw = 3210478920 bytes/sec
msg_rate = 758 /sec
msg_size = 4238256 bytes
send_cost = 98116202 ns/GB
recv_cost = 236724803 ns/GB
send_cpus_used = 31.5 % cpus
recv_cpus_used = 76 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4250400 tcp_bw
tcp_bw:
bw = 3192050400 bytes/sec
msg_rate = 751 /sec
msg_size = 4250400 bytes
send_cost = 136276045 ns/GB
recv_cost = 213029220 ns/GB
send_cpus_used = 43.5 % cpus
recv_cpus_used = 68 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4262544 tcp_bw
tcp_bw:
bw = 3081819312 bytes/sec
msg_rate = 723 /sec
msg_size = 4262544 bytes
send_cost = 105457185 ns/GB
recv_cost = 181710849 ns/GB
send_cpus_used = 32.5 % cpus
recv_cpus_used = 56 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4274688 tcp_bw
tcp_bw:
bw = 3212428032 bytes/sec
msg_rate = 752 /sec
msg_size = 4274688 bytes
send_cost = 93387310 ns/GB
recv_cost = 188331073 ns/GB
send_cpus_used = 30 % cpus
recv_cpus_used = 60.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4286832 tcp_bw
tcp_bw:
bw = 3191546424 bytes/sec
msg_rate = 744 /sec
msg_size = 4286832 bytes
send_cost = 106459932 ns/GB
recv_cost = 117497899 ns/GB
send_cpus_used = 34 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4298976 tcp_bw
tcp_bw:
bw = 3209185584 bytes/sec
msg_rate = 746 /sec
msg_size = 4298976 bytes
send_cost = 88807577 ns/GB
recv_cost = 102829832 ns/GB
send_cpus_used = 28.5 % cpus
recv_cpus_used = 33 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4311120 tcp_bw
tcp_bw:
bw = 3030717360 bytes/sec
msg_rate = 703 /sec
msg_size = 4311120 bytes
send_cost = 117133981 ns/GB
recv_cost = 140230830 ns/GB
send_cpus_used = 35.5 % cpus
recv_cpus_used = 42.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4323264 tcp_bw
tcp_bw:
bw = 2304299712 bytes/sec
msg_rate = 533 /sec
msg_size = 4323264 bytes
send_cost = 71605272 ns/GB
recv_cost = 164909102 ns/GB
send_cpus_used = 16.5 % cpus
recv_cpus_used = 38 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4335408 tcp_bw
tcp_bw:
bw = 3208201920 bytes/sec
msg_rate = 740 /sec
msg_size = 4335408 bytes
send_cost = 98185839 ns/GB
recv_cost = 120004912 ns/GB
send_cpus_used = 31.5 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4347552 tcp_bw
tcp_bw:
bw = 3223709808 bytes/sec
msg_rate = 742 /sec
msg_size = 4347552 bytes
send_cost = 99264516 ns/GB
recv_cost = 110121571 ns/GB
send_cpus_used = 32 % cpus
recv_cpus_used = 35.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4359696 tcp_bw
tcp_bw:
bw = 3221815344 bytes/sec
msg_rate = 739 /sec
msg_size = 4359696 bytes
send_cost = 69836403 ns/GB
recv_cost = 119497845 ns/GB
send_cpus_used = 22.5 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4371840 tcp_bw
tcp_bw:
bw = 3230789760 bytes/sec
msg_rate = 735 /sec
msg_size = 4371840 bytes
send_cost = 109880251 ns/GB
recv_cost = 122261131 ns/GB
send_cpus_used = 35.3 % cpus
recv_cpus_used = 39.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4383984 tcp_bw
tcp_bw:
bw = 3213460272 bytes/sec
msg_rate = 733 /sec
msg_size = 4383984 bytes
send_cost = 99581126 ns/GB
recv_cost = 129144273 ns/GB
send_cpus_used = 32 % cpus
recv_cpus_used = 41.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4396128 tcp_bw
tcp_bw:
bw = 3213569568 bytes/sec
msg_rate = 731 /sec
msg_size = 4396128 bytes
send_cost = 94910037 ns/GB
recv_cost = 147810708 ns/GB
send_cpus_used = 30.5 % cpus
recv_cpus_used = 47.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4408272 tcp_bw
tcp_bw:
bw = 3220242696 bytes/sec
msg_rate = 730 /sec
msg_size = 4408272 bytes
send_cost = 119556203 ns/GB
recv_cost = 124214242 ns/GB
send_cpus_used = 38.5 % cpus
recv_cpus_used = 40 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4420416 tcp_bw
tcp_bw:
bw = 2977150176 bytes/sec
msg_rate = 674 /sec
msg_size = 4420416 bytes
send_cost = 115882632 ns/GB
recv_cost = 107485338 ns/GB
send_cpus_used = 34.5 % cpus
recv_cpus_used = 32 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4432560 tcp_bw
tcp_bw:
bw = 3162631560 bytes/sec
msg_rate = 714 /sec
msg_size = 4432560 bytes
send_cost = 67933757 ns/GB
recv_cost = 77467135 ns/GB
send_cpus_used = 21.5 % cpus
recv_cpus_used = 24.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4444704 tcp_bw
tcp_bw:
bw = 3224632752 bytes/sec
msg_rate = 726 /sec
msg_size = 4444704 bytes
send_cost = 62022568 ns/GB
recv_cost = 86831594 ns/GB
send_cpus_used = 20 % cpus
recv_cpus_used = 28 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4456848 tcp_bw
tcp_bw:
bw = 3215615832 bytes/sec
msg_rate = 722 /sec
msg_size = 4456848 bytes
send_cost = 99514373 ns/GB
recv_cost = 80855427 ns/GB
send_cpus_used = 32 % cpus
recv_cpus_used = 26 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4468992 tcp_bw
tcp_bw:
bw = 3222143232 bytes/sec
msg_rate = 721 /sec
msg_size = 4468992 bytes
send_cost = 107071590 ns/GB
recv_cost = 105519829 ns/GB
send_cpus_used = 34.5 % cpus
recv_cpus_used = 34 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4481136 tcp_bw
tcp_bw:
bw = 3212974512 bytes/sec
msg_rate = 717 /sec
msg_size = 4481136 bytes
send_cost = 94927615 ns/GB
recv_cost = 141613328 ns/GB
send_cpus_used = 30.5 % cpus
recv_cpus_used = 45.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4493280 tcp_bw
tcp_bw:
bw = 3214941840 bytes/sec
msg_rate = 716 /sec
msg_size = 4493280 bytes
send_cost = 110421901 ns/GB
recv_cost = 160189519 ns/GB
send_cpus_used = 35.5 % cpus
recv_cpus_used = 51.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4505424 tcp_bw
tcp_bw:
bw = 3014128656 bytes/sec
msg_rate = 669 /sec
msg_size = 4505424 bytes
send_cost = 116119792 ns/GB
recv_cost = 89578131 ns/GB
send_cpus_used = 35 % cpus
recv_cpus_used = 27 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4517568 tcp_bw
tcp_bw:
bw = 3236837472 bytes/sec
msg_rate = 713 /sec
msg_size = 4517568 bytes
send_cost = 94227779 ns/GB
recv_cost = 242520680 ns/GB
send_cpus_used = 30.3 % cpus
recv_cpus_used = 78.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4529712 tcp_bw
tcp_bw:
bw = 3222890088 bytes/sec
msg_rate = 712 /sec
msg_size = 4529712 bytes
send_cost = 80672931 ns/GB
recv_cost = 105495377 ns/GB
send_cpus_used = 26 % cpus
recv_cpus_used = 34 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4541856 tcp_bw
tcp_bw:
bw = 3206550336 bytes/sec
msg_rate = 706 /sec
msg_size = 4541856 bytes
send_cost = 73287482 ns/GB
recv_cost = 88880562 ns/GB
send_cpus_used = 23.5 % cpus
recv_cpus_used = 28.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4554000 tcp_bw
tcp_bw:
bw = 3190077000 bytes/sec
msg_rate = 700 /sec
msg_size = 4554000 bytes
send_cost = 117552021 ns/GB
recv_cost = 150466584 ns/GB
send_cpus_used = 37.5 % cpus
recv_cpus_used = 48 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4566144 tcp_bw
tcp_bw:
bw = 3239679168 bytes/sec
msg_rate = 710 /sec
msg_size = 4566144 bytes
send_cost = 112586138 ns/GB
recv_cost = 125012379 ns/GB
send_cpus_used = 36.5 % cpus
recv_cpus_used = 40.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4578288 tcp_bw
tcp_bw:
bw = 3218536464 bytes/sec
msg_rate = 703 /sec
msg_size = 4578288 bytes
send_cost = 83889064 ns/GB
recv_cost = 99424069 ns/GB
send_cpus_used = 27 % cpus
recv_cpus_used = 32 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4590432 tcp_bw
tcp_bw:
bw = 3188055024 bytes/sec
msg_rate = 694 /sec
msg_size = 4590432 bytes
send_cost = 103436923 ns/GB
recv_cost = 159972142 ns/GB
send_cpus_used = 33 % cpus
recv_cpus_used = 51 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4602576 tcp_bw
tcp_bw:
bw = 3184982592 bytes/sec
msg_rate = 692 /sec
msg_size = 4602576 bytes
send_cost = 128729117 ns/GB
recv_cost = 199373143 ns/GB
send_cpus_used = 41 % cpus
recv_cpus_used = 63.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4614720 tcp_bw
tcp_bw:
bw = 3232611360 bytes/sec
msg_rate = 700 /sec
msg_size = 4614720 bytes
send_cost = 108271597 ns/GB
recv_cost = 120645491 ns/GB
send_cpus_used = 35 % cpus
recv_cpus_used = 39 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4626864 tcp_bw
tcp_bw:
bw = 3197163024 bytes/sec
msg_rate = 691 /sec
msg_size = 4626864 bytes
send_cost = 96960962 ns/GB
recv_cost = 129802575 ns/GB
send_cpus_used = 31 % cpus
recv_cpus_used = 41.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4639008 tcp_bw
tcp_bw:
bw = 3224110560 bytes/sec
msg_rate = 695 /sec
msg_size = 4639008 bytes
send_cost = 89882621 ns/GB
recv_cost = 105455442 ns/GB
send_cpus_used = 29 % cpus
recv_cpus_used = 34 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4651152 tcp_bw
tcp_bw:
bw = 3202318152 bytes/sec
msg_rate = 688 /sec
msg_size = 4651152 bytes
send_cost = 96804873 ns/GB
recv_cost = 98366241 ns/GB
send_cpus_used = 31 % cpus
recv_cpus_used = 31.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4663296 tcp_bw
tcp_bw:
bw = 3215342592 bytes/sec
msg_rate = 690 /sec
msg_size = 4663296 bytes
send_cost = 115073276 ns/GB
recv_cost = 180385127 ns/GB
send_cpus_used = 37 % cpus
recv_cpus_used = 58 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4675440 tcp_bw
tcp_bw:
bw = 2510711280 bytes/sec
msg_rate = 537 /sec
msg_size = 4675440 bytes
send_cost = 45803754 ns/GB
recv_cost = 191180879 ns/GB
send_cpus_used = 11.5 % cpus
recv_cpus_used = 48 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4687584 tcp_bw
tcp_bw:
bw = 2543014320 bytes/sec
msg_rate = 542 /sec
msg_size = 4687584 bytes
send_cost = 45221925 ns/GB
recv_cost = 163192157 ns/GB
send_cpus_used = 11.5 % cpus
recv_cpus_used = 41.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4699728 tcp_bw
tcp_bw:
bw = 2798688024 bytes/sec
msg_rate = 596 /sec
msg_size = 4699728 bytes
send_cost = 80394811 ns/GB
recv_cost = 94687219 ns/GB
send_cpus_used = 22.5 % cpus
recv_cpus_used = 26.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4711872 tcp_bw
tcp_bw:
bw = 2490224352 bytes/sec
msg_rate = 528 /sec
msg_size = 4711872 bytes
send_cost = 62243388 ns/GB
recv_cost = 60235539 ns/GB
send_cpus_used = 15.5 % cpus
recv_cpus_used = 15 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4724016 tcp_bw
tcp_bw:
bw = 2489556432 bytes/sec
msg_rate = 527 /sec
msg_size = 4724016 bytes
send_cost = 152492950 ns/GB
recv_cost = 90377543 ns/GB
send_cpus_used = 38 % cpus
recv_cpus_used = 22.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4736160 tcp_bw
tcp_bw:
bw = 3199276080 bytes/sec
msg_rate = 676 /sec
msg_size = 4736160 bytes
send_cost = 123465434 ns/GB
recv_cost = 139093964 ns/GB
send_cpus_used = 39.5 % cpus
recv_cpus_used = 44.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4748304 tcp_bw
tcp_bw:
bw = 3178989528 bytes/sec
msg_rate = 670 /sec
msg_size = 4748304 bytes
send_cost = 114730677 ns/GB
recv_cost = 121107662 ns/GB
send_cpus_used = 36.5 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4760448 tcp_bw
tcp_bw:
bw = 3218062848 bytes/sec
msg_rate = 676 /sec
msg_size = 4760448 bytes
send_cost = 110314809 ns/GB
recv_cost = 209753521 ns/GB
send_cpus_used = 35.5 % cpus
recv_cpus_used = 67.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4772592 tcp_bw
tcp_bw:
bw = 2753785584 bytes/sec
msg_rate = 577 /sec
msg_size = 4772592 bytes
send_cost = 121650723 ns/GB
recv_cost = 157964369 ns/GB
send_cpus_used = 33.5 % cpus
recv_cpus_used = 43.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4784736 tcp_bw
tcp_bw:
bw = 3212950224 bytes/sec
msg_rate = 672 /sec
msg_size = 4784736 bytes
send_cost = 116715160 ns/GB
recv_cost = 126052373 ns/GB
send_cpus_used = 37.5 % cpus
recv_cpus_used = 40.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4796880 tcp_bw
tcp_bw:
bw = 2537549520 bytes/sec
msg_rate = 529 /sec
msg_size = 4796880 bytes
send_cost = 100490648 ns/GB
recv_cost = 171425227 ns/GB
send_cpus_used = 25.5 % cpus
recv_cpus_used = 43.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4809024 tcp_bw
tcp_bw:
bw = 3222046080 bytes/sec
msg_rate = 670 /sec
msg_size = 4809024 bytes
send_cost = 103971203 ns/GB
recv_cost = 116385673 ns/GB
send_cpus_used = 33.5 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4821168 tcp_bw
tcp_bw:
bw = 3215719056 bytes/sec
msg_rate = 667 /sec
msg_size = 4821168 bytes
send_cost = 83962562 ns/GB
recv_cost = 93291736 ns/GB
send_cpus_used = 27 % cpus
recv_cpus_used = 30 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4833312 tcp_bw
tcp_bw:
bw = 3211735824 bytes/sec
msg_rate = 664 /sec
msg_size = 4833312 bytes
send_cost = 93407437 ns/GB
recv_cost = 99634593 ns/GB
send_cpus_used = 30 % cpus
recv_cpus_used = 32 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4845456 tcp_bw
tcp_bw:
bw = 3227073696 bytes/sec
msg_rate = 666 /sec
msg_size = 4845456 bytes
send_cost = 75920177 ns/GB
recv_cost = 86765915 ns/GB
send_cpus_used = 24.5 % cpus
recv_cpus_used = 28 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4857600 tcp_bw
tcp_bw:
bw = 3227875200 bytes/sec
msg_rate = 664 /sec
msg_size = 4857600 bytes
send_cost = 100685426 ns/GB
recv_cost = 117724500 ns/GB
send_cpus_used = 32.5 % cpus
recv_cpus_used = 38 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4869744 tcp_bw
tcp_bw:
bw = 3160463856 bytes/sec
msg_rate = 649 /sec
msg_size = 4869744 bytes
send_cost = 104415057 ns/GB
recv_cost = 121817558 ns/GB
send_cpus_used = 33 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4881888 tcp_bw
tcp_bw:
bw = 3187872864 bytes/sec
msg_rate = 653 /sec
msg_size = 4881888 bytes
send_cost = 67443092 ns/GB
recv_cost = 120770183 ns/GB
send_cpus_used = 21.5 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4894032 tcp_bw
tcp_bw:
bw = 3222720072 bytes/sec
msg_rate = 658 /sec
msg_size = 4894032 bytes
send_cost = 99295001 ns/GB
recv_cost = 108603908 ns/GB
send_cpus_used = 32 % cpus
recv_cpus_used = 35 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4906176 tcp_bw
tcp_bw:
bw = 3220904544 bytes/sec
msg_rate = 656 /sec
msg_size = 4906176 bytes
send_cost = 102455695 ns/GB
recv_cost = 116426921 ns/GB
send_cpus_used = 33 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4918320 tcp_bw
tcp_bw:
bw = 3216581280 bytes/sec
msg_rate = 654 /sec
msg_size = 4918320 bytes
send_cost = 93266728 ns/GB
recv_cost = 101038948 ns/GB
send_cpus_used = 30 % cpus
recv_cpus_used = 32.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4930464 tcp_bw
tcp_bw:
bw = 3226988688 bytes/sec
msg_rate = 654 /sec
msg_size = 4930464 bytes
send_cost = 106829206 ns/GB
recv_cost = 119306272 ns/GB
send_cpus_used = 34.5 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4942608 tcp_bw
tcp_bw:
bw = 3205281288 bytes/sec
msg_rate = 648 /sec
msg_size = 4942608 bytes
send_cost = 104434491 ns/GB
recv_cost = 124794041 ns/GB
send_cpus_used = 33.5 % cpus
recv_cpus_used = 40 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4954752 tcp_bw
tcp_bw:
bw = 3230498304 bytes/sec
msg_rate = 652 /sec
msg_size = 4954752 bytes
send_cost = 71196448 ns/GB
recv_cost = 77387442 ns/GB
send_cpus_used = 23 % cpus
recv_cpus_used = 25 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4966896 tcp_bw
tcp_bw:
bw = 3230965848 bytes/sec
msg_rate = 650 /sec
msg_size = 4966896 bytes
send_cost = 61900996 ns/GB
recv_cost = 80471290 ns/GB
send_cpus_used = 20 % cpus
recv_cpus_used = 26 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4979040 tcp_bw
tcp_bw:
bw = 3199033200 bytes/sec
msg_rate = 642 /sec
msg_size = 4979040 bytes
send_cost = 59392943 ns/GB
recv_cost = 81274552 ns/GB
send_cpus_used = 19 % cpus
recv_cpus_used = 26 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 4991184 tcp_bw
tcp_bw:
bw = 3209331312 bytes/sec
msg_rate = 643 /sec
msg_size = 4991184 bytes
send_cost = 99709242 ns/GB
recv_cost = 110614940 ns/GB
send_cpus_used = 32 % cpus
recv_cpus_used = 35.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5003328 tcp_bw
tcp_bw:
bw = 3212136576 bytes/sec
msg_rate = 642 /sec
msg_size = 5003328 bytes
send_cost = 121414509 ns/GB
recv_cost = 107405146 ns/GB
send_cpus_used = 39 % cpus
recv_cpus_used = 34.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5015472 tcp_bw
tcp_bw:
bw = 3207394344 bytes/sec
msg_rate = 640 /sec
msg_size = 5015472 bytes
send_cost = 115358439 ns/GB
recv_cost = 106005052 ns/GB
send_cpus_used = 37 % cpus
recv_cpus_used = 34 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5027616 tcp_bw
tcp_bw:
bw = 3215160432 bytes/sec
msg_rate = 640 /sec
msg_size = 5027616 bytes
send_cost = 97973337 ns/GB
recv_cost = 104193870 ns/GB
send_cpus_used = 31.5 % cpus
recv_cpus_used = 33.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5039760 tcp_bw
tcp_bw:
bw = 3192687960 bytes/sec
msg_rate = 634 /sec
msg_size = 5039760 bytes
send_cost = 92398628 ns/GB
recv_cost = 150343534 ns/GB
send_cpus_used = 29.5 % cpus
recv_cpus_used = 48 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5051904 tcp_bw
tcp_bw:
bw = 3235744512 bytes/sec
msg_rate = 640 /sec
msg_size = 5051904 bytes
send_cost = 84988170 ns/GB
recv_cost = 97350083 ns/GB
send_cpus_used = 27.5 % cpus
recv_cpus_used = 31.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5064048 tcp_bw
tcp_bw:
bw = 3200478336 bytes/sec
msg_rate = 632 /sec
msg_size = 5064048 bytes
send_cost = 70301989 ns/GB
recv_cost = 96860522 ns/GB
send_cpus_used = 22.5 % cpus
recv_cpus_used = 31 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5076192 tcp_bw
tcp_bw:
bw = 3220843824 bytes/sec
msg_rate = 634 /sec
msg_size = 5076192 bytes
send_cost = 97800457 ns/GB
recv_cost = 116429116 ns/GB
send_cpus_used = 31.5 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5088336 tcp_bw
tcp_bw:
bw = 3195475008 bytes/sec
msg_rate = 628 /sec
msg_size = 5088336 bytes
send_cost = 109529880 ns/GB
recv_cost = 126741721 ns/GB
send_cpus_used = 35 % cpus
recv_cpus_used = 40.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5100480 tcp_bw
tcp_bw:
bw = 3243905280 bytes/sec
msg_rate = 636 /sec
msg_size = 5100480 bytes
send_cost = 80087341 ns/GB
recv_cost = 107894641 ns/GB
send_cpus_used = 26 % cpus
recv_cpus_used = 35 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5112624 tcp_bw
tcp_bw:
bw = 3180052128 bytes/sec
msg_rate = 622 /sec
msg_size = 5112624 bytes
send_cost = 110061087 ns/GB
recv_cost = 116350295 ns/GB
send_cpus_used = 35 % cpus
recv_cpus_used = 37 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5124768 tcp_bw
tcp_bw:
bw = 3031300272 bytes/sec
msg_rate = 592 /sec
msg_size = 5124768 bytes
send_cost = 107214713 ns/GB
recv_cost = 97317969 ns/GB
send_cpus_used = 32.5 % cpus
recv_cpus_used = 29.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5136912 tcp_bw
tcp_bw:
bw = 3202864632 bytes/sec
msg_rate = 624 /sec
msg_size = 5136912 bytes
send_cost = 95227255 ns/GB
recv_cost = 101471659 ns/GB
send_cpus_used = 30.5 % cpus
recv_cpus_used = 32.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5149056 tcp_bw
tcp_bw:
bw = 3055964736 bytes/sec
msg_rate = 594 /sec
msg_size = 5149056 bytes
send_cost = 119438554 ns/GB
recv_cost = 109621687 ns/GB
send_cpus_used = 36.5 % cpus
recv_cpus_used = 33.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5161200 tcp_bw
tcp_bw:
bw = 3099300600 bytes/sec
msg_rate = 600 /sec
msg_size = 5161200 bytes
send_cost = 104775124 ns/GB
recv_cost = 83889891 ns/GB
send_cpus_used = 32.5 % cpus
recv_cpus_used = 26 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5173344 tcp_bw
tcp_bw:
bw = 3212646624 bytes/sec
msg_rate = 621 /sec
msg_size = 5173344 bytes
send_cost = 98049999 ns/GB
recv_cost = 118282538 ns/GB
send_cpus_used = 31.5 % cpus
recv_cpus_used = 38 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5185488 tcp_bw
tcp_bw:
bw = 3139812984 bytes/sec
msg_rate = 606 /sec
msg_size = 5185488 bytes
send_cost = 111471605 ns/GB
recv_cost = 113064055 ns/GB
send_cpus_used = 35 % cpus
recv_cpus_used = 35.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5197632 tcp_bw
tcp_bw:
bw = 2385713088 bytes/sec
msg_rate = 459 /sec
msg_size = 5197632 bytes
send_cost = 50299425 ns/GB
recv_cost = 213772558 ns/GB
send_cpus_used = 12 % cpus
recv_cpus_used = 51 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5209776 tcp_bw
tcp_bw:
bw = 2558000016 bytes/sec
msg_rate = 491 /sec
msg_size = 5209776 bytes
send_cost = 41047692 ns/GB
recv_cost = 136825642 ns/GB
send_cpus_used = 10.5 % cpus
recv_cpus_used = 35 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5221920 tcp_bw
tcp_bw:
bw = 2451691440 bytes/sec
msg_rate = 470 /sec
msg_size = 5221920 bytes
send_cost = 44866984 ns/GB
recv_cost = 85655148 ns/GB
send_cpus_used = 11 % cpus
recv_cpus_used = 21 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5234064 tcp_bw
tcp_bw:
bw = 2554223232 bytes/sec
msg_rate = 488 /sec
msg_size = 5234064 bytes
send_cost = 41108387 ns/GB
recv_cost = 62641352 ns/GB
send_cpus_used = 10.5 % cpus
recv_cpus_used = 16 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5246208 tcp_bw
tcp_bw:
bw = 3029685120 bytes/sec
msg_rate = 578 /sec
msg_size = 5246208 bytes
send_cost = 84167161 ns/GB
recv_cost = 105621535 ns/GB
send_cpus_used = 25.5 % cpus
recv_cpus_used = 32 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5258352 tcp_bw
tcp_bw:
bw = 3186561312 bytes/sec
msg_rate = 606 /sec
msg_size = 5258352 bytes
send_cost = 117584698 ns/GB
recv_cost = 127096253 ns/GB
send_cpus_used = 37.5 % cpus
recv_cpus_used = 40.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5270496 tcp_bw
tcp_bw:
bw = 1533714336 bytes/sec
msg_rate = 291 /sec
msg_size = 5270496 bytes
send_cost = 61941130 ns/GB
recv_cost = 371646779 ns/GB
send_cpus_used = 9.5 % cpus
recv_cpus_used = 57 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5282640 tcp_bw
tcp_bw:
bw = 3124681560 bytes/sec
msg_rate = 592 /sec
msg_size = 5282640 bytes
send_cost = 460846979 ns/GB
recv_cost = 83208476 ns/GB
send_cpus_used = 144 % cpus
recv_cpus_used = 26 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5294784 tcp_bw
tcp_bw:
bw = 3052442976 bytes/sec
msg_rate = 576 /sec
msg_size = 5294784 bytes
send_cost = 278465488 ns/GB
recv_cost = 95005867 ns/GB
send_cpus_used = 85 % cpus
recv_cpus_used = 29 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5306928 tcp_bw
tcp_bw:
bw = 3192117192 bytes/sec
msg_rate = 602 /sec
msg_size = 5306928 bytes
send_cost = 458943060 ns/GB
recv_cost = 119043247 ns/GB
send_cpus_used = 146 % cpus
recv_cpus_used = 38 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5319072 tcp_bw
tcp_bw:
bw = 3111657120 bytes/sec
msg_rate = 585 /sec
msg_size = 5319072 bytes
send_cost = 449921030 ns/GB
recv_cost = 109266539 ns/GB
send_cpus_used = 140 % cpus
recv_cpus_used = 34 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5331216 tcp_bw
tcp_bw:
bw = 3217388856 bytes/sec
msg_rate = 604 /sec
msg_size = 5331216 bytes
send_cost = 116554143 ns/GB
recv_cost = 108783865 ns/GB
send_cpus_used = 37.5 % cpus
recv_cpus_used = 35 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5343360 tcp_bw
tcp_bw:
bw = 3240747840 bytes/sec
msg_rate = 606 /sec
msg_size = 5343360 bytes
send_cost = 81771245 ns/GB
recv_cost = 104914057 ns/GB
send_cpus_used = 26.5 % cpus
recv_cpus_used = 34 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5355504 tcp_bw
tcp_bw:
bw = 3132969840 bytes/sec
msg_rate = 585 /sec
msg_size = 5355504 bytes
send_cost = 95755793 ns/GB
recv_cost = 138845895 ns/GB
send_cpus_used = 30 % cpus
recv_cpus_used = 43.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5367648 tcp_bw
tcp_bw:
bw = 3228640272 bytes/sec
msg_rate = 602 /sec
msg_size = 5367648 bytes
send_cost = 77431977 ns/GB
recv_cost = 170350354 ns/GB
send_cpus_used = 25 % cpus
recv_cpus_used = 55 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5379792 tcp_bw
tcp_bw:
bw = 3217115616 bytes/sec
msg_rate = 598 /sec
msg_size = 5379792 bytes
send_cost = 104130547 ns/GB
recv_cost = 119672414 ns/GB
send_cpus_used = 33.5 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5391936 tcp_bw
tcp_bw:
bw = 3232465632 bytes/sec
msg_rate = 600 /sec
msg_size = 5391936 bytes
send_cost = 105182867 ns/GB
recv_cost = 111370098 ns/GB
send_cpus_used = 34 % cpus
recv_cpus_used = 36 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5404080 tcp_bw
tcp_bw:
bw = 3164088840 bytes/sec
msg_rate = 586 /sec
msg_size = 5404080 bytes
send_cost = 79011688 ns/GB
recv_cost = 90073323 ns/GB
send_cpus_used = 25 % cpus
recv_cpus_used = 28.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5416224 tcp_bw
tcp_bw:
bw = 3225361392 bytes/sec
msg_rate = 596 /sec
msg_size = 5416224 bytes
send_cost = 71309840 ns/GB
recv_cost = 80611119 ns/GB
send_cpus_used = 23 % cpus
recv_cpus_used = 26 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5428368 tcp_bw
tcp_bw:
bw = 3216308040 bytes/sec
msg_rate = 592 /sec
msg_size = 5428368 bytes
send_cost = 113484158 ns/GB
recv_cost = 132139088 ns/GB
send_cpus_used = 36.5 % cpus
recv_cpus_used = 42.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5440512 tcp_bw
tcp_bw:
bw = 3199021056 bytes/sec
msg_rate = 588 /sec
msg_size = 5440512 bytes
send_cost = 117223361 ns/GB
recv_cost = 134416123 ns/GB
send_cpus_used = 37.5 % cpus
recv_cpus_used = 43 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5452656 tcp_bw
tcp_bw:
bw = 3225246024 bytes/sec
msg_rate = 592 /sec
msg_size = 5452656 bytes
send_cost = 97666967 ns/GB
recv_cost = 102317780 ns/GB
send_cpus_used = 31.5 % cpus
recv_cpus_used = 33 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5464800 tcp_bw
tcp_bw:
bw = 3224232000 bytes/sec
msg_rate = 590 /sec
msg_size = 5464800 bytes
send_cost = 105451470 ns/GB
recv_cost = 116306767 ns/GB
send_cpus_used = 34 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5476944 tcp_bw
tcp_bw:
bw = 3214966128 bytes/sec
msg_rate = 587 /sec
msg_size = 5476944 bytes
send_cost = 105755392 ns/GB
recv_cost = 124418109 ns/GB
send_cpus_used = 34 % cpus
recv_cpus_used = 40 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5489088 tcp_bw
tcp_bw:
bw = 3235817376 bytes/sec
msg_rate = 590 /sec
msg_size = 5489088 bytes
send_cost = 55627369 ns/GB
recv_cost = 78805435 ns/GB
send_cpus_used = 18 % cpus
recv_cpus_used = 25.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5501232 tcp_bw
tcp_bw:
bw = 3220971336 bytes/sec
msg_rate = 586 /sec
msg_size = 5501232 bytes
send_cost = 58988416 ns/GB
recv_cost = 80720989 ns/GB
send_cpus_used = 19 % cpus
recv_cpus_used = 26 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5513376 tcp_bw
tcp_bw:
bw = 3206028144 bytes/sec
msg_rate = 582 /sec
msg_size = 5513376 bytes
send_cost = 96692851 ns/GB
recv_cost = 116967158 ns/GB
send_cpus_used = 31 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5525520 tcp_bw
tcp_bw:
bw = 3215852640 bytes/sec
msg_rate = 582 /sec
msg_size = 5525520 bytes
send_cost = 100975093 ns/GB
recv_cost = 115055025 ns/GB
send_cpus_used = 32.5 % cpus
recv_cpus_used = 37 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5537664 tcp_bw
tcp_bw:
bw = 3228458112 bytes/sec
msg_rate = 583 /sec
msg_size = 5537664 bytes
send_cost = 116154519 ns/GB
recv_cost = 128544332 ns/GB
send_cpus_used = 37.5 % cpus
recv_cpus_used = 41.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5549808 tcp_bw
tcp_bw:
bw = 3224438448 bytes/sec
msg_rate = 581 /sec
msg_size = 5549808 bytes
send_cost = 91488795 ns/GB
recv_cost = 134907212 ns/GB
send_cpus_used = 29.5 % cpus
recv_cpus_used = 43.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5561952 tcp_bw
tcp_bw:
bw = 2850500400 bytes/sec
msg_rate = 512 /sec
msg_size = 5561952 bytes
send_cost = 122665783 ns/GB
recv_cost = 92966128 ns/GB
send_cpus_used = 35 % cpus
recv_cpus_used = 26.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5574096 tcp_bw
tcp_bw:
bw = 3221827488 bytes/sec
msg_rate = 578 /sec
msg_size = 5574096 bytes
send_cost = 113289743 ns/GB
recv_cost = 117945482 ns/GB
send_cpus_used = 36.5 % cpus
recv_cpus_used = 38 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5586240 tcp_bw
tcp_bw:
bw = 3156225600 bytes/sec
msg_rate = 565 /sec
msg_size = 5586240 bytes
send_cost = 85545219 ns/GB
recv_cost = 96634413 ns/GB
send_cpus_used = 27 % cpus
recv_cpus_used = 30.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5598384 tcp_bw
tcp_bw:
bw = 3132295848 bytes/sec
msg_rate = 560 /sec
msg_size = 5598384 bytes
send_cost = 125992994 ns/GB
recv_cost = 151645955 ns/GB
send_cpus_used = 39.5 % cpus
recv_cpus_used = 47.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5610528 tcp_bw
tcp_bw:
bw = 3209222016 bytes/sec
msg_rate = 572 /sec
msg_size = 5610528 bytes
send_cost = 109060698 ns/GB
recv_cost = 119966767 ns/GB
send_cpus_used = 35 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5622672 tcp_bw
tcp_bw:
bw = 3210545712 bytes/sec
msg_rate = 571 /sec
msg_size = 5622672 bytes
send_cost = 115245207 ns/GB
recv_cost = 123032047 ns/GB
send_cpus_used = 37 % cpus
recv_cpus_used = 39.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5634816 tcp_bw
tcp_bw:
bw = 3192123264 bytes/sec
msg_rate = 566 /sec
msg_size = 5634816 bytes
send_cost = 78317778 ns/GB
recv_cost = 87715911 ns/GB
send_cpus_used = 25 % cpus
recv_cpus_used = 28 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5646960 tcp_bw
tcp_bw:
bw = 2792421720 bytes/sec
msg_rate = 494 /sec
msg_size = 5646960 bytes
send_cost = 130710919 ns/GB
recv_cost = 96690270 ns/GB
send_cpus_used = 36.5 % cpus
recv_cpus_used = 27 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5659104 tcp_bw
tcp_bw:
bw = 3211541520 bytes/sec
msg_rate = 568 /sec
msg_size = 5659104 bytes
send_cost = 96441884 ns/GB
recv_cost = 101197505 ns/GB
send_cpus_used = 31 % cpus
recv_cpus_used = 32.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5671248 tcp_bw
tcp_bw:
bw = 3218433240 bytes/sec
msg_rate = 568 /sec
msg_size = 5671248 bytes
send_cost = 83891754 ns/GB
recv_cost = 94766610 ns/GB
send_cpus_used = 27 % cpus
recv_cpus_used = 30.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5683392 tcp_bw
tcp_bw:
bw = 2995147584 bytes/sec
msg_rate = 527 /sec
msg_size = 5683392 bytes
send_cost = 123533146 ns/GB
recv_cost = 125202512 ns/GB
send_cpus_used = 37 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5695536 tcp_bw
tcp_bw:
bw = 3217977840 bytes/sec
msg_rate = 565 /sec
msg_size = 5695536 bytes
send_cost = 83903626 ns/GB
recv_cost = 113425271 ns/GB
send_cpus_used = 27 % cpus
recv_cpus_used = 36.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5707680 tcp_bw
tcp_bw:
bw = 3099270240 bytes/sec
msg_rate = 543 /sec
msg_size = 5707680 bytes
send_cost = 96796984 ns/GB
recv_cost = 180687697 ns/GB
send_cpus_used = 30 % cpus
recv_cpus_used = 56 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5719824 tcp_bw
tcp_bw:
bw = 3074405400 bytes/sec
msg_rate = 538 /sec
msg_size = 5719824 bytes
send_cost = 74811215 ns/GB
recv_cost = 190280689 ns/GB
send_cpus_used = 23 % cpus
recv_cpus_used = 58.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5731968 tcp_bw
tcp_bw:
bw = 2530663872 bytes/sec
msg_rate = 442 /sec
msg_size = 5731968 bytes
send_cost = 53345688 ns/GB
recv_cost = 114594433 ns/GB
send_cpus_used = 13.5 % cpus
recv_cpus_used = 29 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5744112 tcp_bw
tcp_bw:
bw = 2521665168 bytes/sec
msg_rate = 439 /sec
msg_size = 5744112 bytes
send_cost = 67415771 ns/GB
recv_cost = 69398586 ns/GB
send_cpus_used = 17 % cpus
recv_cpus_used = 17.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5756256 tcp_bw
tcp_bw:
bw = 2547143280 bytes/sec
msg_rate = 442 /sec
msg_size = 5756256 bytes
send_cost = 51037567 ns/GB
recv_cost = 66741437 ns/GB
send_cpus_used = 13 % cpus
recv_cpus_used = 17 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5768400 tcp_bw
tcp_bw:
bw = 2561169600 bytes/sec
msg_rate = 444 /sec
msg_size = 5768400 bytes
send_cost = 134704082 ns/GB
recv_cost = 126895145 ns/GB
send_cpus_used = 34.5 % cpus
recv_cpus_used = 32.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5780544 tcp_bw
tcp_bw:
bw = 3176408928 bytes/sec
msg_rate = 550 /sec
msg_size = 5780544 bytes
send_cost = 116377850 ns/GB
recv_cost = 118057847 ns/GB
send_cpus_used = 37 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5792688 tcp_bw
tcp_bw:
bw = 2844209808 bytes/sec
msg_rate = 491 /sec
msg_size = 5792688 bytes
send_cost = 101961533 ns/GB
recv_cost = 147668426 ns/GB
send_cpus_used = 29 % cpus
recv_cpus_used = 42 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5804832 tcp_bw
tcp_bw:
bw = 3154926192 bytes/sec
msg_rate = 544 /sec
msg_size = 5804832 bytes
send_cost = 115692091 ns/GB
recv_cost = 118861735 ns/GB
send_cpus_used = 36.5 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5816976 tcp_bw
tcp_bw:
bw = 3213879240 bytes/sec
msg_rate = 552 /sec
msg_size = 5816976 bytes
send_cost = 98012394 ns/GB
recv_cost = 110458410 ns/GB
send_cpus_used = 31.5 % cpus
recv_cpus_used = 35.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5829120 tcp_bw
tcp_bw:
bw = 3168126720 bytes/sec
msg_rate = 544 /sec
msg_size = 5829120 bytes
send_cost = 121522914 ns/GB
recv_cost = 124679360 ns/GB
send_cpus_used = 38.5 % cpus
recv_cpus_used = 39.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5841264 tcp_bw
tcp_bw:
bw = 3180568248 bytes/sec
msg_rate = 544 /sec
msg_size = 5841264 bytes
send_cost = 105327093 ns/GB
recv_cost = 116331415 ns/GB
send_cpus_used = 33.5 % cpus
recv_cpus_used = 37 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5853408 tcp_bw
tcp_bw:
bw = 3168411893 bytes/sec
msg_rate = 544 /sec
msg_size = 5853408 bytes
send_cost = 102064720 ns/GB
recv_cost = 122477664 ns/GB
send_cpus_used = 32.5 % cpus
recv_cpus_used = 38.8 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5865552 tcp_bw
tcp_bw:
bw = 3211389720 bytes/sec
msg_rate = 548 /sec
msg_size = 5865552 bytes
send_cost = 84075754 ns/GB
recv_cost = 161923661 ns/GB
send_cpus_used = 27 % cpus
recv_cpus_used = 52 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5877696 tcp_bw
tcp_bw:
bw = 3220977408 bytes/sec
msg_rate = 548 /sec
msg_size = 5877696 bytes
send_cost = 117976610 ns/GB
recv_cost = 142813795 ns/GB
send_cpus_used = 38 % cpus
recv_cpus_used = 46 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5889840 tcp_bw
tcp_bw:
bw = 3224687400 bytes/sec
msg_rate = 548 /sec
msg_size = 5889840 bytes
send_cost = 89849141 ns/GB
recv_cost = 94582814 ns/GB
send_cpus_used = 29 % cpus
recv_cpus_used = 30.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5901984 tcp_bw
tcp_bw:
bw = 3190022352 bytes/sec
msg_rate = 540 /sec
msg_size = 5901984 bytes
send_cost = 111284483 ns/GB
recv_cost = 120688807 ns/GB
send_cpus_used = 35.5 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5914128 tcp_bw
tcp_bw:
bw = 3195394531 bytes/sec
msg_rate = 543 /sec
msg_size = 5914128 bytes
send_cost = 101202862 ns/GB
recv_cost = 116772538 ns/GB
send_cpus_used = 32.5 % cpus
recv_cpus_used = 37.3 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5926272 tcp_bw
tcp_bw:
bw = 3235744512 bytes/sec
msg_rate = 546 /sec
msg_size = 5926272 bytes
send_cost = 81897685 ns/GB
recv_cost = 103531044 ns/GB
send_cpus_used = 26.5 % cpus
recv_cpus_used = 33.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5938416 tcp_bw
tcp_bw:
bw = 3224559888 bytes/sec
msg_rate = 543 /sec
msg_size = 5938416 bytes
send_cost = 72811117 ns/GB
recv_cost = 86833556 ns/GB
send_cpus_used = 23.5 % cpus
recv_cpus_used = 28 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5950560 tcp_bw
tcp_bw:
bw = 3213302400 bytes/sec
msg_rate = 540 /sec
msg_size = 5950560 bytes
send_cost = 110478239 ns/GB
recv_cost = 122926498 ns/GB
send_cpus_used = 35.5 % cpus
recv_cpus_used = 39.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5962704 tcp_bw
tcp_bw:
bw = 3216878808 bytes/sec
msg_rate = 540 /sec
msg_size = 5962704 bytes
send_cost = 115018323 ns/GB
recv_cost = 304643127 ns/GB
send_cpus_used = 37 % cpus
recv_cpus_used = 98 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5974848 tcp_bw
tcp_bw:
bw = 3247329888 bytes/sec
msg_rate = 544 /sec
msg_size = 5974848 bytes
send_cost = 90843862 ns/GB
recv_cost = 140115119 ns/GB
send_cpus_used = 29.5 % cpus
recv_cpus_used = 45.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5986992 tcp_bw
tcp_bw:
bw = 3221001696 bytes/sec
msg_rate = 538 /sec
msg_size = 5986992 bytes
send_cost = 86929480 ns/GB
recv_cost = 105557226 ns/GB
send_cpus_used = 28 % cpus
recv_cpus_used = 34 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 5999136 tcp_bw
tcp_bw:
bw = 3218536464 bytes/sec
msg_rate = 536 /sec
msg_size = 5999136 bytes
send_cost = 100977569 ns/GB
recv_cost = 167778128 ns/GB
send_cpus_used = 32.5 % cpus
recv_cpus_used = 54 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6011280 tcp_bw
tcp_bw:
bw = 3225051720 bytes/sec
msg_rate = 536 /sec
msg_size = 6011280 bytes
send_cost = 54262695 ns/GB
recv_cost = 77518137 ns/GB
send_cpus_used = 17.5 % cpus
recv_cpus_used = 25 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6023424 tcp_bw
tcp_bw:
bw = 3177356160 bytes/sec
msg_rate = 528 /sec
msg_size = 6023424 bytes
send_cost = 62945415 ns/GB
recv_cost = 107007206 ns/GB
send_cpus_used = 20 % cpus
recv_cpus_used = 34 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6035568 tcp_bw
tcp_bw:
bw = 3177726552 bytes/sec
msg_rate = 526 /sec
msg_size = 6035568 bytes
send_cost = 113288544 ns/GB
recv_cost = 116435445 ns/GB
send_cpus_used = 36 % cpus
recv_cpus_used = 37 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6047712 tcp_bw
tcp_bw:
bw = 3208311216 bytes/sec
msg_rate = 530 /sec
msg_size = 6047712 bytes
send_cost = 120000824 ns/GB
recv_cost = 115325472 ns/GB
send_cpus_used = 38.5 % cpus
recv_cpus_used = 37 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6059856 tcp_bw
tcp_bw:
bw = 3211723680 bytes/sec
msg_rate = 530 /sec
msg_size = 6059856 bytes
send_cost = 116759733 ns/GB
recv_cost = 113646143 ns/GB
send_cpus_used = 37.5 % cpus
recv_cpus_used = 36.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6072000 tcp_bw
tcp_bw:
bw = 3029928000 bytes/sec
msg_rate = 499 /sec
msg_size = 6072000 bytes
send_cost = 115398664 ns/GB
recv_cost = 97362045 ns/GB
send_cpus_used = 35 % cpus
recv_cpus_used = 29.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6084144 tcp_bw
tcp_bw:
bw = 3221554248 bytes/sec
msg_rate = 530 /sec
msg_size = 6084144 bytes
send_cost = 103987077 ns/GB
recv_cost = 103987077 ns/GB
send_cpus_used = 33.5 % cpus
recv_cpus_used = 33.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6096288 tcp_bw
tcp_bw:
bw = 3191406768 bytes/sec
msg_rate = 524 /sec
msg_size = 6096288 bytes
send_cost = 111236209 ns/GB
recv_cost = 117503041 ns/GB
send_cpus_used = 35.5 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6108432 tcp_bw
tcp_bw:
bw = 3209981016 bytes/sec
msg_rate = 526 /sec
msg_size = 6108432 bytes
send_cost = 68536230 ns/GB
recv_cost = 91900851 ns/GB
send_cpus_used = 22 % cpus
recv_cpus_used = 29.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6120576 tcp_bw
tcp_bw:
bw = 3228603840 bytes/sec
msg_rate = 528 /sec
msg_size = 6120576 bytes
send_cost = 106857334 ns/GB
recv_cost = 120795243 ns/GB
send_cpus_used = 34.5 % cpus
recv_cpus_used = 39 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6132720 tcp_bw
tcp_bw:
bw = 3201279840 bytes/sec
msg_rate = 522 /sec
msg_size = 6132720 bytes
send_cost = 109331271 ns/GB
recv_cost = 142130659 ns/GB
send_cpus_used = 35 % cpus
recv_cpus_used = 45.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6144864 tcp_bw
tcp_bw:
bw = 3149242800 bytes/sec
msg_rate = 512 /sec
msg_size = 6144864 bytes
send_cost = 107962461 ns/GB
recv_cost = 114313198 ns/GB
send_cpus_used = 34 % cpus
recv_cpus_used = 36 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6157008 tcp_bw
tcp_bw:
bw = 3213958176 bytes/sec
msg_rate = 522 /sec
msg_size = 6157008 bytes
send_cost = 80897129 ns/GB
recv_cost = 102677134 ns/GB
send_cpus_used = 26 % cpus
recv_cpus_used = 33 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6169152 tcp_bw
tcp_bw:
bw = 3235720224 bytes/sec
msg_rate = 524 /sec
msg_size = 6169152 bytes
send_cost = 84988808 ns/GB
recv_cost = 111258078 ns/GB
send_cpus_used = 27.5 % cpus
recv_cpus_used = 36 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6181296 tcp_bw
tcp_bw:
bw = 3220455216 bytes/sec
msg_rate = 521 /sec
msg_size = 6181296 bytes
send_cost = 93154536 ns/GB
recv_cost = 114890592 ns/GB
send_cpus_used = 30 % cpus
recv_cpus_used = 37 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6193440 tcp_bw
tcp_bw:
bw = 3214395360 bytes/sec
msg_rate = 519 /sec
msg_size = 6193440 bytes
send_cost = 110440674 ns/GB
recv_cost = 127551203 ns/GB
send_cpus_used = 35.5 % cpus
recv_cpus_used = 41 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6205584 tcp_bw
tcp_bw:
bw = 3214492512 bytes/sec
msg_rate = 518 /sec
msg_size = 6205584 bytes
send_cost = 99549149 ns/GB
recv_cost = 108881882 ns/GB
send_cpus_used = 32 % cpus
recv_cpus_used = 35 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6217728 tcp_bw
tcp_bw:
bw = 3223891968 bytes/sec
msg_rate = 518 /sec
msg_size = 6217728 bytes
send_cost = 110115349 ns/GB
recv_cost = 111666277 ns/GB
send_cpus_used = 35.5 % cpus
recv_cpus_used = 36 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6229872 tcp_bw
tcp_bw:
bw = 3183464592 bytes/sec
msg_rate = 511 /sec
msg_size = 6229872 bytes
send_cost = 105128400 ns/GB
recv_cost = 131931729 ns/GB
send_cpus_used = 33.5 % cpus
recv_cpus_used = 42 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6242016 tcp_bw
tcp_bw:
worker1: failed to connect
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6254160 tcp_bw
tcp_bw:
bw = 2517299400 bytes/sec
msg_rate = 402 /sec
msg_size = 6254160 bytes
send_cost = 55615157 ns/GB
recv_cost = 63560177 ns/GB
send_cpus_used = 14 % cpus
recv_cpus_used = 16 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6266304 tcp_bw
tcp_bw:
bw = 2074146624 bytes/sec
msg_rate = 329 /sec
msg_size = 6266304 bytes
send_cost = 45801969 ns/GB
recv_cost = 156690942 ns/GB
send_cpus_used = 9.45 % cpus
recv_cpus_used = 32.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6278448 tcp_bw
tcp_bw:
bw = 2517657648 bytes/sec
msg_rate = 401 /sec
msg_size = 6278448 bytes
send_cost = 51635295 ns/GB
recv_cost = 258176475 ns/GB
send_cpus_used = 13 % cpus
recv_cpus_used = 65 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6290592 tcp_bw
tcp_bw:
bw = 2475551379 bytes/sec
msg_rate = 396 /sec
msg_size = 6290592 bytes
send_cost = 48232884 ns/GB
recv_cost = 76368734 ns/GB
send_cpus_used = 12 % cpus
recv_cpus_used = 18.9 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6302736 tcp_bw
tcp_bw:
bw = 3119854320 bytes/sec
msg_rate = 495 /sec
msg_size = 6302736 bytes
send_cost = 113787361 ns/GB
recv_cost = 118595283 ns/GB
send_cpus_used = 35.5 % cpus
recv_cpus_used = 37 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6314880 tcp_bw
tcp_bw:
bw = 3217431360 bytes/sec
msg_rate = 510 /sec
msg_size = 6314880 bytes
send_cost = 110336461 ns/GB
recv_cost = 128984878 ns/GB
send_cpus_used = 35.5 % cpus
recv_cpus_used = 41.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6327024 tcp_bw
tcp_bw:
bw = 3173002536 bytes/sec
msg_rate = 502 /sec
msg_size = 6327024 bytes
send_cost = 113457210 ns/GB
recv_cost = 130790942 ns/GB
send_cpus_used = 36 % cpus
recv_cpus_used = 41.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6339168 tcp_bw
tcp_bw:
bw = 3229806096 bytes/sec
msg_rate = 510 /sec
msg_size = 6339168 bytes
send_cost = 88240590 ns/GB
recv_cost = 108365637 ns/GB
send_cpus_used = 28.5 % cpus
recv_cpus_used = 35 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6351312 tcp_bw
tcp_bw:
bw = 3197885592 bytes/sec
msg_rate = 504 /sec
msg_size = 6351312 bytes
send_cost = 109447316 ns/GB
recv_cost = 123519119 ns/GB
send_cpus_used = 35 % cpus
recv_cpus_used = 39.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6363456 tcp_bw
tcp_bw:
bw = 3200818368 bytes/sec
msg_rate = 503 /sec
msg_size = 6363456 bytes
send_cost = 115595439 ns/GB
recv_cost = 123405944 ns/GB
send_cpus_used = 37 % cpus
recv_cpus_used = 39.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6375600 tcp_bw
tcp_bw:
bw = 3194175600 bytes/sec
msg_rate = 501 /sec
msg_size = 6375600 bytes
send_cost = 100182342 ns/GB
recv_cost = 109574437 ns/GB
send_cpus_used = 32 % cpus
recv_cpus_used = 35 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6387744 tcp_bw
tcp_bw:
bw = 2251679760 bytes/sec
msg_rate = 352 /sec
msg_size = 6387744 bytes
send_cost = 88822579 ns/GB
recv_cost = 202071370 ns/GB
send_cpus_used = 20 % cpus
recv_cpus_used = 45.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6399888 tcp_bw
tcp_bw:
bw = 3206343888 bytes/sec
msg_rate = 501 /sec
msg_size = 6399888 bytes
send_cost = 118396886 ns/GB
recv_cost = 127871498 ns/GB
send_cpus_used = 38 % cpus
recv_cpus_used = 41 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6412032 tcp_bw
tcp_bw:
bw = 3222046080 bytes/sec
msg_rate = 502 /sec
msg_size = 6412032 bytes
send_cost = 85349495 ns/GB
recv_cost = 79142256 ns/GB
send_cpus_used = 27.5 % cpus
recv_cpus_used = 25.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6424176 tcp_bw
tcp_bw:
bw = 3183179208 bytes/sec
msg_rate = 496 /sec
msg_size = 6424176 bytes
send_cost = 113094485 ns/GB
recv_cost = 131943557 ns/GB
send_cpus_used = 36 % cpus
recv_cpus_used = 42 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6436320 tcp_bw
tcp_bw:
bw = 3195632880 bytes/sec
msg_rate = 496 /sec
msg_size = 6436320 bytes
send_cost = 122041549 ns/GB
recv_cost = 125170826 ns/GB
send_cpus_used = 39 % cpus
recv_cpus_used = 40 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6448464 tcp_bw
tcp_bw:
bw = 2389155912 bytes/sec
msg_rate = 370 /sec
msg_size = 6448464 bytes
send_cost = 140216889 ns/GB
recv_cost = 83711574 ns/GB
send_cpus_used = 33.5 % cpus
recv_cpus_used = 20 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6460608 tcp_bw
tcp_bw:
bw = 3168928224 bytes/sec
msg_rate = 490 /sec
msg_size = 6460608 bytes
send_cost = 72579746 ns/GB
recv_cost = 89935769 ns/GB
send_cpus_used = 23 % cpus
recv_cpus_used = 28.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6472752 tcp_bw
tcp_bw:
bw = 3207248616 bytes/sec
msg_rate = 496 /sec
msg_size = 6472752 bytes
send_cost = 123158526 ns/GB
recv_cost = 134071305 ns/GB
send_cpus_used = 39.5 % cpus
recv_cpus_used = 43 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6484896 tcp_bw
tcp_bw:
bw = 3216508416 bytes/sec
msg_rate = 496 /sec
msg_size = 6484896 bytes
send_cost = 118140526 ns/GB
recv_cost = 139903252 ns/GB
send_cpus_used = 38 % cpus
recv_cpus_used = 45 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6497040 tcp_bw
tcp_bw:
bw = 3206289240 bytes/sec
msg_rate = 494 /sec
msg_size = 6497040 bytes
send_cost = 101363278 ns/GB
recv_cost = 109160456 ns/GB
send_cpus_used = 32.5 % cpus
recv_cpus_used = 35 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6509184 tcp_bw
tcp_bw:
bw = 3228555264 bytes/sec
msg_rate = 496 /sec
msg_size = 6509184 bytes
send_cost = 82080053 ns/GB
recv_cost = 111504987 ns/GB
send_cpus_used = 26.5 % cpus
recv_cpus_used = 36 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6521328 tcp_bw
tcp_bw:
bw = 3231318024 bytes/sec
msg_rate = 496 /sec
msg_size = 6521328 bytes
send_cost = 85104593 ns/GB
recv_cost = 106767578 ns/GB
send_cpus_used = 27.5 % cpus
recv_cpus_used = 34.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6533472 tcp_bw
tcp_bw:
bw = 3224268432 bytes/sec
msg_rate = 494 /sec
msg_size = 6533472 bytes
send_cost = 60478833 ns/GB
recv_cost = 77536969 ns/GB
send_cpus_used = 19.5 % cpus
recv_cpus_used = 25 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6545616 tcp_bw
tcp_bw:
bw = 3226988688 bytes/sec
msg_rate = 493 /sec
msg_size = 6545616 bytes
send_cost = 63526717 ns/GB
recv_cost = 89867062 ns/GB
send_cpus_used = 20.5 % cpus
recv_cpus_used = 29 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6557760 tcp_bw
tcp_bw:
bw = 3232975680 bytes/sec
msg_rate = 493 /sec
msg_size = 6557760 bytes
send_cost = 52583137 ns/GB
recv_cost = 80421264 ns/GB
send_cpus_used = 17 % cpus
recv_cpus_used = 26 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6569904 tcp_bw
tcp_bw:
bw = 3209398104 bytes/sec
msg_rate = 488 /sec
msg_size = 6569904 bytes
send_cost = 71664529 ns/GB
recv_cost = 470493202 ns/GB
send_cpus_used = 23 % cpus
recv_cpus_used = 151 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6582048 tcp_bw
tcp_bw:
bw = 3208748400 bytes/sec
msg_rate = 488 /sec
msg_size = 6582048 bytes
send_cost = 110521679 ns/GB
recv_cost = 436307183 ns/GB
send_cpus_used = 35.5 % cpus
recv_cpus_used = 140 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6594192 tcp_bw
tcp_bw:
bw = 3204777312 bytes/sec
msg_rate = 486 /sec
msg_size = 6594192 bytes
send_cost = 90489904 ns/GB
recv_cost = 443088495 ns/GB
send_cpus_used = 29 % cpus
recv_cpus_used = 142 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6606336 tcp_bw
tcp_bw:
bw = 3213982464 bytes/sec
msg_rate = 486 /sec
msg_size = 6606336 bytes
send_cost = 96453545 ns/GB
recv_cost = 452709391 ns/GB
send_cpus_used = 31 % cpus
recv_cpus_used = 146 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6618480 tcp_bw
tcp_bw:
bw = 3163633440 bytes/sec
msg_rate = 478 /sec
msg_size = 6618480 bytes
send_cost = 124725974 ns/GB
recv_cost = 510488981 ns/GB
send_cpus_used = 39.5 % cpus
recv_cpus_used = 162 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6630624 tcp_bw
tcp_bw:
bw = 3113077968 bytes/sec
msg_rate = 470 /sec
msg_size = 6630624 bytes
send_cost = 81912499 ns/GB
recv_cost = 88337012 ns/GB
send_cpus_used = 25.5 % cpus
recv_cpus_used = 27.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6642768 tcp_bw
tcp_bw:
bw = 3192494472 bytes/sec
msg_rate = 483 /sec
msg_size = 6642768 bytes
send_cost = 105969944 ns/GB
recv_cost = 121553754 ns/GB
send_cpus_used = 34 % cpus
recv_cpus_used = 38.8 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6654912 tcp_bw
tcp_bw:
bw = 2881576896 bytes/sec
msg_rate = 433 /sec
msg_size = 6654912 bytes
send_cost = 119726112 ns/GB
recv_cost = 100639338 ns/GB
send_cpus_used = 34.5 % cpus
recv_cpus_used = 29 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6667056 tcp_bw
tcp_bw:
bw = 3113515152 bytes/sec
msg_rate = 467 /sec
msg_size = 6667056 bytes
send_cost = 118836745 ns/GB
recv_cost = 117230844 ns/GB
send_cpus_used = 37 % cpus
recv_cpus_used = 36.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6679200 tcp_bw
tcp_bw:
bw = 3232732800 bytes/sec
msg_rate = 484 /sec
msg_size = 6679200 bytes
send_cost = 77333951 ns/GB
recv_cost = 95894100 ns/GB
send_cpus_used = 25 % cpus
recv_cpus_used = 31 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6691344 tcp_bw
tcp_bw:
bw = 3201808104 bytes/sec
msg_rate = 478 /sec
msg_size = 6691344 bytes
send_cost = 112436474 ns/GB
recv_cost = 129614261 ns/GB
send_cpus_used = 36 % cpus
recv_cpus_used = 41.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6703488 tcp_bw
tcp_bw:
bw = 3241136448 bytes/sec
msg_rate = 484 /sec
msg_size = 6703488 bytes
send_cost = 87932119 ns/GB
recv_cost = 121870837 ns/GB
send_cpus_used = 28.5 % cpus
recv_cpus_used = 39.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6715632 tcp_bw
tcp_bw:
bw = 3206714280 bytes/sec
msg_rate = 478 /sec
msg_size = 6715632 bytes
send_cost = 113823677 ns/GB
recv_cost = 124738274 ns/GB
send_cpus_used = 36.5 % cpus
recv_cpus_used = 40 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6727776 tcp_bw
tcp_bw:
bw = 3219240816 bytes/sec
msg_rate = 478 /sec
msg_size = 6727776 bytes
send_cost = 118040251 ns/GB
recv_cost = 163081921 ns/GB
send_cpus_used = 38 % cpus
recv_cpus_used = 52.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6739920 tcp_bw
tcp_bw:
bw = 3214941840 bytes/sec
msg_rate = 477 /sec
msg_size = 6739920 bytes
send_cost = 108866664 ns/GB
recv_cost = 122863812 ns/GB
send_cpus_used = 35 % cpus
recv_cpus_used = 39.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6752064 tcp_bw
tcp_bw:
bw = 3237614688 bytes/sec
msg_rate = 480 /sec
msg_size = 6752064 bytes
send_cost = 94205159 ns/GB
recv_cost = 125092094 ns/GB
send_cpus_used = 30.5 % cpus
recv_cpus_used = 40.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6764208 tcp_bw
tcp_bw:
bw = 2441879088 bytes/sec
msg_rate = 361 /sec
msg_size = 6764208 bytes
send_cost = 114507195 ns/GB
recv_cost = 186331918 ns/GB
send_cpus_used = 28 % cpus
recv_cpus_used = 45.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6776352 tcp_bw
tcp_bw:
bw = 2527579296 bytes/sec
msg_rate = 373 /sec
msg_size = 6776352 bytes
send_cost = 63301672 ns/GB
recv_cost = 130559707 ns/GB
send_cpus_used = 16 % cpus
recv_cpus_used = 33 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6788496 tcp_bw
tcp_bw:
bw = 2498166528 bytes/sec
msg_rate = 368 /sec
msg_size = 6788496 bytes
send_cost = 55965061 ns/GB
recv_cost = 74054312 ns/GB
send_cpus_used = 14 % cpus
recv_cpus_used = 18.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6800640 tcp_bw
tcp_bw:
bw = 2210208000 bytes/sec
msg_rate = 325 /sec
msg_size = 6800640 bytes
send_cost = 49769071 ns/GB
recv_cost = 126684910 ns/GB
send_cpus_used = 11 % cpus
recv_cpus_used = 28 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6812784 tcp_bw
tcp_bw:
bw = 2149433352 bytes/sec
msg_rate = 316 /sec
msg_size = 6812784 bytes
send_cost = 51176278 ns/GB
recv_cost = 113983532 ns/GB
send_cpus_used = 11 % cpus
recv_cpus_used = 24.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6824928 tcp_bw
tcp_bw:
bw = 3180416448 bytes/sec
msg_rate = 466 /sec
msg_size = 6824928 bytes
send_cost = 113192728 ns/GB
recv_cost = 116336967 ns/GB
send_cpus_used = 36 % cpus
recv_cpus_used = 37 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6837072 tcp_bw
tcp_bw:
bw = 3052752648 bytes/sec
msg_rate = 446 /sec
msg_size = 6837072 bytes
send_cost = 106461291 ns/GB
recv_cost = 121202091 ns/GB
send_cpus_used = 32.5 % cpus
recv_cpus_used = 37 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6849216 tcp_bw
tcp_bw:
bw = 3088996416 bytes/sec
msg_rate = 451 /sec
msg_size = 6849216 bytes
send_cost = 111563075 ns/GB
recv_cost = 144059731 ns/GB
send_cpus_used = 34.5 % cpus
recv_cpus_used = 44.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6861360 tcp_bw
tcp_bw:
bw = 2082422760 bytes/sec
msg_rate = 304 /sec
msg_size = 6861360 bytes
send_cost = 79234635 ns/GB
recv_cost = 244907038 ns/GB
send_cpus_used = 16.5 % cpus
recv_cpus_used = 51 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6873504 tcp_bw
tcp_bw:
bw = 3189305856 bytes/sec
msg_rate = 464 /sec
msg_size = 6873504 bytes
send_cost = 141096530 ns/GB
recv_cost = 136393316 ns/GB
send_cpus_used = 45 % cpus
recv_cpus_used = 43.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6885648 tcp_bw
tcp_bw:
bw = 3157069608 bytes/sec
msg_rate = 458 /sec
msg_size = 6885648 bytes
send_cost = 98192324 ns/GB
recv_cost = 121948528 ns/GB
send_cpus_used = 31 % cpus
recv_cpus_used = 38.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6897792 tcp_bw
tcp_bw:
bw = 3214371072 bytes/sec
msg_rate = 466 /sec
msg_size = 6897792 bytes
send_cost = 97997397 ns/GB
recv_cost = 116663569 ns/GB
send_cpus_used = 31.5 % cpus
recv_cpus_used = 37.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6909936 tcp_bw
tcp_bw:
bw = 3206210304 bytes/sec
msg_rate = 464 /sec
msg_size = 6909936 bytes
send_cost = 116960512 ns/GB
recv_cost = 132555251 ns/GB
send_cpus_used = 37.5 % cpus
recv_cpus_used = 42.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6922080 tcp_bw
tcp_bw:
bw = 3194539920 bytes/sec
msg_rate = 462 /sec
msg_size = 6922080 bytes
send_cost = 106431603 ns/GB
recv_cost = 114257458 ns/GB
send_cpus_used = 34 % cpus
recv_cpus_used = 36.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6934224 tcp_bw
tcp_bw:
bw = 3203611488 bytes/sec
msg_rate = 462 /sec
msg_size = 6934224 bytes
send_cost = 82719140 ns/GB
recv_cost = 95205055 ns/GB
send_cpus_used = 26.5 % cpus
recv_cpus_used = 30.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6946368 tcp_bw
tcp_bw:
bw = 2934840480 bytes/sec
msg_rate = 422 /sec
msg_size = 6946368 bytes
send_cost = 80072495 ns/GB
recv_cost = 129478927 ns/GB
send_cpus_used = 23.5 % cpus
recv_cpus_used = 38 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6958512 tcp_bw
tcp_bw:
bw = 3134809656 bytes/sec
msg_rate = 450 /sec
msg_size = 6958512 bytes
send_cost = 92509601 ns/GB
recv_cost = 98889577 ns/GB
send_cpus_used = 29 % cpus
recv_cpus_used = 31 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6970656 tcp_bw
tcp_bw:
bw = 3203016432 bytes/sec
msg_rate = 460 /sec
msg_size = 6970656 bytes
send_cost = 107710967 ns/GB
recv_cost = 126443310 ns/GB
send_cpus_used = 34.5 % cpus
recv_cpus_used = 40.5 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6982800 tcp_bw
tcp_bw:
bw = 3219070800 bytes/sec
msg_rate = 461 /sec
msg_size = 6982800 bytes
send_cost = 76108921 ns/GB
recv_cost = 96301082 ns/GB
send_cpus_used = 24.5 % cpus
recv_cpus_used = 31 % cpus
####################################################
ssh worker2 smc_run qperf -v -uu -H worker1 -m 6994944 tcp_bw
tcp_bw:
bw = 3231664128 bytes/sec
msg_rate = 462 /sec
msg_size = 6994944 bytes
send_cost = 123775241 ns/GB
recv_cost = 133058384 ns/GB
send_cpus_used = 40 % cpus
recv_cpus_used = 43 % cpus
