> On 8/16/2018 1:26 PM, Sagi Grimberg wrote: > > > >> Let me know if you want me to try this or any particular fix. > > > > Steve, can you test this one? > > Yes! I'll try it out tomorrow. > > Stevo > Hey Sagi, The patch works allowing connections for the various affinity mappings below: One comp_vector per core across all cores, starting with numa-local cores: [ 3798.494963] iw_cxgb4: comp_vector 0, irq 203 mask 0x100 [ 3798.500717] iw_cxgb4: comp_vector 1, irq 204 mask 0x200 [ 3798.506396] iw_cxgb4: comp_vector 2, irq 205 mask 0x400 [ 3798.512043] iw_cxgb4: comp_vector 3, irq 206 mask 0x800 [ 3798.517675] iw_cxgb4: comp_vector 4, irq 207 mask 0x1000 [ 3798.523382] iw_cxgb4: comp_vector 5, irq 208 mask 0x2000 [ 3798.529075] iw_cxgb4: comp_vector 6, irq 209 mask 0x4000 [ 3798.534754] iw_cxgb4: comp_vector 7, irq 210 mask 0x8000 [ 3798.540425] iw_cxgb4: comp_vector 8, irq 211 mask 0x1 [ 3798.545825] iw_cxgb4: comp_vector 9, irq 212 mask 0x2 [ 3798.551231] iw_cxgb4: comp_vector 10, irq 213 mask 0x4 [ 3798.556713] iw_cxgb4: comp_vector 11, irq 214 mask 0x8 [ 3798.562189] iw_cxgb4: comp_vector 12, irq 215 mask 0x10 [ 3798.567755] iw_cxgb4: comp_vector 13, irq 216 mask 0x20 [ 3798.573312] iw_cxgb4: comp_vector 14, irq 217 mask 0x40 [ 3798.578855] iw_cxgb4: comp_vector 15, irq 218 mask 0x80 [ 3798.584384] set->mq_map[0] queue 8 vector 8 [ 3798.588879] set->mq_map[1] queue 9 vector 9 [ 3798.593358] set->mq_map[2] queue 10 vector 10 [ 3798.598008] set->mq_map[3] queue 11 vector 11 [ 3798.602633] set->mq_map[4] queue 12 vector 12 [ 3798.607260] set->mq_map[5] queue 13 vector 13 [ 3798.611872] set->mq_map[6] queue 14 vector 14 [ 3798.616470] set->mq_map[7] queue 15 vector 15 [ 3798.621059] set->mq_map[8] queue 0 vector 0 [ 3798.625460] set->mq_map[9] queue 1 vector 1 [ 3798.629852] set->mq_map[10] queue 2 vector 2 [ 3798.634331] set->mq_map[11] queue 3 vector 3 [ 3798.638796] set->mq_map[12] queue 4 vector 4 [ 3798.643263] set->mq_map[13] queue 5 vector 5 [ 3798.647727] set->mq_map[14] queue 6 vector 6 [ 3798.652197] set->mq_map[15] queue 7 vector 7 One comp_vector per core, but only numa-local cores: [ 3855.406027] iw_cxgb4: comp_vector 0, irq 203 mask 0x400 [ 3855.411577] iw_cxgb4: comp_vector 1, irq 204 mask 0x800 [ 3855.417057] iw_cxgb4: comp_vector 2, irq 205 mask 0x1000 [ 3855.422618] iw_cxgb4: comp_vector 3, irq 206 mask 0x2000 [ 3855.428176] iw_cxgb4: comp_vector 4, irq 207 mask 0x4000 [ 3855.433731] iw_cxgb4: comp_vector 5, irq 208 mask 0x8000 [ 3855.439293] iw_cxgb4: comp_vector 6, irq 209 mask 0x100 [ 3855.444770] iw_cxgb4: comp_vector 7, irq 210 mask 0x200 [ 3855.450231] iw_cxgb4: comp_vector 8, irq 211 mask 0x400 [ 3855.455691] iw_cxgb4: comp_vector 9, irq 212 mask 0x800 [ 3855.461144] iw_cxgb4: comp_vector 10, irq 213 mask 0x1000 [ 3855.466768] iw_cxgb4: comp_vector 11, irq 214 mask 0x2000 [ 3855.472379] iw_cxgb4: comp_vector 12, irq 215 mask 0x4000 [ 3855.477992] iw_cxgb4: comp_vector 13, irq 216 mask 0x8000 [ 3855.483599] iw_cxgb4: comp_vector 14, irq 217 mask 0x100 [ 3855.489116] iw_cxgb4: comp_vector 15, irq 218 mask 0x200 [ 3855.494644] set->mq_map[0] queue 8 vector 8 [ 3855.499046] set->mq_map[1] queue 9 vector 9 [ 3855.503445] set->mq_map[2] queue 10 vector 10 [ 3855.508025] set->mq_map[3] queue 11 vector 11 [ 3855.512600] set->mq_map[4] queue 12 vector 12 [ 3855.517176] set->mq_map[5] queue 13 vector 13 [ 3855.521750] set->mq_map[6] queue 14 vector 14 [ 3855.526325] set->mq_map[7] queue 15 vector 15 [ 3855.530902] set->mq_map[8] queue 6 vector 6 [ 3855.535306] set->mq_map[9] queue 7 vector 7 [ 3855.539703] set->mq_map[10] queue 0 vector 0 [ 3855.544197] set->mq_map[11] queue 1 vector 1 [ 3855.548670] set->mq_map[12] queue 2 vector 2 [ 3855.553144] set->mq_map[13] queue 3 vector 3 [ 3855.557630] set->mq_map[14] queue 4 vector 4 [ 3855.562105] set->mq_map[15] queue 5 vector 5 Each comp_vector has affinity to all numa-local cores: [ 4010.002954] iw_cxgb4: comp_vector 0, irq 203 mask 0xff00 [ 4010.008606] iw_cxgb4: comp_vector 1, irq 204 mask 0xff00 [ 4010.014179] iw_cxgb4: comp_vector 2, irq 205 mask 0xff00 [ 4010.019741] iw_cxgb4: comp_vector 3, irq 206 mask 0xff00 [ 4010.025310] iw_cxgb4: comp_vector 4, irq 207 mask 0xff00 [ 4010.030881] iw_cxgb4: comp_vector 5, irq 208 mask 0xff00 [ 4010.036448] iw_cxgb4: comp_vector 6, irq 209 mask 0xff00 [ 4010.042012] iw_cxgb4: comp_vector 7, irq 210 mask 0xff00 [ 4010.047562] iw_cxgb4: comp_vector 8, irq 211 mask 0xff00 [ 4010.053103] iw_cxgb4: comp_vector 9, irq 212 mask 0xff00 [ 4010.058632] iw_cxgb4: comp_vector 10, irq 213 mask 0xff00 [ 4010.064248] iw_cxgb4: comp_vector 11, irq 214 mask 0xff00 [ 4010.069863] iw_cxgb4: comp_vector 12, irq 215 mask 0xff00 [ 4010.075462] iw_cxgb4: comp_vector 13, irq 216 mask 0xff00 [ 4010.081066] iw_cxgb4: comp_vector 14, irq 217 mask 0xff00 [ 4010.086676] iw_cxgb4: comp_vector 15, irq 218 mask 0xff00 [ 4010.092283] set->mq_map[0] queue 8 vector 8 [ 4010.096683] set->mq_map[1] queue 9 vector 9 [ 4010.101085] set->mq_map[2] queue 10 vector 10 [ 4010.105663] set->mq_map[3] queue 11 vector 11 [ 4010.110239] set->mq_map[4] queue 12 vector 12 [ 4010.114810] set->mq_map[5] queue 13 vector 13 [ 4010.119379] set->mq_map[6] queue 14 vector 14 [ 4010.123942] set->mq_map[7] queue 15 vector 15 [ 4010.128502] set->mq_map[8] queue 0 vector 0 [ 4010.132903] set->mq_map[9] queue 1 vector 1 [ 4010.137299] set->mq_map[10] queue 2 vector 2 [ 4010.141792] set->mq_map[11] queue 3 vector 3 [ 4010.146274] set->mq_map[12] queue 4 vector 4 [ 4010.150754] set->mq_map[13] queue 5 vector 5 [ 4010.155235] set->mq_map[14] queue 6 vector 6 [ 4010.159716] set->mq_map[15] queue 7 vector 7
