I'm also getting the same issues with a 6 core baremetal server.
if I load the XDP in native mode, it will drop packets, if it is in
generic mode, it will not drop packets.
However if I only create 1 xsk socket instead of 1 per core, it
doesn't drop packets in native mode. The strange thing is that I get
dropped packets even when I don't send anything to xsk sockets in my
xdp filter.
I try to make xsk sockets with non-shared umem for each cpu core.
for (int queue_number=0; i< get_nprocs_conf(); queue_number++)
xsks[queue_number] = xsk_configure(NULL, queue_number);
....
xsk_socket__create(&xsk->xsk, opt_if, queue_number, umem->umem, rxr, txr, &cfg);
So if I just do this instead, it doesn't drop any packets in native mode.
xsks[0] = xsk_configure(NULL, 0);
xsk_socket__create(&xsk->xsk, opt_if, 0, umem->umem, rxr, txr, &cfg);
Any tips on how to fix this?
----
5.0.0-37-generic #40~18.04.1-Ubuntu SMP Thu Nov 14 12:06:39 UTC 2019
x86_64 x86_64 x86_64 GNU/Linux
01:00.0 Ethernet controller: Intel Corporation 82599 10 Gigabit
Network Connection (rev 01)
Subsystem: Super Micro Computer Inc 82599 10 Gigabit Network Connection
Flags: bus master, fast devsel, latency 0, IRQ 16
Memory at 91300000 (64-bit, prefetchable) [size=512K]
I/O ports at 4000 [size=32]
Memory at 91380000 (64-bit, prefetchable) [size=16K]
Expansion ROM at 91100000 [disabled] [size=512K]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
Capabilities: [70] MSI-X: Enable+ Count=64 Masked-
Capabilities: [a0] Express Endpoint, MSI 00
Capabilities: [e0] Vital Product Data
Capabilities: [100] Advanced Error Reporting
Capabilities: [140] Device Serial Number ac-1f-6b-ff-ff-a5-1a-6b
Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
Capabilities: [160] Single Root I/O Virtualization (SR-IOV)
Kernel driver in use: ixgbe
Kernel modules: ixgbe
On Fri, Jan 31, 2020 at 1:33 PM Elerion <elerion1000@xxxxxxxxx> wrote:
>
> Not sure if this is a known issue or if I'm doing something wrong, but
> when I tried to load an xdp program in native mode, my server starts
> randomly dropping packets while there are no issues with generic mode.
>
> bpf_set_link_xdp_fd(ifindex, fd, XDP_FLAGS_DRV_MODE); // drops packets
> bpf_set_link_xdp_fd(ifindex, fd, XDP_FLAGS_SKB_MODE); // doesn't drop packets
>
> Guest
> 5.0.0-16-generic #17~18.04.1-Ubuntu SMP Mon May 20 14:00:27 UTC 2019
> x86_64 x86_64 x86_64 GNU/Linux
>
> 00:03.0 Ethernet controller: Red Hat, Inc. Virtio network device
> Subsystem: Red Hat, Inc. Virtio network device
> Physical Slot: 3
> Flags: bus master, fast devsel, latency 0, IRQ 10
> I/O ports at c000 [size=64]
> Memory at febf1000 (32-bit, non-prefetchable) [size=4K]
> Memory at fe000000 (64-bit, prefetchable) [size=16K]
> Capabilities: [98] MSI-X: Enable+ Count=18 Masked-
> Capabilities: [84] Vendor Specific Information: VirtIO: <unknown>
> Capabilities: [70] Vendor Specific Information: VirtIO: Notify
> Capabilities: [60] Vendor Specific Information: VirtIO: DeviceCfg
> Capabilities: [50] Vendor Specific Information: VirtIO: ISR
> Capabilities: [40] Vendor Specific Information: VirtIO: CommonCfg
> Kernel driver in use: virtio-pci
>
> Host
> Unknown. It is a server from vultr.com
|