Hi All,
First time mailing here.
First time mailing here.
I have installed on a CentOS 7.0 KVM (with DPDK and OVS) one Deep Packet Inspection VM.
I have one channel and some virtual traffic generator.
The traffic is lost between dpdk vhostuser and the DPI VM.
The setup is attached. Any suggestions or ideas?
Regarding the OVS+DPDK configuration, the following configuration is already made:
- SELINUX is disabled
- QEMU 2.9.0 was downloaded from sources
- All Linux packages were updated for QEMU 2.9.0
- DPDK source was downloaded
- Paths were set
- epel repo was installed
- DPDK 16.11 was installed
- OVS 2.7.0 was installed with DPDK option
- Hugepages VM is set
- NICs are configured for DPDK
- Permissions are set for DPDK
Regarding the OVS+DPDK startup steps, the following configuration is in place:
B. OVS+DPDK startup and configuration
1. Set and verify the memory hugepages
mount -t hugetlbfs nodev /mnt/huge
echo 64 > /sys/devices/system/node/node0/hugepages/hugepages-1048576kB/nr_hugepages
2. Setting the driver permissions
modprobe vfio-pci
/usr/bin/chmod a+x /dev/vfio
/usr/bin/chmod 0666 /dev/vfio/*
3. Configure the PATHS to DPDK and OVS database
cd dpdk-stable-16.11.1/
export DPDK_DIR=$PWD
export PATH=$PATH:/usr/local/share/openvswitch/scripts
export DB_SOCK=/usr/local/var/run/openvswitch/db.sock
4. Re-initializing OVS
rm /usr/local/etc/openvswitch/conf.db
mkdir -p /usr/local/etc/openvswitch
mkdir -p /usr/local/var/run/openvswitch
ovsdb-tool create /usr/local/etc/openvswitch/conf.db /usr/local/share/openvswitch/vswitch.ovsschema
5. Starting OVS + DPDK
ovsdb-server --remote=punix:/usr/local/var/run/openvswitch/db.sock --remote=db:Open_vSwitch,Open_vSwitch,manager_options --pidfile --detach
ovs-vsctl --no-wait set Open_vSwitch . other_config:dpdk-init=true
ovs-vsctl --no-wait set Open_vSwitch . other_config:dpdk-socket-mem="1024,1024"
ovs-ctl --no-ovsdb-server --db-sock="$DB_SOCK" start
6. Cheking driver mapping for NICs
driverctl -v list-devices | grep -i net
$DPDK_DIR/tools/dpdk-devbind.py --status
7. Adding OVS+DPDK bridge and ports
ovs-vsctl add-br ch1int_dpdk -- set bridge ch1int_dpdk datapath_type=netdev
ovs-vsctl add-br ch1ext_dpdk -- set bridge ch1ext_dpdk datapath_type=netdev
ovs-vsctl add-port ch1int_dpdk nic810 -- set Interface nic810 type=dpdk options:dpdk-devargs=0000:81:00.0
ovs-vsctl add-port ch1ext_dpdk nic811 -- set Interface nic811 type=dpdk options:dpdk-devargs=0000:81:00.1
8. Adding OVS (no DPDK) bridge and ports
ovs-vsctl add-br br0
ovs-vsctl add-port br0 myportnameone
9. Adding VM ports to OVS (or OVS+DPDK) bridge
#<interface type='bridge'>
# <mac address='52:54:00:cb:57:af'/>
# <source bridge='br0'/>
# <virtualport type='openvswitch'/>
# ...
#</interface>
10. Adding dpdkvhostuser to the ovs switch - these are used for the socket created between the VM and the OVS bridge
ovs-vsctl add-port ch1int_dpdk ch1int_dvhu -- set Interface ch1int_dvhu type=dpdkvhostuser
ovs-vsctl add-port ch1ext_dpdk ch1ext_dvhu -- set Interface ch1ext_dvhu type=dpdkvhostuser
11. DPI deployment
virt-install --connect qemu:///system --name=DPI --memory=16384 --vcpus=16 --os-type=linux --os-variant=virtio26 --disk path=/path/image.qcow2,format=qcow2,bus=virtio,cache=none --network bridge=admin,model=e1000 --nographics --noautoconsole --import
12. Adding vhostuser ports to guest VM - for this the XML file for the virtual machine found at etc/libvirt/qemu/<VM_name>.xml was edited
<interface type='vhostuser'>
<mac address='52:54:00:2f:e8:de'/>
<source type='unix' path='/usr/local/var/run/openvswitch/ch1int_dvhu' mode='client'/>
<model type='virtio'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
</interface>
<interface type='vhostuser'>
<mac address='52:54:00:b9:40:d0'/>
<source type='unix' path='/usr/local/var/run/openvswitch/ch1ext_dvhu' mode='client'/>
<model type='virtio'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/>
</interface>
Thanks,
Daniel
_______________________________________________ CentOS-virt mailing list CentOS-virt@xxxxxxxxxx https://lists.centos.org/mailman/listinfo/centos-virt
