Hello,
I don't use netplan, and still on Ubuntu 16.04.
But I use VLAN? on the bond, not directly on the interfaces :
bond0 :
- enp179s0f0
- enp179s0f1
Then I use bond0.323 and bond0.324.
(I use a bridge on top to be more like my OpenStack cluster, and with more friendly names : br-mgmt, br-storage, br-replic...)
Le 31/03/2020 à 15:32, James McEwan a écrit :
> Hi,
>
> I am currently building a 10 node Ceph cluster, each OSD node has 2x 25 Gbit/s nics, and I have 2 TOR switches (mlag not supported).
> enp179s0f0 -> sw1
> enp179s0f1 -> sw2
>
> vlan 323 is used for ‘public network’
> vlan 324 is used for ‘cluster network’
>
> My desired configuration is to create two bond interfaces in active-backup mode:
> bond0
> - enp179s0f0.323 (active)
> - enp179s0f1.323 (backup)
> bond1
> - enp179s0f0.324 (backup)
> - enp179s0f1.324 (active)
>
> This way, the public network will use switch1, and the cluster network will use switch2, under normal operation.
>
> I am, however, having an issue implementing this configuration in Ubuntu 18.04 with netplan (see configuration at the end of this post).
>
> When I reboot a node with the below netplan configuration, the bond interface is created, but the vlan interfaces are not added to the bond.
>
> I see the following errors in the log:
> systemd-networkd[1641]: enp179s0f0.323: Enslaving by 'bond0’
> systemd-networkd[1641]: bond0: Enslaving link 'enp179s0f0.323’
> systemd-networkd[1641]: enp179s0f1.323: Enslaving by 'bond0’
> systemd-networkd[1641]: bond0: Enslaving link 'enp179s0f1.323’
> systemd-networkd[1643]: enp179s0f1.323: Could not join netdev: Operation not permitted
> systemd-networkd[1643]: enp179s0f1.323: Failed
> systemd-networkd[1643]: enp179s0f0.323: Could not join netdev: Operation not permitted
> systemd-networkd[1643]: enp179s0f0.323: Failed
>
> If I manually run ’systemctl restart systemd-networkd’ after boot has completed, then the bond is successfully created with the vlan interfaces.
>
> Does anybody have a similar configuration working specifically with netplan/networkd? Could you please share your configuration?
>
> Netplan config that doesn’t work at boot time:
>
> network:
> version: 2
> renderer: networkd
> ethernets:
> enp179s0f0: {}
> enp179s0f1: {}
>
> bonds:
> bond0:
> dhcp4: false
> dhcp6: false
> interfaces:
> - enp179s0f0.323
> - enp179s0f1.323
> parameters:
> mode: active-backup
> primary: enp179s0f0.323
> mii-monitor-interval: 1
> addresses: [insert address here]
> bond1:
> dhcp4: false
> dhcp6: false
> interfaces:
> - enp179s0f0.324
> - enp179s0f1.324
> parameters:
> mode: active-backup
> primary: enp179s0f1.324
> mii-monitor-interval: 1
> addresses: [insert address here]
>
> vlans:
> enp179s0f0.323:
> id: 323
> link: enp179s0f0
> enp179s0f1.323:
> id: 323
> link: enp179s0f1
> enp179s0f0.324:
> id: 324
> link: enp179s0f0
> enp179s0f1.324:
> id: 324
> link: enp179s0f1
>
> _______________________________________________
> ceph-users mailing list -- ceph-users@xxxxxxx
> To unsubscribe send an email to ceph-users-leave@xxxxxxx
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
