On March 5, 2020 7:52:48 AM GMT+02:00, Sanju Rakonde <srakonde@xxxxxxxxxx> wrote: >Not sure whether I understood it correctly, are you using an >heterogeneous cluster? If yes, why? > >Are the new servers are in part of the cluster? You need to peer probe >the >servers before adding bricks. Copying the configurations of volume will >not >help. > >scp -r /var/lib/glusterd/vols/* root@diufnas22:/var/lib/glusterd/vols/ >scp -r /var/lib/glusterd/vols/* root@diufnas23:/var/lib/glusterd/vols/ > >Please paste the peer status output and glusterd logs from peers around >the >time when add-brick is performed. > >On Tue, Mar 3, 2020 at 2:56 PM DUCARROZ Birgit ><birgit.ducarroz@xxxxxxxx> >wrote: > >> >> Just some additional info: >> >> On diufnas26 and diufnas27: >> glusterfs 4.1.8 >> >> On diufnas22 and diufnas23: >> glusterfs 7.2 >> >> >> setfattr -x --> does not help >> >> On 03/03/20 10:01, DUCARROZ Birgit wrote: >> > Hi, >> > >> > Having 2 servers diufnas26 and diufnas27 with 3 volumes >> (Type=Distribute): >> > vol-backup >> > vol-restore >> > vol-veeam >> > >> > diufnas26 >> > /bigdisk/brick1 >> > >> > diufnas27 >> > /bigdisk/brick2 >> > >> > >> > I would like to add 2 new servers: diufnas22 and diufnas23. >> > >> > diufnas22 >> > /bigdisk/brick3 >> > >> > diufnas23 >> > /bigdisk/brick4 >> > >> > gluster peer status on all servers shows State: Peer in Cluster >> (Connected) >> > >> > Wanna add the 2 new bricks: >> > >> > root@diufnas26:/bigdisk/brick1# gluster volume add-brick vol-backup >> > diufnas22:/bigdisk/brick3 diufnas23:/bigdisk/brick4 force >> > *volume add-brick: failed: Pre Validation failed on diufnas23. >Please >> > check log file for details. >> > Pre Validation failed on diufnas22. Please check log file for >details.* >> > >> > >> > >> > I tried this, but it does not help: >> > scp -r /var/lib/glusterd/vols/* >root@diufnas22:/var/lib/glusterd/vols/ >> > scp -r /var/lib/glusterd/vols/* >root@diufnas23:/var/lib/glusterd/vols/ >> > >> > >> > root@diufnas26:/bigdisk/brick1# tail /var/log/glusterfs/*log -f | >grep E >> > >> > [2020-03-03 08:37:52.544881] : volume add-brick vol-backup >> > diufnas22:/bigdisk/brick3 diufnas23:/bigdisk/brick4 force : FAILED >: Pre >> > Validation failed on diufnas22. Please check log file for details. >> > [2020-03-03 08:39:35.991559] : volume add-brick vol-backup >> > diufnas22:/bigdisk/brick3 diufnas23:/bigdisk/brick4 force : FAILED >: Pre >> > Validation failed on diufnas23. Please check log file for details. >> > [2020-03-03 08:42:40.800060] : volume add-brick vol-backup >> > diufnas22:/bigdisk/brick3 diufnas23:/bigdisk/brick4 force : FAILED >: Pre >> > Validation failed on diufnas23. Please check log file for details. >> > [2020-03-03 08:50:15.699112] : volume add-brick vol-backup >> > diufnas22:/bigdisk/brick3 diufnas23:/bigdisk/brick4 force : FAILED >: Pre >> > Validation failed on diufnas22. Please check log file for details. >> > [2020-03-03 08:54:56.472727] : volume add-brick vol-backup >> > diufnas22:/bigdisk/brick3 diufnas23:/bigdisk/brick4 force : FAILED >: Pre >> > Validation failed on diufnas23. Please check log file for details. >> > [2020-03-03 08:50:15.698286] E [MSGID: 106121] >> > [glusterd-mgmt.c:1148:glusterd_mgmt_v3_pre_validate] 0-management: >Pre >> > Validation failed on peers >> > [2020-03-03 08:50:15.698315] E [MSGID: 106121] >> > [glusterd-mgmt.c:2242:glusterd_mgmt_v3_initiate_all_phases] >> > 0-management: Pre Validation Failed >> > [2020-03-03 08:54:56.471628] E [MSGID: 106115] >> > [glusterd-mgmt.c:124:gd_mgmt_v3_collate_errors] 0-management: Pre >> > Validation failed on diufnas23. Please check log file for details. >> > [2020-03-03 08:54:56.471687] E [MSGID: 106115] >> > [glusterd-mgmt.c:124:gd_mgmt_v3_collate_errors] 0-management: Pre >> > Validation failed on diufnas22. Please check log file for details. >> > [2020-03-03 08:54:56.471908] E [MSGID: 106121] >> > [glusterd-mgmt.c:1148:glusterd_mgmt_v3_pre_validate] 0-management: >Pre >> > Validation failed on peers >> > [2020-03-03 08:54:56.471935] E [MSGID: 106121] >> > [glusterd-mgmt.c:2242:glusterd_mgmt_v3_initiate_all_phases] >> > 0-management: Pre Validation Failed >> > >> > >> > What am I missing? >> > Thank you for any help. >> > Regards, Birgit >> > >> > ________ >> > >> > >> > >> > Community Meeting Calendar: >> > >> > Schedule - >> > Every Tuesday at 14:30 IST / 09:00 UTC >> > Bridge: https://bluejeans.com/441850968 >> > >> > Gluster-users mailing list >> > Gluster-users@xxxxxxxxxxx >> > https://lists.gluster.org/mailman/listinfo/gluster-users >> ________ >> >> >> >> Community Meeting Calendar: >> >> Schedule - >> Every Tuesday at 14:30 IST / 09:00 UTC >> Bridge: https://bluejeans.com/441850968 >> >> Gluster-users mailing list >> Gluster-users@xxxxxxxxxxx >> https://lists.gluster.org/mailman/listinfo/gluster-users >> Mixing major versions is always a recipe for a disaster. Consider upgrading the v4.X nodes as soon as possible. Best Regards, Strahil Nikolov ________ Community Meeting Calendar: Schedule - Every Tuesday at 14:30 IST / 09:00 UTC Bridge: https://bluejeans.com/441850968 Gluster-users mailing list Gluster-users@xxxxxxxxxxx https://lists.gluster.org/mailman/listinfo/gluster-users