See the thread "iSCSI Gateway reboots and permanent loss" from yesterday -- it's not currently possible to remove a gateway that no longer exists. On Wed, Dec 4, 2019 at 3:49 AM Gesiel Galvão Bernardes <gesiel.bernardes@xxxxxxxxx> wrote: > > I updated and restarted rbd-target-api, and this error appearly resolved. Now, I have other problem: A gateway that I losed: > > s> create ceph-iscsi3 192.168.201.3 > Adding gateway, sync'ing 3 disk(s) and 2 client(s) > Failed : Gateway creation failed, gateway(s) unavailable:ceph-iscsi2(UNKNOWN state) > > > If i try delete: > /iscsi-target...-igw/gateways> delete ceph-iscsi2 > Deleting gateway, ceph-iscsi2 > Failed : Gateway deletion failed, gateway(s) unavailable:ceph-iscsi2(UNKNOWN state) > > How to delete a losed gateway? > > Gesiel > > Em ter., 3 de dez. de 2019 às 23:46, Mike Christie <mchristi@xxxxxxxxxx> escreveu: >> >> Also, I do not think we saw if the ceph-iscsi versions are the same. We >> saw the ceph versions are different which is ok. If you were using a old >> ceph-iscsi version which has different settings/values with a newer >> version then you could see this error. >> >> On 12/03/2019 06:47 PM, Jason Dillaman wrote: >> > You haven't answered whether or not you tried restarting the API >> > daemons yet AFAICT. >> > >> > On Tue, Dec 3, 2019 at 5:53 PM Gesiel Galvão Bernardes >> > <gesiel.bernardes@xxxxxxxxx> wrote: >> >> >> >> I copied the /etc/ceph folder from one to the other, restarted rbd-target-api but the error continues. >> >> >> >> Any tips on which direction I can look? >> >> >> >> Em ter., 3 de dez. de 2019 às 15:10, Jason Dillaman <jdillama@xxxxxxxxxx> escreveu: >> >>> >> >>> On Tue, Dec 3, 2019 at 12:58 PM Gesiel Galvão Bernardes >> >>> <gesiel.bernardes@xxxxxxxxx> wrote: >> >>>>> >> >>>>> Jason, >> >>>> >> >>>> >> >>>> Returned a json with "data" and a different strnig. Were they supposed to be the same? >> >>> >> >>> Yes, they should be the same since those are the hashes of the config. >> >>> >> >>>> Now I checked that ceph version is different in the gateways: ceph-iscsi1 running 13.2.6 and ceph-iscsi1 running 13.2.7. Could this be the problem? >> >>> >> >>> The Ceph version shouldn't matter. Perhaps you are running different >> >>> ceph-iscsi versions and a setting's default value unexpectedly >> >>> changed? >> >>> >> >>>> Gesiel >> >>>> Em ter., 3 de dez. de 2019 às 14:43, Jason Dillaman <jdillama@xxxxxxxxxx> escreveu: >> >>>>> >> >>>>> You might need to reset the target API service. You can compare what >> >>>>> the two REST APIs think the config is by running: >> >>>>> >> >>>>> $ curl --insecure --user <username>:<password> -X GET >> >>>>> http://ceph-iscsi1:5000/api/sysinfo/checkconf >> >>>>> $ curl --insecure --user <username>:<password> -X GET >> >>>>> http://ceph-iscsi3:5000/api/sysinfo/checkconf >> >>>> >> >>>> >> >>>>> >> >>>>> (tweak username, password, http/https, and port as appropriate as per >> >>>>> your configs) >> >>>>> >> >>>>> On Tue, Dec 3, 2019 at 12:34 PM Gesiel Galvão Bernardes >> >>>>> <gesiel.bernardes@xxxxxxxxx> wrote: >> >>>>>> >> >>>>>> Are exactly the same: >> >>>>>> >> >>>>>> [root@ceph-iscsi1 ~]# sha256sum /etc/ceph/iscsi-gateway.cfg >> >>>>>> 33620867c9c3c5e6a666df2bb461150d4a885db2989cd3aea812a29555fdc45a /etc/ceph/iscsi-gateway.cfg >> >>>>>> >> >>>>>> [root@ceph-iscsi3 ~]# sha256sum /etc/ceph/iscsi-gateway.cfg >> >>>>>> 33620867c9c3c5e6a666df2bb461150d4a885db2989cd3aea812a29555fdc45a /etc/ceph/iscsi-gateway.cfg >> >>>>>> >> >>>>>> Em ter., 3 de dez. de 2019 às 14:28, Jason Dillaman <jdillama@xxxxxxxxxx> escreveu: >> >>>>>>> >> >>>>>>> The sha256sum between the "/etc/ceph/iscsi-gateway.cfg" where you are >> >>>>>>> running the 'gwcli' tool and `ceph-iscsi3` most likely mismatches. >> >>>>>>> >> >>>>>>> On Tue, Dec 3, 2019 at 12:19 PM Gesiel Galvão Bernardes >> >>>>>>> <gesiel.bernardes@xxxxxxxxx> wrote: >> >>>>>>>> >> >>>>>>>> Hi everyone, >> >>>>>>>> >> >>>>>>>> I have a problem trying to add an ISCSI gateway. The following error is generated when trying to add the new gateway: >> >>>>>>>> >> >>>>>>>> iscsi-target...-igw/gateways> create ceph-iscsi3 192.168.201.3 >> >>>>>>>> Adding gateway, sync'ing 3 disk(s) and 2 client(s) >> >>>>>>>> Failed : /etc/ceph/iscsi-gateway.cfg on ceph-iscsi3 does not match the local version. Correct and retry request >> >>>>>>>> >> >>>>>>>> But the file iscsi-gateway.cfg is exactly the same in all gateways. >> >>>>>>>> Selinux is disabled, permissios are OK too. >> >>>>>>>> >> >>>>>>>> I using ceph 13.2.6. Can anyone help-me? >> >>>>>>>> >> >>>>>>>> Regards >> >>>>>>>> Gesiel >> >>>>>>>> >> >>>>>>>> _______________________________________________ >> >>>>>>>> ceph-users mailing list -- ceph-users@xxxxxxx >> >>>>>>>> To unsubscribe send an email to ceph-users-leave@xxxxxxx >> >>>>>>> >> >>>>>>> >> >>>>>>> >> >>>>>>> -- >> >>>>>>> Jason >> >>>>>>> >> >>>>> >> >>>>> >> >>>>> -- >> >>>>> Jason >> >>>>> >> >>> >> >>> >> >>> -- >> >>> Jason >> >>> >> > >> > >> -- Jason _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx