Re: ceph-iscsi-cli: cannot remove duplicated gateways.

[Xiubo Li <xiubli@xxxxxxxxxx>]

Cool :-)

On 20/02/2023 10:19, luckydog xf wrote:
> okay, I restored the correct configuration by 'sudo rados put 
> gateway.conf local-gw -p rbd
> Now problems resolved. Thanks and have a nice day.
>
>
> On Mon, Feb 20, 2023 at 10:13 AM Xiubo Li <xiubli@xxxxxxxxxx> wrote:
>
>
>     On 20/02/2023 10:11, luckydog xf wrote:
> >     Oh, please forgive my carelessness.
> >     --
> >     sudo rados -p rbd get gateway.conf local-gw.conf
> >     ---
> >     get all the contents. I'll try to edit it.
>     Correct.
>
>
> >     On Mon, Feb 20, 2023 at 9:50 AM luckydog xf
> >     <luckydogxf@xxxxxxxxx> wrote:
> >
> >         Hi, Xiubo.
> >         I'm not clear about the commands that dump and restore an
> >         object. Could you give me an example?
> >         `rados ls -p rbd` shows tons of uuids.
> >         https://docs.ceph.com/en/latest/man/8/rados/
> >
> >         On Mon, Feb 20, 2023 at 9:30 AM Xiubo Li <xiubli@xxxxxxxxxx>
> >         wrote:
> >
> >             Hi
> >
> >             So you are using the default 'rbd' pool to store
> >             'gateway.conf' config object.
> >
> >             And the 'gateway.conf' is corrupted. If you couldn't
> >             remove it by using force option, then you should dump the
> >             'gateway.conf' object from 'rbd' pool and then delete the
> >             'ceph-iscsi-gw-1.ipa.pthl.hklocalhost.localdomain'
> >             related configures manually and then store it back. Then
> >             to see will it disappear, if not please restart the
> >             ceph-iscsi services.
> >
> >             If you are not sure what should be deleted you can send
> >             it to me, I will help revise it for you.
> >
> >             Thanks
> >
> >             - Xiubo
> >
> >             On 20/02/2023 09:20, luckydog xf wrote:
> > >                 Hi,
> > >
> > >                 [root@ceph-iscsi-gw-1 ~]# gwcli ls
> > >                 o- /
> > >                 .........................................................................................................................
> > >                 [...]
> > >                   o- cluster
> > >                 .........................................................................................................
> > >                 [Clusters: 1]
> > >                   | o- ceph
> > >                 ............................................................................................................
> > >                 [HEALTH_OK]
> > >                   |   o- pools
> > >                 .........................................................................................................
> > >                 [Pools: 22]
> > >                   |   | o- .rgw.root
> > >                 ..............................................................
> > >                 [(x3), Commit: 0.00Y/115222232M (0%), Used: 52K]
> > >                   |   | o- cinder-ceph
> > >                 ................................................
> > >                 [(x3), Commit: 0.00Y/115222232M (0%), Used:
> > >                 28703946995700b]
> > >                   |   | o- default.rgw.buckets.data
> > >                 ............................................. [(x3),
> > >                 Commit: 0.00Y/115222232M (0%), Used: 4587b]
> > >                   |   | o- default.rgw.buckets.extra
> > >                 ............................................ [(x3),
> > >                 Commit: 0.00Y/115222232M (0%), Used: 0.00Y]
> > >                   |   | o- default.rgw.buckets.index
> > >                 ............................................ [(x3),
> > >                 Commit: 0.00Y/115222232M (0%), Used: 0.00Y]
> > >                   |   | o- default.rgw.control
> > >                 ..................................................
> > >                 [(x3), Commit: 0.00Y/115222232M (0%), Used: 0.00Y]
> > >                   |   | o- default.rgw.data.root
> > >                 ................................................
> > >                 [(x3), Commit: 0.00Y/115222232M (0%), Used: 0.00Y]
> > >                   |   | o- default.rgw.gc
> > >                 .......................................................
> > >                 [(x3), Commit: 0.00Y/115222232M (0%), Used: 0.00Y]
> > >                   |   | o- default.rgw.intent-log
> > >                 ...............................................
> > >                 [(x3), Commit: 0.00Y/115222232M (0%), Used: 0.00Y]
> > >                   |   | o- default.rgw.log
> > >                 .......................................................
> > >                 [(x3), Commit: 0.00Y/115222232M (0%), Used: 384K]
> > >                   |   | o- default.rgw.meta
> > >                 .......................................................
> > >                 [(x3), Commit: 0.00Y/115222232M (0%), Used: 24K]
> > >                   |   | o- default.rgw.usage
> > >                 ....................................................
> > >                 [(x3), Commit: 0.00Y/115222232M (0%), Used: 0.00Y]
> > >                   |   | o- default.rgw.users.email
> > >                 ..............................................
> > >                 [(x3), Commit: 0.00Y/115222232M (0%), Used: 0.00Y]
> > >                   |   | o- default.rgw.users.keys
> > >                 ...............................................
> > >                 [(x3), Commit: 0.00Y/115222232M (0%), Used: 0.00Y]
> > >                   |   | o- default.rgw.users.swift
> > >                 ..............................................
> > >                 [(x3), Commit: 0.00Y/115222232M (0%), Used: 0.00Y]
> > >                   |   | o- default.rgw.users.uid
> > >                 ................................................
> > >                 [(x3), Commit: 0.00Y/115222232M (0%), Used: 0.00Y]
> > >                   |   | o- device_health_metrics
> > >                 ........................................... [(x3),
> > >                 Commit: 0.00Y/115222232M (0%), Used: 305303172b]
> > >                   |   | o- glance
> > >                 .......................................................
> > >                 [(x3), Commit: 0.00Y/115222232M (0%), Used:
> > >                 525074107902b]
> > >                   |   | o- gnocchi
> > >                 .........................................................
> > >                 [(x3), Commit: 0.00Y/115222232M (0%), Used: 989498938b]
> > >                   |   | o- nova
> > >                 ...................................................................
> > >                 [(x3), Commit: 0.00Y/115222232M (0%), Used: 12K]
> > >                   |   | o- rbd
> > >                 ........................................................
> > >                 [(x3), Commit: 20.0T/115222232M (18%), Used:
> > >                 3274867542037b]
> > >                   |   | o- scbench
> > >                 ..........................................................
> > >                 [(x3), Commit: 0.00Y/115222232M (0%), Used: 88829964K]
> > >                   |   o- topology
> > >                 ..............................................................................................
> > >                 [OSDs: 108,MONs: 3]
> > >                   o- disks
> > >                 .......................................................................................................
> > >                 [20.0T, Disks: 1]
> > >                   | o- rbd
> > >                 ...........................................................................................................
> > >                 [rbd (20.0T)]
> > >                   |   o- ceph-iscsi
> > >                 ...............................................................................
> > >                 [rbd/ceph-iscsi (Online, 20.0T)]
> > >                   o- iscsi-targets
> > >                 ...............................................................................
> > >                 [DiscoveryAuth: None, Targets: 1]
> > >                     o- iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw
> > >                 .........................................................
> > >                 [Auth: None, Gateways: 3]
> > >                       o- disks
> > >                 ..........................................................................................................
> > >                 [Disks: 1]
> > >                       | o- rbd/ceph-iscsi
> > >                 .............................................................
> > >                 [Owner: ceph-iscsi-gw-1.ipa.pthl.hk
> > >                 <http://ceph-iscsi-gw-1.ipa.pthl.hk>, Lun: 0]
> > >                       o- gateways
> > >                 ............................................................................................
> > >                 [Up: 2/3, Portals: 3]
> > >                       | o- ceph-iscsi-gw-1.ipa.pthl.hk
> > >                 <http://ceph-iscsi-gw-1.ipa.pthl.hk>
> > >                 .......................................................................
> > >                 [172.16.202.251 (UP)]
> > >                       | o-
> > >                 ceph-iscsi-gw-1.ipa.pthl.hklocalhost.localdomain
> > >                 .............................................
> > >                 [172.16.202.251 (UNKNOWN)]
> > >                       | o- ceph-iscsi-gw-2.ipa.pthl.hk
> > >                 <http://ceph-iscsi-gw-2.ipa.pthl.hk>
> > >                 .......................................................................
> > >                 [172.16.202.252 (UP)]
> > >                       o- host-groups
> > >                 ..................................................................................................
> > >                 [Groups : 0]
> > >                       o- hosts
> > >                 ......................................................................................
> > >                 [Auth: ACL_DISABLED, Hosts: 0]
> > >
> > >
> > >
> > >             ===
> > >             [root@ceph-iscsi-gw-1 ~]# cat /etc/ceph/iscsi-gateway.cfg
> > >             [config]
> > >             # Name of the Ceph storage cluster. A suitable Ceph
> > >             configuration file allowing
> > >             # access to the Ceph storage cluster from the gateway
> > >             node is required, if not
> > >             # colocated on an OSD node.
> > >             cluster_name = ceph
> > >
> > >             # Place a copy of the ceph cluster's admin keyring in
> > >             the gateway's /etc/ceph
> > >             # drectory and reference the filename here
> > >             gateway_keyring = ceph.client.admin.keyring
> > >
> > >
> > >             # API settings.
> > >             # The API supports a number of options that allow you to
> > >             tailor it to your
> > >             # local environment. If you want to run the API under
> > >             https, you will need to
> > >             # create cert/key files that are compatible for each
> > >             iSCSI gateway node, that is
> > >             # not locked to a specific node. SSL cert and key files
> > >             *must* be called
> > >             # 'iscsi-gateway.crt' and 'iscsi-gateway.key' and placed
> > >             in the '/etc/ceph/' directory
> > >             # on *each* gateway node. With the SSL files in place,
> > >             you can use 'api_secure = true'
> > >             # to switch to https mode.
> > >
> > >             # To support the API, the bare minimum settings are:
> > >             api_secure = false
> > >
> > >             # Additional API configuration options are as follows,
> > >             defaults shown.
> > >             api_user = admin
> > >             api_password = admin
> > >             api_port = 5001
> > >             # API IP
> > >             trusted_ip_list = 172.16.200.251,172.16.200.252
> >
> >             -- 
> >             Best Regards,
> >
> >             Xiubo Li (李秀波)
> >
> >             Email:xiubli@xxxxxxxxxx/xiubli@xxxxxxx
> >             Slack: @Xiubo Li
>     -- 
>     Best Regards,
>
>     Xiubo Li (李秀波)
>
>     Email:xiubli@xxxxxxxxxx/xiubli@xxxxxxx
>     Slack: @Xiubo Li
--
Best Regards,

Xiubo Li (李秀波)

Email:xiubli@xxxxxxxxxx/xiubli@xxxxxxx
Slack: @Xiubo Li
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx