"unable to connect to cluster" after monitor IP change

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



gentooserver ~ # ceph-mon -i mon0 --extract-monmap /tmp/monmap
2018-04-06 15:38:10.863444 7f8aa2b72f80 -1 wrote monmap to /tmp/monmap
gentooserver ~ # monmaptool --print /tmp/monmap
monmaptool: monmap file /tmp/monmap
epoch 3
fsid a736559a-92d1-483e-9289-d2c7feed510f
last_changed 2018-04-06 14:53:12.892574
created 2018-04-06 14:52:18.190509
0: [2605:6000:1020:2056:7d79:3f08:ee64:2aa3]:6789/0 mon.mon0

This is the monmap I injected into my monitor.


gentooserver ~ # systemctl status ceph-mon@mon0
● ceph-mon@mon0.service - Ceph cluster monitor daemon
   Loaded: loaded (/lib/systemd/system/ceph-mon@.service; indirect; vendor preset: disabled)
   Active: active (running) since Fri 2018-04-06 15:47:51 CDT; 16s ago
 Main PID: 4362 (ceph-mon)
   CGroup: /system.slice/system-ceph\x2dmon.slice/ceph-mon@mon0.service
           └─4362 /usr/bin/ceph-mon -f --cluster ceph --id mon0 --setuser ceph --setgroup ceph

Apr 06 15:47:51 gentooserver systemd[1]: Started Ceph cluster monitor daemon.
Apr 06 15:47:51 gentooserver ceph-mon[4362]: 2018-04-06 15:47:51.841218 7f5824d44f80 -1 distro_detect - can't detect distro_version

gentooserver ~ # systemctl status ceph-mgr@mgr0
● ceph-mgr@mgr0.service - Ceph cluster manager daemon
   Loaded: loaded (/lib/systemd/system/ceph-mgr@.service; indirect; vendor preset: disabled)
   Active: active (running) since Fri 2018-04-06 15:10:01 CDT; 38min ago
 Main PID: 3807 (ceph-mgr)
   CGroup: /system.slice/system-ceph\x2dmgr.slice/ceph-mgr@mgr0.service
           └─3807 /usr/bin/ceph-mgr -f --cluster ceph --id mgr0 --setuser ceph --setgroup ceph

Apr 06 15:10:01 gentooserver systemd[1]: Started Ceph cluster manager daemon.

gentooserver ~ # systemctl status ceph-mds@mds0
● ceph-mds@mds0.service - Ceph metadata server daemon
   Loaded: loaded (/lib/systemd/system/ceph-mds@.service; disabled; vendor preset: disabled)
  Drop-In: /etc/systemd/system/ceph-mds@.service.d
           └─00gentoo.conf
   Active: active (running) since Fri 2018-04-06 15:10:25 CDT; 38min ago
 Main PID: 3827 (ceph-mds)
   CGroup: /system.slice/system-ceph\x2dmds.slice/ceph-mds@mds0.service
           └─3827 /usr/bin/ceph-mds -f --cluster ceph --id mds0 --setuser ceph --setgroup ceph

Apr 06 15:10:25 gentooserver systemd[1]: Started Ceph metadata server daemon.
Apr 06 15:10:25 gentooserver ceph-mds[3827]: starting mds.mds0 at -

All the daemons report they are running.


gentooserver ~ # ceph daemon mon.mon0 mon_status
{
    "name": "mon0",
    "rank": 0,
    "state": "leader",
    "election_epoch": 39,
    "quorum": [
        0
    ],
    "features": {
        "required_con": "153140804152475648",
        "required_mon": [
            "kraken",
            "luminous"
        ],
        "quorum_con": "2305244844532236283",
        "quorum_mon": [
            "kraken",
            "luminous"
        ]
    },
    "outside_quorum": [],
    "extra_probe_peers": [],
    "sync_provider": [],
    "monmap": {
        "epoch": 3,
        "fsid": "a736559a-92d1-483e-9289-d2c7feed510f",
        "modified": "2018-04-06 14:53:12.892574",
        "created": "2018-04-06 14:52:18.190509",
        "features": {
            "persistent": [
                "kraken",
                "luminous"
            ],
            "optional": []
        },
        "mons": [
            {
                "rank": 0,
                "name": "mon0",
                "addr": "[2605:6000:1020:2056:7d79:3f08:ee64:2aa3]:6789/0",
                "public_addr": "[2605:6000:1020:2056:7d79:3f08:ee64:2aa3]:6789/0"
            }
        ]
    },
    "feature_map": {
        "mon": {
            "group": {
                "features": "0x1ffddff8eea4fffb",
                "release": "luminous",
                "num": 1
            }
        }
    }
}


gentooserver ~ # cat /etc/ceph/ceph.conf
[global]
cluster = ceph
fsid = a736559a-92d1-483e-9289-d2c7feed510f
ms bind ipv6 = true
auth cluster required = none
auth service required = none
auth client required = none
mon host = gentooserver
mon addr = [2605:6000:1020:2056:7d79:3f08:ee64:2aa3]:6789
mon pg warn max per osd = 300

[mon]
mon initial members = mon0
mon host = gentooserver
mon addr = [2605:6000:1020:2056:7d79:3f08:ee64:2aa3]:6789
mon pg warn max per osd = 300
mon allow pool delete = true

[mon.mon0]
host = gentooserver
mon addr = [2605:6000:1020:2056:7d79:3f08:ee64:2aa3]:6789

[osd]
osd journal size = 10000
osd crush chooseleaf type = 0
host = gentooserver
osd pool default size = 3
osd pool default min size = 2

[mds.mds0]
host = gentooserver


ceph -s times out:

gentooserver ~ # ceph -s
2018-04-06 15:58:29.861647 7f5e7f891700  0 monclient(hunting): authenticate timed out after 300
2018-04-06 15:58:29.861672 7f5e7f891700  0 librados: client.admin authentication error (110) Connection timed out
[errno 110] error connecting to the cluster


The cluster was working before the IP address changed. HELP

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux