Configuring Ceph using multiple networks

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 





I have successfully installed Luminous on Ubutnu  16.04 by one network.
 
Now I am trying to install same by using two networks this.(on different machine)
public network =   192.168.10.0/24
cluster network =  172.16.50.0/24
 
Eeach node has two interfaces. One in public network other in cluster network.
 
 
While creating the initial monitors  facing the the below error
 
“Some monitors have still not reached quorum”
 
Below is /etc/hosts file on each host
172.16.50.1 mon1
172.16.50.2 mon2
172.16.50.3 mon3
172.16.50.4 osd1
172.16.50.5 osd2
 
This is ceph.conf  file
mon1:/home/cephadmin/my-cluster# cat ceph.conf
[global]
fsid = 7f0ffa2b-7528-407b-8a63-360741d80939
mon_initial_members = mon1, mon2, mon3
mon_host = 172.16.50.1,172.16.50.2,172.16.50.3
auth_cluster_required = cephx
auth_service_required = cephx
auth_client_required = cephx
 
# Public and cluster network
public network =   192.168.10.0/24
cluster network =  172.16.50.0/24
# Write an object 2 times
osd pool default size = 2
# 1 for a multi node cluster in a single rack
osd crush chooseleaf type = 1
 
 
 
While searching on net , I found same error discussed in below post
 
 
I am observing same error in my case  that during ceph-deploy mon create-initial  all devices name are not resolving properly.
 
Log:
[2017-10-07 00:31:18,975][mon1][DEBUG ] status for monitor: mon.mon1
[2017-10-07 00:31:18,976][mon1][DEBUG ] {
[2017-10-07 00:31:18,976][mon1][DEBUG ]   "election_epoch": 0,
[2017-10-07 00:31:18,976][mon1][DEBUG ]   "extra_probe_peers": [
[2017-10-07 00:31:18,976][mon1][DEBUG ]     "172.16.50.1:6789/0",
[2017-10-07 00:31:18,977][mon1][DEBUG ]     "172.16.50.2:6789/0",
[2017-10-07 00:31:18,977][mon1][DEBUG ]     "172.16.50.3:6789/0
[2017-10-07 00:31:18,982][mon1][DEBUG ]         "addr": "192.168.10.31:6789/0",
[2017-10-07 00:31:18,982][mon1][DEBUG ]         "name": "mon1",
[2017-10-07 00:31:18,982][mon1][DEBUG ]         "public_addr": "192.168.10.31:6789/0",
[2017-10-07 00:31:18,982][mon1][DEBUG ]         "rank": 0
[2017-10-07 00:31:18,983][mon1][DEBUG ]       },
[2017-10-07 00:31:18,983][mon1][DEBUG ]       {
[2017-10-07 00:31:18,983][mon1][DEBUG ]         "addr": "0.0.0.0:0/1",
[2017-10-07 00:31:18,983][mon1][DEBUG ]         "name": "mon2",
[2017-10-07 00:31:18,983][mon1][DEBUG ]         "public_addr": "0.0.0.0:0/1",
[2017-10-07 00:31:18,983][mon1][DEBUG ]         "rank": 1
[2017-10-07 00:31:18,984][mon1][DEBUG ]       },
[2017-10-07 00:31:18,984][mon1][DEBUG ]       {
[2017-10-07 00:31:18,984][mon1][DEBUG ]         "addr": "0.0.0.0:0/2",
[2017-10-07 00:31:18,984][mon1][DEBUG ]         "name": "mon3",
[2017-10-07 00:31:18,984][mon1][DEBUG ]         "public_addr": "0.0.0.0:0/2",
[2017-10-07 00:31:18,985][mon1][DEBUG ]         "rank": 2
 
 
 
I configured the DNS also as suggested solution in above link, but  issue did not resolve.
 
Can some one help in this regard?
 
I am not sue in DNSlooup name should be resolve to node’s public IP or cluster IP?
 
In /etc/hosts file which IP of nodes should use cluster or public ?
 
 
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux