Re: ceph-mon listens on wrong interface

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 






On Mon, Aug 26, 2013 at 3:41 PM, Fuchs, Andreas (SwissTXT) <Andreas.Fuchs@xxxxxxxxxxx> wrote:
Hi Sage

Many thanks for your answer. The Cluster is now up and running and "talking" on the right interfaces.

Regards
Andi

-----Original Message-----
From: Sage Weil [mailto:sage@xxxxxxxxxxx]
Sent: Montag, 26. August 2013 18:20
To: Fuchs, Andreas (SwissTXT)
Cc: ceph-users@xxxxxxxx
Subject: RE: ceph-mon listens on wrong interface

On Mon, 26 Aug 2013, Fuchs, Andreas (SwissTXT) wrote:
> Hi Sage
>
> Thanks for your answer
>
> I had ceph.conf already adjusted
>   mon_hosts has the list of public ip's of the mon servers
>
> but ceph-mon is listening on eth0 instead of the ip listed in
> mon_hosts
>
> also entering [mon.ceph-ceph01] sections with host= and mon_addr=
> entries did not change this
>
> do I have to redeploy the installation, so far I just pushed the new config and restarted the services?

You will need to redeploy.  ceph-deploy purge and ceph-deploy purgedata to reset your nodes.

> Btw.
> ceph-deploy new ceph01:10.100.214.x ... wont't work as it requires a
> name not an ip, but in my case ceph01 resolves to the correct ip

Andreas, I confirmed this was the case and it is indeed a bug, so I created a ticket and I just got it
merged and fixed in the master branch. Ticket link: http://tracker.ceph.com/issues/6124

There should be a bug-fix release later this week including this change. Thanks for reporting it!

Interesting; we should make ceph-deploy take an IP there too.

sage

>
> regards
> Andi
>
> -----Original Message-----
> From: Sage Weil [mailto:sage@xxxxxxxxxxx]
> Sent: Freitag, 23. August 2013 17:28
> To: Fuchs, Andreas (SwissTXT)
> Cc: ceph-users@xxxxxxxx
> Subject: Re: ceph-mon listens on wrong interface
>
> Hi Andreas,
>
> On Fri, 23 Aug 2013, Fuchs, Andreas (SwissTXT) wrote:
> > Hi, we built a ceph cluster with the folling network setup
> >
> > eth0 is on a management network (access for admins and monitoring
> > tools)
> > eth1 is ceph sync
> > eth2 is ceph public
> >
> > deployed by ceph-deploy I have the following config
> >
> > [global]
> > fsid = 18c6b4db-b936-43a2-ba68-d750036036cc
> > mon_initial_members = ceph01, ceph02, ceph03 mon_host =
> > 10.100.214.11,10.100.214.12,10.100.214.13
> > auth_supported = cephx
> > osd_journal_size = 5000
> > filestore_xattr_use_omap = true
> > public_network = 10.100.214.0/24
> > cluster_network = 10.100.213.0/24
> >
> > the problem is now that ceph-mon is listening on eth0
> >
> > netstat -lpn | grep 6789
> > tcp        0      0 10.100.220.111:6789     0.0.0.0:*               LISTEN      1609/ceph-mon
> >
> > where it should listen on eth0 10.100.214.x
> >
> > how can I achieve this?
>
> I assume you used ceph-deploy here?  The problem is that when you do
>
>  ceph-deploy new ceph01 ceph02 ceph03
>
> it is using the ceph01 etc as both the hostname to identify the
> instance
> (good) and looking it up via DNS to resolve the IP for the mon_host
> list (bad, in your case).  Try
>
>  ceph-deploy new ceph01:10.100.214.x ...
>
> or
>
>  ceph-deploy new ceph01:ceph01.myothernetwork.foo.com ...
>
> Or, just manually edit the ceph.conf after the 'ceph-deploy new ...'
> command to get how you want it.
>
> sage
>
>
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux