Re: New user questions with radosgw with Jewel 10.2.1

"Sylvain, Eric" <Eric.Sylvain@xxxxxxxxx> · Tue, 7 Jun 2016 17:14:25 +0000

Hi JC,

Thanks for the reply.

Yes, my system is set to run as “ceph”:

/etc/systemd/system/ceph-radosgw.target.wants/ceph-radosgw@rgw.p6-os1-mon7.service
       ExecStart=/usr/bin/radosgw -f --cluster ${CLUSTER} --name client.%i -conf  --setuser ceph --setgroup ceph

Yet changing these to “root” has no effect.
   ExecStart=/usr/bin/radosgw -f --cluster ${CLUSTER} --name client.%i -conf  --setuser root --setgroup root

Also doing: chown root.root /usr/bin/radosgw; chmod 4755 /usr/bin/radosgw
Had no effect.

I feel the issue is in reading /etc/ceph/ceph.conf, because even if I change

   rgw frontends = “bogus bogus bogus”
Expecting some failure, it still started up fine (on port 7480).

The config still says:
    # ceph --admin-daemon /var/run/ceph/ceph-client.rgw.p6-os1-mon7.asok config show
    …
    "rgw_frontends": "fastcgi, civetweb port=7480",
    …

Again suspecting keyring I created “client.radosgw.gateway” and changed ceph.conf for it, to see if that would help, no luck…

Could this be tied to having admin, mon and radosgw on same host?

Does keyring restrict what parts of ceph.conf are available?

Thanks in advance for anything you can provide

-Eric

From: LOPEZ Jean-Charles [mailto:jelopez@xxxxxxxxxx]

Sent: Tuesday, May 24, 2016 1:52 PM

To: Sylvain, Eric <Eric.Sylvain@xxxxxxxxx>

Cc: ceph-users@xxxxxxxx

Subject: Re: [ceph-users] New user questions with radosgw with Jewel 10.2.1

Hi Sylvain,

this is probably related to the fact that the systemd unit file for the RGW is configured to run as user ceph. As ceph is not a privileged user, it can not bind to lower port numbers.

Modify the ceph-radosgw unit file and make sure the set user is set for root.

To verify this is the root cause, manually start the ceph-radosgw process from the command line being connected as root. If it works and you can query your RGW on port 80, then it is this problem.

Cheers

JC

On May 23, 2016, at 10:03, Sylvain, Eric <Eric.Sylvain@xxxxxxxxx> wrote:

Hello,

I’m a fairly new user and I am trying to bring up radosgw.

I am following this page: http://docs.ceph.com/docs/master/install/install-ceph-gateway/

I have Jewel 10.2.1 installed with a co-located admin/mon host and a separate osd host

First a question: Can I run radosgw on a co-located admin/monitor host?

And then my issue: I cannot seem to get the frontent (civetweb) to run on port 80.

(I do the following)

su – ceph

cd my-cluster

sudo ceph-deploy install –rgw p6-os1-mon2

ceph-deploy --overwrite-conf rgw create p6-os1-mon

   (Note it says: The Ceph Object Gateway (RGW) is now running on host p6-os1-mon2 and default port 7480)

   (Testing to http://p6-os1-mon2:7480 show
 the correct info)

Edit ~ceph/my-cluster/ceph.conf and add:

   [client.radosgw.p6-os1-mon2]

   rgw_frontends = "civetweb port=80”

Reboot p6-os1/mon2

After everything is back up, try http://p6-os1-mon2:80

   No luck, it appears it is still running at 7480…

What am I missing that would make radosgw get the correct port?

(Running by hand, I see “listening_ports”

2016-05-23 12:13:43.479136 7fc0793f7a40 20 civetweb config: decode_url: no

2016-05-23 12:13:43.479138 7fc0793f7a40 20 civetweb config: enable_keep_alive: yes

2016-05-23 12:13:43.479138 7fc0793f7a40 20 civetweb config: listening_ports: 7480

2016-05-23 12:13:43.479139 7fc0793f7a40 20 civetweb config: num_threads: 100

2016-05-23 12:13:43.479140 7fc0793f7a40 20 civetweb config: run_as_user: ceph

    I suspected maybe the keyring? So I did:

      $ sudo rm -rf /etc/ceph/ceph.client.radosgw.keyring

      $ sudo ceph-authtool --create-keyring /etc/ceph/ceph.client.radosgw.keyring

      $ sudo chmod +r /etc/ceph/ceph.client.radosgw.keyring

      $ sudo ceph-authtool /etc/ceph/ceph.client.radosgw.keyring -n client.radosgw.p6-os1-mon2

      $ sudo ceph-authtool /etc/ceph/ceph.client.radosgw.keyring -n client.radosgw.p6-os1-mon2 --gen-key

      $ sudo ceph-authtool -n client.radosgw.p6-os1-mon2 --cap osd 'allow rwx' --cap mon 'allow rwx' /etc/ceph/ceph.client.radosgw.keyring

      $ sudo ceph -k /etc/ceph/ceph.client.admin.keyring auth add client.radosgw.p6-os1-mon2 -i /etc/ceph/ceph.client.radosgw.keyring

      (Also copied to to my osd node…)

      Reboot everything, still no luck civetweb remains on 7480

Ideas? Comments?

_______________________________________________

ceph-users mailing list

ceph-users@xxxxxxxxxxxxxx

http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com