Re: modify civetweb default port won't work

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Thank you Iban.
Can you please also send me the output of : ps -ef ! grep rgw 
Many Thanks.

On Mar 13, 2017 7:32 PM, "Iban Cabrillo" <cabrillo@xxxxxxxxxxxxxx> wrote:
HI Yair,
  This is my conf:

[client.rgw.cephrgw]
host = cephrgw01
rgw_frontends = "civetweb port=8080s ssl_certificate=/etc/pki/tls/cephrgw01.crt"
rgw_zone = RegionOne
keyring = /etc/ceph/ceph.client.rgw.cephrgw.keyring
log_file = /var/log/ceph/client.rgw.cephrgw.log
rgw_keystone_url = https://keystone.xxx,xx:5000
rgw_keystone_admin_user = cloud
rgw_keystone_admin_password = XXXXXXXXXXXXXXX 
rgw_keystone_admin_tenant = service
rgw_keystone_accepted_roles = admin member _member_
rgw keystone admin project = service
rgw keystone admin domain = admin
rgw keystone api version = 2
rgw_s3_auth_use_keystone = true
nss_db_path = /var/ceph/nss/
rgw_keystone_verify_ssl = true

Regards, I

2017-03-13 17:28 GMT+01:00 Yair Magnezi <yair.magnezi@xxxxxxxxxxx>:
But per the doc the client stanza should include  client.radosgw.instance_name 


[client.rgw.ceph-rgw-02]
host = ceph-rgw-02
keyring = /etc/ceph/ceph.client.radosgw.keyring
log file = /var/log/radosgw/client.radosgw.gateway.log
rgw_frontends = "civetweb port=8080"


"For example, if your node name is gateway-node1, add a section like this after the [global] section:

[client.rgw.gateway-node1]
rgw_frontends = "civetweb port=80" " 


Here, {hostname} is the short hostname (output of command hostname -s) of the node that is going to provide the gateway service i.e, the gateway host.

The [client.radosgw.gateway] portion of the gateway instance identifies this portion of the Ceph configuration file as configuring a Ceph Storage Cluster client where the client type is a Ceph Object Gateway (i.e., radosgw).


Does anyone run the RGW on a different port and can share his configuration ? 

Thanks







On Mon, Mar 13, 2017 at 5:28 PM, Abhishek Lekshmanan <abhishek@xxxxxxxx> wrote:


On 03/13/2017 04:06 PM, Yair Magnezi wrote:
Thank you Abhishek

But still ...

root@ceph-rgw-02:/var/log/ceph# ps -ef | grep rgw
ceph      1332     1  1 14:59 ?        00:00:00 /usr/bin/radosgw
--cluster=ceph --id *rgw.ceph-rgw-02* -f --setuser ceph --setgroup ceph


root@ceph-rgw-02:/var/log/ceph# cat /etc/ceph/ceph.conf
[global]
fsid = 00c167db-aea1-41b4-903b-69b0c86b6a0f
mon_initial_members = ceph-osd-01 ceph-osd-02
mon_host = 10.83.1.78,10.83.1.79
auth_cluster_required = cephx
auth_service_required = cephx
auth_client_required = cephx
public_network = 10.83.1.0/24 <http://10.83.1.0/24>
rbd default features = 3
#debug ms = 1
#debug rgw = 20

[client.radosgw.*rgw.ceph-rgw-02*]
host = ceph-rgw-02
keyring = /etc/ceph/ceph.client.radosgw.keyring
log file = /var/log/radosgw/client.radosgw.gateway.log
rgw_frontends = "civetweb port=8080"


Try client.rgw.ceph-rgw-02 here (and similar in id), ie. basically what you pass as the id should be what the ceph.conf section should look like.


root@ceph-rgw-02:/var/log/ceph# netstat -an | grep 80
tcp        0      0 0.0.0.0:7480 <http://0.0.0.0:7480>
 0.0.0.0:*               LISTEN
tcp        0      0 10.83.1.100:56884 <http://10.83.1.100:56884>
10.83.1.78:6800 <http://10.83.1.78:6800>         ESTABLISHED
tcp        0      0 10.83.1.100:47842 <http://10.83.1.100:47842>
10.83.1.78:6804 <http://10.83.1.78:6804>         TIME_WAIT
tcp        0      0 10.83.1.100:47846 <http://10.83.1.100:47846>
10.83.1.78:6804 <http://10.83.1.78:6804>         ESTABLISHED
tcp        0      0 10.83.1.100:44791 <http://10.83.1.100:44791>
10.83.1.80:6804 <http://10.83.1.80:6804>         ESTABLISHED
tcp        0      0 10.83.1.100:44782 <http://10.83.1.100:44782>
10.83.1.80:6804 <http://10.83.1.80:6804>         TIME_WAIT
tcp        0      0 10.83.1.100:38082 <http://10.83.1.100:38082>
10.83.1.80:6789 <http://10.83.1.80:6789>         ESTABLISHED
tcp        0      0 10.83.1.100:41999 <http://10.83.1.100:41999>
10.83.1.80:6800 <http://10.83.1.80:6800>         ESTABLISHED
tcp        0      0 10.83.1.100:59681 <http://10.83.1.100:59681>
10.83.1.79:6800 <http://10.83.1.79:6800>         ESTABLISHED
tcp        0      0 10.83.1.100:37590 <http://10.83.1.100:37590>
10.83.1.79:6804 <http://10.83.1.79:6804>         ESTABLISHED


2017-03-13 15:05:23.836844 7f5c2fc80900  0 starting handler: civetweb
2017-03-13 15:05:23.838497 7f5c11379700  0 -- 10.83.1.100:0/2130438046
<http://10.83.1.100:0/2130438046> submit_message
mon_subscribe({osdmap=48}) v2 remote, 10.83.1.78:6789/0
<http://10.83.1.78:6789/0>, failed lossy con, dropping message
0x7f5bfc011850
2017-03-13 15:05:23.842769 7f5c11379700  0 monclient: hunting for new mon
2017-03-13 15:05:23.846976 7f5c2fc80900  0 starting handler: fastcgi
2017-03-13 15:05:23.849245 7f5b87a6a700  0 ERROR: no socket server point
defined, cannot start fcgi frontend




Any more ideas

Thanks




*
*
**



On Mon, Mar 13, 2017 at 4:34 PM, Abhishek Lekshmanan <abhishek@xxxxxxxx
<mailto:abhishek@xxxxxxxx>> wrote:



    On 03/13/2017 03:26 PM, Yair Magnezi wrote:

        Hello Wido

        yes , the is my  /etc/cep/ceph.conf

        and yes  radosgw.ceph-rgw-02 is the running instance .

        root@ceph-rgw-02:/var/log/ceph# ps -ef | grep -i rgw
        ceph     17226     1  0 14:02 ?        00:00:01 /usr/bin/radosgw
        --cluster=ceph --id rgw.ceph-rgw-02 -f --setuser ceph --setgroup
        ceph


    The ID passed to rgw here is `rgw.ceph-rgw-02`, whereas your conf
    has a section named `radosgw.ceph-rgw-02` try running this service
    (systemctl start ceph-radosgw@xxxxxxxxxxxx-rgw-02 maybe?)

    --
    Abhishek Lekshmanan
    SUSE Linux GmbH, GF: Felix Imendörffer, Jane Smithard, Graham
    Norton, HRB 21284 (AG Nürnberg)


        Thanks



        *Yair Magnezi *
        *Storage & Data Protection TL   // *Kenshoo*
        *Office* +972 7 32862423 <tel:%2B972%207%2032862423>   //
        *Mobile* +972 50 575-2955 <tel:%2B972%2050%20575-2955>
        __________________________________________
        *
        **



        On Mon, Mar 13, 2017 at 4:06 PM, Wido den Hollander
        <wido@xxxxxxxx <mailto:wido@xxxxxxxx>
        <mailto:wido@xxxxxxxx <mailto:wido@xxxxxxxx>>> wrote:


            > Op 13 maart 2017 om 15:03 schreef Yair Magnezi
            <yair.magnezi@xxxxxxxxxxx <mailto:yair.magnezi@kenshoo.com>
        <mailto:yair.magnezi@kenshoo.com

        <mailto:yair.magnezi@kenshoo.com>>>:
            >
            >
            > Hello Cephers .
            >
            > I'm trying to modify the   civetweb default  port to 80
        but from some
            > reason it insists on listening on the default 7480 port
            >
            > My configuration is quiet  simple ( experimental  ) and
        looks like this :
            >
            >
            > [global]
            > fsid = 00c167db-aea1-41b4-903b-69b0c86b6a0f
            > mon_initial_members = ceph-osd-01 ceph-osd-02
            > mon_host = 10.83.1.78,10.83.1.79
            > auth_cluster_required = cephx
            > auth_service_required = cephx
            > auth_client_required = cephx
            > public_network = 10.83.1.0/24 <http://10.83.1.0/24>
        <http://10.83.1.0/24>
            > rbd default features = 3
            > #debug ms = 1
            > #debug rgw = 20
            >
            > [client.radosgw.ceph-rgw-02]
            > host = ceph-rgw-02
            > keyring = /etc/ceph/ceph.client.radosgw.keyring
            > log file = /var/log/radosgw/client.radosgw.gateway.log
            > rgw_frontends = "civetweb port=80"
            >
            >

            Are you sure this is in /etc/ceph/ceph.conf?

            In addition, are you also sure the RGW is running as user
            'radosgw.ceph-rgw-02' ?

            Wido

            > after restart still the same :
            >
            > root@ceph-rgw-02:/var/log/ceph# netstat -an |  grep 80
            > *tcp        0      0 0.0.0.0:7480 <http://0.0.0.0:7480>
        <http://0.0.0.0:7480>
            <http://0.0.0.0:7480>
            >  0.0.0.0:*               LISTEN*
            > tcp        0      0 10.83.1.100:56697
        <http://10.83.1.100:56697> <http://10.83.1.100:56697>
                 10.83.1.79:6804 <http://10.83.1.79:6804>
        <http://10.83.1.79:6804>
            > ESTABLISHED
            > tcp        0      0 10.83.1.100:59482
        <http://10.83.1.100:59482> <http://10.83.1.100:59482>
                 10.83.1.79:6800 <http://10.83.1.79:6800>
        <http://10.83.1.79:6800>
            > TIME_WAIT
            > tcp        0      0 10.83.1.100:33129
        <http://10.83.1.100:33129> <http://10.83.1.100:33129>
                 10.83.1.78:6804 <http://10.83.1.78:6804>
        <http://10.83.1.78:6804>
            > ESTABLISHED
            > tcp        0      0 10.83.1.100:56318
        <http://10.83.1.100:56318> <http://10.83.1.100:56318>
                 10.83.1.80:6804 <http://10.83.1.80:6804>
        <http://10.83.1.80:6804>
            > TIME_WAIT
            > tcp        0      0 10.83.1.100:56324
        <http://10.83.1.100:56324> <http://10.83.1.100:56324>
                 10.83.1.80:6804 <http://10.83.1.80:6804>
        <http://10.83.1.80:6804>
            > ESTABLISHED
            > tcp        0      0 10.83.1.100:60990
        <http://10.83.1.100:60990> <http://10.83.1.100:60990>
                 10.83.1.78:6800 <http://10.83.1.78:6800>
        <http://10.83.1.78:6800>
            > ESTABLISHED
            > tcp        0      0 10.83.1.100:60985
        <http://10.83.1.100:60985> <http://10.83.1.100:60985>
                 10.83.1.78:6800 <http://10.83.1.78:6800>
        <http://10.83.1.78:6800>
            > TIME_WAIT
            > tcp        0      0 10.83.1.100:56691
        <http://10.83.1.100:56691> <http://10.83.1.100:56691>
                 10.83.1.79:6804 <http://10.83.1.79:6804>
        <http://10.83.1.79:6804>
            > TIME_WAIT
            > tcp        0      0 10.83.1.100:33123
        <http://10.83.1.100:33123> <http://10.83.1.100:33123>
                 10.83.1.78:6804 <http://10.83.1.78:6804>
        <http://10.83.1.78:6804>
            > TIME_WAIT
            > tcp        0      0 10.83.1.100:59494
        <http://10.83.1.100:59494> <http://10.83.1.100:59494>
                 10.83.1.79:6800 <http://10.83.1.79:6800>
        <http://10.83.1.79:6800>
            > ESTABLISHED
            > tcp        0      0 10.83.1.100:55924
        <http://10.83.1.100:55924> <http://10.83.1.100:55924>
                 10.83.1.80:6800 <http://10.83.1.80:6800>
        <http://10.83.1.80:6800>
            > ESTABLISHED
            > tcp        0      0 10.83.1.100:57629
        <http://10.83.1.100:57629> <http://10.83.1.100:57629>
                 10.83.1.80:6789 <http://10.83.1.80:6789>
        <http://10.83.1.80:6789>
            > ESTABLISHED
            >
            >
            > Besides that it also looks like the service tries  to
        start the
            fcgi  (
            > besides the civetweb ) is there a reason for that ?  (
        fastcgi &
            Apache are
            > not  installed )  ?
            >
            >
            > 2017-03-13 13:44:35.938897 7f05f3fd7700  1 handle_sigterm set
            alarm for 120
            > 2017-03-13 13:44:35.938916 7f06692c7900 -1 shutting down
            > 2017-03-13 13:44:36.170559 7f06692c7900  1 final shutdown
            > 2017-03-13 13:45:13.980814 7fbdb2e6c900  0 deferred set
        uid:gid to
            > 64045:64045 (ceph:ceph)
            > 2017-03-13 13:45:13.980992 7fbdb2e6c900  0 ceph version 10.2.6
            > (656b5b63ed7c43bd014bcafd81b001959d5f089f), process
        radosgw, pid 16995
            > *2017-03-13 13:45:14.115639 7fbdb2e6c900  0 starting handler:
            civetweb*
            > 2017-03-13 13:45:14.117003 7fbd8ffff700  0 --
        10.83.1.100:0/3241919968 <http://10.83.1.100:0/3241919968>
        <http://10.83.1.100:0/3241919968 <http://10.83.1.100:0/3241919968>>

            > submit_message mon_subscribe({osdmap=48}) v2 remote,
        10.83.1.78:6789/0 <http://10.83.1.78:6789/0>
        <http://10.83.1.78:6789/0>,

            > failed lossy con, dropping message 0x7fbd78011cc0
            > 2017-03-13 13:45:14.117644 7fbd8ffff700  0 monclient:
        hunting for new mon
            > *2017-03-13 13:45:14.120767 7fbdb2e6c900  0 starting
        handler: fastcgi*
            > *2017-03-13 13:45:14.123000 7fbd09f7b700  0 ERROR: no socket
            server point
            > defined, cannot start fcgi frontend*
            >
            >
            > Any idea what do i miss here
            >
            >
            > ceph version --> 10.2.6
            > ceph-rgw-02 is the gateway .
            >
            > Many Thanks
            >
            > Yair
            >
            > --
            > This e-mail, as well as any attached document, may contain
            material which
            > is confidential and privileged and may include trademark,
            copyright and
            > other intellectual property rights that are proprietary to
        Kenshoo
            Ltd,
            >  its subsidiaries or affiliates ("Kenshoo"). This e-mail
        and its
            > attachments may be read, copied and used only by the
        addressee for the
            > purpose(s) for which it was disclosed herein. If you have
        received
            it in
            > error, please destroy the message and any attachment, and
        contact us
            > immediately. If you are not the intended recipient, be
        aware that any
            > review, reliance, disclosure, copying, distribution or use
        of the
            contents
            > of this message without Kenshoo's express permission is
        strictly
            prohibited.
            > _______________________________________________
            > ceph-users mailing list
            > ceph-users@xxxxxxxxxxxxxx
        <mailto:ceph-users@xxxxxxxxxx.com>
        <mailto:ceph-users@xxxxxxxxxx.com

        <mailto:ceph-users@xxxxxxxxxx.com>>
            > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
        <http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com>
            <http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
        <http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com>>



        This e-mail, as well as any attached document, may contain material
        which is confidential and privileged and may include trademark,
        copyright and other intellectual property rights that are
        proprietary to
        Kenshoo Ltd,  its subsidiaries or affiliates ("Kenshoo"). This
        e-mail
        and its attachments may be read, copied and used only by the
        addressee
        for the purpose(s) for which it was disclosed herein. If you have
        received it in error, please destroy the message and any
        attachment, and
        contact us immediately. If you are not the intended recipient,
        be aware
        that any review, reliance, disclosure, copying, distribution or
        use of
        the contents of this message without Kenshoo's express permission is
        strictly prohibited.


        _______________________________________________
        ceph-users mailing list
        ceph-users@xxxxxxxxxxxxxx <mailto:ceph-users@xxxxxxxxxx.com>
        http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
        <http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com>



This e-mail, as well as any attached document, may contain material
which is confidential and privileged and may include trademark,
copyright and other intellectual property rights that are proprietary to
Kenshoo Ltd,  its subsidiaries or affiliates ("Kenshoo"). This e-mail
and its attachments may be read, copied and used only by the addressee
for the purpose(s) for which it was disclosed herein. If you have
received it in error, please destroy the message and any attachment, and
contact us immediately. If you are not the intended recipient, be aware
that any review, reliance, disclosure, copying, distribution or use of
the contents of this message without Kenshoo's express permission is
strictly prohibited.

--
Abhishek Lekshmanan
SUSE Linux GmbH, GF: Felix Imendörffer, Jane Smithard, Graham Norton, HRB 21284 (AG Nürnberg)


This e-mail, as well as any attached document, may contain material which is confidential and privileged and may include trademark, copyright and other intellectual property rights that are proprietary to Kenshoo Ltd,  its subsidiaries or affiliates ("Kenshoo"). This e-mail and its attachments may be read, copied and used only by the addressee for the purpose(s) for which it was disclosed herein. If you have received it in error, please destroy the message and any attachment, and contact us immediately. If you are not the intended recipient, be aware that any review, reliance, disclosure, copying, distribution or use of the contents of this message without Kenshoo's express permission is strictly prohibited.

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




--
############################################################################
Iban Cabrillo Bartolome
Instituto de Fisica de Cantabria (IFCA)
Santander, Spain
Tel: +34942200969
PGP PUBLIC KEY: http://pgp.mit.edu/pks/lookup?op=get&search=0xD9DF0B3D6C8C08AC
############################################################################
Bertrand Russell:"El problema con el mundo es que los estúpidos están seguros de todo y los inteligentes están llenos de dudas"


This e-mail, as well as any attached document, may contain material which is confidential and privileged and may include trademark, copyright and other intellectual property rights that are proprietary to Kenshoo Ltd,  its subsidiaries or affiliates ("Kenshoo"). This e-mail and its attachments may be read, copied and used only by the addressee for the purpose(s) for which it was disclosed herein. If you have received it in error, please destroy the message and any attachment, and contact us immediately. If you are not the intended recipient, be aware that any review, reliance, disclosure, copying, distribution or use of the contents of this message without Kenshoo's express permission is strictly prohibited.
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux