Hello, We definitely need more info. Does only HEAD-on-account fail or other requests are affected as well? Can we get more verbose RadosGW's log? In such situation debug_rgw=20 might be necessary. Regards, Radoslaw Zarzynski On Mon, Sep 19, 2016 at 12:33 PM, Orit Wasserman <owasserm@xxxxxxxxxx> wrote: > Any ideas? > I would guess the swift user is not created correctly but as it with > keystone ... > > > ---------- Forwarded message ---------- > From: Brian Chang-Chien <brian.changchien@xxxxxxxxx> > Date: Mon, Sep 19, 2016 at 5:22 AM > Subject: Re: swiftclient call radosgw, it always response > 401 Unauthorized > To: ceph-users@xxxxxxxxxxxxxx > > > no body meet this situation? Can somebody help me slove the issue, > please !!! THX > > 2016-09-16 13:02 GMT+08:00 Brian Chang-Chien <brian.changchien@xxxxxxxxx>: >> >> Can anyone know this problem,please help me to watch this >> >> >> 2016年9月13日 下午5:58,"Brian Chang-Chien" <brian.changchien@xxxxxxxxx>寫道: >>> >>> Hi ,naga.b >>> >>> I use Ceph jewel 10.2.2 >>> my ceph.conf as follow >>> [global] >>> fsid = d056c174-2e3a-4c36-a067-cb774d176ce2 >>> mon_initial_members = brianceph >>> mon_host = 10.62.9.140 >>> auth_cluster_required = cephx >>> auth_service_required = cephx >>> auth_client_required = cephx >>> osd_crush_chooseleaf_type = 0 >>> osd_pool_default_size = 1 >>> osd_journal_size = 100 >>> [client.radosgw.gateway] >>> host = brianceph >>> keyring = /etc/ceph/ceph.client.radosgw.keyring >>> log_file = /var/log/ceph/radosgw.log >>> rgw_dns_name = brianceph >>> rgw_keystone_url = http://10.62.13.253:35357 >>> rgw_keystone_admin_token = 7bb8e26cbc714c47a26ffec3d96f246f >>> rgw_keystone_accepted_roles = admin, swiftuser >>> rgw_ketstone_token_cache_size = 200 >>> rgw_keystone_revocation_interval = 30 >>> rgw_s3_auth_use_keystone = true >>> nss_db_path = /var/ceph/nss >>> >>> and my radosgw.log >>> >>> 2016-09-13 17:42:38.638462 7efd964619c0 0 starting handler: fastcgi >>> 2016-09-13 17:42:38.638523 7efcadf9b700 0 ERROR: no socket server point defined, cannot start fcgi frontend >>> 2016-09-13 17:47:33.597070 7efcdeffd700 1 ====== starting new request req=0x7efcdeff7710 ===== >>> 2016-09-13 17:47:33.597329 7efcdeffd700 1 ====== req done req=0x7efcdeff7710 op status=0 http_status=401 ====== >>> 2016-09-13 17:47:33.597379 7efcdeffd700 1 civetweb: 0x7efd20000bb0: 10.62.9.34 - - [13/Sep/2016:17:47:33 +0800] "HEAD /swift/v1 HTTP/1.1" 401 0 - python-swiftclient-2.6.0 >>> 2016-09-13 17:47:34.755291 7efcdffff700 1 ====== starting new request req=0x7efcdfff9710 ===== >>> 2016-09-13 17:47:34.755443 7efcdffff700 1 ====== req done req=0x7efcdfff9710 op status=0 http_status=401 ====== >>> 2016-09-13 17:47:34.755481 7efcdffff700 1 civetweb: 0x7efd48004020: 10.62.9.34 - - [13/Sep/2016:17:47:34 +0800] "HEAD /swift/v1 HTTP/1.1" 401 0 - python-swiftclient-2.6.0 >>> 2016-09-13 17:49:04.718249 7efcdf7fe700 1 ====== starting new request req=0x7efcdf7f8710 ===== >>> 2016-09-13 17:49:04.718438 7efcdf7fe700 1 ====== req done req=0x7efcdf7f8710 op status=0 http_status=401 ====== >>> 2016-09-13 17:49:04.718483 7efcdf7fe700 1 civetweb: 0x7efd68001f60: 10.62.9.34 - - [13/Sep/2016:17:49:04 +0800] "HEAD /swift/v1 HTTP/1.1" 401 0 - python-swiftclient-2.6.0 >>> 2016-09-13 17:49:05.870115 7efcde7fc700 1 ====== starting new request req=0x7efcde7f6710 ===== >>> 2016-09-13 17:49:05.870280 7efcde7fc700 1 ====== req done req=0x7efcde7f6710 op status=0 http_status=401 ====== >>> 2016-09-13 17:49:05.870324 7efcde7fc700 1 civetweb: 0x7efd28000bb0: 10.62.9.34 - - [13/Sep/2016:17:49:05 +0800] "HEAD /swift/v1 HTTP/1.1" 401 0 - python-swiftclient-2.6.0 >>> 2016-09-13 17:51:32.036065 7efd157fa700 1 handle_sigterm >>> 2016-09-13 17:51:32.036099 7efd157fa700 1 handle_sigterm set alarm for 120 >>> 2016-09-13 17:51:32.036153 7efd964619c0 -1 shutting down >>> 2016-09-13 17:51:32.037977 7efd78df9700 0 monclient: hunting for new mon >>> 2016-09-13 17:51:32.038172 7efd783f6700 0 -- 10.62.9.140:0/1002906388 >> 10.62.9.140:6789/0 pipe(0x7efd60016670 sd=7 :0 s=1 pgs=0 cs=0 l=1 c=0x7efd60014d70).fault >>> 2016-09-13 17:51:32.906553 7efd964619c0 1 final shutdown >>> 2016-09-13 17:51:39.294948 7ff5175f29c0 0 deferred set uid:gid to 167:167 (ceph:ceph) >>> 2016-09-13 17:51:39.295097 7ff5175f29c0 0 ceph version 10.2.2 (45107e21c568dd033c2f0a3107dec8f0b0e58374), process radosgw, pid 13251 >>> 2016-09-13 17:51:39.318311 7ff5175e8700 0 -- :/175783115 >> 10.62.9.140:6789/0 pipe(0x7ff51987b9b0 sd=7 :0 s=1 pgs=0 cs=0 l=1 c=0x7ff519842430).fault >>> 2016-09-13 17:51:39.596568 7ff4fc10d700 0 -- 10.62.9.140:0/175783115 >> 10.62.9.140:6800/11336 pipe(0x7ff519880080 sd=8 :0 s=1 pgs=0 cs=0 l=1 c=0x7ff519881390).fault >>> 2016-09-13 17:51:40.197109 7ff4fc10d700 0 -- 10.62.9.140:0/175783115 >> 10.62.9.140:6800/11336 pipe(0x7ff519880080 sd=8 :42233 s=1 pgs=0 cs=0 l=1 c=0x7ff519881390).connect claims to be 10.62.9.140:6800/13358 not 10.62.9.140:6800/11336 - wrong node! >>> 2016-09-13 17:51:40.997618 7ff4fc10d700 0 -- 10.62.9.140:0/175783115 >> 10.62.9.140:6800/11336 pipe(0x7ff519880080 sd=8 :42234 s=1 pgs=0 cs=0 l=1 c=0x7ff519881390).connect claims to be 10.62.9.140:6800/13358 not 10.62.9.140:6800/11336 - wrong node! >>> 2016-09-13 17:51:42.598080 7ff4fc10d700 0 -- 10.62.9.140:0/175783115 >> 10.62.9.140:6800/11336 pipe(0x7ff519880080 sd=8 :42235 s=1 pgs=0 cs=0 l=1 c=0x7ff519881390).connect claims to be 10.62.9.140:6800/13358 not 10.62.9.140:6800/11336 - wrong node! >>> 2016-09-13 17:51:45.798587 7ff4fc10d700 0 -- 10.62.9.140:0/175783115 >> 10.62.9.140:6800/11336 pipe(0x7ff519880080 sd=8 :42236 s=1 pgs=0 cs=0 l=1 c=0x7ff519881390).connect claims to be 10.62.9.140:6800/13358 not 10.62.9.140:6800/11336 - wrong node! >>> 2016-09-13 17:51:52.199050 7ff4fc10d700 0 -- 10.62.9.140:0/175783115 >> 10.62.9.140:6800/11336 pipe(0x7ff519880080 sd=8 :42237 s=1 pgs=0 cs=0 l=1 c=0x7ff519881390).connect claims to be 10.62.9.140:6800/13358 not 10.62.9.140:6800/11336 - wrong node! >>> 2016-09-13 17:51:54.596518 7ff4fc10d700 0 -- 10.62.9.140:0/175783115 >> 10.62.9.140:6800/11336 pipe(0x7ff519880080 sd=8 :42238 s=1 pgs=0 cs=0 l=1 c=0x7ff519881390).connect claims to be 10.62.9.140:6800/13358 not 10.62.9.140:6800/11336 - wrong node! >>> 2016-09-13 17:51:54.611720 7ff5175f29c0 0 RGWZoneParams::create(): error creating default zone params: (17) File exists >>> 2016-09-13 17:51:55.285047 7ff5175f29c0 0 starting handler: civetweb >>> 2016-09-13 17:51:55.285405 7ff4f5d7b700 0 monclient: hunting for new mon >>> 2016-09-13 17:51:55.289646 7ff5175f29c0 0 starting handler: fastcgi >>> 2016-09-13 17:51:55.289712 7ff42dfa3700 0 ERROR: no socket server point defined, cannot start fcgi frontend >>> 2016-09-13 17:52:40.055599 7ff469ffb700 1 handle_sigterm >>> 2016-09-13 17:52:40.055639 7ff469ffb700 1 handle_sigterm set alarm for 120 >>> 2016-09-13 17:52:40.055652 7ff5175f29c0 -1 shutting down >>> 2016-09-13 17:52:40.825472 7ff5175f29c0 1 final shutdown >>> 2016-09-13 17:52:40.855310 7f488bcd19c0 0 deferred set uid:gid to 167:167 (ceph:ceph) >>> 2016-09-13 17:52:40.855346 7f488bcd19c0 0 ceph version 10.2.2 (45107e21c568dd033c2f0a3107dec8f0b0e58374), process radosgw, pid 14025 >>> 2016-09-13 17:52:40.893218 7f488bcd19c0 0 RGWZoneParams::create(): error creating default zone params: (17) File exists >>> 2016-09-13 17:52:40.980767 7f488bcd19c0 0 starting handler: civetweb >>> 2016-09-13 17:52:40.981060 7f486a57c700 0 monclient: hunting for new mon >>> 2016-09-13 17:52:40.984229 7f488bcd19c0 0 starting handler: fastcgi >>> 2016-09-13 17:52:40.984290 7f47a379e700 0 ERROR: no socket server point defined, cannot start fcgi frontend >>> 2016-09-13 17:52:47.822307 7f47f5ffb700 1 ====== starting new request req=0x7f47f5ff5710 ===== >>> 2016-09-13 17:52:47.829912 7f47f5ffb700 1 ====== req done req=0x7f47f5ff5710 op status=0 http_status=200 ====== >>> 2016-09-13 17:52:47.829982 7f47f5ffb700 1 civetweb: 0x7f4850003e40: 10.62.8.246 - - [13/Sep/2016:17:52:47 +0800] "GET / HTTP/1.1" 200 0 - Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.2743.116 Safari/537.36 >>> 2016-09-13 17:53:13.496015 7f47f4ff9700 1 ====== starting new request req=0x7f47f4ff3710 ===== >>> 2016-09-13 17:53:13.496232 7f47f4ff9700 1 ====== req done req=0x7f47f4ff3710 op status=0 http_status=401 ====== >>> 2016-09-13 17:53:13.496314 7f47f4ff9700 1 civetweb: 0x7f4858001280: 10.62.13.253 - - [13/Sep/2016:17:53:13 +0800] "HEAD /swift/v1 HTTP/1.1" 401 0 - python-swiftclient-2.6.0 >>> 2016-09-13 17:53:14.597218 7f47d3fff700 1 ====== starting new request req=0x7f47d3ff9710 ===== >>> 2016-09-13 17:53:14.597366 7f47d3fff700 1 ====== req done req=0x7f47d3ff9710 op status=0 http_status=401 ====== >>> 2016-09-13 17:53:14.597403 7f47d3fff700 1 civetweb: 0x7f4818000bb0: 10.62.13.253 - - [13/Sep/2016:17:53:14 +0800] "HEAD /swift/v1 HTTP/1.1" 401 0 - python-swiftclient-2.6.0 >>> >>> >>> Please help me to find out problem, Thx >>> >>> >>> 2016-09-13 2:21 GMT+08:00 B, Naga Venkata <naga.b@xxxxxxx>: >>>> >>>> The parameters you configured for keystone in ceph.conf are correct? Can you provide your radosgw configuration in ceph.conf? >>>> >>>> And include radosgw.log after radosgw service restart and during swift list. >>>> >>>> >>>> >>>> Thanks & Regards, >>>> >>>> Naga Venkata >>>> >>>> >>>> >>>> From: ceph-users [mailto:ceph-users-bounces@xxxxxxxxxxxxxx] On Behalf Of Brian Chang-Chien >>>> Sent: Monday, September 12, 2016 11:35 AM >>>> To: ceph-users@xxxxxxxxxxxxxx >>>> Subject: swiftclient call radosgw, it always response 401 Unauthorized >>>> >>>> >>>> >>>> Hi all >>>> >>>> >>>> >>>> I use openstack keystone to integrate with ceph radosgw for object storage >>>> >>>> But when i call "swift stat" command , it always 401 error >>>> >>>> "Account HEAD failed: http://10.62.9.140:7480/swift/v1 401 Unauthorized" >>>> >>>> >>>> >>>> following is log >>>> >>>> >>>> >>>> DEBUG:keystoneclient.auth.identity.v2:Making authentication request to http://10.62.13.253:5000/v2.0/tokens >>>> INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1): 10.62.13.253 >>>> DEBUG:requests.packages.urllib3.connectionpool:"POST /v2.0/tokens HTTP/1.1" 200 3638 >>>> INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1): 10.62.9.140 >>>> DEBUG:requests.packages.urllib3.connectionpool:"HEAD /swift/v1 HTTP/1.1" 401 0 >>>> INFO:swiftclient:REQ: curl -i http://10.62.9.140:7480/swift/v1 -I -H "X-Auth-Token: 677444dfb01b41f98d786a28c84ad4e2" >>>> INFO:swiftclient:RESP STATUS: 401 Unauthorized >>>> INFO:swiftclient:RESP HEADERS: [('X-Trans-Id', 'tx000000000000000000001-0057d6600f-d352-default'), ('Content-Length', '12'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'text/plain; charset=utf-8'), ('Date', 'Mon, 12 Sep 2016 07:58:07 GMT')] >>>> DEBUG:keystoneclient.auth.identity.v2:Making authentication request to http://10.62.13.253:5000/v2.0/tokens >>>> INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1): 10.62.13.253 >>>> DEBUG:requests.packages.urllib3.connectionpool:"POST /v2.0/tokens HTTP/1.1" 200 3638 >>>> INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1): 10.62.9.140 >>>> DEBUG:requests.packages.urllib3.connectionpool:"HEAD /swift/v1 HTTP/1.1" 401 0 >>>> INFO:swiftclient:REQ: curl -i http://10.62.9.140:7480/swift/v1 -I -H "X-Auth-Token: f67c29ebff52413a9b2f0119fbf9c60e" >>>> INFO:swiftclient:RESP STATUS: 401 Unauthorized >>>> INFO:swiftclient:RESP HEADERS: [('X-Trans-Id', 'tx000000000000000000002-0057d66010-d352-default'), ('Content-Length', '12'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'text/plain; charset=utf-8'), ('Date', 'Mon, 12 Sep 2016 07:58:08 GMT')] >>>> ERROR:swiftclient:Account HEAD failed: http://10.62.9.140:7480/swift/v1 401 Unauthorized >>>> Traceback (most recent call last): >>>> File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 1390, in _retry >>>> service_token=self.service_token, **kwargs) >>>> File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 591, in head_account >>>> http_response_content=body) >>>> ClientException: Account HEAD failed: http://10.62.9.140:7480/swift/v1 401 Unauthorized >>>> ERROR:swiftclient.service:Account HEAD failed: http://10.62.9.140:7480/swift/v1 401 Unauthorized >>>> Traceback (most recent call last): >>>> File "/usr/lib/python2.7/site-packages/swiftclient/service.py", line 435, in stat >>>> items, headers = get_future_result(stats_future) >>>> File "/usr/lib/python2.7/site-packages/swiftclient/service.py", line 204, in get_future_result >>>> res = f.result(timeout=timeout) >>>> File "/usr/lib/python2.7/site-packages/concurrent/futures/_base.py", line 403, in result >>>> return self.__get_result() >>>> File "/usr/lib/python2.7/site-packages/concurrent/futures/thread.py", line 55, in run >>>> result = self.fn(*self.args, **self.kwargs) >>>> File "/usr/lib/python2.7/site-packages/swiftclient/multithreading.py", line 188, in conn_fn >>>> return fn(*conn_args, **kwargs) >>>> File "/usr/lib/python2.7/site-packages/swiftclient/command_helpers.py", line 23, in stat_account >>>> headers = conn.head_account() >>>> File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 1430, in head_account >>>> return self._retry(None, head_account) >>>> File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 1390, in _retry >>>> service_token=self.service_token, **kwargs) >>>> File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 591, in head_account >>>> http_response_content=body) >>>> ClientException: Account HEAD failed: http://10.62.9.140:7480/swift/v1 401 Unauthorized >>>> Account HEAD failed: http://10.62.9.140:7480/swift/v1 401 Unauthorized >>>> >>>> >>>> >>>> Could you tell me what happened ? >>>> >>>> >>>> >>>> >>> >>> > > > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com