Hello Radek,
Thank-you for your analysis so far! Please find attached logs for both
the admin user and a keystone backed user from 10.2.5 (same host as
before, I have simply downgraded the packages). Both users can
authenticate and list buckets on 10.2.5.
Also - I tried version 10.2.6 and see the same behavior as 10.2.7, so
the bug i'm hitting looks like it was introduced in 10.2.6
Kind regards,
Ben Morrice
______________________________________________________________________
Ben Morrice | e: ben.morrice@xxxxxxx | t: +41-21-693-9670
EPFL / BBP
Biotech Campus
Chemin des Mines 9
1202 Geneva
Switzerland
On 27/04/17 04:45, Radoslaw Zarzynski wrote:
Thanks for the logs, Ben.
It looks that two completely different authenticators have failed:
the local, RADOS-backed auth (admin.txt) and Keystone-based
one as well. In the second case I'm pretty sure that Keystone has
rejected [1][2] to authenticate provided signature/StringToSign.
RGW tried to fallback to the local auth which obviously didn't have
any chance as the credentials were stored remotely. This explains
the presence of "error reading user info" in the user-keystone.txt.
What is common for both scenarios are the low-level things related
to StringToSign crafting/signature generation at RadosGW's side.
Following one has been composed for the request from admin.txt:
GET
Wed, 26 Apr 2017 09:18:42 GMT
/bbpsrvc15.cscs.ch/
If you could provide a similar log from v10.2.5, I would be really grateful.
Regards,
Radek
[1] https://github.com/ceph/ceph/blob/v10.2.7/src/rgw/rgw_rest_s3.cc#L3269-L3272
[2] https://github.com/ceph/ceph/blob/v10.2.7/src/rgw/rgw_common.h#L170
On Wed, Apr 26, 2017 at 11:29 AM, Morrice Ben <ben.morrice@xxxxxxx> wrote:
Hello Radek,
Please find attached the failed request for both the admin user and a standard user (backed by keystone).
Kind regards,
Ben Morrice
______________________________________________________________________
Ben Morrice | e: ben.morrice@xxxxxxx | t: +41-21-693-9670
EPFL BBP
Biotech Campus
Chemin des Mines 9
1202 Geneva
Switzerland
________________________________________
From: Radoslaw Zarzynski <rzarzynski@xxxxxxxxxxxx>
Sent: Tuesday, April 25, 2017 7:38 PM
To: Morrice Ben
Cc: ceph-users@xxxxxxxxxxxxxx
Subject: Re: RGW 10.2.5->10.2.7 authentication fail?
Hello Ben,
Could you provide full RadosGW's log for the failed request?
I mean the lines starting from header listing, through the start
marker ("====== starting new request...") till the end marker?
At the moment we can't see any details related to the signature
calculation.
Regards,
Radek
On Thu, Apr 20, 2017 at 5:08 PM, Ben Morrice <ben.morrice@xxxxxxx> wrote:
Hi all,
I have tried upgrading one of our RGW servers from 10.2.5 to 10.2.7 (RHEL7)
and authentication is in a very bad state. This installation is part of a
multigw configuration, and I have just updated one host in the secondary
zone (all other hosts/zones are running 10.2.5).
On the 10.2.7 server I cannot authenticate as a user (normally backed by
OpenStack Keystone), but even worse I can also not authenticate with an
admin user.
Please see [1] for the results of performing a list bucket operation with
python boto (script works against rgw 10.2.5)
Also, if I try to authenticate from the 'master' rgw zone with a
"radosgw-admin sync status --rgw-zone=bbp-gva-master" I get:
"ERROR: failed to fetch datalog info"
"failed to retrieve sync info: (13) Permission denied"
The above errors correlates to the errors in the log on the server running
10.2.7 (debug level 20) at [2]
I'm not sure what I have done wrong or can try next?
By the way, downgrading the packages from 10.2.7 to 10.2.5 returns
authentication functionality
[1]
boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden
<?xml version="1.0"
encoding="UTF-8"?><Error><Code>SignatureDoesNotMatch</Code><RequestId>tx000000000000000000004-0058f8c86a-3fa2959-bbp-gva-secondary</RequestId><HostId>3fa2959-bbp-gva-secondary-bbp-gva</HostId></Error>
[2]
/bbpsrvc15.cscs.ch/admin/log
2017-04-20 16:43:04.916253 7ff87c6c0700 15 calculated
digest=Ofg/f/NI0L4eEG1MsGk4PsVscTM=
2017-04-20 16:43:04.916255 7ff87c6c0700 15
auth_sign=qZ3qsy7AuNCOoPMhr8yNoy5qMKU=
2017-04-20 16:43:04.916255 7ff87c6c0700 15 compare=34
2017-04-20 16:43:04.916266 7ff87c6c0700 10 failed to authorize request
2017-04-20 16:43:04.916268 7ff87c6c0700 20 handler->ERRORHANDLER:
err_no=-2027 new_err_no=-2027
2017-04-20 16:43:04.916329 7ff87c6c0700 2 req 354:0.052585:s3:GET
/admin/log:get_obj:op status=0
2017-04-20 16:43:04.916339 7ff87c6c0700 2 req 354:0.052595:s3:GET
/admin/log:get_obj:http status=403
2017-04-20 16:43:04.916343 7ff87c6c0700 1 ====== req done
req=0x7ff87c6ba710 op status=0 http_status=403 ======
2017-04-20 16:43:04.916350 7ff87c6c0700 20 process_request() returned -2027
2017-04-20 16:43:04.916390 7ff87c6c0700 1 civetweb: 0x7ff990015610:
10.80.6.26 - - [20/Apr/2017:16:43:04 +0200] "GET /admin/log HTTP/1.1" 403 0
- -
2017-04-20 16:43:04.917212 7ff9777e6700 20
cr:s=0x7ff97000d420:op=0x7ff9703a5440:18RGWMetaSyncShardCR: operate()
2017-04-20 16:43:04.917223 7ff9777e6700 20 rgw meta sync:
incremental_sync:1544: shard_id=20
mdlog_marker=1_1492686039.901886_5551978.1
sync_marker.marker=1_1492686039.901886_5551978.1 period_marker=
2017-04-20 16:43:04.917227 7ff9777e6700 20 rgw meta sync:
incremental_sync:1551: shard_id=20 syncing mdlog for shard_id=20
2017-04-20 16:43:04.917236 7ff9777e6700 20
cr:s=0x7ff97000d420:op=0x7ff970066b80:24RGWCloneMetaLogCoroutine: operate()
2017-04-20 16:43:04.917238 7ff9777e6700 20 rgw meta sync: operate:
shard_id=20: init request
2017-04-20 16:43:04.917240 7ff9777e6700 20
cr:s=0x7ff97000d420:op=0x7ff970066b80:24RGWCloneMetaLogCoroutine: operate()
2017-04-20 16:43:04.917241 7ff9777e6700 20 rgw meta sync: operate:
shard_id=20: reading shard status
2017-04-20 16:43:04.917303 7ff9777e6700 20 run: stack=0x7ff97000d420 is io
blocked
2017-04-20 16:43:04.918285 7ff9777e6700 20
cr:s=0x7ff97000d420:op=0x7ff970066b80:24RGWCloneMetaLogCoroutine: operate()
2017-04-20 16:43:04.918295 7ff9777e6700 20 rgw meta sync: operate:
shard_id=20: reading shard status complete
2017-04-20 16:43:04.918307 7ff9777e6700 20 rgw meta sync: shard_id=20
marker=1_1492686039.901886_5551978.1 last_update=2017-04-20
13:00:39.0.901886s
2017-04-20 16:43:04.918316 7ff9777e6700 20
cr:s=0x7ff97000d420:op=0x7ff970066b80:24RGWCloneMetaLogCoroutine: operate()
2017-04-20 16:43:04.918317 7ff9777e6700 20 rgw meta sync: operate:
shard_id=20: sending rest request
2017-04-20 16:43:04.918381 7ff9777e6700 20 RGWEnv::set(): HTTP_DATE: Thu Apr
20 14:43:04 2017
2017-04-20 16:43:04.918390 7ff9777e6700 20 > HTTP_DATE -> Thu Apr 20
14:43:04 2017
2017-04-20 16:43:04.918404 7ff9777e6700 10 get_canon_resource():
dest=/admin/log
2017-04-20 16:43:04.918406 7ff9777e6700 10 generated canonical header: GET
--
Kind regards,
Ben Morrice
______________________________________________________________________
Ben Morrice | e: ben.morrice@xxxxxxx | t: +41-21-693-9670
EPFL / BBP
Biotech Campus
Chemin des Mines 9
1202 Geneva
Switzerland
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
2017-04-27 09:49:59.117313 7f4a90ff9700 20 RGWEnv::set(): HTTP_HOST: bbpsrvc15.cscs.ch
2017-04-27 09:49:59.117337 7f4a90ff9700 20 RGWEnv::set(): HTTP_ACCEPT_ENCODING: identity
2017-04-27 09:49:59.117340 7f4a90ff9700 20 RGWEnv::set(): HTTP_DATE: Thu, 27 Apr 2017 07:49:59 GMT
2017-04-27 09:49:59.117341 7f4a90ff9700 20 RGWEnv::set(): CONTENT_LENGTH: 0
2017-04-27 09:49:59.117343 7f4a90ff9700 20 RGWEnv::set(): HTTP_AUTHORIZATION: AWS A0QV52GF9GT3A13ADA6C:4Qi5IoJIBd/+HOVRe1q+awR3sEg=
2017-04-27 09:49:59.117346 7f4a90ff9700 20 RGWEnv::set(): HTTP_USER_AGENT: Boto/2.46.1 Python/2.7.12 Linux/4.6.0-040600-generic
2017-04-27 09:49:59.117347 7f4a90ff9700 20 RGWEnv::set(): REQUEST_METHOD: GET
2017-04-27 09:49:59.117348 7f4a90ff9700 20 RGWEnv::set(): REQUEST_URI: /
2017-04-27 09:49:59.117349 7f4a90ff9700 20 RGWEnv::set(): QUERY_STRING:
2017-04-27 09:49:59.117351 7f4a90ff9700 20 RGWEnv::set(): REMOTE_USER:
2017-04-27 09:49:59.117352 7f4a90ff9700 20 RGWEnv::set(): SCRIPT_URI: /
2017-04-27 09:49:59.117355 7f4a90ff9700 20 RGWEnv::set(): SERVER_PORT: 80
2017-04-27 09:49:59.117356 7f4a90ff9700 20 CONTENT_LENGTH=0
2017-04-27 09:49:59.117357 7f4a90ff9700 20 HTTP_ACCEPT_ENCODING=identity
2017-04-27 09:49:59.117358 7f4a90ff9700 20 HTTP_AUTHORIZATION=AWS A0QV52GF9GT3A13ADA6C:4Qi5IoJIBd/+HOVRe1q+awR3sEg=
2017-04-27 09:49:59.117358 7f4a90ff9700 20 HTTP_DATE=Thu, 27 Apr 2017 07:49:59 GMT
2017-04-27 09:49:59.117359 7f4a90ff9700 20 HTTP_HOST=bbpsrvc15.cscs.ch
2017-04-27 09:49:59.117360 7f4a90ff9700 20 HTTP_USER_AGENT=Boto/2.46.1 Python/2.7.12 Linux/4.6.0-040600-generic
2017-04-27 09:49:59.117361 7f4a90ff9700 20 QUERY_STRING=
2017-04-27 09:49:59.117361 7f4a90ff9700 20 REMOTE_USER=
2017-04-27 09:49:59.117362 7f4a90ff9700 20 REQUEST_METHOD=GET
2017-04-27 09:49:59.117362 7f4a90ff9700 20 REQUEST_URI=/
2017-04-27 09:49:59.117363 7f4a90ff9700 20 SCRIPT_URI=/
2017-04-27 09:49:59.117363 7f4a90ff9700 20 SERVER_PORT=80
2017-04-27 09:49:59.117365 7f4a90ff9700 1 ====== starting new request req=0x7f4a90ff3710 =====
2017-04-27 09:49:59.117422 7f4a90ff9700 2 req 2:0.000057::GET /::initializing for trans_id = tx000000000000000000002-005901a2a7-3fbe885-bbp-gva-secondary
2017-04-27 09:49:59.117440 7f4a90ff9700 10 rgw api priority: s3=5 s3website=4
2017-04-27 09:49:59.117443 7f4a90ff9700 10 host=bbpsrvc15.cscs.ch
2017-04-27 09:49:59.117447 7f4a90ff9700 20 subdomain= domain= in_hosted_domain=0 in_hosted_domain_s3website=0
2017-04-27 09:49:59.117449 7f4a90ff9700 20 final domain/bucket subdomain= domain= in_hosted_domain=0 in_hosted_domain_s3website=0 s->info.domain= s->info.request_uri=/
2017-04-27 09:49:59.117483 7f4a90ff9700 20 get_handler handler=26RGWHandler_REST_Service_S3
2017-04-27 09:49:59.117490 7f4a90ff9700 10 handler=26RGWHandler_REST_Service_S3
2017-04-27 09:49:59.117492 7f4a90ff9700 2 req 2:0.000127:s3:GET /::getting op 0
2017-04-27 09:49:59.117497 7f4a90ff9700 10 op=26RGWListBuckets_ObjStore_S3
2017-04-27 09:49:59.117513 7f4a90ff9700 2 req 2:0.000138:s3:GET /:list_buckets:authorizing
2017-04-27 09:49:59.117517 7f4a90ff9700 20 s3 keystone: trying keystone auth
2017-04-27 09:49:59.117538 7f4a90ff9700 10 get_canon_resource(): dest=/
2017-04-27 09:49:59.117560 7f4a90ff9700 20 found cached admin token
2017-04-27 09:49:59.117607 7f4a90ff9700 20 sending request to https://bbpopenstack.epfl.ch:35357/v3/s3tokens
2017-04-27 09:49:59.164964 7f4a90ff9700 0 Keystone token parse error: missing mandatory field access
2017-04-27 09:49:59.164983 7f4a90ff9700 2 s3 keystone: token parsing failed
2017-04-27 09:49:59.165010 7f4a90ff9700 20 get_system_obj_state: rctx=0x7f4a90ff2250 obj=.bbp-gva-secondary.users:A0QV52GF9GT3A13ADA6C state=0x7f4ae40526e8 s->prefetch_data=0
2017-04-27 09:49:59.166342 7f4a90ff9700 20 get_system_obj_state: s->obj_tag was set empty
2017-04-27 09:49:59.166362 7f4a90ff9700 20 get_system_obj_state: rctx=0x7f4a90ff2250 obj=.bbp-gva-secondary.users:A0QV52GF9GT3A13ADA6C state=0x7f4ae40526e8 s->prefetch_data=0
2017-04-27 09:49:59.166365 7f4a90ff9700 20 rados->read ofs=0 len=524288
2017-04-27 09:49:59.167144 7f4a90ff9700 20 rados->read r=0 bl.length=17
2017-04-27 09:49:59.167168 7f4a90ff9700 20 get_system_obj_state: rctx=0x7f4a90ff1f10 obj=.bbp-gva-secondary.users.uid:admin-bbp-gva state=0x7f4ae40ba3e8 s->prefetch_data=0
2017-04-27 09:49:59.168366 7f4a90ff9700 20 get_system_obj_state: s->obj_tag was set empty
2017-04-27 09:49:59.168388 7f4a90ff9700 20 get_system_obj_state: rctx=0x7f4a90ff1f10 obj=.bbp-gva-secondary.users.uid:admin-bbp-gva state=0x7f4ae40ba3e8 s->prefetch_data=0
2017-04-27 09:49:59.168403 7f4a90ff9700 20 rados->read ofs=0 len=524288
2017-04-27 09:49:59.169266 7f4a90ff9700 20 rados->read r=0 bl.length=341
2017-04-27 09:49:59.169318 7f4a90ff9700 10 get_canon_resource(): dest=/
2017-04-27 09:49:59.169327 7f4a90ff9700 10 auth_hdr:
GET
Thu, 27 Apr 2017 07:49:59 GMT
/
2017-04-27 09:49:59.169364 7f4a90ff9700 15 calculated digest=4Qi5IoJIBd/+HOVRe1q+awR3sEg=
2017-04-27 09:49:59.169371 7f4a90ff9700 15 auth_sign=4Qi5IoJIBd/+HOVRe1q+awR3sEg=
2017-04-27 09:49:59.169372 7f4a90ff9700 15 compare=0
2017-04-27 09:49:59.169373 7f4a90ff9700 20 system request
2017-04-27 09:49:59.169377 7f4a90ff9700 2 req 2:0.052012:s3:GET /:list_buckets:normalizing buckets and tenants
2017-04-27 09:49:59.169386 7f4a90ff9700 10 s->object=<NULL> s->bucket=
2017-04-27 09:49:59.169389 7f4a90ff9700 2 req 2:0.052024:s3:GET /:list_buckets:init permissions
2017-04-27 09:49:59.169393 7f4a90ff9700 2 req 2:0.052028:s3:GET /:list_buckets:recalculating target
2017-04-27 09:49:59.169395 7f4a90ff9700 2 req 2:0.052030:s3:GET /:list_buckets:reading permissions
2017-04-27 09:49:59.169397 7f4a90ff9700 2 req 2:0.052032:s3:GET /:list_buckets:init op
2017-04-27 09:49:59.169399 7f4a90ff9700 2 req 2:0.052034:s3:GET /:list_buckets:verifying op mask
2017-04-27 09:49:59.169401 7f4a90ff9700 20 required_mask= 1 user.op_mask=7
2017-04-27 09:49:59.169402 7f4a90ff9700 2 req 2:0.052037:s3:GET /:list_buckets:verifying op permissions
2017-04-27 09:49:59.169403 7f4a90ff9700 2 req 2:0.052038:s3:GET /:list_buckets:verifying op params
2017-04-27 09:49:59.169404 7f4a90ff9700 2 req 2:0.052039:s3:GET /:list_buckets:pre-executing
2017-04-27 09:49:59.169405 7f4a90ff9700 2 req 2:0.052041:s3:GET /:list_buckets:executing
2017-04-27 09:49:59.170494 7f4a90ff9700 2 req 2:0.053128:s3:GET /:list_buckets:completing
2017-04-27 09:49:59.170530 7f4a90ff9700 2 req 2:0.053164:s3:GET /:list_buckets:op status=0
2017-04-27 09:49:59.170539 7f4a90ff9700 2 req 2:0.053174:s3:GET /:list_buckets:http status=200
2017-04-27 09:49:59.170542 7f4a90ff9700 1 ====== req done req=0x7f4a90ff3710 op status=0 http_status=200 ======
2017-04-27 09:49:59.170587 7f4a90ff9700 1 civetweb: 0x7f4ae4004110: 128.178.97.85 - - [27/Apr/2017:09:49:59 +0200] "GET / HTTP/1.1" 200 0 - Boto/2.46.1 Python/2.7.12 Linux/4.6.0-040600-generic
2017-04-27 09:49:42.252758 7f4a937fe700 20 RGWEnv::set(): HTTP_HOST: bbpsrvc15.cscs.ch
2017-04-27 09:49:42.252775 7f4a937fe700 20 RGWEnv::set(): HTTP_ACCEPT_ENCODING: identity
2017-04-27 09:49:42.252778 7f4a937fe700 20 RGWEnv::set(): HTTP_DATE: Thu, 27 Apr 2017 07:49:42 GMT
2017-04-27 09:49:42.252780 7f4a937fe700 20 RGWEnv::set(): CONTENT_LENGTH: 0
2017-04-27 09:49:42.252781 7f4a937fe700 20 RGWEnv::set(): HTTP_AUTHORIZATION: AWS a958d8c7f55c499aa3cc29b011bcb631:4K1jKM554UIU3t7UTjMzT3Kzv+I=
2017-04-27 09:49:42.252785 7f4a937fe700 20 RGWEnv::set(): HTTP_USER_AGENT: Boto/2.46.1 Python/2.7.12 Linux/4.6.0-040600-generic
2017-04-27 09:49:42.252786 7f4a937fe700 20 RGWEnv::set(): REQUEST_METHOD: GET
2017-04-27 09:49:42.252788 7f4a937fe700 20 RGWEnv::set(): REQUEST_URI: /
2017-04-27 09:49:42.252789 7f4a937fe700 20 RGWEnv::set(): QUERY_STRING:
2017-04-27 09:49:42.252790 7f4a937fe700 20 RGWEnv::set(): REMOTE_USER:
2017-04-27 09:49:42.252791 7f4a937fe700 20 RGWEnv::set(): SCRIPT_URI: /
2017-04-27 09:49:42.252794 7f4a937fe700 20 RGWEnv::set(): SERVER_PORT: 80
2017-04-27 09:49:42.252795 7f4a937fe700 20 CONTENT_LENGTH=0
2017-04-27 09:49:42.252796 7f4a937fe700 20 HTTP_ACCEPT_ENCODING=identity
2017-04-27 09:49:42.252797 7f4a937fe700 20 HTTP_AUTHORIZATION=AWS a958d8c7f55c499aa3cc29b011bcb631:4K1jKM554UIU3t7UTjMzT3Kzv+I=
2017-04-27 09:49:42.252798 7f4a937fe700 20 HTTP_DATE=Thu, 27 Apr 2017 07:49:42 GMT
2017-04-27 09:49:42.252798 7f4a937fe700 20 HTTP_HOST=bbpsrvc15.cscs.ch
2017-04-27 09:49:42.252799 7f4a937fe700 20 HTTP_USER_AGENT=Boto/2.46.1 Python/2.7.12 Linux/4.6.0-040600-generic
2017-04-27 09:49:42.252799 7f4a937fe700 20 QUERY_STRING=
2017-04-27 09:49:42.252800 7f4a937fe700 20 REMOTE_USER=
2017-04-27 09:49:42.252800 7f4a937fe700 20 REQUEST_METHOD=GET
2017-04-27 09:49:42.252834 7f4a937fe700 20 REQUEST_URI=/
2017-04-27 09:49:42.252835 7f4a937fe700 20 SCRIPT_URI=/
2017-04-27 09:49:42.252836 7f4a937fe700 20 SERVER_PORT=80
2017-04-27 09:49:42.252840 7f4a937fe700 1 ====== starting new request req=0x7f4a937f8710 =====
2017-04-27 09:49:42.252878 7f4a937fe700 2 req 1:0.000038::GET /::initializing for trans_id = tx000000000000000000001-005901a296-3fbe885-bbp-gva-secondary
2017-04-27 09:49:42.252888 7f4a937fe700 10 rgw api priority: s3=5 s3website=4
2017-04-27 09:49:42.252890 7f4a937fe700 10 host=bbpsrvc15.cscs.ch
2017-04-27 09:49:42.252897 7f4a937fe700 20 subdomain= domain= in_hosted_domain=0 in_hosted_domain_s3website=0
2017-04-27 09:49:42.252899 7f4a937fe700 20 final domain/bucket subdomain= domain= in_hosted_domain=0 in_hosted_domain_s3website=0 s->info.domain= s->info.request_uri=/
2017-04-27 09:49:42.252940 7f4a937fe700 20 get_handler handler=26RGWHandler_REST_Service_S3
2017-04-27 09:49:42.252951 7f4a937fe700 10 handler=26RGWHandler_REST_Service_S3
2017-04-27 09:49:42.252953 7f4a937fe700 2 req 1:0.000113:s3:GET /::getting op 0
2017-04-27 09:49:42.252973 7f4a937fe700 10 op=26RGWListBuckets_ObjStore_S3
2017-04-27 09:49:42.252975 7f4a937fe700 2 req 1:0.000135:s3:GET /:list_buckets:authorizing
2017-04-27 09:49:42.252996 7f4a937fe700 20 s3 keystone: trying keystone auth
2017-04-27 09:49:42.253022 7f4a937fe700 10 get_canon_resource(): dest=/
2017-04-27 09:49:42.253053 7f4a937fe700 20 found cached admin token
2017-04-27 09:49:42.253101 7f4a937fe700 20 sending request to https://bbpopenstack.epfl.ch:35357/v3/s3tokens
2017-04-27 09:49:42.341860 7f4a937fe700 5 s3 keystone: validated token: morrice:morrice expires: 1493282982
2017-04-27 09:49:42.341925 7f4a937fe700 20 get_system_obj_state: rctx=0x7f4a937f7410 obj=.bbp-gva-secondary.users.uid:cbe1db78d12e40899a7a72e6e6f79a31 state=0x7f4af40540a8 s->prefetch_data=0
2017-04-27 09:49:42.343129 7f4a937fe700 20 get_system_obj_state: s->obj_tag was set empty
2017-04-27 09:49:42.343139 7f4a937fe700 20 get_system_obj_state: rctx=0x7f4a937f7410 obj=.bbp-gva-secondary.users.uid:cbe1db78d12e40899a7a72e6e6f79a31 state=0x7f4af40540a8 s->prefetch_data=0
2017-04-27 09:49:42.343142 7f4a937fe700 20 rados->read ofs=0 len=524288
2017-04-27 09:49:42.343831 7f4a937fe700 20 rados->read r=0 bl.length=211
2017-04-27 09:49:42.343872 7f4a937fe700 2 req 1:0.091031:s3:GET /:list_buckets:normalizing buckets and tenants
2017-04-27 09:49:42.343885 7f4a937fe700 10 s->object=<NULL> s->bucket=
2017-04-27 09:49:42.343888 7f4a937fe700 2 req 1:0.091048:s3:GET /:list_buckets:init permissions
2017-04-27 09:49:42.343895 7f4a937fe700 2 req 1:0.091056:s3:GET /:list_buckets:recalculating target
2017-04-27 09:49:42.343897 7f4a937fe700 2 req 1:0.091057:s3:GET /:list_buckets:reading permissions
2017-04-27 09:49:42.343901 7f4a937fe700 2 req 1:0.091061:s3:GET /:list_buckets:init op
2017-04-27 09:49:42.343913 7f4a937fe700 2 req 1:0.091074:s3:GET /:list_buckets:verifying op mask
2017-04-27 09:49:42.343916 7f4a937fe700 20 required_mask= 1 user.op_mask=7
2017-04-27 09:49:42.343917 7f4a937fe700 2 req 1:0.091078:s3:GET /:list_buckets:verifying op permissions
2017-04-27 09:49:42.343919 7f4a937fe700 2 req 1:0.091079:s3:GET /:list_buckets:verifying op params
2017-04-27 09:49:42.343920 7f4a937fe700 2 req 1:0.091081:s3:GET /:list_buckets:pre-executing
2017-04-27 09:49:42.343921 7f4a937fe700 2 req 1:0.091082:s3:GET /:list_buckets:executing
2017-04-27 09:49:42.346301 7f4a937fe700 2 req 1:0.093461:s3:GET /:list_buckets:completing
2017-04-27 09:49:42.346348 7f4a937fe700 2 req 1:0.093508:s3:GET /:list_buckets:op status=0
2017-04-27 09:49:42.346358 7f4a937fe700 2 req 1:0.093518:s3:GET /:list_buckets:http status=200
2017-04-27 09:49:42.346364 7f4a937fe700 1 ====== req done req=0x7f4a937f8710 op status=0 http_status=200 ======
2017-04-27 09:49:42.346433 7f4a937fe700 1 civetweb: 0x7f4af4004110: 128.178.97.85 - - [27/Apr/2017:09:49:42 +0200] "GET / HTTP/1.1" 200 0 - Boto/2.46.1 Python/2.7.12 Linux/4.6.0-040600-generic
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
