radosgw-agent.sync object state is error

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 

Hi,guys
this problem bother me couple of weeks.
I can sync users and buckets from master to slave zone,but object can not,the error is:
  ERROR:radosgw_agent.worker:failed to sync object qwer1/brs.sql: state is error
 
region-map is :
{ "name": "us",
  "api_name": "us",
  "is_master": "true",
  "endpoints": [
        "http:\/\/ceph1.gcis3test.com:80\/"],
  "master_zone": "us-east",
  "zones": [
        { "name": "us-east",
          "endpoints": [
                "http:\/\/ceph1.gcis3test.com:80\/"],
          "log_meta": "true",
          "log_data": "true"},
        { "name": "us-west",
          "endpoints": [
                "http:\/\/rceph1.gcis3test.com:80\/"],
          "log_meta": "false",
          "log_data": "false"}],
  "placement_targets": [
        { "name": "default-placement",
          "tags": []}],
  "default_placement": "default-placement"}
--------------------------------------------------------------------------
zone config is:
{ "domain_root": ".us-west.rgw.domain",
  "control_pool": ".us-west.rgw.control",
  "gc_pool": ".us-west.rgw.gc",
  "log_pool": ".us-west.log",
  "intent_log_pool": ".us-west.intent-log",
  "usage_log_pool": ".us-west.usage",
  "user_keys_pool": ".us-west.users",
  "user_email_pool": ".us-west.users.email",
  "user_swift_pool": ".us-west.users.swift",
  "user_uid_pool": ".us-west.users.uid",
  "system_key": { "access_key": "0YPTFZIICAUY10D7FEPP",
      "secret_key": "RsniW1vqGLKt4EzVSHdSA+oWRN4bPzFhzTRi9cn6"},
  "placement_pools": []}
------------------------------------------------------------------------------------
{ "domain_root": ".us-east.rgw.domain",
  "control_pool": ".us-east.rgw.control",
  "gc_pool": ".us-east.rgw.gc",
  "log_pool": ".us-east.log",
  "intent_log_pool": ".us-east.intent-log",
  "usage_log_pool": ".us-east.usage",
  "user_keys_pool": ".us-east.users",
  "user_email_pool": ".us-east.users.email",
  "user_swift_pool": ".us-east.users.swift",
  "user_uid_pool": ".us-east.users.uid",
  "system_key": { "access_key": "OF1JBOO4S6LK7IQICY8P",
      "secret_key": "RHyyLatkxAoeLuvWg7bUb4aMYj0ayL55Gh4meTql"},
  "placement_pools": []}
--------------------------------------------------------------------------
ceph.conf about radosgw is:
[client.radosgw.us-west-1]
rgw region = us
rgw region root pool = .us.rgw.root
rgw zone = us-west
rgw zone root pool = .us-west.rgw.root
keyring = /etc/ceph/ceph.client.radosgw.keyring
rgw socket path = /var/run/ceph/client.radosgw.us-west-1.sock
host = rceph1
debug ms=1
debug rgw=30
--------------------------------------------------
I donot know whether this list can include attach,
so the main log about sync object in the radosgw log of slave zone is below:
2013-12-19 11:18:39.456342 7fef467e4700  1 ====== starting new request req=0x173c300 =====
2013-12-19 11:18:39.456418 7fef467e4700  2 req 369:0.000075::GET /admin/replica_log::initializing
2013-12-19 11:18:39.456473 7fef467e4700 20 FCGI_ROLE=RESPONDER
2013-12-19 11:18:39.456475 7fef467e4700 20 SCRIPT_URL=/admin/replica_log
2013-12-19 11:18:39.456477 7fef467e4700 20 SCRIPT_URI=http://rceph1.gcis3test.com/admin/replica_log
2013-12-19 11:18:39.456478 7fef467e4700 20 HTTP_AUTHORIZATION=AWS 0YPTFZIICAUY10D7FEPP:AY6yy6R0Nx/Z9q6WxQYEJph72zA=
2013-12-19 11:18:39.456479 7fef467e4700 20 HTTP_HOST=rceph1.gcis3test.com
2013-12-19 11:18:39.456480 7fef467e4700 20 CONTENT_LENGTH=0
2013-12-19 11:18:39.456481 7fef467e4700 20 HTTP_ACCEPT_ENCODING=gzip, deflate, compress
2013-12-19 11:18:39.456482 7fef467e4700 20 HTTP_ACCEPT=*/*
2013-12-19 11:18:39.456483 7fef467e4700 20 HTTP_USER_AGENT=Boto/2.2.2 (linux2)
2013-12-19 11:18:39.456484 7fef467e4700 20 HTTP_DATE=Thu, 19 Dec 2013 03:18:39 GMT
2013-12-19 11:18:39.456486 7fef467e4700 20 PATH=/usr/local/bin:/usr/bin:/bin
2013-12-19 11:18:39.456487 7fef467e4700 20 SERVER_SIGNATURE=
2013-12-19 11:18:39.456489 7fef467e4700 20 SERVER_SOFTWARE=Apache/2.2.22 (Ubuntu)
2013-12-19 11:18:39.456490 7fef467e4700 20 SERVER_NAME=rceph1.gcis3test.com
2013-12-19 11:18:39.456492 7fef467e4700 20 SERVER_ADDR=10.122.129.34
2013-12-19 11:18:39.456493 7fef467e4700 20 SERVER_PORT=80
2013-12-19 11:18:39.456494 7fef467e4700 20 REMOTE_ADDR=10.122.129.34
2013-12-19 11:18:39.456495 7fef467e4700 20 DOCUMENT_ROOT=/var/www
2013-12-19 11:18:39.456495 7fef467e4700 20 SERVER_ADMIN=hesong313326@xxxxxxx
2013-12-19 11:18:39.456496 7fef467e4700 20 SCRIPT_FILENAME=/var/www/s3gw.fcgi
2013-12-19 11:18:39.456497 7fef467e4700 20 REMOTE_PORT=55144
2013-12-19 11:18:39.456498 7fef467e4700 20 GATEWAY_INTERFACE=CGI/1.1
2013-12-19 11:18:39.456499 7fef467e4700 20 SERVER_PROTOCOL=HTTP/1.1
2013-12-19 11:18:39.456500 7fef467e4700 20 REQUEST_METHOD=GET
2013-12-19 11:18:39.456501 7fef467e4700 20 QUERY_STRING=page=admin&params=/replica_log&bounds&type=bucket-index&bucket-instance=qwer1%3Aus-east.4281.1
2013-12-19 11:18:39.456504 7fef467e4700 20 REQUEST_URI=/admin/replica_log?bounds&type=bucket-index&bucket-instance=qwer1%3Aus-east.4281.1
2013-12-19 11:18:39.456506 7fef467e4700 20 SCRIPT_NAME=/admin/replica_log
2013-12-19 11:18:39.456508 7fef467e4700  2 req 369:0.000166::GET /admin/replica_log::getting op
2013-12-19 11:18:39.456514 7fef467e4700  2 req 369:0.000172::GET /admin/replica_log:replicabilog_getbounds:authorizing
2013-12-19 11:18:39.456537 7fef467e4700 20 get_obj_state: rctx=0x7fef5401a0a0 obj=.us-west.users:0YPTFZIICAUY10D7FEPP state=0x7fef54016958 s->prefetch_data=0
2013-12-19 11:18:39.456549 7fef467e4700 10 moving .us-west.users+0YPTFZIICAUY10D7FEPP to cache LRU end
2013-12-19 11:18:39.456552 7fef467e4700 10 cache get: name=.us-west.users+0YPTFZIICAUY10D7FEPP : hit
2013-12-19 11:18:39.456562 7fef467e4700 20 get_obj_state: s->obj_tag was set empty
2013-12-19 11:18:39.456570 7fef467e4700 10 moving .us-west.users+0YPTFZIICAUY10D7FEPP to cache LRU end
2013-12-19 11:18:39.456573 7fef467e4700 10 cache get: name=.us-west.users+0YPTFZIICAUY10D7FEPP : hit
2013-12-19 11:18:39.456591 7fef467e4700 20 get_obj_state: rctx=0x7fef540157e0 obj=.us-west.users.uid:us-west state=0x7fef54024cc8 s->prefetch_data=0
2013-12-19 11:18:39.456599 7fef467e4700 10 moving .us-west.users.uid+us-west to cache LRU end
2013-12-19 11:18:39.456601 7fef467e4700 10 cache get: name=.us-west.users.uid+us-west : hit
2013-12-19 11:18:39.456607 7fef467e4700 20 get_obj_state: s->obj_tag was set empty
2013-12-19 11:18:39.456613 7fef467e4700 10 moving .us-west.users.uid+us-west to cache LRU end
2013-12-19 11:18:39.456616 7fef467e4700 10 cache get: name=.us-west.users.uid+us-west : hit
2013-12-19 11:18:39.456666 7fef467e4700 10 get_canon_resource(): dest=/admin/replica_log
2013-12-19 11:18:39.456670 7fef467e4700 10 auth_hdr:
GET
 
 
Thu, 19 Dec 2013 03:18:39 GMT
/admin/replica_log
2013-12-19 11:18:39.456747 7fef467e4700 15 calculated digest=AY6yy6R0Nx/Z9q6WxQYEJph72zA=
2013-12-19 11:18:39.456752 7fef467e4700 15 auth_sign=AY6yy6R0Nx/Z9q6WxQYEJph72zA=
2013-12-19 11:18:39.456754 7fef467e4700 15 compare=0
2013-12-19 11:18:39.456757 7fef467e4700 20 system request
2013-12-19 11:18:39.456762 7fef467e4700  2 req 369:0.000419::GET /admin/replica_log:replicabilog_getbounds:reading permissions
2013-12-19 11:18:39.456767 7fef467e4700  2 req 369:0.000425::GET /admin/replica_log:replicabilog_getbounds:init op
2013-12-19 11:18:39.456771 7fef467e4700  2 req 369:0.000429::GET /admin/replica_log:replicabilog_getbounds:verifying op mask
2013-12-19 11:18:39.456775 7fef467e4700 20 required_mask= 0 user.op_mask=7
2013-12-19 11:18:39.456778 7fef467e4700  2 req 369:0.000436::GET /admin/replica_log:replicabilog_getbounds:verifying op permissions
2013-12-19 11:18:39.456783 7fef467e4700  2 overriding permissions due to system operation
2013-12-19 11:18:39.456784 7fef467e4700  2 req 369:0.000442::GET /admin/replica_log:replicabilog_getbounds:verifying op params
2013-12-19 11:18:39.456788 7fef467e4700  2 req 369:0.000446::GET /admin/replica_log:replicabilog_getbounds:executing
2013-12-19 11:18:39.456908 7fef467e4700 20 reading from .us-west.rgw.domain:.bucket.meta.qwer1:us-east.4281.1
2013-12-19 11:18:39.456929 7fef467e4700 20 get_obj_state: rctx=0x7fef54040480 obj=.us-west.rgw.domain:.bucket.meta.qwer1:us-east.4281.1 state=0x7fef54040548 s->prefetch_data=0
2013-12-19 11:18:39.456940 7fef467e4700 10 cache get: name=.us-west.rgw.domain+.bucket.meta.qwer1:us-east.4281.1 : miss
2013-12-19 11:18:39.457135 7fef467e4700  1 -- 10.122.129.34:0/1004322 --> 10.122.129.35:6802/4750 -- osd_op(client.4497.0:508 .bucket.meta.qwer1:us-east.4281.1 [call version.read,getxattrs,stat] 28.ddbda3de e95) v4 -- ?+0 0x7fef54040c90 con 0x7fef68023a90
2013-12-19 11:18:39.470466 7fef7ceb8700  1 -- 10.122.129.34:0/1004322 <== osd.1 10.122.129.35:6802/4750 167 ==== osd_op_reply(508 .bucket.meta.qwer1:us-east.4281.1 [call,getxattrs,stat] v0'0 uv1 _ondisk_ = 0) v6 ==== 276+0+274 (943646018 0 1551755869) 0x17474a0 con 0x7fef68023a90
2013-12-19 11:18:39.470596 7fef467e4700 10 cache put: name=.us-west.rgw.domain+.bucket.meta.qwer1:us-east.4281.1
2013-12-19 11:18:39.470608 7fef467e4700 10 adding .us-west.rgw.domain+.bucket.meta.qwer1:us-east.4281.1 to cache LRU end
2013-12-19 11:18:39.470611 7fef467e4700 10 updating xattr: name=user.rgw.acl bl.length()=115
2013-12-19 11:18:39.470620 7fef467e4700 20 get_obj_state: s->obj_tag was set empty
2013-12-19 11:18:39.470633 7fef467e4700 10 moving .us-west.rgw.domain+.bucket.meta.qwer1:us-east.4281.1 to cache LRU end
2013-12-19 11:18:39.470636 7fef467e4700 10 cache get: name=.us-west.rgw.domain+.bucket.meta.qwer1:us-east.4281.1 : type miss (requested=17, cached=22)
2013-12-19 11:18:39.470653 7fef467e4700 20 get_obj_state: rctx=0x7fef54040480 obj=.us-west.rgw.domain:.bucket.meta.qwer1:us-east.4281.1 state=0x7fef5400b988 s->prefetch_data=0
2013-12-19 11:18:39.470662 7fef467e4700 10 moving .us-west.rgw.domain+.bucket.meta.qwer1:us-east.4281.1 to cache LRU end
2013-12-19 11:18:39.470664 7fef467e4700 10 cache get: name=.us-west.rgw.domain+.bucket.meta.qwer1:us-east.4281.1 : hit
2013-12-19 11:18:39.470670 7fef467e4700 20 get_obj_state: s->obj_tag was set empty
2013-12-19 11:18:39.470679 7fef467e4700 20 get_obj_state: rctx=0x7fef54040480 obj=.us-west.rgw.domain:.bucket.meta.qwer1:us-east.4281.1 state=0x7fef5400b988 s->prefetch_data=0
2013-12-19 11:18:39.470684 7fef467e4700 20 state for obj=.us-west.rgw.domain:.bucket.meta.qwer1:us-east.4281.1 is not atomic, not appending atomic test
2013-12-19 11:18:39.470731 7fef467e4700 20 rados->read obj-ofs=0 read_ofs=0 read_len=524288
2013-12-19 11:18:39.470766 7fef467e4700  1 -- 10.122.129.34:0/1004322 --> 10.122.129.35:6802/4750 -- osd_op(client.4497.0:509 .bucket.meta.qwer1:us-east.4281.1 [call version.check_conds,call version.read,read 0~524288] 28.ddbda3de e95) v4 -- ?+0 0x7fef540525e0 con 0x7fef68023a90
2013-12-19 11:18:39.473435 7fef7ceb8700  1 -- 10.122.129.34:0/1004322 <== osd.1 10.122.129.35:6802/4750 168 ==== osd_op_reply(509 .bucket.meta.qwer1:us-east.4281.1 [call,call,read 0~524288] v0'0 uv1 _ondisk_ = 0) v6 ==== 276+0+190 (353128705 0 620725048) 0x17474a0 con 0x7fef68023a90
2013-12-19 11:18:39.473502 7fef467e4700 20 rados->read r=0 bl.length=142
2013-12-19 11:18:39.473521 7fef467e4700 10 cache put: name=.us-west.rgw.domain+.bucket.meta.qwer1:us-east.4281.1
2013-12-19 11:18:39.473524 7fef467e4700 10 moving .us-west.rgw.domain+.bucket.meta.qwer1:us-east.4281.1 to cache LRU end
2013-12-19 11:18:39.473578 7fef467e4700  1 -- 10.122.129.34:0/1004322 --> 10.122.129.34:6800/3916 -- osd_op(client.4497.0:510 replica_log.qwer1 [call replica_log.get] 21.e492ba0b e95) v4 -- ?+0 0x7fef54052680 con 0x7fef680233f0
2013-12-19 11:18:39.485119 7fef7ceb8700  1 -- 10.122.129.34:0/1004322 <== osd.0 10.122.129.34:6800/3916 219 ==== osd_op_reply(510 replica_log.qwer1 [call] v0'0 uv35 _ondisk_ = 0) v6 ==== 176+0+116 (3308203004 0 423676903) 0x7fef54052680 con 0x7fef680233f0
2013-12-19 11:18:39.485238 7fef467e4700  2 req 369:0.028896::GET /admin/replica_log:replicabilog_getbounds:http status=200
2013-12-19 11:18:39.487956 7fef467e4700  1 ====== req done req=0x173c300 http_status=200 ======
2013-12-19 11:18:39.542154 7fef86f0e780 20 enqueued request req=0x1730810
2013-12-19 11:18:39.542185 7fef86f0e780 20 RGWWQ:
2013-12-19 11:18:39.542189 7fef86f0e780 20 req: 0x1730810
2013-12-19 11:18:39.542196 7fef86f0e780 10 allocated request req=0x1796d80
2013-12-19 11:18:39.542220 7fef457e2700 20 dequeued request req=0x1730810
2013-12-19 11:18:39.542225 7fef457e2700 20 RGWWQ: empty
2013-12-19 11:18:39.542232 7fef457e2700  1 ====== starting new request req=0x1730810 =====
2013-12-19 11:18:39.542347 7fef457e2700  2 req 370:0.000115::PUT /qwer1/brs.sql::initializing
2013-12-19 11:18:39.542382 7fef457e2700 10 meta>> HTTP_X_AMZ_COPY_SOURCE
2013-12-19 11:18:39.542428 7fef457e2700 10 x>> x-amz-copy-source:qwer1%2Fbrs.sql
2013-12-19 11:18:39.542536 7fef457e2700 10 s->object=brs.sql s->bucket=qwer1
2013-12-19 11:18:39.542608 7fef457e2700 20 FCGI_ROLE=RESPONDER
2013-12-19 11:18:39.542611 7fef457e2700 20 SCRIPT_URL=/qwer1/brs.sql
2013-12-19 11:18:39.542613 7fef457e2700 20 SCRIPT_URI=http://rceph1.gcis3test.com/qwer1/brs.sql
2013-12-19 11:18:39.542614 7fef457e2700 20 HTTP_AUTHORIZATION=AWS 0YPTFZIICAUY10D7FEPP:mjdwyrgIQYJPlcbT4txFXhbIAC4=
2013-12-19 11:18:39.542616 7fef457e2700 20 HTTP_HOST=rceph1.gcis3test.com
2013-12-19 11:18:39.542617 7fef457e2700 20 CONTENT_LENGTH=0
2013-12-19 11:18:39.542619 7fef457e2700 20 HTTP_ACCEPT_ENCODING=gzip, deflate, compress
2013-12-19 11:18:39.542620 7fef457e2700 20 HTTP_ACCEPT=*/*
2013-12-19 11:18:39.542622 7fef457e2700 20 HTTP_USER_AGENT=Boto/2.2.2 (linux2)
2013-12-19 11:18:39.542624 7fef457e2700 20 HTTP_X_AMZ_COPY_SOURCE=qwer1%2Fbrs.sql
2013-12-19 11:18:39.542625 7fef457e2700 20 HTTP_DATE=Thu, 19 Dec 2013 03:18:39 GMT
2013-12-19 11:18:39.542627 7fef457e2700 20 CONTENT_TYPE=application/json; charset=UTF-8
2013-12-19 11:18:39.542628 7fef457e2700 20 PATH=/usr/local/bin:/usr/bin:/bin
2013-12-19 11:18:39.542629 7fef457e2700 20 SERVER_SIGNATURE=
2013-12-19 11:18:39.542630 7fef457e2700 20 SERVER_SOFTWARE=Apache/2.2.22 (Ubuntu)
2013-12-19 11:18:39.542631 7fef457e2700 20 SERVER_NAME=rceph1.gcis3test.com
2013-12-19 11:18:39.542632 7fef457e2700 20 SERVER_ADDR=10.122.129.34
2013-12-19 11:18:39.542634 7fef457e2700 20 SERVER_PORT=80
2013-12-19 11:18:39.542635 7fef457e2700 20 REMOTE_ADDR=10.122.129.34
2013-12-19 11:18:39.542636 7fef457e2700 20 DOCUMENT_ROOT=/var/www
2013-12-19 11:18:39.542637 7fef457e2700 20 SERVER_ADMIN=hesong313326@xxxxxxx
2013-12-19 11:18:39.542638 7fef457e2700 20 SCRIPT_FILENAME=/var/www/s3gw.fcgi
2013-12-19 11:18:39.542639 7fef457e2700 20 REMOTE_PORT=55146
2013-12-19 11:18:39.542641 7fef457e2700 20 GATEWAY_INTERFACE=CGI/1.1
2013-12-19 11:18:39.542642 7fef457e2700 20 SERVER_PROTOCOL=HTTP/1.1
2013-12-19 11:18:39.542643 7fef457e2700 20 REQUEST_METHOD=PUT
2013-12-19 11:18:39.542644 7fef457e2700 20 QUERY_STRING=page=qwer1&params=/brs.sql&rgwx-op-id=rceph1%3A4960%3A1&rgwx-source-zone=us-east&rgwx-client-id=radosgw-agent
2013-12-19 11:18:39.542647 7fef457e2700 20 REQUEST_URI=/qwer1/brs.sql?rgwx-op-id=rceph1%3A4960%3A1&rgwx-source-zone=us-east&rgwx-client-id=radosgw-agent
2013-12-19 11:18:39.542649 7fef457e2700 20 SCRIPT_NAME=/qwer1/brs.sql
2013-12-19 11:18:39.542652 7fef457e2700  2 req 370:0.000421:s3:PUT /qwer1/brs.sql::getting op
2013-12-19 11:18:39.542668 7fef457e2700  2 req 370:0.000437:s3:PUT /qwer1/brs.sql:copy_obj:authorizing
2013-12-19 11:18:39.542702 7fef457e2700 20 get_obj_state: rctx=0x7fef7800afb0 obj=.us-west.users:0YPTFZIICAUY10D7FEPP state=0x7fef780465f8 s->prefetch_data=0
2013-12-19 11:18:39.542716 7fef457e2700 10 moving .us-west.users+0YPTFZIICAUY10D7FEPP to cache LRU end
2013-12-19 11:18:39.542721 7fef457e2700 10 cache get: name=.us-west.users+0YPTFZIICAUY10D7FEPP : hit
2013-12-19 11:18:39.542732 7fef457e2700 20 get_obj_state: s->obj_tag was set empty
2013-12-19 11:18:39.542740 7fef457e2700 10 moving .us-west.users+0YPTFZIICAUY10D7FEPP to cache LRU end
2013-12-19 11:18:39.542742 7fef457e2700 10 cache get: name=.us-west.users+0YPTFZIICAUY10D7FEPP : hit
2013-12-19 11:18:39.542765 7fef457e2700 20 get_obj_state: rctx=0x7fef780300b0 obj=.us-west.users.uid:us-west state=0x7fef78005968 s->prefetch_data=0
2013-12-19 11:18:39.542774 7fef457e2700 10 moving .us-west.users.uid+us-west to cache LRU end
2013-12-19 11:18:39.542776 7fef457e2700 10 cache get: name=.us-west.users.uid+us-west : hit
2013-12-19 11:18:39.542782 7fef457e2700 20 get_obj_state: s->obj_tag was set empty
2013-12-19 11:18:39.542788 7fef457e2700 10 moving .us-west.users.uid+us-west to cache LRU end
2013-12-19 11:18:39.542791 7fef457e2700 10 cache get: name=.us-west.users.uid+us-west : hit
2013-12-19 11:18:39.542854 7fef457e2700 10 get_canon_resource(): dest=/qwer1/brs.sql
2013-12-19 11:18:39.542859 7fef457e2700 10 auth_hdr:
PUT
 
application/json; charset=UTF-8
Thu, 19 Dec 2013 03:18:39 GMT
x-amz-copy-source:qwer1%2Fbrs.sql
/qwer1/brs.sql
2013-12-19 11:18:39.542966 7fef457e2700 15 calculated digest=mjdwyrgIQYJPlcbT4txFXhbIAC4=
2013-12-19 11:18:39.542971 7fef457e2700 15 auth_sign=mjdwyrgIQYJPlcbT4txFXhbIAC4=
2013-12-19 11:18:39.542972 7fef457e2700 15 compare=0
2013-12-19 11:18:39.542976 7fef457e2700 20 system request
2013-12-19 11:18:39.543003 7fef457e2700  2 req 370:0.000771:s3:PUT /qwer1/brs.sql:copy_obj:reading permissions
2013-12-19 11:18:39.543044 7fef457e2700 20 get_obj_state: rctx=0x7fef78004510 obj=.us-west.rgw.domain:qwer1%2Fbrs.sql state=0x7fef7801b1d8 s->prefetch_data=0
2013-12-19 11:18:39.543055 7fef457e2700 10 cache get: name=.us-west.rgw.domain+qwer1%2Fbrs.sql : miss
2013-12-19 11:18:39.543121 7fef457e2700  1 -- 10.122.129.34:0/1004322 --> 10.122.129.35:6802/4750 -- osd_op(client.4497.0:511 qwer1%2Fbrs.sql [call version.read,getxattrs,stat] 28.94256a4e e95) v4 -- ?+0 0x7fef7804f510 con 0x7fef68023a90
2013-12-19 11:18:39.545997 7fef7ceb8700  1 -- 10.122.129.34:0/1004322 <== osd.1 10.122.129.35:6802/4750 169 ==== osd_op_reply(511 qwer1%2Fbrs.sql [call,getxattrs,stat] v0'0 uv0 ack = -2 (No such file or directory)) v6 ==== 258+0+0 (368262196 0 0) 0x178fff0 con 0x7fef68023a90
2013-12-19 11:18:39.555836 7fef457e2700 10 cache put: name=.us-west.rgw.domain+qwer1%2Fbrs.sql
2013-12-19 11:18:39.555863 7fef457e2700 10 adding .us-west.rgw.domain+qwer1%2Fbrs.sql to cache LRU end
2013-12-19 11:18:39.555979 7fef457e2700 20 get_obj_state: rctx=0x7fef78004510 obj=.us-west.rgw.domain:qwer1 state=0x7fef7804f1f8 s->prefetch_data=0
2013-12-19 11:18:39.556003 7fef457e2700 10 cache get: name=.us-west.rgw.domain+qwer1 : miss
2013-12-19 11:18:39.556062 7fef457e2700  1 -- 10.122.129.34:0/1004322 --> 10.122.129.35:6802/4750 -- osd_op(client.4497.0:512 qwer1 [call version.read,getxattrs,stat] 28.43308f07 e95) v4 -- ?+0 0x7fef780176d0 con 0x7fef68023a90
2013-12-19 11:18:39.574138 7fef7ceb8700  1 -- 10.122.129.34:0/1004322 <== osd.1 10.122.129.35:6802/4750 170 ==== osd_op_reply(512 qwer1 [call,getxattrs,stat] v0'0 uv1 _ondisk_ = 0) v6 ==== 248+0+139 (3958050444 0 3340206787) 0x1790830 con 0x7fef68023a90
2013-12-19 11:18:39.574349 7fef457e2700 10 cache put: name=.us-west.rgw.domain+qwer1
2013-12-19 11:18:39.574388 7fef457e2700 10 adding .us-west.rgw.domain+qwer1 to cache LRU end
2013-12-19 11:18:39.574403 7fef457e2700 20 get_obj_state: s->obj_tag was set empty
2013-12-19 11:18:39.574410 7fef457e2700 20 Read xattr: user.rgw.idtag
2013-12-19 11:18:39.574414 7fef457e2700 20 Read xattr: user.rgw.manifest
2013-12-19 11:18:39.574426 7fef457e2700 10 moving .us-west.rgw.domain+qwer1 to cache LRU end
2013-12-19 11:18:39.574431 7fef457e2700 10 cache get: name=.us-west.rgw.domain+qwer1 : type miss (requested=17, cached=22)
2013-12-19 11:18:39.574441 7fef457e2700 20 get_obj_state: rctx=0x7fef78004510 obj=.us-west.rgw.domain:qwer1 state=0x7fef7804f1f8 s->prefetch_data=0
2013-12-19 11:18:39.574451 7fef457e2700 20 get_obj_state: rctx=0x7fef78004510 obj=.us-west.rgw.domain:qwer1 state=0x7fef7804f1f8 s->prefetch_data=0
2013-12-19 11:18:39.574457 7fef457e2700 20 state for obj=.us-west.rgw.domain:qwer1 is not atomic, not appending atomic test
2013-12-19 11:18:39.574493 7fef457e2700 20 rados->read obj-ofs=0 read_ofs=0 read_len=524288
2013-12-19 11:18:39.574899 7fef457e2700  1 -- 10.122.129.34:0/1004322 --> 10.122.129.35:6802/4750 -- osd_op(client.4497.0:513 qwer1 [call version.check_conds,call version.read,read 0~524288] 28.43308f07 e95) v4 -- ?+0 0x7fef78047090 con 0x7fef68023a90
2013-12-19 11:18:39.577676 7fef7ceb8700  1 -- 10.122.129.34:0/1004322 <== osd.1 10.122.129.35:6802/4750 171 ==== osd_op_reply(513 qwer1 [call,call,read 0~524288] v0'0 uv1 _ondisk_ = 0) v6 ==== 248+0+153 (1545703325 0 3924168904) 0x1790830 con 0x7fef68023a90
2013-12-19 11:18:39.578012 7fef457e2700 20 rados->read r=0 bl.length=105
2013-12-19 11:18:39.578043 7fef457e2700 10 cache put: name=.us-west.rgw.domain+qwer1
2013-12-19 11:18:39.578049 7fef457e2700 10 moving .us-west.rgw.domain+qwer1 to cache LRU end
2013-12-19 11:18:39.578063 7fef457e2700 20 rgw_get_bucket_info: bucket instance: qwer1(@.rgw.buckets[us-east.4281.1])
2013-12-19 11:18:39.578085 7fef457e2700 20 reading from .us-west.rgw.domain:.bucket.meta.qwer1:us-east.4281.1
2013-12-19 11:18:39.578216 7fef457e2700 20 get_obj_state: rctx=0x7fef78004510 obj=.us-west.rgw.domain:.bucket.meta.qwer1:us-east.4281.1 state=0x7fef78047108 s->prefetch_data=0
2013-12-19 11:18:39.578237 7fef457e2700 10 moving .us-west.rgw.domain+.bucket.meta.qwer1:us-east.4281.1 to cache LRU end
2013-12-19 11:18:39.578242 7fef457e2700 10 cache get: name=.us-west.rgw.domain+.bucket.meta.qwer1:us-east.4281.1 : type miss (requested=22, cached=19)
2013-12-19 11:18:39.578320 7fef457e2700  1 -- 10.122.129.34:0/1004322 --> 10.122.129.35:6802/4750 -- osd_op(client.4497.0:514 .bucket.meta.qwer1:us-east.4281.1 [call version.read,getxattrs,stat] 28.ddbda3de e95) v4 -- ?+0 0x7fef78047b00 con 0x7fef68023a90
2013-12-19 11:18:39.580444 7fef7ceb8700  1 -- 10.122.129.34:0/1004322 <== osd.1 10.122.129.35:6802/4750 172 ==== osd_op_reply(514 .bucket.meta.qwer1:us-east.4281.1 [call,getxattrs,stat] v0'0 uv1 _ondisk_ = 0) v6 ==== 276+0+274 (943646018 0 1551755869) 0x1790830 con 0x7fef68023a90
2013-12-19 11:18:39.580579 7fef457e2700 10 cache put: name=.us-west.rgw.domain+.bucket.meta.qwer1:us-east.4281.1
2013-12-19 11:18:39.580590 7fef457e2700 10 moving .us-west.rgw.domain+.bucket.meta.qwer1:us-east.4281.1 to cache LRU end
2013-12-19 11:18:39.580596 7fef457e2700 10 updating xattr: name=user.rgw.acl bl.length()=115
2013-12-19 11:18:39.580605 7fef457e2700 20 get_obj_state: s->obj_tag was set empty
2013-12-19 11:18:39.580609 7fef457e2700 20 Read xattr: user.rgw.acl
2013-12-19 11:18:39.580611 7fef457e2700 20 Read xattr: user.rgw.idtag
2013-12-19 11:18:39.580612 7fef457e2700 20 Read xattr: user.rgw.manifest
2013-12-19 11:18:39.580621 7fef457e2700 10 moving .us-west.rgw.domain+.bucket.meta.qwer1:us-east.4281.1 to cache LRU end
2013-12-19 11:18:39.580623 7fef457e2700 10 cache get: name=.us-west.rgw.domain+.bucket.meta.qwer1:us-east.4281.1 : hit
2013-12-19 11:18:39.580711 7fef457e2700 15 Read AccessControlPolicy<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>asd</ID><DisplayName>asd</DisplayName></Owner><AccessControlList><Grant><Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:type="CanonicalUser"><ID>asd</ID><DisplayName>asd</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>
2013-12-19 11:18:39.580753 7fef457e2700  2 req 370:0.038521:s3:PUT /qwer1/brs.sql:copy_obj:init op
2013-12-19 11:18:39.580762 7fef457e2700  2 req 370:0.038531:s3:PUT /qwer1/brs.sql:copy_obj:verifying op mask
2013-12-19 11:18:39.580766 7fef457e2700 20 required_mask= 2 user.op_mask=7
2013-12-19 11:18:39.580769 7fef457e2700  2 req 370:0.038538:s3:PUT /qwer1/brs.sql:copy_obj:verifying op permissions
2013-12-19 11:18:39.581072 7fef457e2700 20 get_obj_state: rctx=0x7fef78004510 obj=.us-west.rgw.domain:qwer1 state=0x7fef7804f1f8 s->prefetch_data=0
2013-12-19 11:18:39.581087 7fef457e2700 20 Read xattr: user.rgw.idtag
2013-12-19 11:18:39.581090 7fef457e2700 20 Read xattr: user.rgw.manifest
2013-12-19 11:18:39.581098 7fef457e2700 10 moving .us-west.rgw.domain+qwer1 to cache LRU end
2013-12-19 11:18:39.581102 7fef457e2700 10 cache get: name=.us-west.rgw.domain+qwer1 : hit
2013-12-19 11:18:39.581118 7fef457e2700 20 rgw_get_bucket_info: bucket instance: qwer1(@.rgw.buckets[us-east.4281.1])
2013-12-19 11:18:39.581124 7fef457e2700 20 reading from .us-west.rgw.domain:.bucket.meta.qwer1:us-east.4281.1
2013-12-19 11:18:39.581132 7fef457e2700 20 get_obj_state: rctx=0x7fef78004510 obj=.us-west.rgw.domain:.bucket.meta.qwer1:us-east.4281.1 state=0x7fef78047108 s->prefetch_data=0
2013-12-19 11:18:39.581137 7fef457e2700 20 Read xattr: user.rgw.acl
2013-12-19 11:18:39.581139 7fef457e2700 20 Read xattr: user.rgw.idtag
2013-12-19 11:18:39.581140 7fef457e2700 20 Read xattr: user.rgw.manifest
2013-12-19 11:18:39.581145 7fef457e2700 10 moving .us-west.rgw.domain+.bucket.meta.qwer1:us-east.4281.1 to cache LRU end
2013-12-19 11:18:39.581148 7fef457e2700 10 cache get: name=.us-west.rgw.domain+.bucket.meta.qwer1:us-east.4281.1 : hit
2013-12-19 11:18:39.581191 7fef457e2700  0 WARNING: couldn't find acl header for bucket, generating default
2013-12-19 11:18:39.581213 7fef457e2700 20 get_obj_state: rctx=0x7fef7800faa0 obj=.us-west.users.uid:asd state=0x7fef7800fb68 s->prefetch_data=0
2013-12-19 11:18:39.581222 7fef457e2700 10 cache get: name=.us-west.users.uid+asd : miss
2013-12-19 11:18:39.581256 7fef457e2700  1 -- 10.122.129.34:0/1004322 --> 10.122.129.35:6802/4750 -- osd_op(client.4497.0:515 asd [getxattrs,stat] 27.b364b448 e95) v4 -- ?+0 0x7fef780108d0 con 0x7fef68023a90
2013-12-19 11:18:39.602369 7fef7ceb8700  1 -- 10.122.129.34:0/1004322 <== osd.1 10.122.129.35:6802/4750 173 ==== osd_op_reply(515 asd [getxattrs,stat] v0'0 uv1 _ondisk_ = 0) v6 ==== 204+0+91 (992005831 0 1543089698) 0x1790830 con 0x7fef68023a90
2013-12-19 11:18:39.602504 7fef457e2700 10 cache put: name=.us-west.users.uid+asd
2013-12-19 11:18:39.602521 7fef457e2700 10 adding .us-west.users.uid+asd to cache LRU end
2013-12-19 11:18:39.602529 7fef457e2700 20 get_obj_state: s->obj_tag was set empty
2013-12-19 11:18:39.602542 7fef457e2700 10 moving .us-west.users.uid+asd to cache LRU end
2013-12-19 11:18:39.602544 7fef457e2700 10 cache get: name=.us-west.users.uid+asd : type miss (requested=1, cached=6)
2013-12-19 11:18:39.602554 7fef457e2700 20 get_obj_state: rctx=0x7fef7800faa0 obj=.us-west.users.uid:asd state=0x7fef78010528 s->prefetch_data=0
2013-12-19 11:18:39.602562 7fef457e2700 10 moving .us-west.users.uid+asd to cache LRU end
2013-12-19 11:18:39.602564 7fef457e2700 10 cache get: name=.us-west.users.uid+asd : hit
2013-12-19 11:18:39.602569 7fef457e2700 20 get_obj_state: s->obj_tag was set empty
2013-12-19 11:18:39.602572 7fef457e2700 20 get_obj_state: rctx=0x7fef7800faa0 obj=.us-west.users.uid:asd state=0x7fef78010528 s->prefetch_data=0
2013-12-19 11:18:39.602576 7fef457e2700 20 state for obj=.us-west.users.uid:asd is not atomic, not appending atomic test
2013-12-19 11:18:39.602579 7fef457e2700 20 rados->read obj-ofs=0 read_ofs=0 read_len=524288
2013-12-19 11:18:39.602824 7fef457e2700  1 -- 10.122.129.34:0/1004322 --> 10.122.129.35:6802/4750 -- osd_op(client.4497.0:516 asd [read 0~524288] 27.b364b448 e95) v4 -- ?+0 0x7fef780113e0 con 0x7fef68023a90
2013-12-19 11:18:39.609656 7fef7ceb8700  1 -- 10.122.129.34:0/1004322 <== osd.1 10.122.129.35:6802/4750 174 ==== osd_op_reply(516 asd [read 0~524288] v0'0 uv1 _ondisk_ = 0) v6 ==== 162+0+280 (1151645485 0 1651205856) 0x1790830 con 0x7fef68023a90
2013-12-19 11:18:39.609777 7fef457e2700 20 rados->read r=0 bl.length=280
2013-12-19 11:18:39.609848 7fef457e2700 10 cache put: name=.us-west.users.uid+asd
2013-12-19 11:18:39.609854 7fef457e2700 10 moving .us-west.users.uid+asd to cache LRU end
2013-12-19 11:18:39.609940 7fef457e2700  2 req 370:0.067708:s3:PUT /qwer1/brs.sql:copy_obj:verifying op params
2013-12-19 11:18:39.609950 7fef457e2700  2 req 370:0.067719:s3:PUT /qwer1/brs.sql:copy_obj:executing
2013-12-19 11:18:39.609983 7fef457e2700 10 x>> x-amz-copy-source:qwer1%2Fbrs.sql
2013-12-19 11:18:39.610139 7fef457e2700  5 Copy object qwer1(@.rgw.buckets[us-east.4281.1]):brs.sql => qwer1(@.rgw.buckets[us-east.4281.1]):brs.sql
2013-12-19 11:18:39.610490 7fef457e2700  1 -- 10.122.129.34:0/1004322 --> 10.122.129.34:6800/3916 -- osd_op(client.4497.0:517 statelog.obj_opstate.30 [call statelog.add] 21.31e93f12 e95) v4 -- ?+0 0x7fef78011930 con 0x7fef680233f0
2013-12-19 11:18:39.615561 7fef7ceb8700  1 -- 10.122.129.34:0/1004322 <== osd.0 10.122.129.34:6800/3916 220 ==== osd_op_reply(517 statelog.obj_opstate.30 [call] v95'19 uv19 _ondisk_ = 0) v6 ==== 182+0+0 (970169557 0 0) 0x7fef54021170 con 0x7fef680233f0
2013-12-19 11:18:39.615844 7fef457e2700 10 meta>> HTTP_X_AMZ_COPY_SOURCE
2013-12-19 11:18:39.615862 7fef457e2700 10 x>> x-amz-copy-source:qwer1%2Fbrs.sql
2013-12-19 11:18:39.615865 7fef457e2700  0 > HTTP_DATE -> Thu Dec 19 03:18:39 2013
2013-12-19 11:18:39.615867 7fef457e2700  0 > HTTP_X_AMZ_COPY_SOURCE -> qwer1%2Fbrs.sql
2013-12-19 11:18:39.615882 7fef457e2700 10 get_canon_resource(): dest=/qwer1/brs.sql
2013-12-19 11:18:39.615885 7fef457e2700 10 generated canonical header: GET
 
 
Thu Dec 19 03:18:39 2013
x-amz-copy-source:qwer1%2Fbrs.sql
/qwer1/brs.sql
2013-12-19 11:18:39.615966 7fef457e2700 15 generated auth header: AWS 0YPTFZIICAUY10D7FEPP:drENjY6+MVoCaYw/vcvnEOdKxao=
2013-12-19 11:18:39.616183 7fef457e2700 20 sending request to http://ceph1.gcis3test.com:80/qwer1/brs.sql?rgwx-uid=us-west&rgwx-region=us&rgwx-prepend-metadata=us
2013-12-19 11:18:39.657231 7fef457e2700 10 receive_http_header
2013-12-19 11:18:39.657318 7fef457e2700 10 received header:HTTP/1.1 411 Length Required
2013-12-19 11:18:39.657365 7fef457e2700 10 receive_http_header
2013-12-19 11:18:39.657416 7fef457e2700 10 received header:Date: Thu, 19 Dec 2013 03:18:39 GMT
2013-12-19 11:18:39.657481 7fef457e2700 10 receive_http_header
2013-12-19 11:18:39.657526 7fef457e2700 10 received header:Server: Apache/2.2.22 (Ubuntu)
2013-12-19 11:18:39.657567 7fef457e2700 10 receive_http_header
2013-12-19 11:18:39.657603 7fef457e2700 10 received header:Vary: Accept-Encoding
2013-12-19 11:18:39.657647 7fef457e2700 10 receive_http_header
2013-12-19 11:18:39.657683 7fef457e2700 10 received header:Content-Length: 238
2013-12-19 11:18:39.657724 7fef457e2700 10 receive_http_header
2013-12-19 11:18:39.658002 7fef457e2700 10 received header:Connection: close
2013-12-19 11:18:39.658064 7fef457e2700 10 receive_http_header
2013-12-19 11:18:39.658101 7fef457e2700 10 received header:Content-Type: text/html; charset=iso-8859-1
2013-12-19 11:18:39.658141 7fef457e2700 10 receive_http_header
2013-12-19 11:18:39.658175 7fef457e2700 10 received header:
2013-12-19 11:18:39.658565 7fef457e2700  1 -- 10.122.129.34:0/1004322 --> 10.122.129.34:6800/3916 -- osd_op(client.4497.0:518 statelog.obj_opstate.30 [call statelog.add] 21.31e93f12 e95) v4 -- ?+0 0x7fef78054710 con 0x7fef680233f0
2013-12-19 11:18:39.664009 7fef7ceb8700  1 -- 10.122.129.34:0/1004322 <== osd.0 10.122.129.34:6800/3916 221 ==== osd_op_reply(518 statelog.obj_opstate.30 [call] v95'20 uv20 _ondisk_ = 0) v6 ==== 182+0+0 (2738709228 0 0) 0x7fef54021170 con 0x7fef680233f0
2013-12-19 11:18:39.664195 7fef457e2700  0 WARNING: set_req_state_err err_no=5 resorting to 500
2013-12-19 11:18:39.664322 7fef457e2700  2 req 370:0.122090:s3:PUT /qwer1/brs.sql:copy_obj:http status=500
2013-12-19 11:18:39.668967 7fef457e2700  1 ====== req done req=0x1730810 http_status=500 ======
2013-12-19 11:18:39.673783 7fef86f0e780 20 enqueued request req=0x1796d80
2013-12-19 11:18:39.673900 7fef86f0e780 20 RGWWQ:
2013-12-19 11:18:39.673905 7fef86f0e780 20 req: 0x1796d80
2013-12-19 11:18:39.673912 7fef86f0e780 10 allocated request req=0x173d840
2013-12-19 11:18:39.673937 7fef3bfcf700 20 dequeued request req=0x1796d80
2013-12-19 11:18:39.673940 7fef3bfcf700 20 RGWWQ: empty
2013-12-19 11:18:39.673946 7fef3bfcf700  1 ====== starting new request req=0x1796d80 =====
2013-12-19 11:18:39.674129 7fef3bfcf700  2 req 371:0.000183::GET /admin/opstate::initializing
2013-12-19 11:18:39.674194 7fef3bfcf700 20 FCGI_ROLE=RESPONDER
2013-12-19 11:18:39.674197 7fef3bfcf700 20 SCRIPT_URL=/admin/opstate
2013-12-19 11:18:39.674198 7fef3bfcf700 20 SCRIPT_URI=http://rceph1.gcis3test.com/admin/opstate
2013-12-19 11:18:39.674200 7fef3bfcf700 20 HTTP_AUTHORIZATION=AWS 0YPTFZIICAUY10D7FEPP:YmrsjkTER5fJ11ayBXXN0jBvQ1Y=
2013-12-19 11:18:39.674201 7fef3bfcf700 20 HTTP_HOST=rceph1.gcis3test.com
2013-12-19 11:18:39.674203 7fef3bfcf700 20 CONTENT_LENGTH=0
2013-12-19 11:18:39.674204 7fef3bfcf700 20 HTTP_ACCEPT_ENCODING=gzip, deflate, compress
2013-12-19 11:18:39.674205 7fef3bfcf700 20 HTTP_ACCEPT=*/*
2013-12-19 11:18:39.674207 7fef3bfcf700 20 HTTP_USER_AGENT=Boto/2.2.2 (linux2)
2013-12-19 11:18:39.674208 7fef3bfcf700 20 HTTP_DATE=Thu, 19 Dec 2013 03:18:39 GMT
2013-12-19 11:18:39.674210 7fef3bfcf700 20 PATH=/usr/local/bin:/usr/bin:/bin
2013-12-19 11:18:39.674211 7fef3bfcf700 20 SERVER_SIGNATURE=
2013-12-19 11:18:39.674212 7fef3bfcf700 20 SERVER_SOFTWARE=Apache/2.2.22 (Ubuntu)
2013-12-19 11:18:39.674214 7fef3bfcf700 20 SERVER_NAME=rceph1.gcis3test.com
2013-12-19 11:18:39.674215 7fef3bfcf700 20 SERVER_ADDR=10.122.129.34
2013-12-19 11:18:39.674216 7fef3bfcf700 20 SERVER_PORT=80
2013-12-19 11:18:39.674217 7fef3bfcf700 20 REMOTE_ADDR=10.122.129.34
2013-12-19 11:18:39.674218 7fef3bfcf700 20 DOCUMENT_ROOT=/var/www
2013-12-19 11:18:39.674219 7fef3bfcf700 20 SERVER_ADMIN=hesong313326@xxxxxxx
2013-12-19 11:18:39.674221 7fef3bfcf700 20 SCRIPT_FILENAME=/var/www/s3gw.fcgi
2013-12-19 11:18:39.674222 7fef3bfcf700 20 REMOTE_PORT=55148
2013-12-19 11:18:39.674224 7fef3bfcf700 20 GATEWAY_INTERFACE=CGI/1.1
2013-12-19 11:18:39.674225 7fef3bfcf700 20 SERVER_PROTOCOL=HTTP/1.1
2013-12-19 11:18:39.674226 7fef3bfcf700 20 REQUEST_METHOD=GET
2013-12-19 11:18:39.674227 7fef3bfcf700 20 QUERY_STRING=page=admin&params=/opstate&client-id=radosgw-agent&object=qwer1%2Fbrs.sql&op-id=rceph1%3A4960%3A1
2013-12-19 11:18:39.674230 7fef3bfcf700 20 REQUEST_URI=/admin/opstate?client-id=radosgw-agent&object=qwer1%2Fbrs.sql&op-id=rceph1%3A4960%3A1
2013-12-19 11:18:39.674232 7fef3bfcf700 20 SCRIPT_NAME=/admin/opstate
2013-12-19 11:18:39.674234 7fef3bfcf700  2 req 371:0.000289::GET /admin/opstate::getting op
2013-12-19 11:18:39.674239 7fef3bfcf700  2 req 371:0.000294::GET /admin/opstate:opstate_list:authorizing
2013-12-19 11:18:39.674265 7fef3bfcf700 20 get_obj_state: rctx=0x7fef7002e650 obj=.us-west.users:0YPTFZIICAUY10D7FEPP state=0x7fef700265b8 s->prefetch_data=0
2013-12-19 11:18:39.674277 7fef3bfcf700 10 moving .us-west.users+0YPTFZIICAUY10D7FEPP to cache LRU end
2013-12-19 11:18:39.674281 7fef3bfcf700 10 cache get: name=.us-west.users+0YPTFZIICAUY10D7FEPP : hit
2013-12-19 11:18:39.674291 7fef3bfcf700 20 get_obj_state: s->obj_tag was set empty
2013-12-19 11:18:39.674300 7fef3bfcf700 10 moving .us-west.users+0YPTFZIICAUY10D7FEPP to cache LRU end
2013-12-19 11:18:39.674302 7fef3bfcf700 10 cache get: name=.us-west.users+0YPTFZIICAUY10D7FEPP : hit
2013-12-19 11:18:39.674321 7fef3bfcf700 20 get_obj_state: rctx=0x7fef700119d0 obj=.us-west.users.uid:us-west state=0x7fef700096a8 s->prefetch_data=0
2013-12-19 11:18:39.674330 7fef3bfcf700 10 moving .us-west.users.uid+us-west to cache LRU end
2013-12-19 11:18:39.674332 7fef3bfcf700 10 cache get: name=.us-west.users.uid+us-west : hit
2013-12-19 11:18:39.674338 7fef3bfcf700 20 get_obj_state: s->obj_tag was set empty
2013-12-19 11:18:39.674343 7fef3bfcf700 10 moving .us-west.users.uid+us-west to cache LRU end
2013-12-19 11:18:39.674346 7fef3bfcf700 10 cache get: name=.us-west.users.uid+us-west : hit
2013-12-19 11:18:39.674406 7fef3bfcf700 10 get_canon_resource(): dest=/admin/opstate
2013-12-19 11:18:39.674411 7fef3bfcf700 10 auth_hdr:
GET
 
 
Thu, 19 Dec 2013 03:18:39 GMT
/admin/opstate
2013-12-19 11:18:39.674488 7fef3bfcf700 15 calculated digest=YmrsjkTER5fJ11ayBXXN0jBvQ1Y=
2013-12-19 11:18:39.674493 7fef3bfcf700 15 auth_sign=YmrsjkTER5fJ11ayBXXN0jBvQ1Y=
2013-12-19 11:18:39.674495 7fef3bfcf700 15 compare=0
2013-12-19 11:18:39.674498 7fef3bfcf700 20 system request
2013-12-19 11:18:39.674503 7fef3bfcf700  2 req 371:0.000558::GET /admin/opstate:opstate_list:reading permissions
2013-12-19 11:18:39.674508 7fef3bfcf700  2 req 371:0.000563::GET /admin/opstate:opstate_list:init op
2013-12-19 11:18:39.674512 7fef3bfcf700  2 req 371:0.000567::GET /admin/opstate:opstate_list:verifying op mask
2013-12-19 11:18:39.674515 7fef3bfcf700 20 required_mask= 0 user.op_mask=7
2013-12-19 11:18:39.674518 7fef3bfcf700  2 req 371:0.000572::GET /admin/opstate:opstate_list:verifying op permissions
2013-12-19 11:18:39.674521 7fef3bfcf700  2 overriding permissions due to system operation
2013-12-19 11:18:39.674524 7fef3bfcf700  2 req 371:0.000578::GET /admin/opstate:opstate_list:verifying op params
2013-12-19 11:18:39.674526 7fef3bfcf700  2 req 371:0.000581::GET /admin/opstate:opstate_list:executing
2013-12-19 11:18:39.674611 7fef3bfcf700  1 -- 10.122.129.34:0/1004322 --> 10.122.129.34:6800/3916 -- osd_op(client.4497.0:519 statelog.obj_opstate.30 [call statelog.list] 21.31e93f12 e95) v4 -- ?+0 0x7fef70047460 con 0x7fef680233f0
2013-12-19 11:18:39.677874 7fef7ceb8700  1 -- 10.122.129.34:0/1004322 <== osd.0 10.122.129.34:6800/3916 222 ==== osd_op_reply(519 statelog.obj_opstate.30 [call] v0'0 uv20 _ondisk_ = 0) v6 ==== 182+0+88 (2721736754 0 1625741506) 0x7fef54021170 con 0x7fef680233f0
2013-12-19 11:18:39.678070 7fef3bfcf700  2 req 371:0.004124::GET /admin/opstate:opstate_list:http status=200
2013-12-19 11:18:39.679122 7fef3bfcf700  1 ====== req done req=0x1796d80 http_status=200 ======

Attachment: ceph-client.radosgw.us-east-1
Description: Binary data

Attachment: ceph-client.radosgw.us-west-1
Description: Binary data

Attachment: radosgw-sync-us-east2west.log
Description: Binary data

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]

  Powered by Linux