Re: RGW region metadata sync prevents writes to non-master region

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 30/01/15 06:31, Yehuda Sadeh wrote:
On Wed, Jan 28, 2015 at 8:04 PM, Mark Kirkwood
<mark.kirkwood@xxxxxxxxxxxxxxx> wrote:
On 29/01/15 13:58, Mark Kirkwood wrote:


However if I
try to write to eu-west I get:


Sorry - that should have said:

However if I try to write to eu-*east* I get:

The actual code is (see below) connecting to the endpoint for eu-east
(ceph4:80), so seeing it redirected to us-*west* is pretty strange!

The bucket creation is synchronous, and sent to the master region for
completion. Not sure why it actually fails, that's what the master
region sends back. What does the corresponding log at the master
region show?



The log from us-west (ceph1) below. It looks to be failing because the user does not exist. That is reasonable - I've created the user in us-*east* and it has been replicated to eu-east...

What is puzzling is why oit is going to that zone (instead of us-east). I'll include the region json below too (in case three is something obviously dumb in them)!

$ tail radosgw.log

2015-01-29 21:23:05.260158 7f9f66f7d700 1 ====== starting new request req=0x7f9fa802b390 ===== 2015-01-29 21:23:05.260173 7f9f66f7d700 2 req 1:0.000015::PUT /bucket1/::initializing
2015-01-29 21:23:05.260178 7f9f66f7d700 10 host=ceph1 rgw_dns_name=ceph1
2015-01-29 21:23:05.260220 7f9f66f7d700 10 s->object=<NULL> s->bucket=bucket1 2015-01-29 21:23:05.260230 7f9f66f7d700 2 req 1:0.000072:s3:PUT /bucket1/::getting op 2015-01-29 21:23:05.260241 7f9f66f7d700 2 req 1:0.000083:s3:PUT /bucket1/:create_bucket:authorizing 2015-01-29 21:23:05.260282 7f9f66f7d700 20 get_obj_state: rctx=0x7f9fac0280a0 obj=.us-west.users:eu-east key state=0x7f9fac028380 s->prefetch_data=0 2015-01-29 21:23:05.260291 7f9f66f7d700 10 cache get: name=.us-west.users+eu-east key : miss 2015-01-29 21:23:05.261188 7f9f66f7d700 10 cache put: name=.us-west.users+eu-east key 2015-01-29 21:23:05.261194 7f9f66f7d700 10 adding .us-west.users+eu-east key to cache LRU end 2015-01-29 21:23:05.261207 7f9f66f7d700 5 error reading user info, uid=eu-east key can't authenticate
2015-01-29 21:23:05.261210 7f9f66f7d700 10 failed to authorize request
2015-01-29 21:23:05.261237 7f9f66f7d700 2 req 1:0.001079:s3:PUT /bucket1/:create_bucket:http status=403 2015-01-29 21:23:05.261240 7f9f66f7d700 1 ====== req done req=0x7f9fa802b390 http_status=403 ======


$ cat us.json
{ "name": "us",
  "api_name": "us",
  "is_master": "true",
  "endpoints": [
        "http:\/\/ceph2:80\/", "http:\/\/ceph1:80\/" ],
  "master_zone": "us-east",
  "zones": [
        { "name": "us-east",
          "endpoints": [
                "http:\/\/ceph2:80\/"],
          "log_meta": "true",
          "log_data": "true"},
        { "name": "us-west",
          "endpoints": [
                "http:\/\/ceph1:80\/"],
          "log_meta": "true",
          "log_data": "true"}],
  "placement_targets": [
   {
     "name": "default-placement",
     "tags": []
   }
  ],
  "default_placement": "default-placement"}

$ cat eu.json
{ "name": "eu",
  "api_name": "eu",
  "is_master": "false",
  "endpoints": [
        "http:\/\/ceph4:80\/", "http:\/\/ceph3:80\/" ],
  "master_zone": "eu-east",
  "zones": [
        { "name": "eu-east",
          "endpoints": [
                "http:\/\/ceph4:80\/"],
          "log_meta": "true",
          "log_data": "true"},
        { "name": "eu-west",
          "endpoints": [
                "http:\/\/ceph3:80\/"],
          "log_meta": "true",
          "log_data": "true"}],
  "placement_targets": [
   {
     "name": "default-placement",
     "tags": []
   }
  ],
  "default_placement": "default-placement"}
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux