How does your regionmap look like? Is it updated correctly on all zones?
On Thu, Jan 29, 2015 at 1:42 PM, Mark Kirkwood
<mark.kirkwood@xxxxxxxxxxxxxxx> wrote:
> On 30/01/15 06:31, Yehuda Sadeh wrote:
>>
>> On Wed, Jan 28, 2015 at 8:04 PM, Mark Kirkwood
>> <mark.kirkwood@xxxxxxxxxxxxxxx> wrote:
>>>
>>> On 29/01/15 13:58, Mark Kirkwood wrote:
>>>>
>>>>
>>>>
>>>> However if I
>>>> try to write to eu-west I get:
>>>>
>>>
>>> Sorry - that should have said:
>>>
>>> However if I try to write to eu-*east* I get:
>>>
>>> The actual code is (see below) connecting to the endpoint for eu-east
>>> (ceph4:80), so seeing it redirected to us-*west* is pretty strange!
>>
>>
>> The bucket creation is synchronous, and sent to the master region for
>> completion. Not sure why it actually fails, that's what the master
>> region sends back. What does the corresponding log at the master
>> region show?
>>
>>
>
> The log from us-west (ceph1) below. It looks to be failing because the user
> does not exist. That is reasonable - I've created the user in us-*east* and
> it has been replicated to eu-east...
>
> What is puzzling is why oit is going to that zone (instead of us-east). I'll
> include the region json below too (in case three is something obviously dumb
> in them)!
>
> $ tail radosgw.log
>
> 2015-01-29 21:23:05.260158 7f9f66f7d700 1 ====== starting new request
> req=0x7f9fa802b390 =====
> 2015-01-29 21:23:05.260173 7f9f66f7d700 2 req 1:0.000015::PUT
> /bucket1/::initializing
> 2015-01-29 21:23:05.260178 7f9f66f7d700 10 host=ceph1 rgw_dns_name=ceph1
> 2015-01-29 21:23:05.260220 7f9f66f7d700 10 s->object=<NULL>
> s->bucket=bucket1
> 2015-01-29 21:23:05.260230 7f9f66f7d700 2 req 1:0.000072:s3:PUT
> /bucket1/::getting op
> 2015-01-29 21:23:05.260241 7f9f66f7d700 2 req 1:0.000083:s3:PUT
> /bucket1/:create_bucket:authorizing
> 2015-01-29 21:23:05.260282 7f9f66f7d700 20 get_obj_state:
> rctx=0x7f9fac0280a0 obj=.us-west.users:eu-east key state=0x7f9fac028380
> s->prefetch_data=0
> 2015-01-29 21:23:05.260291 7f9f66f7d700 10 cache get:
> name=.us-west.users+eu-east key : miss
> 2015-01-29 21:23:05.261188 7f9f66f7d700 10 cache put:
> name=.us-west.users+eu-east key
> 2015-01-29 21:23:05.261194 7f9f66f7d700 10 adding .us-west.users+eu-east key
> to cache LRU end
> 2015-01-29 21:23:05.261207 7f9f66f7d700 5 error reading user info,
> uid=eu-east key can't authenticate
> 2015-01-29 21:23:05.261210 7f9f66f7d700 10 failed to authorize request
> 2015-01-29 21:23:05.261237 7f9f66f7d700 2 req 1:0.001079:s3:PUT
> /bucket1/:create_bucket:http status=403
> 2015-01-29 21:23:05.261240 7f9f66f7d700 1 ====== req done
> req=0x7f9fa802b390 http_status=403 ======
>
>
> $ cat us.json
> { "name": "us",
> "api_name": "us",
> "is_master": "true",
> "endpoints": [
> "http:\/\/ceph2:80\/", "http:\/\/ceph1:80\/" ],
> "master_zone": "us-east",
> "zones": [
> { "name": "us-east",
> "endpoints": [
> "http:\/\/ceph2:80\/"],
> "log_meta": "true",
> "log_data": "true"},
> { "name": "us-west",
> "endpoints": [
> "http:\/\/ceph1:80\/"],
> "log_meta": "true",
> "log_data": "true"}],
> "placement_targets": [
> {
> "name": "default-placement",
> "tags": []
> }
> ],
> "default_placement": "default-placement"}
>
> $ cat eu.json
> { "name": "eu",
> "api_name": "eu",
> "is_master": "false",
> "endpoints": [
> "http:\/\/ceph4:80\/", "http:\/\/ceph3:80\/" ],
> "master_zone": "eu-east",
> "zones": [
> { "name": "eu-east",
> "endpoints": [
> "http:\/\/ceph4:80\/"],
> "log_meta": "true",
> "log_data": "true"},
> { "name": "eu-west",
> "endpoints": [
> "http:\/\/ceph3:80\/"],
> "log_meta": "true",
> "log_data": "true"}],
> "placement_targets": [
> {
> "name": "default-placement",
> "tags": []
> }
> ],
> "default_placement": "default-placement"}
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
