fail to add another rgw

[yuelongguang <fastsync@xxxxxxx>]

hi, clewis:

my environment:

one ceph cluster, 3 nodes, each node has one  monitor and  one osd.  one rgw(rgw1) which is on one of them(osd1).  before i deploy the second rgw(rgw2), the first rgw works well.

after i deploy a second rgw, which can not start.

the number of radosgw process increases constantly. 

the configuration file of rgw1 and rgw2 are almost same, except servername, host option of section of client.radosgw.gateway in ceph.conf.

default region, default zone.

 

another test:

i shutdown rgw1, then try to start rgw2. of course rgw3 can not start like before.

then i try to restart rgw1, it  fails . errors are almost  same as rgw2? 

i try to deploy multiple rgw on one ceph cluster in default zone and default region。

 

thanks。

---log---

[root@cephosd2-monb ceph]# /usr/bin/radosgw -d -c /etc/ceph/ceph.conf --debug-rgw=10 -n client.radosgw.gateway
2014-10-29 21:59:10.763921 7f32d24cf820  0 ceph version 0.80.7 (6c0127fcb58008793d3c8b62d925bc91963672a3), process radosgw, pid 11887
2014-10-29 21:59:10.767922 7f32d24cf820 -1 asok(0xaa3110) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/ceph-client.radosgw.gateway.asok': (17) File exists
2014-10-29 21:59:10.776185 7f32c17fb700  2 RGWDataChangesLog::ChangesRenewThread: start
2014-10-29 21:59:10.777282 7f32d24cf820 10 cache get: name=.rgw.root+default.region : miss
2014-10-29 21:59:10.780609 7f32d24cf820 10 cache put: name=.rgw.root+default.region
2014-10-29 21:59:10.780617 7f32d24cf820 10 adding .rgw.root+default.region to cache LRU end
2014-10-29 21:59:10.780634 7f32d24cf820 10 cache get: name=.rgw.root+default.region : type miss (requested=1, cached=6)
2014-10-29 21:59:10.780658 7f32d24cf820 10 cache get: name=.rgw.root+default.region : hit
2014-10-29 21:59:10.781820 7f32d24cf820 10 cache put: name=.rgw.root+default.region
2014-10-29 21:59:10.781825 7f32d24cf820 10 moving .rgw.root+default.region to cache LRU end
2014-10-29 21:59:10.781883 7f32d24cf820 10 cache get: name=.rgw.root+region_info.default : miss
2014-10-29 21:59:10.783149 7f32d24cf820 10 cache put: name=.rgw.root+region_info.default
2014-10-29 21:59:10.783156 7f32d24cf820 10 adding .rgw.root+region_info.default to cache LRU end
2014-10-29 21:59:10.783168 7f32d24cf820 10 cache get: name=.rgw.root+region_info.default : type miss (requested=1, cached=6)
2014-10-29 21:59:10.783187 7f32d24cf820 10 cache get: name=.rgw.root+region_info.default : hit
2014-10-29 21:59:10.784622 7f32d24cf820 10 cache put: name=.rgw.root+region_info.default
2014-10-29 21:59:10.784627 7f32d24cf820 10 moving .rgw.root+region_info.default to cache LRU end
2014-10-29 21:59:10.784671 7f32d24cf820 10 cache get: name=.rgw.root+zone_info.default : miss
2014-10-29 21:59:10.788050 7f32d24cf820 10 cache put: name=.rgw.root+zone_info.default
2014-10-29 21:59:10.788071 7f32d24cf820 10 adding .rgw.root+zone_info.default to cache LRU end
2014-10-29 21:59:10.788091 7f32d24cf820 10 cache get: name=.rgw.root+zone_info.default : type miss (requested=1, cached=6)
2014-10-29 21:59:10.788125 7f32d24cf820 10 cache get: name=.rgw.root+zone_info.default : hit
2014-10-29 21:59:10.789630 7f32d24cf820 10 cache put: name=.rgw.root+zone_info.default
2014-10-29 21:59:10.789645 7f32d24cf820 10 moving .rgw.root+zone_info.default to cache LRU end
2014-10-29 21:59:10.789695 7f32d24cf820  2 zone default is master
2014-10-29 21:59:10.789742 7f32d24cf820 10 cache get: name=.rgw.root+region_map : miss
2014-10-29 21:59:10.791929 7f32d24cf820 10 cache put: name=.rgw.root+region_map
2014-10-29 21:59:10.791958 7f32d24cf820 10 adding .rgw.root+region_map to cache LRU end
2014-10-29 21:59:10.898679 7f32c0af7700  2 garbage collection: start
2014-10-29 21:59:10.899114 7f32a35fe700  0 ERROR: can't get key: ret=-2
2014-10-29 21:59:10.899663 7f32a35fe700  0 ERROR: sync_all_users() returned ret=-2
2014-10-29 21:59:10.900019 7f32d24cf820  0 framework: fastcgi
2014-10-29 21:59:10.900046 7f32d24cf820  0 starting handler: fastcgi
2014-10-29 21:59:10.909479 7f32a20fb700 10 allocated request req=0x7f329400b7c0
2014-10-29 21:59:10.926163 7f32c0af7700  0 RGWGC::process() failed to acquire lock on gc.89
2014-10-29 21:59:10.927823 7f32c0af7700  0 RGWGC::process() failed to acquire lock on gc.90
2014-10-29 21:59:10.958487 7f32c0af7700  0 RGWGC::process() failed to acquire lock on gc.93
2014-10-29 21:59:11.002497 7f32c0af7700  0 RGWGC::process() failed to acquire lock on gc.97
2014-10-29 21:59:11.032245 7f32c0af7700  0 RGWGC::process() failed to acquire lock on gc.0

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com