Hello, I am having issues getting FG working between east/west data-center test configurations. I have the sync default.conf configured like this: source: "http://10.20.2.39:80"; src_zone: "us-west-1" src_access_key: <src_key> src_secret_key: <src_key) destination: "http://10.30.3.178:80"; dest_zone: "us-east-1" dest_access_key: <dest_key> dest_secret_key: <dest_key) log_file: /var/log/radosgw/radosgw-sync-us-east-west.log No real errors are logged on the agent end, but I see the following in the remove radosgw end: 2014-07-21 15:01:13.346569 7fc5deffd700 1 ====== starting new request req=0x7fc5e000fcf0 ===== 2014-07-21 15:01:13.346947 7fc5deffd700 1 -- 10.30.3.178:0/1028990 --> 10.30.3.178:6800/3700 -- osd_op(client.7160.0:450 testfolder%2FArcherC7v1_en_3_13_34_up_boot%28140402%29.bin [call version.read,getxattrs,stat] 6.44385098 ack+read e66) v4 -- ?+0 0x7fc57c01cdc0 con 0x20dba80 2014-07-21 15:01:13.348006 7fc62fa63700 1 -- 10.30.3.178:0/1028990 <== osd.0 10.30.3.178:6800/3700 99 ==== osd_op_reply(450 testfolder%2FArcherC7v1_en_3_13_34_up_boot%28140402%29.bin [call,getxattrs,stat] v0'0 uv0 ack = -2 ((2) No such file or directory)) v6 ==== 309+0+0 (375136675 0 0) 0x7fc5f4005b90 con 0x20dba80 2014-07-21 15:01:13.348299 7fc5deffd700 1 -- 10.30.3.178:0/1028990 --> 10.30.3.178:6800/3700 -- osd_op(client.7160.0:451 testfolder [call version.read,getxattrs,stat] 6.62cce9f7 ack+read e66) v4 -- ?+0 0x7fc57c01cc10 con 0x20dba80 2014-07-21 15:01:13.349174 7fc62fa63700 1 -- 10.30.3.178:0/1028990 <== osd.0 10.30.3.178:6800/3700 100 ==== osd_op_reply(451 testfolder [call,getxattrs,stat] v0'0 uv1 ondisk = 0) v6 ==== 261+0+139 (3119832768 0 2317765080) 0x7fc5f4005a00 con 0x20dba80 2014-07-21 15:01:13.349324 7fc5deffd700 1 -- 10.30.3.178:0/1028990 --> 10.30.3.178:6800/3700 -- osd_op(client.7160.0:452 testfolder [call version.check_conds,call version.read,read 0~524288] 6.62cce9f7 ack+read e66) v4 -- ?+0 0x7fc57c01cc10 con 0x20dba80 2014-07-21 15:01:13.350009 7fc62fa63700 1 -- 10.30.3.178:0/1028990 <== osd.0 10.30.3.178:6800/3700 101 ==== osd_op_reply(452 testfolder [call,call,read 0~140] v0'0 uv1 ondisk = 0) v6 ==== 261+0+188 (1382517052 0 1901701781) 0x7fc5f4000fd0 con 0x20dba80 2014-07-21 15:01:13.350122 7fc5deffd700 1 -- 10.30.3.178:0/1028990 --> 10.30.3.178:6800/3700 -- osd_op(client.7160.0:453 .bucket.meta.testfolder:us-west.20011.1 [call version.read,getxattrs,stat] 6.1851d0ad ack+read e66) v4 -- ?+0 0x7fc57c01d780 con 0x20dba80 2014-07-21 15:01:13.350914 7fc62fa63700 1 -- 10.30.3.178:0/1028990 <== osd.0 10.30.3.178:6800/3700 102 ==== osd_op_reply(453 .bucket.meta.testfolder:us-west.20011.1 [call,getxattrs,stat] v0'0 uv1 ondisk = 0) v6 ==== 290+0+344 (1757888169 0 2994068559) 0x7fc5f4000fd0 con 0x20dba80 2014-07-21 15:01:13.351131 7fc5deffd700 0 WARNING: couldn't find acl header for bucket, generating default 2014-07-21 15:01:13.351177 7fc5deffd700 1 -- 10.30.3.178:0/1028990 --> 10.30.0.22:6800/12749 -- osd_op(client.7160.0:454 admin [getxattrs,stat] 8.8cee537f ack+read e66) v4 -- ?+0 0x7fc57c023a10 con 0x20e4010 2014-07-21 15:01:13.352755 7fc62fa63700 1 -- 10.30.3.178:0/1028990 <== osd.1 10.30.0.22:6800/12749 150 ==== osd_op_reply(454 admin [getxattrs,stat] v0'0 uv1 ondisk = 0) v6 ==== 214+0+91 (3932713703 0 605478480) 0x7fc5fc001130 con 0x20e4010 2014-07-21 15:01:13.352843 7fc5deffd700 1 -- 10.30.3.178:0/1028990 --> 10.30.0.22:6800/12749 -- osd_op(client.7160.0:455 admin [read 0~524288] 8.8cee537f ack+read e66) v4 -- ?+0 0x7fc57c023810 con 0x20e4010 2014-07-21 15:01:13.353679 7fc62fa63700 1 -- 10.30.3.178:0/1028990 <== osd.1 10.30.0.22:6800/12749 151 ==== osd_op_reply(455 admin [read 0~313] v0'0 uv1 ondisk = 0) v6 ==== 172+0+313 (855218883 0 3348830508) 0x7fc5fc001130 con 0x20e4010 2014-07-21 15:01:13.354106 7fc5deffd700 1 -- 10.30.3.178:0/1028990 --> 10.30.0.23:6800/28001 -- osd_op(client.7160.0:456 statelog.obj_opstate.57 [call statelog.add] 10.bb49d85f ondisk+write e66) v4 -- ?+0 0x7fc57c02b090 con 0x20e0a70 2014-07-21 15:01:13.363690 7fc62fa63700 1 -- 10.30.3.178:0/1028990 <== osd.2 10.30.0.23:6800/28001 103 ==== osd_op_reply(456 statelog.obj_opstate.57 [call] v66'47 uv47 ondisk = 0) v6 ==== 190+0+0 (4198807369 0 0) 0x7fc604005300 con 0x20e0a70 2014-07-21 15:01:13.363928 7fc5deffd700 0 > HTTP_DATE -> Mon Jul 21 20:01:13 2014 2014-07-21 15:01:13.363947 7fc5deffd700 0 > HTTP_X_AMZ_COPY_SOURCE -> testfolder%2FArcherC7v1_en_3_13_34_up_boot%28140402%29.bin 2014-07-21 15:01:13.520133 7fc5deffd700 1 -- 10.30.3.178:0/1028990 --> 10.30.0.23:6800/28001 -- osd_op(client.7160.0:457 statelog.obj_opstate.57 [call statelog.add] 10.bb49d85f ondisk+write e66) v4 -- ?+0 0x7fc57c023870 con 0x20e0a70 2014-07-21 15:01:13.524531 7fc62fa63700 1 -- 10.30.3.178:0/1028990 <== osd.2 10.30.0.23:6800/28001 104 ==== osd_op_reply(457 statelog.obj_opstate.57 [call] v66'48 uv48 ondisk = 0) v6 ==== 190+0+0 (518743807 0 0) 0x7fc6040072d0 con 0x20e0a70 2014-07-21 15:01:13.524723 7fc5deffd700 1 ====== req done req=0x7fc5e000fcf0 http_status=403 ====== 2014-07-21 15:01:13.673430 7fc62d95e700 1 -- 10.30.3.178:0/1028990 --> 10.30.0.24:6800/15997 -- ping v1 -- ?+0 0x7fc6000037e0 con 0x20df800 2014-07-21 15:01:13.673499 7fc62d95e700 1 -- 10.30.3.178:0/1028990 --> 10.30.3.178:6800/3700 -- ping v1 -- ?+0 0x7fc60000a340 con 0x20dba80 2014-07-21 15:01:13.673523 7fc62d95e700 1 -- 10.30.3.178:0/1028990 --> 10.30.0.22:6800/12749 -- ping v1 -- ?+0 0x7fc60000abe0 con 0x20e4010 It appears as far as I can tell that the file never makes it to the remote end, and this goes for all files I could find. Any ideas on what else to look at? Thanks! Justice -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20140721/ebc729f1/attachment.htm>
 |