On Mon, Jul 21, 2014 at 1:07 PM, Justice London <justice at ministrycentered.com> wrote: > Hello, I am having issues getting FG working between east/west data-center > test configurations. I have the sync default.conf configured like this: > > source: "http://10.20.2.39:80"; > src_zone: "us-west-1" > src_access_key: <src_key> > src_secret_key: <src_key) > destination: "http://10.30.3.178:80"; > dest_zone: "us-east-1" > dest_access_key: <dest_key> > dest_secret_key: <dest_key) > log_file: /var/log/radosgw/radosgw-sync-us-east-west.log > > No real errors are logged on the agent end, but I see the following in the > remove radosgw end: > 2014-07-21 15:01:13.346569 7fc5deffd700 1 ====== starting new request > req=0x7fc5e000fcf0 ===== > 2014-07-21 15:01:13.346947 7fc5deffd700 1 -- 10.30.3.178:0/1028990 --> > 10.30.3.178:6800/3700 -- osd_op(client.7160.0:450 > testfolder%2FArcherC7v1_en_3_13_34_up_boot%28140402%29.bin [call > version.read,getxattrs,stat] 6.44385098 ack+read e66) v4 -- ?+0 > 0x7fc57c01cdc0 con 0x20dba80 > 2014-07-21 15:01:13.348006 7fc62fa63700 1 -- 10.30.3.178:0/1028990 <== > osd.0 10.30.3.178:6800/3700 99 ==== osd_op_reply(450 > testfolder%2FArcherC7v1_en_3_13_34_up_boot%28140402%29.bin > [call,getxattrs,stat] v0'0 uv0 ack = -2 ((2) No such file or directory)) v6 > ==== 309+0+0 (375136675 0 0) 0x7fc5f4005b90 con 0x20dba80 > 2014-07-21 15:01:13.348299 7fc5deffd700 1 -- 10.30.3.178:0/1028990 --> > 10.30.3.178:6800/3700 -- osd_op(client.7160.0:451 testfolder [call > version.read,getxattrs,stat] 6.62cce9f7 ack+read e66) v4 -- ?+0 > 0x7fc57c01cc10 con 0x20dba80 > 2014-07-21 15:01:13.349174 7fc62fa63700 1 -- 10.30.3.178:0/1028990 <== > osd.0 10.30.3.178:6800/3700 100 ==== osd_op_reply(451 testfolder > [call,getxattrs,stat] v0'0 uv1 ondisk = 0) v6 ==== 261+0+139 (3119832768 0 > 2317765080) 0x7fc5f4005a00 con 0x20dba80 > 2014-07-21 15:01:13.349324 7fc5deffd700 1 -- 10.30.3.178:0/1028990 --> > 10.30.3.178:6800/3700 -- osd_op(client.7160.0:452 testfolder [call > version.check_conds,call version.read,read 0~524288] 6.62cce9f7 ack+read > e66) v4 -- ?+0 0x7fc57c01cc10 con 0x20dba80 > 2014-07-21 15:01:13.350009 7fc62fa63700 1 -- 10.30.3.178:0/1028990 <== > osd.0 10.30.3.178:6800/3700 101 ==== osd_op_reply(452 testfolder > [call,call,read 0~140] v0'0 uv1 ondisk = 0) v6 ==== 261+0+188 (1382517052 0 > 1901701781) 0x7fc5f4000fd0 con 0x20dba80 > 2014-07-21 15:01:13.350122 7fc5deffd700 1 -- 10.30.3.178:0/1028990 --> > 10.30.3.178:6800/3700 -- osd_op(client.7160.0:453 > .bucket.meta.testfolder:us-west.20011.1 [call version.read,getxattrs,stat] > 6.1851d0ad ack+read e66) v4 -- ?+0 0x7fc57c01d780 con 0x20dba80 > 2014-07-21 15:01:13.350914 7fc62fa63700 1 -- 10.30.3.178:0/1028990 <== > osd.0 10.30.3.178:6800/3700 102 ==== osd_op_reply(453 > .bucket.meta.testfolder:us-west.20011.1 [call,getxattrs,stat] v0'0 uv1 > ondisk = 0) v6 ==== 290+0+344 (1757888169 0 2994068559) 0x7fc5f4000fd0 con > 0x20dba80 > 2014-07-21 15:01:13.351131 7fc5deffd700 0 WARNING: couldn't find acl header > for bucket, generating default > 2014-07-21 15:01:13.351177 7fc5deffd700 1 -- 10.30.3.178:0/1028990 --> > 10.30.0.22:6800/12749 -- osd_op(client.7160.0:454 admin [getxattrs,stat] > 8.8cee537f ack+read e66) v4 -- ?+0 0x7fc57c023a10 con 0x20e4010 > 2014-07-21 15:01:13.352755 7fc62fa63700 1 -- 10.30.3.178:0/1028990 <== > osd.1 10.30.0.22:6800/12749 150 ==== osd_op_reply(454 admin [getxattrs,stat] > v0'0 uv1 ondisk = 0) v6 ==== 214+0+91 (3932713703 0 605478480) > 0x7fc5fc001130 con 0x20e4010 > 2014-07-21 15:01:13.352843 7fc5deffd700 1 -- 10.30.3.178:0/1028990 --> > 10.30.0.22:6800/12749 -- osd_op(client.7160.0:455 admin [read 0~524288] > 8.8cee537f ack+read e66) v4 -- ?+0 0x7fc57c023810 con 0x20e4010 > 2014-07-21 15:01:13.353679 7fc62fa63700 1 -- 10.30.3.178:0/1028990 <== > osd.1 10.30.0.22:6800/12749 151 ==== osd_op_reply(455 admin [read 0~313] > v0'0 uv1 ondisk = 0) v6 ==== 172+0+313 (855218883 0 3348830508) > 0x7fc5fc001130 con 0x20e4010 > 2014-07-21 15:01:13.354106 7fc5deffd700 1 -- 10.30.3.178:0/1028990 --> > 10.30.0.23:6800/28001 -- osd_op(client.7160.0:456 statelog.obj_opstate.57 > [call statelog.add] 10.bb49d85f ondisk+write e66) v4 -- ?+0 0x7fc57c02b090 > con 0x20e0a70 > 2014-07-21 15:01:13.363690 7fc62fa63700 1 -- 10.30.3.178:0/1028990 <== > osd.2 10.30.0.23:6800/28001 103 ==== osd_op_reply(456 > statelog.obj_opstate.57 [call] v66'47 uv47 ondisk = 0) v6 ==== 190+0+0 > (4198807369 0 0) 0x7fc604005300 con 0x20e0a70 > 2014-07-21 15:01:13.363928 7fc5deffd700 0 > HTTP_DATE -> Mon Jul 21 > 20:01:13 2014 > 2014-07-21 15:01:13.363947 7fc5deffd700 0 > HTTP_X_AMZ_COPY_SOURCE -> > testfolder%2FArcherC7v1_en_3_13_34_up_boot%28140402%29.bin > 2014-07-21 15:01:13.520133 7fc5deffd700 1 -- 10.30.3.178:0/1028990 --> > 10.30.0.23:6800/28001 -- osd_op(client.7160.0:457 statelog.obj_opstate.57 > [call statelog.add] 10.bb49d85f ondisk+write e66) v4 -- ?+0 0x7fc57c023870 > con 0x20e0a70 > 2014-07-21 15:01:13.524531 7fc62fa63700 1 -- 10.30.3.178:0/1028990 <== > osd.2 10.30.0.23:6800/28001 104 ==== osd_op_reply(457 > statelog.obj_opstate.57 [call] v66'48 uv48 ondisk = 0) v6 ==== 190+0+0 > (518743807 0 0) 0x7fc6040072d0 con 0x20e0a70 > 2014-07-21 15:01:13.524723 7fc5deffd700 1 ====== req done > req=0x7fc5e000fcf0 http_status=403 ====== Did you set the system flag on the sync agent user? Yehuda > 2014-07-21 15:01:13.673430 7fc62d95e700 1 -- 10.30.3.178:0/1028990 --> > 10.30.0.24:6800/15997 -- ping v1 -- ?+0 0x7fc6000037e0 con 0x20df800 > 2014-07-21 15:01:13.673499 7fc62d95e700 1 -- 10.30.3.178:0/1028990 --> > 10.30.3.178:6800/3700 -- ping v1 -- ?+0 0x7fc60000a340 con 0x20dba80 > 2014-07-21 15:01:13.673523 7fc62d95e700 1 -- 10.30.3.178:0/1028990 --> > 10.30.0.22:6800/12749 -- ping v1 -- ?+0 0x7fc60000abe0 con 0x20e4010 > > > It appears as far as I can tell that the file never makes it to the remote > end, and this goes for all files I could find. > > Any ideas on what else to look at? > > Thanks! > > Justice > > _______________________________________________ > ceph-users mailing list > ceph-users at lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >
 |