Below is a part of a sync transfer. First it is fast, and then suddently
it gets really slow.
The stats for the bucket are:
{
"bucket": "testbucket",
"pool": "nl.demo.rgw.buckets.data",
"index_pool": "nl.demo.rgw.buckets.index",
"id": "1adc4b51-3345-4a4b-bf6d-b55b35991530.154674.1",
"marker": "1adc4b51-3345-4a4b-bf6d-b55b35991530.154674.1",
"owner": "demo-nl-bofh",
"ver": "0#468519",
"master_ver": "0#0",
"mtime": "2016-08-20 00:53:45.450618",
"max_marker": "0#",
"usage": {
"rgw.main": {
"size_kb": 3950065,
"size_kb_actual": 4064488,
"num_objects": 41759
},
"rgw.multimeta": {
"size_kb": 0,
"size_kb_actual": 0,
"num_objects": 0
}
},
"bucket_quota": {
"enabled": false,
"max_size_kb": -1,
"max_objects": -1
}
},
Jan Hugo
upload: 'testdir/data1/tar/pkcs11HSMtools/pkcs11.h' ->
's3://testbucket/tar/pkcs11HSMtools/pkcs11.h' [41531 of 41537]
9737 of 9737 100% in 0s 634.38 kB/s done
upload: 'testdir/data1/tar/pkcs11HSMtools/pkcs11f.h' ->
's3://testbucket/tar/pkcs11HSMtools/pkcs11f.h' [41532 of 41537]
28511 of 28511 100% in 0s 1769.93 kB/s done
upload: 'testdir/data1/tar/pkcs11HSMtools/pkcs11t.h' ->
's3://testbucket/tar/pkcs11HSMtools/pkcs11t.h' [41533 of 41537]
61859 of 61859 100% in 0s 3.43 MB/s done
upload: 'testdir/data1/trickle-1.06-2.rf.src.rpm' ->
's3://testbucket/trickle-1.06-2.rf.src.rpm' [41534 of 41537]
169951 of 169951 100% in 0s 8.02 MB/s done
upload: 'testdir/data1/w32x86.zip' -> 's3://testbucket/w32x86.zip'
[part 1 of 3, 15MB] [41535 of 41537]
65536 of 15728640 0% in 0s 600.65 kB/s failed
WARNING: Upload failed:
/w32x86.zip?partNumber=1&uploadId=2~ZgYYLdM072plFPNXIboFrt1sf5sz0Qm
([Errno 32] Broken pipe)
WARNING: Retrying on lower speed (throttle=0.00)
WARNING: Waiting 3 sec...
upload: 'testdir/data1/w32x86.zip' -> 's3://testbucket/w32x86.zip'
[part 1 of 3, 15MB] [41535 of 41537]
15728640 of 15728640 100% in 0s 48.94 MB/s done
upload: 'testdir/data1/w32x86.zip' -> 's3://testbucket/w32x86.zip'
[part 2 of 3, 15MB] [41535 of 41537]
15728640 of 15728640 100% in 0s 54.65 MB/s done
upload: 'testdir/data1/w32x86.zip' -> 's3://testbucket/w32x86.zip'
[part 3 of 3, 8MB] [41535 of 41537]
9074431 of 9074431 100% in 0s 52.37 MB/s done
upload: 'testdir/data1/wpa2_xp/WindowsXP-KB893357-v2-x86-ENU.exe' ->
's3://testbucket/wpa2_xp/WindowsXP-KB893357-v2-x86-ENU.exe' [41536 of
41537]
1244400 of 1244400 100% in 0s 27.41 MB/s done
upload: 'testdir/data1/wpa2_xp/WindowsXP-KB893357-v2-x86-NLD.exe' ->
's3://testbucket/wpa2_xp/WindowsXP-KB893357-v2-x86-NLD.exe' [41537 of
41537]
1253104 of 1253104 100% in 0s 26.45 MB/s done
WARNING: Retrying failed request:
/Adobe+Flex+Builder+2.0.1/FlexBuilder2_Installer/Windows/resource/jre/lib/images/cursors/win32_CopyNoDrop32x32.gif?acl
('')
WARNING: Waiting 3 sec...
remote copy: 'Adobe Flex Builder
2.0.1/FlexBuilder2_Installer/Windows/resource/jre/lib/images/cursors/invalid32x32.gif'
-> 'Adobe Flex Builder
2.0.1/FlexBuilder2_Installer/Windows/resource/jre/lib/images/cursors/win32_CopyNoDrop32x32.gif'
WARNING: Retrying failed request:
/Adobe+Flex+Builder+2.0.1/FlexBuilder2_Installer/Windows/resource/jre/lib/images/cursors/win32_LinkNoDrop32x32.gif?acl
('')
WARNING: Waiting 3 sec...
remote copy: 'Adobe Flex Builder
2.0.1/FlexBuilder2_Installer/Windows/resource/jre/lib/images/cursors/invalid32x32.gif'
-> 'Adobe Flex Builder
2.0.1/FlexBuilder2_Installer/Windows/resource/jre/lib/images/cursors/win32_LinkNoDrop32x32.gif'
WARNING: Retrying failed request:
/Adobe+Flex+Builder+2.0.1/FlexBuilder2_Installer/Windows/resource/jre/lib/images/cursors/win32_MoveNoDrop32x32.gif?acl
('')
WARNING: Waiting 3 sec...
remote copy: 'Adobe Flex Builder
2.0.1/FlexBuilder2_Installer/Windows/resource/jre/lib/images/cursors/invalid32x32.gif'
-> 'Adobe Flex Builder
2.0.1/FlexBuilder2_Installer/Windows/resource/jre/lib/images/cursors/win32_MoveNoDrop32x32.gif'
WARNING: Retrying failed request:
/Adobe+Flex+Builder+2.0.1/FlexBuilder2_Installer/Windows/resource/jre/lib/zi/Africa/Asmera?acl
('')
WARNING: Waiting 3 sec...
remote copy: 'Adobe Flex Builder
2.0.1/FlexBuilder2_Installer/Windows/resource/jre/lib/zi/Africa/Addis_Ababa'
-> 'Adobe Flex Builder
2.0.1/FlexBuilder2_Installer/Windows/resource/jre/lib/zi/Africa/Asmera'
WARNING: Retrying failed request:
/Adobe+Flex+Builder+2.0.1/FlexBuilder2_Installer/Windows/resource/jre/lib/zi/Africa/Lubumbashi?acl
('')
WARNING: Waiting 3 sec...
On 08/23/2016 01:15 PM, jan hugo prins wrote:
> Hi,
>
> I'm testing S3 and I created a test where I sync a big part of my
> homedirectory, about 4GB of data in a lot of small objects, towards a S3
> bucket.
> The first part of the sync was very fast but after some time it became a
> lot slower.
>
> What I basically see is this for every file:
>
> The file gets transferred.
> The S3 gateway returns a 200 for the transfer
> s3cmd seems to think that something failed (probably the acl???)
> It starts a new transfer of the same file with ?acl behind the call and
> inserts a 3 second delay for this transfer.
>
> With 40.000 files this really takes a very long time.
>
> I have created debug logfiles for this but they are really big and I
> probably need to filter out the parts related to one set of calls to
> make it usable.
>
> The user that I use to do the transfer has full controll on the bucket.
>
> Has anyone seen this before?
>
--
Met vriendelijke groet / Best regards,
Jan Hugo Prins
Infra and Isilon storage consultant
Better.be B.V.
Auke Vleerstraat 140 E | 7547 AN Enschede | KvK 08097527
T +31 (0) 53 48 00 694 | M +31 (0)6 26 358 951
jprins@xxxxxxxxxxxx | www.betterbe.com
This e-mail is intended exclusively for the addressee(s), and may not
be passed on to, or made available for use by any person other than
the addressee(s). Better.be B.V. rules out any and every liability
resulting from any electronic transmission.
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
