s3 upload to ceph slow after few chunks

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hey guys, I am having an s3 upload to ceph issue where in the upload seems to crawl after the first few chunks for a multipart upload. The test file is 38M in size and the upload was tried with s3 default chunk size at 15M and then tried again with chunk size set to 5M and then was tested again with multipart disabled. Each time the upload halted at seeming random amount and I cannot seem to figure out why.


[10.0.144.2] $ /opt/utilities/s3cmd/s3cmd put ACCOUNT\ EXTRACT-GENERATED.PDF.test.2 's3://<some directory path>'  
<some file> -> s3://<some directory path>/<some file>  [part 1 of 3, 15MB] 
 15728640 of 15728640   100% in    2s     7.43 MB/s  done
<some file> -> s3://<some directory path>/<some file>  [part 2 of 3, 15MB] 
     4096 of 15728640     0% in    0s    31.68 kB/s 
ERROR: Upload of 'ACCOUNT EXTRACT-GENERATED.PDF.test.2' part 2 failed. 
Use
  <some directory path>/<some file> 2~T2OI6bU-TYE_dOtm3tPIndtYTek-V0r 
to abort the upload, or 
 ./s3cmd --upload-id 2~T2OI6bU-TYE_dOtm3tPIndtYTek-V0r put ...        
to continue the upload.
See ya! 

Rishiraj Rana

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux