Re: export-diff exported only 4kb instead of 200-600gb

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



There is probably something that I am not understanding, but to me it sounds like you are saying that there are no/minimal deltas between snapshots move2db24-20150428 and 2015-05-05 (both from the export-diff and from your clone).  Are you certain that you made 700-800GBs of changes between the two snapshots and no trim operations released your changes back?  If you diff from move2db24-20150428 to HEAD, do you see all your changes?

-- 

Jason Dillaman 
Red Hat 
dillaman@xxxxxxxxxx 
http://www.redhat.com 


----- Original Message ----- 
From: "Ultral" <ultralisc@xxxxxxxxx> 
To: "ceph-users" <ceph-users@xxxxxxxx> 
Sent: Thursday, May 7, 2015 11:45:46 AM 
Subject:  export-diff exported only 4kb instead of 200-600gb 

Hi all, 


Something strange occurred. 
I have ceph 0.87 version and 2048gb image format 1. I decided to made incremental backups between clusters 

i've made initial copy, 

time bbcp -x 7M -P 3600 -w 32M -s 6 -Z 5030:5035 -N io "rbd export-diff --cluster cluster1 --pool RBD-01 --image CEPH_006__000001__NA__0003__ESX__ALL_EXT --snap move2db24-20150428 -" 1.1.1.1 :"rbd import-diff - --cluster cluster2 --pool TST-INT-SD-RBD-1DC --image temp 
and decide to move incremental(it should be about 200-600gb of changes) 

time bbcp -c -x 7M -P 3600 -w 32M -s 6 -Z 5030:5035 -N io "rbd --cluster cluster1 --pool RBD-01 --image CEPH_006__000001__NA__0003__ESX__ALL_EXT --from-snap move2db24-20150428 --snap 2015-05-05 -" 1.1.1.1 :"rbd import-diff - --cluster cluster2 --pool TST-INT-SD-RBD-1DC --image temp " 
it itakes about 30min(it was too fast because i have limitation 7M bettween clusters) and i decided to check how much data was transfered 
time rbd export-diff --cluster cluster1 --pool RBD-01 --image CEPH_006__000001__NA__0003__ESX__ALL_EXT --from-snap move2db24-20150428 --snap 2015-05-05 -|wc -c 
4753
Exporting image: 100% complete...done. 
i've double checked it.. it was really 4753 bytes, i've decided to check export-diff file 

0000000: 7262 6420 6469 6666 2076 310a 6612 0000  rbd diff v1.f...
0000010: 006d 6f76 6532 6462 3234 2d32 3031 3530  .move2db24-20150
0000020: 3432 3874 0a00 0000 3230 3135 2d30 352d  428t....2015-05-
0000030: 3035 7300 0000 0000 0200 0077 0080 5501  05s........w..U.
0000040: 0000 0000 0002 0000 0000 0000 02ef cdab  ................
0000050: 0080 3500 0000 0000 0d00 0000 0000 0000  ..5.............
0000060: 2d58 3aff 5002 0000 bc56 2255 08fc 14a9  -X:.P....V"U....
0000070: e6c0 e839 351a 942c 01de 4603 0e00 0000  ...95..,..F.....
0000080: 3a00 0000 0000 0000 0000 0000 0000 0000  :...............
0000090: 0000 0000 0000 0000 0000 0000 0000 0000  ................
00000a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................

......
0001270: 0000 0000 0000 0000 0000 0000 0000 0000  ................
0001280: 0000 0000 0000 0000 0000 0000 0000 0000  ................
0001290: 65                                       e 
it look like correct format.. 

i've made clone(like flex clone) from snapshot 2015-05-05 & found that it doesn't have changes from snap move2db24-20150428 

Do you have any ideas, what should i check? why is it hapend? 

_______________________________________________ 
ceph-users mailing list 
ceph-users@xxxxxxxxxxxxxx 
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com





[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux