Corrupted Data From Rsync

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi All,

I'm seeing some weird "corruption" like behavior on some binary files that I rysnced to gluster from a different NFS server.

Basically, the file contents are the same, except the destination file in gluster is actually larger than it's source, and is padded with 0 bytes at the end.

I'm suspecting some weird cache behavior but am unsure.  When I initially tried to rsync the file a second time, it still remained with the padded bytes:

[torme@ip-10-10-10-10 ~]$ ls -al /source/test.bin
-rw-rw-r--. 1 torme torme 10404400003 Nov 13 03:14 /source/test.bin
[torme@ip-10-10-10-10 ~]$ ls -al /gluster/test.bin
-rw-rw-r--. 1 torme torme 10404924291 Nov 19 15:58 /gluster/test.bin
[torme@ip-10-10-10-10 ~]$ sudo rsync -av /source/test.bin /gluster/test.bin
sending incremental file list
test.bin

sent 10,406,940,246 bytes  received 35 bytes  174,906,559.34 bytes/sec
total size is 10,404,400,003  speedup is 1.00
[torme@ip-10-10-10-10 ~]$ ls -al /source/test.bin
-rw-rw-r--. 1 torme torme 10404400003 Nov 13 03:14 /source/test.bin
[torme@ip-10-10-10-10 ~]$ ls -al /gluster/test.bin
-rw-rw-r--. 1 torme torme 10404924291 Nov 19 15:58 /gluster/test.bin

You can see the source is still only 10404400003 bytes whereas the gluster copy is 10404924291 bytes.

Copying the file to a different location did the correct operation:

[torme@ip-10-10-10-10 ~]$ sudo cp /source/test.bin /gluster/test.bin.test
[torme@ip-10-10-10-10 ~]$ ls -al /gluster/
-rw-rw-r--. 1 torme torme 10404924291 Nov 19 15:58 /gluster/test.bin
-rw-r--r--. 1 torme torme 10404400003 Nov 19 17:35 /gluster/test.bin.test

When I waited a bit, and retried the rsync command again however, it worked correctly:

[torme@ip-10-10-10-10 ~]$ ls -al /source/test.bin
-rw-rw-r--. 1 torme torme 10404400003 Nov 13 03:14 /source/test.bin
[torme@ip-10-10-10-10 ~]$ ls -al /gluster/test.bin
-rw-rw-r--. 1 torme torme 10404924291 Nov 19 15:58 /gluster/test.bin
[torme@ip-10-10-10-10 ~]$ sudo rsync -av /source/test.bin /gluster/test.bin
sending incremental file list
test.bin

sent 10,406,940,246 bytes  received 35 bytes  174,906,559.34 bytes/sec
total size is 10,404,400,003  speedup is 1.00
[torme@ip-10-10-10-10 ~]$ ls -al /source/test.bin
-rw-rw-r--. 1 torme torme 10404400003 Nov 13 03:14 /source/test.bin
[torme@ip-10-10-10-10 ~]$ ls -al /gluster/test.bin
-rw-rw-r--. 1 torme torme 10404400003 Nov 19 15:58 /gluster/test.bin

So it seems that after some time things are fixed. Any idea what might be causing this?

Let me know what settings are helpful and I can provide them!

Thanks,
Tim
________

Community Meeting Calendar:

APAC Schedule -
Every 2nd and 4th Tuesday at 11:30 AM IST
Bridge: https://bluejeans.com/118564314

NA/EMEA Schedule -
Every 1st and 3rd Tuesday at 01:00 PM EDT
Bridge: https://bluejeans.com/118564314

Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
https://lists.gluster.org/mailman/listinfo/gluster-users

[Index of Archives]     [Gluster Development]     [Linux Filesytems Development]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Bugtraq]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]

  Powered by Linux