Hi, replies within. On Mon, 2014-09-29 at 13:50 +0530, Aravinda wrote: > On 09/27/2014 04:45 AM, Kingsley wrote: > > Hi, > > > > I'm new to gluster so forgive me if I'm being an idiot. I've searched > > the list archives back to May but haven't found the exact issue I've > > come across, so I thought I'd ask on here. > > > > Firstly, I'd like to thank the people working on this project. I've > > found gluster to be pretty simple to get going and it seems to work > > pretty well so far. It looks like it will be a good fit for the > > application I have in mind, if we can get geo-replication to work > > reliably. > > > > Now on to my problem ... > > > > I've set up an additional gluster volume and configured geo-replication > > to replicate the master volume to it using the instructions here: > > > > https://github.com/gluster/glusterfs/blob/master/doc/admin-guide/en-US/markdown/admin_distributed_geo_rep.md > > > > To keep things simple while it was all new to me and I was just testing, > > I didn't want to add confusion by thinking about using non-privileged > > accounts and mountbroker and stuff so I just set everything up to use > > root. > > > > Anyway, I mounted the master volume and slave on a client machine (I > > didn't modify the content of the slave volume, I just mounted it so that > > I could check things were working). > > > > When I manually create or delete a few files and wait 60 seconds for > > replication to do its thing, it seems to work fine. > > > > However, when I hit it with a script to simulate intense user activity, > > geo-replication breaks. I deleted the geo-replication and removed the > > slave volume, then re-created and re-enabled geo-replication several > > times so that I could start again from scratch. Each time, my script > > (which just creates, renames and deletes files in the master volume via > > a glusterfs mount) runs for barely a minute before geo-replication > > breaks. > > Are these fop involves renames and delete of the same files? Pretty much, yes. My test script partly simulates a voicemail app we have, which writes voicemail messages as wav files into a directory, one directory per mailbox. In the real app, the message files are numbered sequentially starting at msg0000.wav, then msg0001.wav and so on. New messages are saved with the next message number in sequence, but deleting a message involves renumbering all of the later messages. Therefore, deleting a single message can result in a lot of files being renamed (we didn't write this voicemail app ourselves). My test script follows the same basic logic but uses slightly different filenames. I just ran it again for a few ops with a newly created geo-replication volume slaving from the gv2 volume. msg000000 already existed before I ran the script; the script log is below this (bear in mind that a delete also renames any higher-numbered files): Mon Sep 29 10:50:04 2014 1/10: created /mnt/gv2/mailtest/mbx0/msg000002, 3217034 bytes in 0.325s Mon Sep 29 10:50:04 2014 2/10: created /mnt/gv2/mailtest/mbx0/msg000003, 3913942 bytes in 0.239s Mon Sep 29 10:50:04 2014 3/10: created /mnt/gv2/mailtest/mbx0/msg000004, 250056 bytes in 0.166s Mon Sep 29 10:50:05 2014 4/10: created /mnt/gv2/mailtest/mbx0/msg000005, 205757 bytes in 0.152s Mon Sep 29 10:50:05 2014 5/10: created /mnt/gv2/mailtest/mbx0/msg000006, 7555 bytes in 0.112s Mon Sep 29 10:50:05 2014 6/10: created /mnt/gv2/mailtest/mbx0/msg000007, 2507883 bytes in 0.228s Mon Sep 29 10:50:05 2014 7/10: created /mnt/gv2/mailtest/mbx0/msg000008, 3256424 bytes in 0.244s Mon Sep 29 10:50:05 2014 8/10: created /mnt/gv2/mailtest/mbx0/msg000009, 855269 bytes in 0.242s Mon Sep 29 10:50:06 2014 9/10: deleted /mnt/gv2/mailtest/mbx0/msg000005 in 0.167s Mon Sep 29 10:50:06 2014 10/10: deleted /mnt/gv2/mailtest/mbx0/msg000003 in 0.214s This resulted in the following files within the mailtest directory on gv2 (the master); remember msg000001 already existsed: drwxr-xr-x 3 root root 4096 Sep 29 10:28 . drwxr-xr-x 2 root root 4096 Sep 29 10:50 ./mbx0 -rw-r--r-- 1 root root 997207 Sep 29 10:40 ./mbx0/msg000001 -rw-r--r-- 1 root root 3217034 Sep 29 10:50 ./mbx0/msg000002 -rw-r--r-- 1 root root 250056 Sep 29 10:50 ./mbx0/msg000003 -rw-r--r-- 1 root root 7555 Sep 29 10:50 ./mbx0/msg000004 -rw-r--r-- 1 root root 2507883 Sep 29 10:50 ./mbx0/msg000005 -rw-r--r-- 1 root root 3256424 Sep 29 10:50 ./mbx0/msg000006 -rw-r--r-- 1 root root 855269 Sep 29 10:50 ./mbx0/msg000007 but this was what ended up in the gv2-slave volume - not the same list: drwxr-xr-x 3 root root 4096 Sep 29 10:29 . drwxr-xr-x 2 root root 4096 Sep 29 10:50 ./mbx0 -rw-r--r-- 1 root root 997207 Sep 29 10:40 ./mbx0/msg000001 -rw-r--r-- 1 root root 3217034 Sep 29 10:50 ./mbx0/msg000002 -rw-r--r-- 0 root root 3256424 Sep 29 10:50 ./mbx0/msg000003 -rw-r--r-- 0 root root 3256424 Sep 29 10:50 ./mbx0/msg000004 -rw-r--r-- 1 root root 855269 Sep 29 10:50 ./mbx0/msg000005 -rw-r--r-- 0 root root 3256424 Sep 29 10:50 ./mbx0/msg000006 -rw-r--r-- 1 root root 855269 Sep 29 10:50 ./mbx0/msg000007 Although it seems that the issue I have may have been patched, I've copied log extracts seen on the master and slave bricks and uploaded those in case you want to download them (links below). FWIW, we're running in timezone GMT+1 (UTC+1); the logs on the master show local time but the logs on the slave show UTC: http://gluster.dogwind.com/files/georep-master.log http://gluster.dogwind.com/files/georep-slave.log The master log was taken from a file called /var/log/glusterfs/geo-replication/gv2/ssh%3A%2F%2Froot% 4088.151.43.14%3Agluster%3A%2F%2F127.0.0.1%3Agv2-slave.log The slave log was taken from a file called /var/log/glusterfs/geo-replication-slaves/50d67d25-c159-4900-aa2e-123669020477:gluster%3A%2F%2F127.0.0.1%3Agv2-slave.gluster.log > Geo-rep had > issue with short lived renamed files(Now fixed in Master > http://review.gluster.org/#/c/8761/). OK, I'll generate myself an OpenID and go and have a look at that, thanks. > > I tried this with the slave volume containing just one brick, and also > > with it containing 2 bricks replicating each other. Each time, it broke. > > > > On the slave, I noticed that the geo-replication logs contained entries > > like these: > > > > [2014-09-26 16:32:23.995539] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 6384: SETXATTR() /.gfid/5f9b6d20-a062-4168-9333-8d28f2ba2d57 => -1 (File exists) > > [2014-09-26 16:32:23.995798] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:855b5eda-f694-487c-adae-a4723fe6c316>/msg000002 > > [2014-09-26 16:32:23.996042] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 6385: SETXATTR() /.gfid/855b5eda-f694-487c-adae-a4723fe6c316 => -1 (File exists) > > [2014-09-26 16:32:24.550009] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 6469: /.gfid/05a27020-5931-4890-9b74-a77cb1aca918 => -1 (Operation not permitted) > > [2014-09-26 16:32:24.550533] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7fb2ebd1e7d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7fb2ebd07063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7fb2eef36fbe]))) 0-fuse: xlator does not implement release_cbk > File exists errors can be ignored as these are soft errors, which are > already handled in Geo-replication. OK. > > I also noticed that at some point, rsync was returning error code 23. > Above mentioned patch also handles error code 23. Excellent. > > > > Now ... I noted from the page I linked above that it requires rsync > > version 3.0.7 and the version that ships with CentOS 6.5 is, wait for > > it ... 3.0.6. Is this going to be the issue, or is the problem something > > else? > No issue with rsync version. OK, thanks for confirming that. -- Cheers, Kingsley.
[2014-09-29 10:46:35.889601] I [master(/data/brick/gv2):445:crawlwrap] _GMaster: 20 crawls, 0 turns [2014-09-29 10:47:37.51127] I [master(/data/brick/gv2):445:crawlwrap] _GMaster: 20 crawls, 0 turns [2014-09-29 10:48:38.258196] I [master(/data/brick/gv2):445:crawlwrap] _GMaster: 20 crawls, 0 turns [2014-09-29 10:49:08.846997] I [master(/data/brick/gv2):1059:crawl] _GMaster: slave's time: (1411983666, 0) [2014-09-29 10:49:39.840430] I [master(/data/brick/gv2):445:crawlwrap] _GMaster: 20 crawls, 1 turns [2014-09-29 10:50:10.561655] I [master(/data/brick/gv2):1059:crawl] _GMaster: slave's time: (1411984146, 0) [2014-09-29 10:50:11.241992] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/6258032a-f537-4ad0-936e-2d274e8ab2e3 [errcode: 23] [2014-09-29 10:50:11.242827] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/8dd088e6-bccc-4ac2-a360-b2ba7dfbba65 [errcode: 23] [2014-09-29 10:50:11.243268] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/fdc10266-0cc8-4c29-a608-d1564a457eee [errcode: 23] [2014-09-29 10:50:11.243664] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/b9006804-d72e-420b-8701-9d6dc3489d71 [errcode: 23] [2014-09-29 10:50:11.244924] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/c0219fef-35e7-4dca-8d77-a18b467de711 [errcode: 23] [2014-09-29 10:50:11.245060] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/08d29eb6-ec11-4eee-a6d6-27239719df1f [errcode: 23] [2014-09-29 10:50:11.245213] W [master(/data/brick/gv2):877:process] _GMaster: incomplete sync, retrying changelogs: CHANGELOG.1411984207 [2014-09-29 10:50:12.284461] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/6258032a-f537-4ad0-936e-2d274e8ab2e3 [errcode: 23] [2014-09-29 10:50:12.284965] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/8dd088e6-bccc-4ac2-a360-b2ba7dfbba65 [errcode: 23] [2014-09-29 10:50:12.285502] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/fdc10266-0cc8-4c29-a608-d1564a457eee [errcode: 23] [2014-09-29 10:50:12.285665] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/b9006804-d72e-420b-8701-9d6dc3489d71 [errcode: 23] [2014-09-29 10:50:12.287040] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/c0219fef-35e7-4dca-8d77-a18b467de711 [errcode: 23] [2014-09-29 10:50:12.287192] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/08d29eb6-ec11-4eee-a6d6-27239719df1f [errcode: 23] [2014-09-29 10:50:12.287345] W [master(/data/brick/gv2):877:process] _GMaster: incomplete sync, retrying changelogs: CHANGELOG.1411984207 [2014-09-29 10:50:13.703212] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/6258032a-f537-4ad0-936e-2d274e8ab2e3 [errcode: 23] [2014-09-29 10:50:13.703696] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/8dd088e6-bccc-4ac2-a360-b2ba7dfbba65 [errcode: 23] [2014-09-29 10:50:13.703820] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/fdc10266-0cc8-4c29-a608-d1564a457eee [errcode: 23] [2014-09-29 10:50:13.704297] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/b9006804-d72e-420b-8701-9d6dc3489d71 [errcode: 23] [2014-09-29 10:50:13.705605] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/c0219fef-35e7-4dca-8d77-a18b467de711 [errcode: 23] [2014-09-29 10:50:13.705739] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/08d29eb6-ec11-4eee-a6d6-27239719df1f [errcode: 23] [2014-09-29 10:50:13.705898] W [master(/data/brick/gv2):877:process] _GMaster: incomplete sync, retrying changelogs: CHANGELOG.1411984207 [2014-09-29 10:50:14.781212] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/6258032a-f537-4ad0-936e-2d274e8ab2e3 [errcode: 23] [2014-09-29 10:50:14.781708] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/8dd088e6-bccc-4ac2-a360-b2ba7dfbba65 [errcode: 23] [2014-09-29 10:50:14.781837] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/fdc10266-0cc8-4c29-a608-d1564a457eee [errcode: 23] [2014-09-29 10:50:14.781960] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/b9006804-d72e-420b-8701-9d6dc3489d71 [errcode: 23] [2014-09-29 10:50:14.783278] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/c0219fef-35e7-4dca-8d77-a18b467de711 [errcode: 23] [2014-09-29 10:50:14.783422] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/08d29eb6-ec11-4eee-a6d6-27239719df1f [errcode: 23] [2014-09-29 10:50:14.783593] W [master(/data/brick/gv2):877:process] _GMaster: incomplete sync, retrying changelogs: CHANGELOG.1411984207 [2014-09-29 10:50:16.162370] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/6258032a-f537-4ad0-936e-2d274e8ab2e3 [errcode: 23] [2014-09-29 10:50:16.179641] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/8dd088e6-bccc-4ac2-a360-b2ba7dfbba65 [errcode: 23] [2014-09-29 10:50:16.179790] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/fdc10266-0cc8-4c29-a608-d1564a457eee [errcode: 23] [2014-09-29 10:50:16.179927] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/b9006804-d72e-420b-8701-9d6dc3489d71 [errcode: 23] [2014-09-29 10:50:16.181416] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/c0219fef-35e7-4dca-8d77-a18b467de711 [errcode: 23] [2014-09-29 10:50:16.181577] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/08d29eb6-ec11-4eee-a6d6-27239719df1f [errcode: 23] [2014-09-29 10:50:16.181745] W [master(/data/brick/gv2):877:process] _GMaster: incomplete sync, retrying changelogs: CHANGELOG.1411984207 [2014-09-29 10:50:17.251226] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/6258032a-f537-4ad0-936e-2d274e8ab2e3 [errcode: 23] [2014-09-29 10:50:17.251709] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/8dd088e6-bccc-4ac2-a360-b2ba7dfbba65 [errcode: 23] [2014-09-29 10:50:17.251842] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/fdc10266-0cc8-4c29-a608-d1564a457eee [errcode: 23] [2014-09-29 10:50:17.251971] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/b9006804-d72e-420b-8701-9d6dc3489d71 [errcode: 23] [2014-09-29 10:50:17.253289] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/c0219fef-35e7-4dca-8d77-a18b467de711 [errcode: 23] [2014-09-29 10:50:17.253436] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/08d29eb6-ec11-4eee-a6d6-27239719df1f [errcode: 23] [2014-09-29 10:50:17.253597] W [master(/data/brick/gv2):877:process] _GMaster: incomplete sync, retrying changelogs: CHANGELOG.1411984207 [2014-09-29 10:50:18.625196] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/6258032a-f537-4ad0-936e-2d274e8ab2e3 [errcode: 23] [2014-09-29 10:50:18.625690] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/8dd088e6-bccc-4ac2-a360-b2ba7dfbba65 [errcode: 23] [2014-09-29 10:50:18.625822] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/fdc10266-0cc8-4c29-a608-d1564a457eee [errcode: 23] [2014-09-29 10:50:18.625942] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/b9006804-d72e-420b-8701-9d6dc3489d71 [errcode: 23] [2014-09-29 10:50:18.627363] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/c0219fef-35e7-4dca-8d77-a18b467de711 [errcode: 23] [2014-09-29 10:50:18.627502] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/08d29eb6-ec11-4eee-a6d6-27239719df1f [errcode: 23] [2014-09-29 10:50:18.627680] W [master(/data/brick/gv2):877:process] _GMaster: incomplete sync, retrying changelogs: CHANGELOG.1411984207 [2014-09-29 10:50:19.719289] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/6258032a-f537-4ad0-936e-2d274e8ab2e3 [errcode: 23] [2014-09-29 10:50:19.719796] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/8dd088e6-bccc-4ac2-a360-b2ba7dfbba65 [errcode: 23] [2014-09-29 10:50:19.719919] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/fdc10266-0cc8-4c29-a608-d1564a457eee [errcode: 23] [2014-09-29 10:50:19.720040] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/b9006804-d72e-420b-8701-9d6dc3489d71 [errcode: 23] [2014-09-29 10:50:19.721338] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/c0219fef-35e7-4dca-8d77-a18b467de711 [errcode: 23] [2014-09-29 10:50:19.721472] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/08d29eb6-ec11-4eee-a6d6-27239719df1f [errcode: 23] [2014-09-29 10:50:19.721637] W [master(/data/brick/gv2):877:process] _GMaster: incomplete sync, retrying changelogs: CHANGELOG.1411984207 [2014-09-29 10:50:20.761183] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/6258032a-f537-4ad0-936e-2d274e8ab2e3 [errcode: 23] [2014-09-29 10:50:20.761665] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/8dd088e6-bccc-4ac2-a360-b2ba7dfbba65 [errcode: 23] [2014-09-29 10:50:20.761795] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/fdc10266-0cc8-4c29-a608-d1564a457eee [errcode: 23] [2014-09-29 10:50:20.761923] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/b9006804-d72e-420b-8701-9d6dc3489d71 [errcode: 23] [2014-09-29 10:50:20.763277] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/c0219fef-35e7-4dca-8d77-a18b467de711 [errcode: 23] [2014-09-29 10:50:20.763433] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/08d29eb6-ec11-4eee-a6d6-27239719df1f [errcode: 23] [2014-09-29 10:50:20.763602] W [master(/data/brick/gv2):877:process] _GMaster: incomplete sync, retrying changelogs: CHANGELOG.1411984207 [2014-09-29 10:50:22.87227] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/6258032a-f537-4ad0-936e-2d274e8ab2e3 [errcode: 23] [2014-09-29 10:50:22.87727] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/8dd088e6-bccc-4ac2-a360-b2ba7dfbba65 [errcode: 23] [2014-09-29 10:50:22.87871] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/fdc10266-0cc8-4c29-a608-d1564a457eee [errcode: 23] [2014-09-29 10:50:22.87992] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/b9006804-d72e-420b-8701-9d6dc3489d71 [errcode: 23] [2014-09-29 10:50:22.89507] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/c0219fef-35e7-4dca-8d77-a18b467de711 [errcode: 23] [2014-09-29 10:50:22.89662] W [master(/data/brick/gv2):250:regjob] <top>: Rsync: .gfid/08d29eb6-ec11-4eee-a6d6-27239719df1f [errcode: 23] [2014-09-29 10:50:22.89822] W [master(/data/brick/gv2):860:process] _GMaster: changelogs CHANGELOG.1411984207 could not be processed - moving on... [2014-09-29 10:50:22.110567] W [master(/data/brick/gv2):862:process] _GMaster: SKIPPED GFID = [2014-09-29 10:50:40.470597] I [master(/data/brick/gv2):445:crawlwrap] _GMaster: 16 crawls, 1 turns [2014-09-29 10:51:41.626858] I [master(/data/brick/gv2):445:crawlwrap] _GMaster: 20 crawls, 0 turns [2014-09-29 10:52:42.945712] I [master(/data/brick/gv2):445:crawlwrap] _GMaster: 20 crawls, 0 turns [2014-09-29 10:53:44.340747] I [master(/data/brick/gv2):445:crawlwrap] _GMaster: 20 crawls, 0 turns [2014-09-29 10:54:45.735884] I [master(/data/brick/gv2):445:crawlwrap] _GMaster: 20 crawls, 0 turns [2014-09-29 10:55:47.142977] I [master(/data/brick/gv2):445:crawlwrap] _GMaster: 20 crawls, 0 turns
[2014-09-29 09:40:15.797465] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 240: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:40:15.797758] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000002 [2014-09-29 09:40:15.797789] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 241: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:11.752903] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000002 [2014-09-29 09:50:11.752938] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 564: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:11.753206] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000003 [2014-09-29 09:50:11.753232] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 565: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:11.753466] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000004 [2014-09-29 09:50:11.753491] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 566: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:11.753734] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000005 [2014-09-29 09:50:11.753759] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 567: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:11.754010] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000006 [2014-09-29 09:50:11.754037] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 568: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:11.754266] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000007 [2014-09-29 09:50:11.754299] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 569: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:12.019387] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 646: /.gfid/8dd088e6-bccc-4ac2-a360-b2ba7dfbba65 => -1 (Operation not permitted) [2014-09-29 09:50:12.019758] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:12.138013] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 695: /.gfid/fdc10266-0cc8-4c29-a608-d1564a457eee => -1 (Operation not permitted) [2014-09-29 09:50:12.138095] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:12.794885] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000002 [2014-09-29 09:50:12.794917] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 699: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:12.795192] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000003 [2014-09-29 09:50:12.795218] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 700: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:12.795452] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000004 [2014-09-29 09:50:12.795477] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 701: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:12.795707] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000005 [2014-09-29 09:50:12.795733] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 702: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:12.795978] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000006 [2014-09-29 09:50:12.796004] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 703: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:12.796236] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000007 [2014-09-29 09:50:12.796261] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 704: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:13.441160] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 779: /.gfid/8dd088e6-bccc-4ac2-a360-b2ba7dfbba65 => -1 (Operation not permitted) [2014-09-29 09:50:13.441237] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:13.500604] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 782: /.gfid/b9006804-d72e-420b-8701-9d6dc3489d71 => -1 (Operation not permitted) [2014-09-29 09:50:13.500691] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:13.553750] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 831: /.gfid/fdc10266-0cc8-4c29-a608-d1564a457eee => -1 (Operation not permitted) [2014-09-29 09:50:13.553845] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:14.213318] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000002 [2014-09-29 09:50:14.213352] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 835: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:14.213674] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000003 [2014-09-29 09:50:14.213699] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 836: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:14.213949] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000004 [2014-09-29 09:50:14.213975] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 837: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:14.214207] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000005 [2014-09-29 09:50:14.214232] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 838: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:14.214474] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000006 [2014-09-29 09:50:14.214499] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 839: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:14.214729] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000007 [2014-09-29 09:50:14.214754] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 840: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:14.520200] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 906: /.gfid/8dd088e6-bccc-4ac2-a360-b2ba7dfbba65 => -1 (Operation not permitted) [2014-09-29 09:50:14.520277] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:14.578930] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 909: /.gfid/b9006804-d72e-420b-8701-9d6dc3489d71 => -1 (Operation not permitted) [2014-09-29 09:50:14.579003] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:14.632108] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 958: /.gfid/fdc10266-0cc8-4c29-a608-d1564a457eee => -1 (Operation not permitted) [2014-09-29 09:50:14.632194] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:15.291304] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000002 [2014-09-29 09:50:15.291344] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 962: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:15.291751] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000003 [2014-09-29 09:50:15.291782] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 963: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:15.292094] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000004 [2014-09-29 09:50:15.292126] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 964: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:15.292411] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000005 [2014-09-29 09:50:15.292444] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 965: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:15.292731] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000006 [2014-09-29 09:50:15.292762] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 966: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:15.293064] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000007 [2014-09-29 09:50:15.293096] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 967: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:15.902404] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 1033: /.gfid/8dd088e6-bccc-4ac2-a360-b2ba7dfbba65 => -1 (Operation not permitted) [2014-09-29 09:50:15.902481] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:15.961093] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 1036: /.gfid/b9006804-d72e-420b-8701-9d6dc3489d71 => -1 (Operation not permitted) [2014-09-29 09:50:15.961170] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:16.014081] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 1085: /.gfid/fdc10266-0cc8-4c29-a608-d1564a457eee => -1 (Operation not permitted) [2014-09-29 09:50:16.014157] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:16.689360] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000002 [2014-09-29 09:50:16.689402] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1089: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:16.689667] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000003 [2014-09-29 09:50:16.689693] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1090: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:16.689943] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000004 [2014-09-29 09:50:16.689970] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1091: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:16.690205] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000005 [2014-09-29 09:50:16.690231] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1092: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:16.690463] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000006 [2014-09-29 09:50:16.690488] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1093: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:16.690723] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000007 [2014-09-29 09:50:16.690748] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1094: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:16.988101] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 1160: /.gfid/8dd088e6-bccc-4ac2-a360-b2ba7dfbba65 => -1 (Operation not permitted) [2014-09-29 09:50:16.988180] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:17.047022] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 1163: /.gfid/b9006804-d72e-420b-8701-9d6dc3489d71 => -1 (Operation not permitted) [2014-09-29 09:50:17.047095] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:17.101473] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 1212: /.gfid/fdc10266-0cc8-4c29-a608-d1564a457eee => -1 (Operation not permitted) [2014-09-29 09:50:17.101551] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:17.761325] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000002 [2014-09-29 09:50:17.761358] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1216: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:17.761632] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000003 [2014-09-29 09:50:17.761658] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1217: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:17.761905] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000004 [2014-09-29 09:50:17.761932] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1218: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:17.762167] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000005 [2014-09-29 09:50:17.762193] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1219: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:17.762423] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000006 [2014-09-29 09:50:17.762448] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1220: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:17.762678] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000007 [2014-09-29 09:50:17.762704] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1221: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:18.362970] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 1287: /.gfid/8dd088e6-bccc-4ac2-a360-b2ba7dfbba65 => -1 (Operation not permitted) [2014-09-29 09:50:18.363055] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:18.421661] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 1290: /.gfid/b9006804-d72e-420b-8701-9d6dc3489d71 => -1 (Operation not permitted) [2014-09-29 09:50:18.421735] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:18.475612] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 1339: /.gfid/fdc10266-0cc8-4c29-a608-d1564a457eee => -1 (Operation not permitted) [2014-09-29 09:50:18.475689] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:19.135039] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000002 [2014-09-29 09:50:19.135072] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1343: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:19.135394] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000003 [2014-09-29 09:50:19.135421] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1344: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:19.135663] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000004 [2014-09-29 09:50:19.135689] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1345: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:19.135934] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000005 [2014-09-29 09:50:19.135961] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1346: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:19.136193] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000006 [2014-09-29 09:50:19.136219] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1347: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:19.136452] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000007 [2014-09-29 09:50:19.136477] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1348: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:19.453708] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 1414: /.gfid/8dd088e6-bccc-4ac2-a360-b2ba7dfbba65 => -1 (Operation not permitted) [2014-09-29 09:50:19.453787] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:19.513460] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 1417: /.gfid/b9006804-d72e-420b-8701-9d6dc3489d71 => -1 (Operation not permitted) [2014-09-29 09:50:19.513540] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:19.569468] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 1466: /.gfid/fdc10266-0cc8-4c29-a608-d1564a457eee => -1 (Operation not permitted) [2014-09-29 09:50:19.569545] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:20.229023] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000002 [2014-09-29 09:50:20.229074] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1470: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:20.229423] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000003 [2014-09-29 09:50:20.229450] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1471: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:20.229689] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000004 [2014-09-29 09:50:20.229715] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1472: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:20.229974] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000005 [2014-09-29 09:50:20.230001] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1473: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:20.230239] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000006 [2014-09-29 09:50:20.230265] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1474: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:20.230499] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000007 [2014-09-29 09:50:20.230524] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1475: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:20.498428] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 1541: /.gfid/8dd088e6-bccc-4ac2-a360-b2ba7dfbba65 => -1 (Operation not permitted) [2014-09-29 09:50:20.498508] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:20.558438] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 1544: /.gfid/b9006804-d72e-420b-8701-9d6dc3489d71 => -1 (Operation not permitted) [2014-09-29 09:50:20.558515] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:20.611517] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 1593: /.gfid/fdc10266-0cc8-4c29-a608-d1564a457eee => -1 (Operation not permitted) [2014-09-29 09:50:20.611594] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:21.271402] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000002 [2014-09-29 09:50:21.271435] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1597: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:21.271758] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000003 [2014-09-29 09:50:21.271784] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1598: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:21.272032] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000004 [2014-09-29 09:50:21.272059] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1599: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:21.272293] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000005 [2014-09-29 09:50:21.272318] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1600: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:21.272566] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000006 [2014-09-29 09:50:21.272591] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1601: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:21.272832] W [client-rpc-fops.c:256:client3_3_mknod_cbk] 0-gv2-slave-client-0: remote operation failed: File exists. Path: <gfid:ed1839c2-b555-46d9-ae4d-639943f7bd64>/msg000007 [2014-09-29 09:50:21.272859] W [fuse-bridge.c:1214:fuse_err_cbk] 0-glusterfs-fuse: 1602: SETXATTR() /.gfid/ed1839c2-b555-46d9-ae4d-639943f7bd64 => -1 (File exists) [2014-09-29 09:50:21.824443] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 1668: /.gfid/8dd088e6-bccc-4ac2-a360-b2ba7dfbba65 => -1 (Operation not permitted) [2014-09-29 09:50:21.824523] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:21.883689] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 1671: /.gfid/b9006804-d72e-420b-8701-9d6dc3489d71 => -1 (Operation not permitted) [2014-09-29 09:50:21.883773] W [defaults.c:1381:default_release] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(+0x1e7d0) [0x7f4dbdee67d0] (-->/usr/lib64/glusterfs/3.5.2/xlator/mount/fuse.so(free_fuse_state+0x93) [0x7f4dbdecf063] (-->/usr/lib64/libglusterfs.so.0(fd_unref+0x10e) [0x7f4dc10fefbe]))) 0-fuse: xlator does not implement release_cbk [2014-09-29 09:50:21.938255] W [fuse-bridge.c:1911:fuse_create_cbk] 0-glusterfs-fuse: 1720: /.gfid/fdc10266-0cc8-4c29-a608-d1564a457eee => -1 (Operation not permitted)
_______________________________________________ Gluster-users mailing list Gluster-users@xxxxxxxxxxx http://supercolony.gluster.org/mailman/listinfo/gluster-users
