Copying from a local filesystem to the GlusterFS now works without issue,
but copying from the GlusterFS to the GlusterFS still complains. See
attached strace.
Note that my local filesystem is not mounted with the acl option, but the
underlying mounts that make up my GlusterFS do have the acl mount option.
Thanks,
Brent
PS Are these fixes actually enabling support for ACLs? If they are, that's
very cool and well ahead of the roadmap!
On Sat, 21 Jul 2007, Anand Avati wrote:
Brent,
there was a bug in setxattr, of the length getting calculated by -1 for
(non ascii) binary values of setxattr. can you please check if your cp goes
through now? I'm very sorry I am unable to test this ourselves since we dont
have a system which uses posix acls, though xattrs are now working fine on
binary data (before the fix it was working only for pure ascii data only)
thanks,
avati
2007/7/20, Brent A Nelson <brent@xxxxxxxxxxxx>:
Nope, it's still there. Example strace snippet:
setxattr("/beast/glusterfs/beast", "system.posix_acl_access",
"\x02\x00\x00\x00\x01\x00\x06\x00\xff\xff\xff\xff\x04\x00\x04\x00\xff\xff\xff\xff
\x00\x04\x00\xff\xff\xff\xff", 28, 0) = -1 EINVAL (Invalid argument)
It presumably should have returned EOPNOTSUPP (Operation not supported),
instead.
Thanks,
Brent
On Fri, 20 Jul 2007, Anand Avati wrote:
> Brent,
> there was a fix in fuse_setxattr in patch-325. please check if it fixes
> your issue. AFR was only reporting the errno's passing via it.
>
> thanks,
> avati
>
> 2007/7/20, Brent A Nelson <brent@xxxxxxxxxxxx>:
>>
>> I should point out that this was with the full (AFR/unify) setup, not
the
>> stripped-down setup. I also get a lot of messages such as the
following
>> in /var/log/glusterfs/glusterfs.log:
>> 2007-07-19 15:19:28 E [afr.c:514:afr_setxattr_cbk] mirror4: (path=/usr0
>> child=share4-0) op_ret=-1 op_errno=22
>> 2007-07-19 15:19:28 E [afr.c:514:afr_setxattr_cbk] mirror0: (path=/usr0
>> child=share0-0) op_ret=-1 op_errno=22
>> 2007-07-19 15:57:17 E [afr.c:575:afr_getxattr_cbk] mirror7:
>> (path=/nfs/share/locale/cs/LC_TIME child=share7-1) op_ret=-1
op_errno=61
>> 2007-07-19 15:57:17 E [afr.c:575:afr_getxattr_cbk] mirror7:
>> (path=/nfs/share/locale/cs/LC_TIME child=share7-1) op_ret=-1
op_errno=61
>> 2007-07-19 15:57:24 E [afr.c:575:afr_getxattr_cbk] mirror7:
>> (path=/nfs/share/locale/cs/LC_TIME child=share7-1) op_ret=-1
op_errno=61
>> 2007-07-19 15:57:24 E [afr.c:575:afr_getxattr_cbk] mirror7:
>> (path=/nfs/share/locale/cs/LC_TIME child=share7-1) op_ret=-1
op_errno=61
>> 2007-07-19 15:57:24 E [afr.c:575:afr_getxattr_cbk] mirror6:
>> (path=/nfs/share/locale/cs child=share6-0) op_ret=-1 op_errno=61
>> 2007-07-19 15:57:24 E [afr.c:575:afr_getxattr_cbk] mirror6:
>> (path=/nfs/share/locale/cs child=share6-0) op_ret=-1 op_errno=61
>> 2007-07-19 15:57:24 E [afr.c:575:afr_getxattr_cbk] mirror7:
>> (path=/nfs/share/locale/cs/LC_TIME child=share7-1) op_ret=-1
op_errno=61
>> 2007-07-19 15:57:24 E [afr.c:575:afr_getxattr_cbk] mirror7:
>> (path=/nfs/share/locale/cs/LC_TIME child=share7-1) op_ret=-1
op_errno=61
>>
>> Thanks,
>>
>> Brent
>>
>> On Thu, 19 Jul 2007, Brent A Nelson wrote:
>>
>> > Patch 322 seems to have fixed the stray ls errors, but not the cp -a
>> > complaints. A "cp -a" strace is attached.
>> >
>> > Thanks,
>> >
>> > Brent
>> >
>> > On Wed, 18 Jul 2007, Brent A Nelson wrote:
>> >
>> >> Aha, it looks like GlusterFS is giving odd/varying error responses
to
>> >> queries for ACL information (I assume it should be giving an
"operation
>> not
>> >> supported" error). This must be related to my previously reported
>> problem
>> >> copying from GlusterFS to GlusterFS where it was complaining about
>> >> preserving ACLs for every file copied.
>> >>
>> >> See attached strace.
>> >>
>> >> Thanks,
>> >>
>> >> Brent
>> >>
>> >> PS At least in this simple case where glusterfs is directly mounting
a
>> >> storage/posix, NFS reexport works fine. I haven't had a chance to
test
>> a
>> >> full setup with recent GlusterFS tlas, but I will once the ACL
glitch
>> is
>> >> squashed.
>> >>
>> >> On Wed, 18 Jul 2007, Anand Avati wrote:
>> >>
>> >>> Brent,
>> >>> very interesting diagnosis! is it possible for you to re-create the
>> 'posix
>> >>> only' setup (no server/client) and again do 'strace ls -ial /beast'
?
>> we
>> >>> are
>> >>> not able to reproduce this error at our setup.
>> >>>
>> >>> thanks
>> >>> avati
>> >>>
>> >>> 2007/7/17, Brent A Nelson <brent@xxxxxxxxxxxx>:
>> >>>>
>> >>>> Just a quick note that this doesn't seem to be any sort of
corruption
>> >>>> issue. I completely emptied all my shares (even removing
lost+found)
>> and
>> >>>> my namespace and rsynced the corresponding AFR shares and
>> namespace. The
>> >>>> only thing different between the AFRs would be ctimes.
>> >>>>
>> >>>> I restarted everything, and did:
>> >>>> ls -al /beast
>> >>>> ls: /beast: File exists
>> >>>> ls: /beast/.: File exists
>> >>>> total 8
>> >>>> drwxr-xr-x 2 root root 4096 2007-07-17 09:27 .
>> >>>> drwxr-xr-x 27 root root 4096 2007-07-02 10:18 ..
>> >>>>
>> >>>> I also tried disabling readahead and writebehind (my only
performance
>> >>>> translators). It didn't help. Changing the unify from alu to rr
>> also
>> >>>> didn't help.
>> >>>>
>> >>>> I then tried "glusterfs -f /etc/glusterfs/beast -n mirror0 /beast"
to
>> >>>> mount a single AFR, no unify. It STILL produces the same
messages.
>> >>>>
>> >>>> I then tried "glusterfs -f /etc/glusterfs/beast -n share0-0
/beast"
>> to
>> >>>> mount a simple, single share used as half of an AFR. Same issue.
>> >>>>
>> >>>> I then stripped down a server to serve out one single
storage/posix
>> >>>> share,
>> >>>> with no posix locks (I wasn't using any other translators on the
>> server
>> >>>> side, apart from protocol/server, of course). I mounted that
share
>> as in
>> >>>> the previous attempt. No difference!
>> >>>>
>> >>>> So, this issue occurs even with just protocol/client,
>> protocol/server,
>> >>>> and
>> >>>> storage/posix in use. As barebones as you can get. Almost.
>> >>>>
>> >>>> One more try. No glusterfsd, and glusterfs accesses a single
>> >>>> storage/posix directly:
>> >>>>
>> >>>> ls -al /beast
>> >>>> ls: /beast: File exists
>> >>>> ls: /beast/.: File exists
>> >>>> total 8
>> >>>> drwxr-xr-x 2 root root 4096 2007-07-17 09:27 .
>> >>>> drwxr-xr-x 27 root root 4096 2007-07-02 10:18 ..
>> >>>>
>> >>>> No difference, even with just glusterfs directly accessing a
single,
>> >>>> local
>> >>>> storage/posix, with no other translators. Spec is simply:
>> >>>>
>> >>>> volume share0
>> >>>> type storage/posix # POSIX FS translator
>> >>>> option directory /share0 # Export this directory
>> >>>> end-volume
>> >>>>
>> >>>> Ubuntu Feisty, Fuse 2.6.3.
>> >>>>
>> >>>> Any ideas?
>> >>>>
>> >>>> Thanks,
>> >>>>
>> >>>> Brent
>> >>>>
>> >>>>
>> >>>> On Sat, 14 Jul 2007, Brent A Nelson wrote:
>> >>>>
>> >>>> > It's the same spec I was using previously (AFRed namespace
cache,
>> >>>> unified
>> >>>> > AFRs spread across four servers, posix-locks, readahead, and
>> >>>> writebehind).
>> >>>> > It's not just the top-level directory; it's everywhere.
>> >>>> >
>> >>>> > Thanks,
>> >>>> >
>> >>>> > Brent
>> >>>> >
>> >>>> > On Sat, 14 Jul 2007, Anand Avati wrote:
>> >>>> >
>> >>>> >> Brent,
>> >>>> >> this is strange, we are having patch-313 work pretty smooth so
>> far.
>> >>>> are
>> >>>> >> there any changes in your spec? is this behaviour seen only in
>> this
>> >>>> >> particular directory or 'anywhere' in general? please attach
your
>> spec
>> >>>> so
>> >>>> >> that we can try to reproduce it in our labs.
>> >>>> >>
>> >>>> >> thanks,
>> >>>> >> avati
>> >>>> >>
>> >>>> >> 2007/7/14, Brent A Nelson <brent@xxxxxxxxxxxx>:
>> >>>> >>>
>> >>>> >>> Updating to the latest TLA patch, I got odd issues just with
>> "ls":
>> >>>> >>>
>> >>>> >>> Example:
>> >>>> >>>
>> >>>> >>> ls -al /beast/
>> >>>> >>> ls: /beast/: No such file or directory
>> >>>> >>> ls: /beast/.: No such file or directory
>> >>>> >>> ls: /beast/lost+found: No such file or directory
>> >>>> >>> ls: /beast/usr0: No such file or directory
>> >>>> >>> ls: /beast/usr: No such file or directory
>> >>>> >>> total 32
>> >>>> >>> drwxr-xr-x 5 root root 4096 2007-07-13 16:18 .
>> >>>> >>> drwxr-xr-x 27 root root 4096 2007-06-25 18:34 ..
>> >>>> >>> drwx------ 2 root root 16384 2007-06-25 17:08 lost+found
>> >>>> >>> drwxr-xr-x 10 root root 4096 2007-06-18 13:31 usr
>> >>>> >>> drwxr-xr-x 10 root root 4096 2007-06-18 13:31 usr0
>> >>>> >>>
>> >>>> >>> I have one machine that is no longer returning from an
"ls". I
>> get
>> >>>> other
>> >>>> >>> messages sometimes, not just "No such file or directory", but
>> also
>> >>>> "Bad
>> >>>> >>> file descriptor" or even "File exists". These extraneous
>> messages
>> >>>> are
>> >>>> >>> also occurring when copying from the GlusterFS to the
>> GlusterFS. The
>> >>>> >>> files and directories mentioned do, in fact, exist, no matter
>> what
>> >>>> the
>> >>>> >>> extraneous error message says.
>> >>>> >>>
>> >>>> >>> Is there a known issue with the current patchset?
>> >>>> >>>
>> >>>> >>> Thanks,
>> >>>> >>>
>> >>>> >>> Brent
>> >>>> >>>
>> >>>> >>>
>> >>>> >>> _______________________________________________
>> >>>> >>> Gluster-devel mailing list
>> >>>> >>> Gluster-devel@xxxxxxxxxx
>> >>>> >>> http://lists.nongnu.org/mailman/listinfo/gluster-devel
>> >>>> >>>
>> >>>> >>
>> >>>> >>
>> >>>> >>
>> >>>> >> --
>> >>>> >> Anand V. Avati
>> >>>> >>
>> >>>> >
>> >>>>
>> >>>
>> >>>
>> >>>
>> >>> --
>> >>> Anand V. Avati
>> >
>>
>
>
>
> --
> Anand V. Avati
>
--
Anand V. Avati
execve("/bin/cp", ["cp", "-a", "/beast/glusterfs", "/beast/glusterfs2"], [/* 19 vars */]) = 0
brk(0) = 0x8057000
access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory)
mmap2(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7f69000
access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory)
open("/etc/ld.so.cache", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=13581, ...}) = 0
mmap2(NULL, 13581, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7f65000
close(3) = 0
access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory)
open("/lib/libacl.so.1", O_RDONLY) = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\340\24"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0644, st_size=22368, ...}) = 0
mmap2(NULL, 25168, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0xb7f5e000
mmap2(0xb7f64000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x5) = 0xb7f64000
close(3) = 0
access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory)
open("/lib/libselinux.so.1", O_RDONLY) = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\0=\0\000"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0644, st_size=83512, ...}) = 0
mmap2(NULL, 88980, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0xb7f48000
mmap2(0xb7f5c000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x13) = 0xb7f5c000
close(3) = 0
access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory)
open("/lib/tls/i686/cmov/libc.so.6", O_RDONLY) = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\0`\1\000"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0644, st_size=1307104, ...}) = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7f47000
mmap2(NULL, 1312164, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0xb7e06000
mmap2(0xb7f41000, 12288, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x13b) = 0xb7f41000
mmap2(0xb7f44000, 9636, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0xb7f44000
close(3) = 0
access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory)
open("/lib/libattr.so.1", O_RDONLY) = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\260\f\0"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0644, st_size=13448, ...}) = 0
mmap2(NULL, 16228, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0xb7e02000
mmap2(0xb7e05000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2) = 0xb7e05000
close(3) = 0
access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory)
open("/lib/tls/i686/cmov/libdl.so.2", O_RDONLY) = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0P\n\0\000"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0644, st_size=9684, ...}) = 0
mmap2(NULL, 12412, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0xb7dfe000
mmap2(0xb7e00000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1) = 0xb7e00000
close(3) = 0
access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory)
open("/lib/libsepol.so.1", O_RDONLY) = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\3604\0"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0644, st_size=220380, ...}) = 0
mmap2(NULL, 265664, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0xb7dbd000
mmap2(0xb7df3000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x35) = 0xb7df3000
mmap2(0xb7df4000, 40384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0xb7df4000
close(3) = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7dbc000
set_thread_area({entry_number:-1 -> 6, base_addr:0xb7dbc8d0, limit:1048575, seg_32bit:1, contents:0, read_exec_only:0, limit_in_pages:1, seg_not_present:0, useable:1}) = 0
mprotect(0xb7f41000, 4096, PROT_READ) = 0
munmap(0xb7f65000, 13581) = 0
access("/etc/selinux/", F_OK) = -1 ENOENT (No such file or directory)
brk(0) = 0x8057000
brk(0x8078000) = 0x8078000
open("/proc/mounts", O_RDONLY|O_LARGEFILE) = 3
fstat64(3, {st_mode=S_IFREG|0444, st_size=0, ...}) = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7f68000
read(3, "rootfs / rootfs rw 0 0\nnone /sys"..., 1024) = 1024
read(3, "/dev/mapper/share1-disk /share1 "..., 1024) = 283
read(3, "", 1024) = 0
close(3) = 0
munmap(0xb7f68000, 4096) = 0
open("/proc/filesystems", O_RDONLY|O_LARGEFILE) = 3
read(3, "nodev\tsysfs\nnodev\trootfs\nnodev\tb"..., 4095) = 324
close(3) = 0
open("/usr/lib/locale/locale-archive", O_RDONLY|O_LARGEFILE) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/locale.alias", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0777, st_size=2586, ...}) = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7f68000
read(3, "# Locale name alias data base.\n#"..., 4096) = 2586
read(3, "", 4096) = 0
close(3) = 0
munmap(0xb7f68000, 4096) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_IDENTIFICATION", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_IDENTIFICATION", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=391, ...}) = 0
mmap2(NULL, 391, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7f68000
close(3) = 0
open("/usr/lib/gconv/gconv-modules.cache", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=25460, ...}) = 0
mmap2(NULL, 25460, PROT_READ, MAP_SHARED, 3, 0) = 0xb7db5000
close(3) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_MEASUREMENT", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_MEASUREMENT", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=23, ...}) = 0
mmap2(NULL, 23, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7f67000
close(3) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_TELEPHONE", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_TELEPHONE", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=59, ...}) = 0
mmap2(NULL, 59, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7f66000
close(3) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_ADDRESS", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_ADDRESS", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=155, ...}) = 0
mmap2(NULL, 155, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7f65000
close(3) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_NAME", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_NAME", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=77, ...}) = 0
mmap2(NULL, 77, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7db4000
close(3) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_PAPER", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_PAPER", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=34, ...}) = 0
mmap2(NULL, 34, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7db3000
close(3) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_MESSAGES", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_MESSAGES", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
close(3) = 0
open("/usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=52, ...}) = 0
mmap2(NULL, 52, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7db2000
close(3) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_MONETARY", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_MONETARY", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=286, ...}) = 0
mmap2(NULL, 286, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7db1000
close(3) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_COLLATE", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_COLLATE", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=880094, ...}) = 0
mmap2(NULL, 880094, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7cda000
close(3) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_TIME", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_TIME", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=2451, ...}) = 0
mmap2(NULL, 2451, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7cd9000
close(3) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_NUMERIC", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_NUMERIC", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=54, ...}) = 0
mmap2(NULL, 54, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7cd8000
close(3) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_CTYPE", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_CTYPE", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=238336, ...}) = 0
mmap2(NULL, 238336, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7c9d000
close(3) = 0
geteuid32() = 0
stat64("/beast/glusterfs2", 0xbfdc3e20) = -1 ENOENT (No such file or directory)
lstat64("/beast/glusterfs", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
lstat64("/beast/glusterfs2", 0xbfdc3c6c) = -1 ENOENT (No such file or directory)
mkdir("/beast/glusterfs2", 040755) = 0
lstat64("/beast/glusterfs2", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
stat64("/beast/glusterfs2", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
open("/beast/glusterfs", O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY) = 3
fstat64(3, {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
fcntl64(3, F_SETFD, FD_CLOEXEC) = 0
getdents64(3, /* 7 entries */, 4096) = 248
getdents64(3, /* 0 entries */, 4096) = 0
close(3) = 0
lstat64("/beast/glusterfs/glusterfs-server.vol", {st_mode=S_IFREG|0644, st_size=1534, ...}) = 0
open("/beast/glusterfs/glusterfs-server.vol", O_RDONLY|O_LARGEFILE) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=1534, ...}) = 0
open("/beast/glusterfs2/glusterfs-server.vol", O_WRONLY|O_CREAT|O_LARGEFILE, 0100644) = 4
fstat64(4, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
fstat64(3, {st_mode=S_IFREG|0644, st_size=1534, ...}) = 0
read(3, "volume disk-ns0\n type storage/p"..., 4096) = 1534
write(4, "volume disk-ns0\n type storage/p"..., 1534) = 1534
read(3, "", 4096) = 0
utimes("/proc/self/fd/4", {1184965608, 0}) = 0
fchown32(4, 0, 0) = 0
getxattr("/beast/glusterfs/glusterfs-server.vol", "system.posix_acl_access", "=\x00\x00\x00\x00\x00\x00", 132) = 8
open("/usr/share/locale/en_US.UTF-8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en_US.utf8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en_US/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en.UTF-8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en.utf8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en_US.UTF-8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en_US.utf8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en_US/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en.UTF-8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en.utf8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
write(2, "cp: ", 4cp: ) = 4
write(2, "`/beast/glusterfs/glusterfs-serv"..., 39`/beast/glusterfs/glusterfs-server.vol') = 39
open("/usr/share/locale/en_US.UTF-8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en_US.utf8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en_US/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en.UTF-8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en.utf8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en_US.UTF-8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en_US.utf8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en_US/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en.UTF-8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en.utf8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
write(2, "cp: ", 4cp: ) = 4
write(2, "preserving ACL for `/beast/glust"..., 59preserving ACL for `/beast/glusterfs2/glusterfs-server.vol') = 59
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
close(4) = 0
close(3) = 0
lstat64("/beast/glusterfs/beast", {st_mode=S_IFREG|0644, st_size=8821, ...}) = 0
open("/beast/glusterfs/beast", O_RDONLY|O_LARGEFILE) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=8821, ...}) = 0
open("/beast/glusterfs2/beast", O_WRONLY|O_CREAT|O_LARGEFILE, 0100644) = 4
fstat64(4, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
fstat64(3, {st_mode=S_IFREG|0644, st_size=8821, ...}) = 0
read(3, "volume ns0-0\n type protocol/cli"..., 4096) = 4096
write(4, "volume ns0-0\n type protocol/cli"..., 4096) = 4096
read(3, "t 6996 # default se"..., 4096) = 4096
write(4, "t 6996 # default se"..., 4096) = 4096
read(3, "option replicate *:2 # Do no"..., 4096) = 629
write(4, "option replicate *:2 # Do no"..., 629) = 629
read(3, "", 4096) = 0
utimes("/proc/self/fd/4", {1184965608, 0}) = 0
fchown32(4, 0, 0) = 0
getxattr("/beast/glusterfs/beast", "system.posix_acl_access", "=\x00\x00\x00\x00\x00\x00", 132) = 8
write(2, "cp: ", 4cp: ) = 4
write(2, "`/beast/glusterfs/beast\'", 24`/beast/glusterfs/beast') = 24
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
write(2, "cp: ", 4cp: ) = 4
write(2, "preserving ACL for `/beast/glust"..., 44preserving ACL for `/beast/glusterfs2/beast') = 44
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
close(4) = 0
close(3) = 0
lstat64("/beast/glusterfs/glusterfs-client.vol.sample", {st_mode=S_IFREG|0644, st_size=1965, ...}) = 0
open("/beast/glusterfs/glusterfs-client.vol.sample", O_RDONLY|O_LARGEFILE) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=1965, ...}) = 0
open("/beast/glusterfs2/glusterfs-client.vol.sample", O_WRONLY|O_CREAT|O_LARGEFILE, 0100644) = 4
fstat64(4, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
fstat64(3, {st_mode=S_IFREG|0644, st_size=1965, ...}) = 0
read(3, "### file: client-volume.spec.sam"..., 4096) = 1965
write(4, "### file: client-volume.spec.sam"..., 1965) = 1965
read(3, "", 4096) = 0
utimes("/proc/self/fd/4", {1184965608, 0}) = 0
fchown32(4, 0, 0) = 0
getxattr("/beast/glusterfs/glusterfs-client.vol.sample", "system.posix_acl_access", "=\x00\x00\x00\x00\x00\x00", 132) = 8
write(2, "cp: ", 4cp: ) = 4
write(2, "`/beast/glusterfs/glusterfs-clie"..., 46`/beast/glusterfs/glusterfs-client.vol.sample') = 46
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
write(2, "cp: ", 4cp: ) = 4
write(2, "preserving ACL for `/beast/glust"..., 66preserving ACL for `/beast/glusterfs2/glusterfs-client.vol.sample') = 66
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
close(4) = 0
close(3) = 0
lstat64("/beast/glusterfs/glusterfs-server.vol.sample", {st_mode=S_IFREG|0644, st_size=1767, ...}) = 0
open("/beast/glusterfs/glusterfs-server.vol.sample", O_RDONLY|O_LARGEFILE) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=1767, ...}) = 0
open("/beast/glusterfs2/glusterfs-server.vol.sample", O_WRONLY|O_CREAT|O_LARGEFILE, 0100644) = 4
fstat64(4, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
fstat64(3, {st_mode=S_IFREG|0644, st_size=1767, ...}) = 0
read(3, "### file: server-volume.spec.sam"..., 4096) = 1767
write(4, "### file: server-volume.spec.sam"..., 1767) = 1767
read(3, "", 4096) = 0
utimes("/proc/self/fd/4", {1184965608, 0}) = 0
fchown32(4, 0, 0) = 0
getxattr("/beast/glusterfs/glusterfs-server.vol.sample", "system.posix_acl_access", "=\x00\x00\x00\x00\x00\x00", 132) = 8
write(2, "cp: ", 4cp: ) = 4
write(2, "`/beast/glusterfs/glusterfs-serv"..., 46`/beast/glusterfs/glusterfs-server.vol.sample') = 46
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
write(2, "cp: ", 4cp: ) = 4
write(2, "preserving ACL for `/beast/glust"..., 66preserving ACL for `/beast/glusterfs2/glusterfs-server.vol.sample') = 66
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
close(4) = 0
close(3) = 0
lstat64("/beast/glusterfs/share0", {st_mode=S_IFREG|0644, st_size=149, ...}) = 0
open("/beast/glusterfs/share0", O_RDONLY|O_LARGEFILE) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=149, ...}) = 0
open("/beast/glusterfs2/share0", O_WRONLY|O_CREAT|O_LARGEFILE, 0100644) = 4
fstat64(4, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
fstat64(3, {st_mode=S_IFREG|0644, st_size=149, ...}) = 0
read(3, "volume share0\n type storage/pos"..., 4096) = 149
write(4, "volume share0\n type storage/pos"..., 149) = 149
read(3, "", 4096) = 0
utimes("/proc/self/fd/4", {1184965608, 0}) = 0
fchown32(4, 0, 0) = 0
getxattr("/beast/glusterfs/share0", "system.posix_acl_access", "=\x00\x00\x00\x00\x00\x00", 132) = 8
write(2, "cp: ", 4cp: ) = 4
write(2, "`/beast/glusterfs/share0\'", 25`/beast/glusterfs/share0') = 25
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
write(2, "cp: ", 4cp: ) = 4
write(2, "preserving ACL for `/beast/glust"..., 45preserving ACL for `/beast/glusterfs2/share0') = 45
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
close(4) = 0
close(3) = 0
SYS_299(0xffffff9c, 0xbfdc4ba1, 0xbfdc3a9c, 0xbfdc4ba1, 0xb7f42ff4) = 0
chown32("/beast/glusterfs2", 0, 0) = 0
getxattr("/beast/glusterfs", "system.posix_acl_access", 0xbfdc3980, 132) = -1 ENODATA (No data available)
stat64("/beast/glusterfs", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
setxattr("/beast/glusterfs2", "system.posix_acl_access", "\x02\x00\x00\x00\x01\x00\x07\x00\xff\xff\xff\xff\x04\x00\x05\x00\xff\xff\xff\xff \x00\x05\x00\xff\xff\xff\xff", 28, 0) = 0
getxattr("/beast/glusterfs", "system.posix_acl_default", 0xbfdc3980, 132) = -1 ENODATA (No data available)
stat64("/beast/glusterfs", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
stat64("/beast/glusterfs2", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
setxattr("/beast/glusterfs2", "system.posix_acl_default", "\x02\x00\x00\x00", 4, 0) = 0
close(1) = 0
exit_group(1) = ?
Process 6230 detached
