Patch 322 seems to have fixed the stray ls errors, but not the cp -a
complaints. A "cp -a" strace is attached.
Thanks,
Brent
On Wed, 18 Jul 2007, Brent A Nelson wrote:
Aha, it looks like GlusterFS is giving odd/varying error responses to queries
for ACL information (I assume it should be giving an "operation not
supported" error). This must be related to my previously reported problem
copying from GlusterFS to GlusterFS where it was complaining about preserving
ACLs for every file copied.
See attached strace.
Thanks,
Brent
PS At least in this simple case where glusterfs is directly mounting a
storage/posix, NFS reexport works fine. I haven't had a chance to test a full
setup with recent GlusterFS tlas, but I will once the ACL glitch is squashed.
On Wed, 18 Jul 2007, Anand Avati wrote:
Brent,
very interesting diagnosis! is it possible for you to re-create the 'posix
only' setup (no server/client) and again do 'strace ls -ial /beast' ? we
are
not able to reproduce this error at our setup.
thanks
avati
2007/7/17, Brent A Nelson <brent@xxxxxxxxxxxx>:
Just a quick note that this doesn't seem to be any sort of corruption
issue. I completely emptied all my shares (even removing lost+found) and
my namespace and rsynced the corresponding AFR shares and namespace. The
only thing different between the AFRs would be ctimes.
I restarted everything, and did:
ls -al /beast
ls: /beast: File exists
ls: /beast/.: File exists
total 8
drwxr-xr-x 2 root root 4096 2007-07-17 09:27 .
drwxr-xr-x 27 root root 4096 2007-07-02 10:18 ..
I also tried disabling readahead and writebehind (my only performance
translators). It didn't help. Changing the unify from alu to rr also
didn't help.
I then tried "glusterfs -f /etc/glusterfs/beast -n mirror0 /beast" to
mount a single AFR, no unify. It STILL produces the same messages.
I then tried "glusterfs -f /etc/glusterfs/beast -n share0-0 /beast" to
mount a simple, single share used as half of an AFR. Same issue.
I then stripped down a server to serve out one single storage/posix share,
with no posix locks (I wasn't using any other translators on the server
side, apart from protocol/server, of course). I mounted that share as in
the previous attempt. No difference!
So, this issue occurs even with just protocol/client, protocol/server, and
storage/posix in use. As barebones as you can get. Almost.
One more try. No glusterfsd, and glusterfs accesses a single
storage/posix directly:
ls -al /beast
ls: /beast: File exists
ls: /beast/.: File exists
total 8
drwxr-xr-x 2 root root 4096 2007-07-17 09:27 .
drwxr-xr-x 27 root root 4096 2007-07-02 10:18 ..
No difference, even with just glusterfs directly accessing a single, local
storage/posix, with no other translators. Spec is simply:
volume share0
type storage/posix # POSIX FS translator
option directory /share0 # Export this directory
end-volume
Ubuntu Feisty, Fuse 2.6.3.
Any ideas?
Thanks,
Brent
On Sat, 14 Jul 2007, Brent A Nelson wrote:
> It's the same spec I was using previously (AFRed namespace cache,
unified
> AFRs spread across four servers, posix-locks, readahead, and
writebehind).
> It's not just the top-level directory; it's everywhere.
>
> Thanks,
>
> Brent
>
> On Sat, 14 Jul 2007, Anand Avati wrote:
>
>> Brent,
>> this is strange, we are having patch-313 work pretty smooth so far. are
>> there any changes in your spec? is this behaviour seen only in this
>> particular directory or 'anywhere' in general? please attach your spec
so
>> that we can try to reproduce it in our labs.
>>
>> thanks,
>> avati
>>
>> 2007/7/14, Brent A Nelson <brent@xxxxxxxxxxxx>:
>>>
>>> Updating to the latest TLA patch, I got odd issues just with "ls":
>>>
>>> Example:
>>>
>>> ls -al /beast/
>>> ls: /beast/: No such file or directory
>>> ls: /beast/.: No such file or directory
>>> ls: /beast/lost+found: No such file or directory
>>> ls: /beast/usr0: No such file or directory
>>> ls: /beast/usr: No such file or directory
>>> total 32
>>> drwxr-xr-x 5 root root 4096 2007-07-13 16:18 .
>>> drwxr-xr-x 27 root root 4096 2007-06-25 18:34 ..
>>> drwx------ 2 root root 16384 2007-06-25 17:08 lost+found
>>> drwxr-xr-x 10 root root 4096 2007-06-18 13:31 usr
>>> drwxr-xr-x 10 root root 4096 2007-06-18 13:31 usr0
>>>
>>> I have one machine that is no longer returning from an "ls". I get
other
>>> messages sometimes, not just "No such file or directory", but also
"Bad
>>> file descriptor" or even "File exists". These extraneous messages are
>>> also occurring when copying from the GlusterFS to the GlusterFS. The
>>> files and directories mentioned do, in fact, exist, no matter what the
>>> extraneous error message says.
>>>
>>> Is there a known issue with the current patchset?
>>>
>>> Thanks,
>>>
>>> Brent
>>>
>>>
>>> _______________________________________________
>>> Gluster-devel mailing list
>>> Gluster-devel@xxxxxxxxxx
>>> http://lists.nongnu.org/mailman/listinfo/gluster-devel
>>>
>>
>>
>>
>> --
>> Anand V. Avati
>>
>
--
Anand V. Avati
execve("/bin/cp", ["cp", "-a", "/beast/usr/share/doc/glusterfs/e"..., "/beast"], [/* 19 vars */]) = 0
brk(0) = 0x8057000
access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory)
mmap2(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7f68000
access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory)
open("/etc/ld.so.cache", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=13581, ...}) = 0
mmap2(NULL, 13581, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7f64000
close(3) = 0
access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory)
open("/lib/libacl.so.1", O_RDONLY) = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\340\24"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0644, st_size=22368, ...}) = 0
mmap2(NULL, 25168, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0xb7f5d000
mmap2(0xb7f63000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x5) = 0xb7f63000
close(3) = 0
access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory)
open("/lib/libselinux.so.1", O_RDONLY) = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\0=\0\000"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0644, st_size=83512, ...}) = 0
mmap2(NULL, 88980, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0xb7f47000
mmap2(0xb7f5b000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x13) = 0xb7f5b000
close(3) = 0
access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory)
open("/lib/tls/i686/cmov/libc.so.6", O_RDONLY) = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\0`\1\000"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0644, st_size=1307104, ...}) = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7f46000
mmap2(NULL, 1312164, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0xb7e05000
mmap2(0xb7f40000, 12288, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x13b) = 0xb7f40000
mmap2(0xb7f43000, 9636, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0xb7f43000
close(3) = 0
access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory)
open("/lib/libattr.so.1", O_RDONLY) = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\260\f\0"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0644, st_size=13448, ...}) = 0
mmap2(NULL, 16228, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0xb7e01000
mmap2(0xb7e04000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2) = 0xb7e04000
close(3) = 0
access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory)
open("/lib/tls/i686/cmov/libdl.so.2", O_RDONLY) = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0P\n\0\000"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0644, st_size=9684, ...}) = 0
mmap2(NULL, 12412, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0xb7dfd000
mmap2(0xb7dff000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1) = 0xb7dff000
close(3) = 0
access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory)
open("/lib/libsepol.so.1", O_RDONLY) = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\3604\0"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0644, st_size=220380, ...}) = 0
mmap2(NULL, 265664, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0xb7dbc000
mmap2(0xb7df2000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x35) = 0xb7df2000
mmap2(0xb7df3000, 40384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0xb7df3000
close(3) = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7dbb000
set_thread_area({entry_number:-1 -> 6, base_addr:0xb7dbb8d0, limit:1048575, seg_32bit:1, contents:0, read_exec_only:0, limit_in_pages:1, seg_not_present:0, useable:1}) = 0
mprotect(0xb7f40000, 4096, PROT_READ) = 0
munmap(0xb7f64000, 13581) = 0
access("/etc/selinux/", F_OK) = -1 ENOENT (No such file or directory)
brk(0) = 0x8057000
brk(0x8078000) = 0x8078000
open("/proc/mounts", O_RDONLY|O_LARGEFILE) = 3
fstat64(3, {st_mode=S_IFREG|0444, st_size=0, ...}) = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7f67000
read(3, "rootfs / rootfs rw 0 0\nnone /sys"..., 1024) = 1024
read(3, "/dev/mapper/share1-disk /share1 "..., 1024) = 283
read(3, "", 1024) = 0
close(3) = 0
munmap(0xb7f67000, 4096) = 0
open("/proc/filesystems", O_RDONLY|O_LARGEFILE) = 3
read(3, "nodev\tsysfs\nnodev\trootfs\nnodev\tb"..., 4095) = 324
close(3) = 0
open("/usr/lib/locale/locale-archive", O_RDONLY|O_LARGEFILE) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/locale.alias", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0777, st_size=2586, ...}) = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7f67000
read(3, "# Locale name alias data base.\n#"..., 4096) = 2586
read(3, "", 4096) = 0
close(3) = 0
munmap(0xb7f67000, 4096) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_IDENTIFICATION", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_IDENTIFICATION", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=391, ...}) = 0
mmap2(NULL, 391, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7f67000
close(3) = 0
open("/usr/lib/gconv/gconv-modules.cache", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=25460, ...}) = 0
mmap2(NULL, 25460, PROT_READ, MAP_SHARED, 3, 0) = 0xb7db4000
close(3) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_MEASUREMENT", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_MEASUREMENT", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=23, ...}) = 0
mmap2(NULL, 23, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7f66000
close(3) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_TELEPHONE", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_TELEPHONE", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=59, ...}) = 0
mmap2(NULL, 59, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7f65000
close(3) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_ADDRESS", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_ADDRESS", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=155, ...}) = 0
mmap2(NULL, 155, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7f64000
close(3) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_NAME", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_NAME", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=77, ...}) = 0
mmap2(NULL, 77, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7db3000
close(3) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_PAPER", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_PAPER", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=34, ...}) = 0
mmap2(NULL, 34, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7db2000
close(3) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_MESSAGES", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_MESSAGES", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
close(3) = 0
open("/usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=52, ...}) = 0
mmap2(NULL, 52, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7db1000
close(3) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_MONETARY", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_MONETARY", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=286, ...}) = 0
mmap2(NULL, 286, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7db0000
close(3) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_COLLATE", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_COLLATE", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=880094, ...}) = 0
mmap2(NULL, 880094, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7cd9000
close(3) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_TIME", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_TIME", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=2451, ...}) = 0
mmap2(NULL, 2451, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7cd8000
close(3) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_NUMERIC", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_NUMERIC", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=54, ...}) = 0
mmap2(NULL, 54, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7cd7000
close(3) = 0
open("/usr/lib/locale/en_US.UTF-8/LC_CTYPE", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_CTYPE", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=238336, ...}) = 0
mmap2(NULL, 238336, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7c9c000
close(3) = 0
geteuid32() = 0
stat64("/beast", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
lstat64("/beast/usr/share/doc/glusterfs/examples", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
lstat64("/beast/examples", 0xbf840eac) = -1 ENOENT (No such file or directory)
mkdir("/beast/examples", 040755) = 0
lstat64("/beast/examples", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
stat64("/beast/examples", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
open("/beast/usr/share/doc/glusterfs/examples", O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY) = 3
fstat64(3, {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
fcntl64(3, F_SETFD, FD_CLOEXEC) = 0
getdents64(3, /* 9 entries */, 4096) = 344
getdents64(3, /* 0 entries */, 4096) = 0
close(3) = 0
lstat64("/beast/usr/share/doc/glusterfs/examples/cluster-server2.vol", {st_mode=S_IFREG|0644, st_size=1739, ...}) = 0
open("/beast/usr/share/doc/glusterfs/examples/cluster-server2.vol", O_RDONLY|O_LARGEFILE) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=1739, ...}) = 0
open("/beast/examples/cluster-server2.vol", O_WRONLY|O_CREAT|O_LARGEFILE, 0100644) = 4
fstat64(4, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
fstat64(3, {st_mode=S_IFREG|0644, st_size=1739, ...}) = 0
read(3, "### file: server-volume.spec.sam"..., 4096) = 1739
write(4, "### file: server-volume.spec.sam"..., 1739) = 1739
read(3, "", 4096) = 0
utimes("/proc/self/fd/4", {1184871046, 0}) = 0
fchown32(4, 0, 0) = 0
getxattr("/beast/usr/share/doc/glusterfs/examples/cluster-server2.vol", "system.posix_acl_access", "=\x00\x00\x00\x00\x00\x00", 132) = 8
open("/usr/share/locale/en_US.UTF-8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en_US.utf8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en_US/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en.UTF-8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en.utf8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en_US.UTF-8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en_US.utf8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en_US/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en.UTF-8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en.utf8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
write(2, "cp: ", 4cp: ) = 4
write(2, "`/beast/usr/share/doc/glusterfs/"..., 61`/beast/usr/share/doc/glusterfs/examples/cluster-server2.vol') = 61
open("/usr/share/locale/en_US.UTF-8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en_US.utf8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en_US/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en.UTF-8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en.utf8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en_US.UTF-8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en_US.utf8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en_US/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en.UTF-8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en.utf8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
write(2, "cp: ", 4cp: ) = 4
write(2, "preserving ACL for `/beast/examp"..., 56preserving ACL for `/beast/examples/cluster-server2.vol') = 56
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
close(4) = 0
close(3) = 0
lstat64("/beast/usr/share/doc/glusterfs/examples/cluster-server1.vol", {st_mode=S_IFREG|0644, st_size=1735, ...}) = 0
open("/beast/usr/share/doc/glusterfs/examples/cluster-server1.vol", O_RDONLY|O_LARGEFILE) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=1735, ...}) = 0
open("/beast/examples/cluster-server1.vol", O_WRONLY|O_CREAT|O_LARGEFILE, 0100644) = 4
fstat64(4, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
fstat64(3, {st_mode=S_IFREG|0644, st_size=1735, ...}) = 0
read(3, "### file: server-volume.spec.sam"..., 4096) = 1735
write(4, "### file: server-volume.spec.sam"..., 1735) = 1735
read(3, "", 4096) = 0
utimes("/proc/self/fd/4", {1184871046, 0}) = 0
fchown32(4, 0, 0) = 0
getxattr("/beast/usr/share/doc/glusterfs/examples/cluster-server1.vol", "system.posix_acl_access", "=\x00\x00\x00\x00\x00\x00", 132) = 8
write(2, "cp: ", 4cp: ) = 4
write(2, "`/beast/usr/share/doc/glusterfs/"..., 61`/beast/usr/share/doc/glusterfs/examples/cluster-server1.vol') = 61
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
write(2, "cp: ", 4cp: ) = 4
write(2, "preserving ACL for `/beast/examp"..., 56preserving ACL for `/beast/examples/cluster-server1.vol') = 56
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
close(4) = 0
close(3) = 0
lstat64("/beast/usr/share/doc/glusterfs/examples/cluster-server3.vol", {st_mode=S_IFREG|0644, st_size=1735, ...}) = 0
open("/beast/usr/share/doc/glusterfs/examples/cluster-server3.vol", O_RDONLY|O_LARGEFILE) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=1735, ...}) = 0
open("/beast/examples/cluster-server3.vol", O_WRONLY|O_CREAT|O_LARGEFILE, 0100644) = 4
fstat64(4, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
fstat64(3, {st_mode=S_IFREG|0644, st_size=1735, ...}) = 0
read(3, "### file: server-volume.spec.sam"..., 4096) = 1735
write(4, "### file: server-volume.spec.sam"..., 1735) = 1735
read(3, "", 4096) = 0
utimes("/proc/self/fd/4", {1184871046, 0}) = 0
fchown32(4, 0, 0) = 0
getxattr("/beast/usr/share/doc/glusterfs/examples/cluster-server3.vol", "system.posix_acl_access", "=\x00\x00\x00\x00\x00\x00", 132) = 8
write(2, "cp: ", 4cp: ) = 4
write(2, "`/beast/usr/share/doc/glusterfs/"..., 61`/beast/usr/share/doc/glusterfs/examples/cluster-server3.vol') = 61
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
write(2, "cp: ", 4cp: ) = 4
write(2, "preserving ACL for `/beast/examp"..., 56preserving ACL for `/beast/examples/cluster-server3.vol') = 56
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
close(4) = 0
close(3) = 0
lstat64("/beast/usr/share/doc/glusterfs/examples/cluster-client.vol", {st_mode=S_IFREG|0644, st_size=4657, ...}) = 0
open("/beast/usr/share/doc/glusterfs/examples/cluster-client.vol", O_RDONLY|O_LARGEFILE) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=4657, ...}) = 0
open("/beast/examples/cluster-client.vol", O_WRONLY|O_CREAT|O_LARGEFILE, 0100644) = 4
fstat64(4, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
fstat64(3, {st_mode=S_IFREG|0644, st_size=4657, ...}) = 0
read(3, "### file: client-volume.spec.sam"..., 4096) = 4096
write(4, "### file: client-volume.spec.sam"..., 4096) = 4096
read(3, "28kB,*mpg:64kB,*vob\n# subvolume"..., 4096) = 561
write(4, "28kB,*mpg:64kB,*vob\n# subvolume"..., 561) = 561
read(3, "", 4096) = 0
utimes("/proc/self/fd/4", {1184871046, 0}) = 0
fchown32(4, 0, 0) = 0
getxattr("/beast/usr/share/doc/glusterfs/examples/cluster-client.vol", "system.posix_acl_access", "=\x00\x00\x00\x00\x00\x00", 132) = 8
write(2, "cp: ", 4cp: ) = 4
write(2, "`/beast/usr/share/doc/glusterfs/"..., 60`/beast/usr/share/doc/glusterfs/examples/cluster-client.vol') = 60
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
write(2, "cp: ", 4cp: ) = 4
write(2, "preserving ACL for `/beast/examp"..., 55preserving ACL for `/beast/examples/cluster-client.vol') = 55
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
close(4) = 0
close(3) = 0
lstat64("/beast/usr/share/doc/glusterfs/examples/standalone-server.vol", {st_mode=S_IFREG|0644, st_size=1774, ...}) = 0
open("/beast/usr/share/doc/glusterfs/examples/standalone-server.vol", O_RDONLY|O_LARGEFILE) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=1774, ...}) = 0
open("/beast/examples/standalone-server.vol", O_WRONLY|O_CREAT|O_LARGEFILE, 0100644) = 4
fstat64(4, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
fstat64(3, {st_mode=S_IFREG|0644, st_size=1774, ...}) = 0
read(3, "### file: server-volume.spec.sam"..., 4096) = 1774
write(4, "### file: server-volume.spec.sam"..., 1774) = 1774
read(3, "", 4096) = 0
utimes("/proc/self/fd/4", {1184871046, 0}) = 0
fchown32(4, 0, 0) = 0
getxattr("/beast/usr/share/doc/glusterfs/examples/standalone-server.vol", "system.posix_acl_access", "=\x00\x00\x00\x00\x00\x00", 132) = 8
write(2, "cp: ", 4cp: ) = 4
write(2, "`/beast/usr/share/doc/glusterfs/"..., 63`/beast/usr/share/doc/glusterfs/examples/standalone-server.vol') = 63
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
write(2, "cp: ", 4cp: ) = 4
write(2, "preserving ACL for `/beast/examp"..., 58preserving ACL for `/beast/examples/standalone-server.vol') = 58
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
close(4) = 0
close(3) = 0
lstat64("/beast/usr/share/doc/glusterfs/examples/standalone-client.vol", {st_mode=S_IFREG|0644, st_size=1757, ...}) = 0
open("/beast/usr/share/doc/glusterfs/examples/standalone-client.vol", O_RDONLY|O_LARGEFILE) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=1757, ...}) = 0
open("/beast/examples/standalone-client.vol", O_WRONLY|O_CREAT|O_LARGEFILE, 0100644) = 4
fstat64(4, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
fstat64(3, {st_mode=S_IFREG|0644, st_size=1757, ...}) = 0
read(3, "### file: client-volume.spec.sam"..., 4096) = 1757
write(4, "### file: client-volume.spec.sam"..., 1757) = 1757
read(3, "", 4096) = 0
utimes("/proc/self/fd/4", {1184871046, 0}) = 0
fchown32(4, 0, 0) = 0
getxattr("/beast/usr/share/doc/glusterfs/examples/standalone-client.vol", "system.posix_acl_access", "=\x00\x00\x00\x00\x00\x00", 132) = 8
write(2, "cp: ", 4cp: ) = 4
write(2, "`/beast/usr/share/doc/glusterfs/"..., 63`/beast/usr/share/doc/glusterfs/examples/standalone-client.vol') = 63
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
write(2, "cp: ", 4cp: ) = 4
write(2, "preserving ACL for `/beast/examp"..., 58preserving ACL for `/beast/examples/standalone-client.vol') = 58
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
close(4) = 0
close(3) = 0
lstat64("/beast/usr/share/doc/glusterfs/examples/glusterfs-mode.el", {st_mode=S_IFREG|0644, st_size=3904, ...}) = 0
open("/beast/usr/share/doc/glusterfs/examples/glusterfs-mode.el", O_RDONLY|O_LARGEFILE) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=3904, ...}) = 0
open("/beast/examples/glusterfs-mode.el", O_WRONLY|O_CREAT|O_LARGEFILE, 0100644) = 4
fstat64(4, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
fstat64(3, {st_mode=S_IFREG|0644, st_size=3904, ...}) = 0
read(3, ";;; Copyright (C) 2007 Z RESEARC"..., 4096) = 3904
write(4, ";;; Copyright (C) 2007 Z RESEARC"..., 3904) = 3904
read(3, "", 4096) = 0
utimes("/proc/self/fd/4", {1184871046, 0}) = 0
fchown32(4, 0, 0) = 0
getxattr("/beast/usr/share/doc/glusterfs/examples/glusterfs-mode.el", "system.posix_acl_access", "=\x00\x00\x00\x00\x00\x00", 132) = 8
write(2, "cp: ", 4cp: ) = 4
write(2, "`/beast/usr/share/doc/glusterfs/"..., 59`/beast/usr/share/doc/glusterfs/examples/glusterfs-mode.el') = 59
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
write(2, "cp: ", 4cp: ) = 4
write(2, "preserving ACL for `/beast/examp"..., 54preserving ACL for `/beast/examples/glusterfs-mode.el') = 54
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
close(4) = 0
close(3) = 0
SYS_299(0xffffff9c, 0x805cd40, 0xbf840cdc, 0x805cd40, 0xb7f41ff4) = 0
chown32("/beast/examples", 0, 0) = 0
getxattr("/beast/usr/share/doc/glusterfs/examples", "system.posix_acl_access", 0xbf840bc0, 132) = -1 ENODATA (No data available)
stat64("/beast/usr/share/doc/glusterfs/examples", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
setxattr("/beast/examples", "system.posix_acl_access", "\x02\x00\x00\x00\x01\x00\x07\x00\xff\xff\xff\xff\x04\x00\x05\x00\xff\xff\xff\xff \x00\x05\x00\xff\xff\xff\xff", 28, 0) = -1 EINVAL (Invalid argument)
chmod("/beast/examples", 040755) = 0
write(2, "cp: ", 4cp: ) = 4
write(2, "preserving permissions for `/bea"..., 44preserving permissions for `/beast/examples') = 44
write(2, ": Invalid argument", 18: Invalid argument) = 18
write(2, "\n", 1
) = 1
close(1) = 0
exit_group(1) = ?
Process 7105 detached
