I'm playing around with glusterfs 3.0.0 on a server acting as both the
glusterfs server and client. I've got a local directory
(/mnt/gluster/gfs2) configured in /etc/glusterfs/glusterfsd.vol:
volume posix1
type storage/posix
option directory /mnt/gluster/gfs2
end-volume
volume locks1
type features/locks
subvolumes posix1
end-volume
volume brick1
type performance/io-threads
option thread-count 8
subvolumes locks1
end-volume
volume server-tcp
type protocol/server
option transport-type tcp
option auth.addr.brick1.allow 127.0.0.1
option transport.socket.listen-port 6996
option transport.socket.nodelay on
subvolumes brick1
end-volume
Glusterfsd starts without problems. The client config is as follows
(gfs2-tcp.vol):
volume localhost-1
type protocol/client
option transport-type tcp
option remote-host localhost
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick1
end-volume
volume writebehind
type performance/write-behind
option cache-size 4MB
subvolumes localhost-1
end-volume
volume readahead
type performance/read-ahead
option page-count 4
subvolumes writebehind
end-volume
volume iocache
type performance/io-cache
option cache-size 1GB
option cache-timeout 1
subvolumes readahead
end-volume
volume quickread
type performance/quick-read
option cache-timeout 1
option max-file-size 64kB
subvolumes iocache
end-volume
volume statprefetch
type performance/stat-prefetch
subvolumes quickread
end-volume
The /etc/booster.fstab:
/etc/glusterfs/gfs2-tcp.vol /var/boot glusterfs
subvolume=brick1,logfile=/var/log/glusterfs/gfs2.log,loglevel=DEBUG,attr_timeout=0
I start apache as follows:
$ export GLUSTERFS_BOOSTER_FSTAB=/etc/booster.fstab
$ LD_PRELOAD=/usr/lib/glusterfs/glusterfs-booster.so /usr/sbin/httpd
I connect using cadaver and try to upload a file (install.log) and
here's what I get in the glusterfs log file:
[2010-01-12 22:10:16] D [libglusterfsclient.c:4968:glusterfs_stat]
libglusterfsclient: path /var/boot/install.log
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1641:_libgf_vmp_search_entry]
libglusterfsclient: VMP Search: path /var/boot/install.log, type:
LongestPrefix
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1728:libgf_vmp_search_entry] libglusterfsclient:
VMP Entry found: path :/var/boot/install.log vmp: /var/boot/
[2010-01-12 22:10:16] D
[libglusterfsclient.c:896:libgf_resolve_path_light]
libglusterfsclient: Path: /install.log, Resolved Path: /install.log
[2010-01-12 22:10:16] D [libglusterfsclient.c:4889:__glusterfs_stat]
libglusterfsclient: path /install.log, op: 2
[2010-01-12 22:10:16] D
[libglusterfsclient-dentry.c:247:__do_path_resolve]
libglusterfsclient-dentry: loc->parent(1) already present. sending
lookup for 1//install.log
[2010-01-12 22:10:16] D
[libglusterfsclient-dentry.c:268:__do_path_resolve]
libglusterfsclient-dentry: resolved path(/install.log) till 1(/).
sending lookup for remaining path
[2010-01-12 22:10:16] D
[libglusterfsclient.c:2110:libgf_client_lookup_cbk]
libglusterfsclient: 1: (op_num=0) /install.log => -1 (No such file or
directory)
[2010-01-12 22:10:16] E [libglusterfsclient.c:4900:__glusterfs_stat]
libglusterfsclient: path lookup failed for (/install.log)
[2010-01-12 22:10:16] E [booster.c:1928:booster_xstat64] booster:
xstat64 failed: No such file or directory
[2010-01-12 22:10:16] D [libglusterfsclient.c:4998:glusterfs_lstat]
libglusterfsclient: path /var
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1641:_libgf_vmp_search_entry]
libglusterfsclient: VMP Search: path /var, type: LongestPrefix
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1731:libgf_vmp_search_entry] libglusterfsclient:
VMP Entry not found: path: /var
[2010-01-12 22:10:16] D [libglusterfsclient.c:4998:glusterfs_lstat]
libglusterfsclient: path /var/boot
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1641:_libgf_vmp_search_entry]
libglusterfsclient: VMP Search: path /var/boot, type: LongestPrefix
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1728:libgf_vmp_search_entry] libglusterfsclient:
VMP Entry found: path :/var/boot vmp: /var/boot/
[2010-01-12 22:10:16] D [libglusterfsclient.c:4889:__glusterfs_stat]
libglusterfsclient: path /, op: 1
[2010-01-12 22:10:16] D
[libglusterfsclient-dentry.c:390:libgf_client_path_lookup]
libglusterfsclient: resolved path(/) to 1/1
[2010-01-12 22:10:16] D [libglusterfsclient.c:4819:libgf_client_stat]
libglusterfsclient: path /, status 0, errno 0
[2010-01-12 22:10:16] D [libglusterfsclient.c:4998:glusterfs_lstat]
libglusterfsclient: path /var/boot/install.log
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1641:_libgf_vmp_search_entry]
libglusterfsclient: VMP Search: path /var/boot/install.log, type:
LongestPrefix
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1728:libgf_vmp_search_entry] libglusterfsclient:
VMP Entry found: path :/var/boot/install.log vmp: /var/boot/
[2010-01-12 22:10:16] D
[libglusterfsclient.c:896:libgf_resolve_path_light]
libglusterfsclient: Path: /install.log, Resolved Path: /install.log
[2010-01-12 22:10:16] D [libglusterfsclient.c:4889:__glusterfs_stat]
libglusterfsclient: path /install.log, op: 1
[2010-01-12 22:10:16] D
[libglusterfsclient-dentry.c:247:__do_path_resolve]
libglusterfsclient-dentry: loc->parent(1) already present. sending
lookup for 1//install.log
[2010-01-12 22:10:16] D
[libglusterfsclient-dentry.c:268:__do_path_resolve]
libglusterfsclient-dentry: resolved path(/install.log) till 1(/).
sending lookup for remaining path
[2010-01-12 22:10:16] D
[libglusterfsclient.c:2110:libgf_client_lookup_cbk]
libglusterfsclient: 3: (op_num=0) /install.log => -1 (No such file or
directory)
[2010-01-12 22:10:16] E [libglusterfsclient.c:4900:__glusterfs_stat]
libglusterfsclient: path lookup failed for (/install.log)
[2010-01-12 22:10:16] E [booster.c:2176:booster_lxstat64] booster:
lxstat64 failed: No such file or directory
[2010-01-12 22:10:16] D [libglusterfsclient.c:3090:glusterfs_open]
libglusterfsclient: path /var/lib/dav/lockdb.dir
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1641:_libgf_vmp_search_entry]
libglusterfsclient: VMP Search: path /var/lib/dav/lockdb.dir, type:
LongestPrefix
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1731:libgf_vmp_search_entry] libglusterfsclient:
VMP Entry not found: path: /var/lib/dav/lockdb.dir
[2010-01-12 22:10:16] E [booster.c:414:vmp_open] booster: VMP open failed
[2010-01-12 22:10:16] D [booster.c:267:do_open] booster: Opening using
MPB: /var/lib/dav/lockdb.dir
[2010-01-12 22:10:16] E [booster.c:272:do_open] booster: Xattr
user.glusterfs-booster-volfile not found: No data available
[2010-01-12 22:10:16] D [libglusterfsclient.c:3090:glusterfs_open]
libglusterfsclient: path /var/lib/dav/lockdb.pag
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1641:_libgf_vmp_search_entry]
libglusterfsclient: VMP Search: path /var/lib/dav/lockdb.pag, type:
LongestPrefix
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1731:libgf_vmp_search_entry] libglusterfsclient:
VMP Entry not found: path: /var/lib/dav/lockdb.pag
[2010-01-12 22:10:16] E [booster.c:414:vmp_open] booster: VMP open failed
[2010-01-12 22:10:16] D [booster.c:267:do_open] booster: Opening using
MPB: /var/lib/dav/lockdb.pag
[2010-01-12 22:10:16] E [booster.c:272:do_open] booster: Xattr
user.glusterfs-booster-volfile not found: No data available
[2010-01-12 22:10:16] D [libglusterfsclient.c:4968:glusterfs_stat]
libglusterfsclient: path /var/boot/install.log
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1641:_libgf_vmp_search_entry]
libglusterfsclient: VMP Search: path /var/boot/install.log, type:
LongestPrefix
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1728:libgf_vmp_search_entry] libglusterfsclient:
VMP Entry found: path :/var/boot/install.log vmp: /var/boot/
[2010-01-12 22:10:16] D
[libglusterfsclient.c:896:libgf_resolve_path_light]
libglusterfsclient: Path: /install.log, Resolved Path: /install.log
[2010-01-12 22:10:16] D [libglusterfsclient.c:4889:__glusterfs_stat]
libglusterfsclient: path /install.log, op: 2
[2010-01-12 22:10:16] D
[libglusterfsclient-dentry.c:247:__do_path_resolve]
libglusterfsclient-dentry: loc->parent(1) already present. sending
lookup for 1//install.log
[2010-01-12 22:10:16] D
[libglusterfsclient-dentry.c:268:__do_path_resolve]
libglusterfsclient-dentry: resolved path(/install.log) till 1(/).
sending lookup for remaining path
[2010-01-12 22:10:16] D
[libglusterfsclient.c:2110:libgf_client_lookup_cbk]
libglusterfsclient: 4: (op_num=0) /install.log => -1 (No such file or
directory)
[2010-01-12 22:10:16] E [libglusterfsclient.c:4900:__glusterfs_stat]
libglusterfsclient: path lookup failed for (/install.log)
[2010-01-12 22:10:16] E [booster.c:1928:booster_xstat64] booster:
xstat64 failed: No such file or directory
[2010-01-12 22:10:16] D [libglusterfsclient.c:3090:glusterfs_open]
libglusterfsclient: path /var/lib/dav/lockdb.dir
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1641:_libgf_vmp_search_entry]
libglusterfsclient: VMP Search: path /var/lib/dav/lockdb.dir, type:
LongestPrefix
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1731:libgf_vmp_search_entry] libglusterfsclient:
VMP Entry not found: path: /var/lib/dav/lockdb.dir
[2010-01-12 22:10:16] E [booster.c:414:vmp_open] booster: VMP open failed
[2010-01-12 22:10:16] D [booster.c:267:do_open] booster: Opening using
MPB: /var/lib/dav/lockdb.dir
[2010-01-12 22:10:16] E [booster.c:272:do_open] booster: Xattr
user.glusterfs-booster-volfile not found: No data available
[2010-01-12 22:10:16] D [libglusterfsclient.c:3090:glusterfs_open]
libglusterfsclient: path /var/lib/dav/lockdb.pag
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1641:_libgf_vmp_search_entry]
libglusterfsclient: VMP Search: path /var/lib/dav/lockdb.pag, type:
LongestPrefix
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1731:libgf_vmp_search_entry] libglusterfsclient:
VMP Entry not found: path: /var/lib/dav/lockdb.pag
[2010-01-12 22:10:16] E [booster.c:414:vmp_open] booster: VMP open failed
[2010-01-12 22:10:16] D [booster.c:267:do_open] booster: Opening using
MPB: /var/lib/dav/lockdb.pag
[2010-01-12 22:10:16] E [booster.c:272:do_open] booster: Xattr
user.glusterfs-booster-volfile not found: No data available
The apache config is fine because if I run apache without glusterfs,
the upload works without a problem. I'm guessing I'm missing
something pretty simple. Thanks for any help or insight.
--
Jiann-Ming Su
"I have to decide between two equally frightening options.
If I wanted to do that, I'd vote." --Duckman
"The system's broke, Hank. The election baby has peed in
the bath water. You got to throw 'em both out." --Dale Gribble
"Those who vote decide nothing.
Those who count the votes decide everything.? --Joseph Stalin
