Re: Re: lighttpd mod_glusterfs cannot run

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,

Can you send following information?

* backtrace from the lighttpd core after lighttpd has crashed.
* complete glusterfs logfile as an attachment.

Also, mod_glusterfs is listed at the end in server.modules. Can you move it to top and retry?

regards,

On Wed, Feb 18, 2009 at 2:20 AM, Titov Alexander <titoff.a@xxxxxxxxx> wrote:
The problem is remained in other words, but before lighhtpd hungs. The lighttpd dies without error after trying to read the URL from glusterfs.

Configuration of lighttpd:
server.modules              = (
            "mod_access",
            "mod_alias",
            "mod_accesslog",
            "mod_compress",
            "mod_rewrite",
            "mod_redirect",
            "mod_status",
            "mod_glusterfs",
 )
server.document-root       = "/var/www/"
server.errorlog            = "/var/log/lighttpd/error.log"
index-file.names           = ( "index.php", "index.html",
                               "index.htm", "default.htm",
                               "index.lighttpd.html" )
accesslog.filename         = "/var/log/lighttpd/access.log"
url.access-deny            = ( "~", ".inc" )
static-file.exclude-extensions = ( ".php", ".pl", ".fcgi" )
server.port               = 8081
server.pid-file            = "/var/run/lighttpd.pid"
dir-listing.encoding        = "utf-8"
server.dir-listing          = "enable"
server.username            = "www-data"
server.groupname           = "www-data"
compress.cache-dir          = "/var/cache/lighttpd/compress/"
compress.filetype           = ("text/plain", "text/html", "application/x-_javascript_", "text/css")
include_shell "/usr/share/lighttpd/create-mime.assign.pl"
include_shell "/usr/share/lighttpd/include-conf-enabled.pl"

$HTTP["url"] =~ "^/" {
    glusterfs.document-root = "/var/www"   
        glusterfs.prefix = "/"
        glusterfs.logfile = "/var/log/lighttpd/glusterfs-lighttpd.log"
        glusterfs.volume-specfile = "/etc/glusterfs/glusterfs-client.vol"
        glusterfs.loglevel = "debug"
        glusterfs.cache-timeout = 300
        glusterfs.xattr-interface-size-limit = "65536"
}

glusterfs-client.vol:
volume server1
  type protocol/client
  option transport-type tcp
  option remote-host 192.168.1.2
  option remote-port 6996   
  option username user
  option password *******
  option remote-subvolume storage
end-volume

volume server2
  type protocol/client
  option transport-type tcp
  option remote-host 192.168.1.2
  option remote-port 6996
  option username user
  option password *******
  option remote-subvolume storage       
end-volume

volume replicate
  type cluster/replicate
  subvolumes server1 server2
end-volume

volume writebehind
  type performance/write-behind
  option aggregate-size 128KB
  option window-size 1MB
  option flush-behind on
  subvolumes replicate
end-volume

volume cache
  type performance/io-cache
  option cache-size 512MB
  subvolumes writebehind
end-volume

In debug mode log is writing:
2009-02-17 19:01:23 D [spec.y:187:new_section] parser: New node for 'client1'
2009-02-17 19:01:23 D [xlator.c:421:xlator_set_type] xlator: attempt to load file /usr/lib/glusterfs/2.0.0rc1/xlator/protocol/client.so
2009-02-17 19:01:23 D [spec.y:213:section_type] parser: Type:client1:protocol/client
2009-02-17 19:01:23 D [spec.y:288:section_option] parser: Option:client1:transport-type:tcp
2009-02-17 19:01:23 D [spec.y:288:section_option] parser: Option:client1:remote-host:192.168.1.1
2009-02-17 19:01:23 D [spec.y:288:section_option] parser: Option:client1:remote-port:6996
2009-02-17 19:01:23 D [spec.y:288:section_option] parser: Option:client1:username:user
2009-02-17 19:01:23 D [spec.y:288:section_option] parser: Option:client1:password:******
2009-02-17 19:01:23 D [spec.y:288:section_option] parser: Option:client1:remote-subvolume:storage
2009-02-17 19:01:23 D [spec.y:372:section_end] parser: end:client1
2009-02-17 19:01:23 D [spec.y:187:new_section] parser: New node for 'client2'
2009-02-17 19:01:23 D [xlator.c:421:xlator_set_type] xlator: attempt to load file /usr/lib/glusterfs/2.0.0rc1/xlator/protocol/client.so
2009-02-17 19:01:23 D [spec.y:213:section_type] parser: Type:client2:protocol/client
2009-02-17 19:01:23 D [spec.y:288:section_option] parser: Option:client2:transport-type:tcp
2009-02-17 19:01:23 D [spec.y:288:section_option] parser: Option:client2:remote-host:192.168.1.2
2009-02-17 19:01:23 D [spec.y:288:section_option] parser: Option:client2:remote-port:6996
2009-02-17 19:01:23 D [spec.y:288:section_option] parser: Option:client2:username:user
2009-02-17 19:01:23 D [spec.y:288:section_option] parser: Option:client2:password:*******
2009-02-17 19:01:23 D [spec.y:288:section_option] parser: Option:client2:remote-subvolume:storage
2009-02-17 19:01:23 D [spec.y:372:section_end] parser: end:client2
2009-02-17 19:01:23 D [spec.y:187:new_section] parser: New node for 'replicate'
2009-02-17 19:01:23 D [xlator.c:421:xlator_set_type] xlator: attempt to load file /usr/lib/glusterfs/2.0.0rc1/xlator/cluster/replicate.so
2009-02-17 19:01:23 D [spec.y:213:section_type] parser: Type:replicate:cluster/replicate
2009-02-17 19:01:23 D [spec.y:357:section_sub] parser: child:replicate->client1
2009-02-17 19:01:23 D [spec.y:357:section_sub] parser: child:replicate->client2
2009-02-17 19:01:23 D [spec.y:372:section_end] parser: end:replicate
2009-02-17 19:01:23 D [spec.y:187:new_section] parser: New node for 'writebehind'
2009-02-17 19:01:23 D [xlator.c:421:xlator_set_type] xlator: attempt to load file /usr/lib/glusterfs/2.0.0rc1/xlator/performance/write-behind.so
2009-02-17 19:01:23 D [xlator.c:461:xlator_set_type] xlator: dlsym(notify) on /usr/lib/glusterfs/2.0.0rc1/xlator/performance/write-behind.so: undefined symbol: notify -- neglecting
2009-02-17 19:01:23 D [spec.y:213:section_type] parser: Type:writebehind:performance/write-behind
2009-02-17 19:01:23 D [spec.y:288:section_option] parser: Option:writebehind:aggregate-size:128KB
2009-02-17 19:01:23 D [spec.y:288:section_option] parser: Option:writebehind:window-size:1MB
2009-02-17 19:01:23 D [spec.y:288:section_option] parser: Option:writebehind:flush-behind:on
2009-02-17 19:01:23 D [spec.y:357:section_sub] parser: child:writebehind->replicate
2009-02-17 19:01:23 D [spec.y:372:section_end] parser: end:writebehind
2009-02-17 19:01:23 D [spec.y:187:new_section] parser: New node for 'cache'
2009-02-17 19:01:23 D [xlator.c:421:xlator_set_type] xlator: attempt to load file /usr/lib/glusterfs/2.0.0rc1/xlator/performance/io-cache.so
2009-02-17 19:01:23 D [xlator.c:461:xlator_set_type] xlator: dlsym(notify) on /usr/lib/glusterfs/2.0.0rc1/xlator/performance/io-cache.so: undefined symbol: notify -- neglecting
2009-02-17 19:01:23 D [spec.y:213:section_type] parser: Type:cache:performance/io-cache
2009-02-17 19:01:23 D [spec.y:288:section_option] parser: Option:cache:cache-size:512MB
2009-02-17 19:01:23 D [spec.y:357:section_sub] parser: child:cache->writebehind
2009-02-17 19:01:23 D [spec.y:372:section_end] parser: end:cache
2009-02-17 19:01:23 D [inode.c:990:inode_table_new] libglusterfsclient: creating new inode table with lru_limit=14057
2009-02-17 19:01:23 D [inode.c:455:__inode_create] libglusterfsclient/inode: create inode(0)
2009-02-17 19:01:23 D [client-protocol.c:5986:init] client1: defaulting transport-timeout to 42
2009-02-17 19:01:23 D [transport.c:141:transport_load] transport: attempt to load file /usr/lib/glusterfs/2.0.0rc1/transport/socket.so
2009-02-17 19:01:23 D [xlator.c:152:_volume_option_value_validate] client1: no range check required for 'option remote-port 6996'
2009-02-17 19:01:23 W [client-protocol.c:6049:init] client1: WARNING: Failed to set 'ulimit -n 1M': Operation not permitted
2009-02-17 19:01:23 E [client-protocol.c:6057:init] client1: Failed to set max open fd to 64k: Operation not permitted
2009-02-17 19:01:23 D [xlator.c:551:xlator_init_rec] client1: Initialization done
2009-02-17 19:01:23 D [client-protocol.c:5986:init] client2: defaulting transport-timeout to 42
2009-02-17 19:01:23 D [transport.c:141:transport_load] transport: attempt to load file /usr/lib/glusterfs/2.0.0rc1/transport/socket.so
2009-02-17 19:01:23 D [xlator.c:152:_volume_option_value_validate] client2: no range check required for 'option remote-port 6996'
2009-02-17 19:01:23 W [client-protocol.c:6049:init] client2: WARNING: Failed to set 'ulimit -n 1M': Operation not permitted
2009-02-17 19:01:23 E [client-protocol.c:6057:init] client2: Failed to set max open fd to 64k: Operation not permitted
2009-02-17 19:01:23 D [xlator.c:551:xlator_init_rec] client2: Initialization done
2009-02-17 19:01:23 D [xlator.c:551:xlator_init_rec] replicate: Initialization done
2009-02-17 19:01:23 D [write-behind.c:1315:init] writebehind: using aggregate-size = 131072
2009-02-17 19:01:23 D [write-behind.c:1364:init] writebehind: aggregate-size is not zero, disabling flush-behind
2009-02-17 19:01:23 D [xlator.c:551:xlator_init_rec] writebehind: Initialization done
2009-02-17 19:01:23 D [io-cache.c:1308:init] cache: using cache-size 536870912
2009-02-17 19:01:23 D [xlator.c:551:xlator_init_rec] cache: Initialization done
2009-02-17 19:01:23 D [client-protocol.c:6296:notify] client1: got GF_EVENT_PARENT_UP, attempting connect on transport
2009-02-17 19:01:23 D [client-protocol.c:6296:notify] client2: got GF_EVENT_PARENT_UP, attempting connect on transport
2009-02-17 19:01:23 D [client-protocol.c:6296:notify] client1: got GF_EVENT_PARENT_UP, attempting connect on transport
2009-02-17 19:01:23 D [client-protocol.c:6296:notify] client2: got GF_EVENT_PARENT_UP, attempting connect on transport
2009-02-17 19:01:24 D [client-protocol.c:5684:client_protocol_reconnect] client1: attempting reconnect
2009-02-17 19:01:24 D [common-utils.c:92:gf_resolve_ip6] resolver: DNS cache not present, freshly probing hostname: 192.168.1.1
2009-02-17 19:01:24 D [common-utils.c:129:gf_resolve_ip6] resolver: returning ip-192.168.1.1 (port-6996) for hostname: 192.168.1.1 and port: 6996
2009-02-17 19:01:24 E [name.c:416:client_bind] client1: cannot bind inet socket (10) to port less than 1024 (Permission denied)
2009-02-17 19:01:24 D [client-protocol.c:5684:client_protocol_reconnect] client2: attempting reconnect
2009-02-17 19:01:24 D [common-utils.c:92:gf_resolve_ip6] resolver: DNS cache not present, freshly probing hostname: 192.168.1.2
2009-02-17 19:01:24 D [client-protocol.c:6328:notify] client1: got GF_EVENT_CHILD_UP
2009-02-17 19:01:24 D [socket.c:924:socket_connect] client1: connect () called on transport already connected
2009-02-17 19:01:24 D [common-utils.c:129:gf_resolve_ip6] resolver: returning ip-192.168.1.2 (port-6996) for hostname: 192.168.1.2 and port: 6996
2009-02-17 19:01:24 E [name.c:416:client_bind] client2: cannot bind inet socket (11) to port less than 1024 (Permission denied)
2009-02-17 19:01:24 D [client-protocol.c:6328:notify] client2: got GF_EVENT_CHILD_UP
2009-02-17 19:01:24 D [socket.c:924:socket_connect] client2: connect () called on transport already connected

After that lighttpd is died.


Lighttpd version 1.4.19.

Help please with this problem.



2009/2/17 Raghavendra G <raghavendra@xxxxxxxxxxxxx>

Hi,

These are warning messages. Even though it cannot bind to any port <= 1024, lighttpd goes ahead and binds to a non privileged port. But since client is bound to non-privileged port, the address based authentication do not accept the client. Hence client should be using login based authentication. More details about authentication methods can be found in <srcdir>/docs/authentication.txt

regards,

On Fri, Feb 13, 2009 at 7:59 PM, Titov Alexander <titoff.a@xxxxxxxxx> wrote:
I solved this error, I add one string to mod_glusterfs.h:
#include <glusterfs/mem-pool.h>"

But mod_glusterfs didn't work still. In lighttpd mod_glusterfs log I saw:
2009-02-13 18:50:31 E [name.c:416:client_bind] client1: cannot bind inet socket (10) to port less than 1024 (Permission denied)
2009-02-13 18:50:31 E [name.c:416:client_bind] client2: cannot bind inet socket (11) to port less than 1024 (Permission denied)

Lighttpd is runing with owner user www-data and www-data can't create socket with port less than 1024.

How I can solve this problem?

 

2009/2/13 Titov Alexander <titoff.a@xxxxxxxxx>

Hello!

I build glusterfs and lighttpd 1.4.19 with mod_glusterfs. When I try to start lighttpd, I  get this error:

2009-02-13 14:42:13: (plugin.c.165) dlopen() failed for: /usr/lib/lighttpd/mod_glusterfs.so /usr/lib/lighttpd/mod_glusterfs.so: undefined symbol: CALLOC
2009-02-13 14:42:13: (server.c.621) loading plugins finally failed

Help me please with strange error.

--
Titov Alexander



--
С уважением,
Титов Александр

_______________________________________________
Gluster-devel mailing list
Gluster-devel@xxxxxxxxxx
http://lists.nongnu.org/mailman/listinfo/gluster-devel




--
Raghavendra G




--
С уважением,
Титов Александр



--
Raghavendra G


[Index of Archives]     [Gluster Users]     [Ceph Users]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Security]     [Bugtraq]     [Linux]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]

  Powered by Linux