On Mon, 14 Nov 2011, Mario van der Linde wrote: > Hello, > > On 14.11.2011 22:39, Sage Weil wrote: > [...] > >> This one gave me some output: > >> rbd create testimg --size=10240 --log-to-stderr 2 --debug-ms 2 > >> > >> See attached file. > > > > It sounds like the OSD can't find the libcls_rbd.so file. Can you verify > > that it is in /usr/lib/rados-classes, and that that location isn't be > > overridden by something in ceph.conf? > > At first, on all Systems this file exists, but in /usr/lib64, not /usr/lib: > > ceph5:~ # for f in `seq 1 5`; do ssh ceph${f} ls -l /usr/lib64/rados-classes; done | grep ' libcls_rbd.so ' > > lrwxrwxrwx 1 root root 19 Nov 10 10:15 libcls_rbd.so -> libcls_rbd.so.1.0.0 > > lrwxrwxrwx 1 root root 19 Nov 10 10:15 libcls_rbd.so -> libcls_rbd.so.1.0.0 > > lrwxrwxrwx 1 root root 19 Nov 10 10:16 libcls_rbd.so -> libcls_rbd.so.1.0.0 > > lrwxrwxrwx 1 root root 19 Nov 10 10:16 libcls_rbd.so -> libcls_rbd.so.1.0.0 > > lrwxrwxrwx 1 root root 19 Nov 10 10:16 libcls_rbd.so -> libcls_rbd.so.1.0.0 > > Seems to be the right place in an x86_64 system. Argh... For now, just add osd class dir = /usr/lib64/rados-classes and that will sort it out. My last attempt to make automake fill in the @libdirpath@ correctly in common/config_opts.h failed miserably, further entrenching my frustration with autotools. It's bug http://tracker.newdream.net/issues/1614, if someone with better autotools-fu than I wants to fix this. IIRC I tried a few different methods but could only make it substitute in @prefix@/lib64, but not /usr/lib64... sage > > In ceph.conf there is no setting regarding to lib path. > > Is ceph-radosgw needed for rbd? I think not, while radosgw is AFAIK the > REST interface... > This package is not installed (due to a not resolveable cgi dependency). > > > Regards > Mario > > > -- > Mario van der Linde > Linux Consultant & Trainer > Tel.: +49-151-16879485 > Mail: linde@xxxxxxxxxxxxx > > B1 Systems GmbH > Osterfeldstraße 7 / 85088 Vohburg / http://www.b1-systems.de > GF: Ralph Dehner / Unternehmenssitz: Vohburg / AG: Ingolstadt,HRB 3537 > >