Hope this help: =================================================== GNU gdb (GDB) Fedora (7.0.50.20100203-15.el5) Copyright (C) 2010 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /usr/local/bin/cosd...done. [New Thread 15605] [New Thread 15366] [New Thread 15365] [New Thread 15228] [New Thread 15469] [New Thread 15226] [New Thread 15233] [New Thread 15607] [New Thread 15227] [New Thread 15240] [New Thread 15254] [New Thread 15229] [New Thread 15243] [New Thread 15255] [New Thread 15253] [New Thread 15230] [New Thread 15247] [New Thread 15256] [New Thread 15231] [New Thread 15252] [New Thread 15232] [New Thread 15311] [New Thread 15302] [New Thread 15234] [New Thread 15470] [New Thread 17426] [New Thread 15237] [New Thread 15473] [New Thread 15299] [New Thread 15475] [New Thread 15303] [New Thread 15246] [New Thread 15304] [New Thread 15245] [New Thread 15606] [New Thread 15307] [New Thread 15241] [New Thread 15309] [New Thread 15251] [New Thread 15242] [New Thread 15239] [New Thread 15308] [New Thread 15244] [New Thread 15236] [New Thread 15248] [New Thread 17425] [New Thread 15235] [New Thread 15250] [New Thread 15609] [New Thread 15238] [New Thread 15249] Error while mapping shared library sections: /opt/ceph_var/tmp/class-AVGRjS: No such file or directory. Reading symbols from /usr/lib64/libnss3.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libnss3.so Reading symbols from /usr/lib64/libnspr4.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libnspr4.so Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done. Loaded symbols for /lib64/libpthread.so.0 Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libdl.so.2 Reading symbols from /usr/lib64/libstdc++.so.6...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libstdc++.so.6 Reading symbols from /lib64/libm.so.6...(no debugging symbols found)...done. Loaded symbols for /lib64/libm.so.6 Reading symbols from /lib64/libgcc_s.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libgcc_s.so.1 Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done. Loaded symbols for /lib64/libc.so.6 Reading symbols from /usr/lib64/libnssutil3.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libnssutil3.so Reading symbols from /usr/lib64/libplc4.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libplc4.so Reading symbols from /usr/lib64/libplds4.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libplds4.so Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 Reading symbols from /usr/lib64/libsoftokn3.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libsoftokn3.so Reading symbols from /usr/lib64/libfreebl3.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libfreebl3.so Symbol file not found for /opt/ceph_var/tmp/class-AVGRjS Core was generated by `/usr/local/bin/cosd -i 2 -c /tmp/ceph.conf.23025'. Program terminated with signal 11, Segmentation fault. #0 0x0000003681a075c8 in ?? () from /lib64/libgcc_s.so.1 (gdb) bt #0 0x0000003681a075c8 in ?? () from /lib64/libgcc_s.so.1 #1 0x0000003681a0882b in _Unwind_Backtrace () from /lib64/libgcc_s.so.1 #2 0x000000367fae5eb8 in backtrace () from /lib64/libc.so.6 #3 0x0000000000661318 in BackTrace (signum=11) at ./common/BackTrace.h:19 #4 handle_fatal_signal (signum=11) at common/signal.cc:72 #5 <signal handler called> #6 0x0000000000000031 in ?? () #7 0x00007fbda871e390 in ?? () #8 0x0000000000000000 in ?? () (gdb) ===================================================== If helpless, I will got more trace info. BTW, where could I get the debug packages? 2011/5/10 Yehuda Sadeh Weinraub <yehudasa@xxxxxxxxx>: > On Tue, May 10, 2011 at 7:15 AM, Simon Tian <aixt2006@xxxxxxxxx> wrote: >> Hi, >> >> Â ÂAs you said, one of the osds crashed: >> ================= log ======================== >> 2011-05-10 21:46:38.990311 4bc90940 osd2 8 pg[3.13a( v 8'1 (0'0,8'1] >> n=1 ec=2 les=6 5/5/4) [2,3] r=0 mlcod 0'0 active+clean] >> oi.user_version=8'2 is_modify=0 >> 2011-05-10 21:46:38.990386 4bc90940 osd2 8 pg[3.13a( v 8'1 (0'0,8'1] >> n=1 ec=2 les=6 5/5/4) [2,3] r=0 mlcod 0'0 active+clean] >> oi.user_version=8'2 is_modify=1 >> *** Caught signal (Segmentation fault) ** >> Âin thread 0x45382940 >> ========================================= >> >> I tried again, this time, i done "rbd create foo --size 1024" >> successfully, but when I run the code of testlibrbd.c, one of the osds >> crash again: >> ================= log ======================== >> 2011-05-10 22:08:20.008871 4c115940 osd3 10 pg[4.1( v 9'4 (9'2,9'4] >> n=1 ec=9 les=9 9/9/9) [3,0] r=0 mlcod 9'3 active+clean >> snaptrimq=[1~1]] dump_watchers testimg.rbd/head testimg.rbd/head(9'4 >> client4107.0:14 wrlock_by=unknown0.0:0) >> 2011-05-10 22:08:20.008903 4c115940 osd3 10 pg[4.1( v 9'4 (9'2,9'4] >> n=1 ec=9 les=9 9/9/9) [3,0] r=0 mlcod 9'3 active+clean >> snaptrimq=[1~1]] Â* obc->watcher: client4107 session=0xc80990 >> 2011-05-10 22:08:20.008925 4c115940 osd3 10 pg[4.1( v 9'4 (9'2,9'4] >> n=1 ec=9 les=9 9/9/9) [3,0] r=0 mlcod 9'3 active+clean >> snaptrimq=[1~1]] Â* oi->watcher: client4107 cookie=2 >> 2011-05-10 22:08:20.009232 4b914940 osd3 10 pg[4.1( v 9'4 (9'2,9'4] >> n=1 ec=9 les=9 9/9/9) [3,0] r=0 mlcod 9'3 active+clean] >> oi.user_version=10'5 is_modify=1 >> 2011-05-10 22:08:20.009267 4b914940 expires 2011-05-10 23:08:19.890032 >> now 2011-05-10 22:08:20.009260 >> 2011-05-10 22:08:20.009284 napshots_list >> 2011-05-10 22:08:20.009307 4b914940 osd3 10 pg[4.1( v 9'4 (9'2,9'4] >> n=1 ec=9 les=9 9/9/9) [3,0] r=0 mlcod 9'3 active+clean] >> oi.user_version=10'5 is_modify=0 >> 2011-05-10 22:08:20.009375 4b914940 osd3 10 pg[4.1( v 9'4 (9'2,9'4] >> n=1 ec=9 les=9 9/9/9) [3,0] r=0 mlcod 9'3 active+clean] >> oi.user_version=10'5 is_modify=1 >> *** Caught signal (Segmentation fault) ** >> Âin thread 0x4eb1c940 >> ========================================= >> > Can you by any chance get backtrace for that crash (gdb cosd core; > bt)? You might need to have the debug packages installed. > Also, note that you're not running the latest version so you might be > hitting something that was already fixed (not that I remember anything > specific, but it might be worth a try). > > Thanks, > Yehuda > -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
