According your log, your ceph version is 0.80.5 which has several KeyValueStore bugs. I recommend you to use the latest ceph version for KeyValueStore On Sun, Sep 7, 2014 at 7:56 PM, ??? <Derek at f-club.cn> wrote: > already set ulimit -a 65536 > already set debug_keyvaluestore=20/20 in global section of ceph.conf > > but still un-able to start up OSDS , i attachd all logs in attachment > > > > ________________________________________ > ???: Haomai Wang [haomaiwang at gmail.com] > ????: 2014?9?7? 17:11 > ?: ??? > ??: Re: ??: ??: ??: ceph osd unexpected error > > I can't get enough info from this, do you improve debug level for > keyvaluestore(debug_keyvaluestore=20/20)? > > On Sun, Sep 7, 2014 at 3:34 PM, ??? <Derek at f-club.cn> wrote: >> dear, >> it happend again , and detail error info is listed below: >> >> 770'25857 snapset=0=[]:[] snapc=0=[]) v10 ==== 1295+0+39 (3373886567 0 3511520646) 0xccbd800 con 0xaa41760 >> -27> 2014-09-07 15:28:58.921019 7f5ad3a92700 5 -- op tracker -- , seq: 1849, time: 2014-09-07 15:28:58.920839, event: header_read, request: osd_sub_op(mds.0.5:4596685 6.16 93408016/10000326762.00000000/head//6 [] v 770'25857 snapset=0=[]:[] snapc=0=[]) v10 >> -26> 2014-09-07 15:28:58.921024 7f5ad3a92700 5 -- op tracker -- , seq: 1849, time: 2014-09-07 15:28:58.920839, event: throttled, request: osd_sub_op(mds.0.5:4596685 6.16 93408016/10000326762.00000000/head//6 [] v 770'25857 snapset=0=[]:[] snapc=0=[]) v10 >> -25> 2014-09-07 15:28:58.921029 7f5ad3a92700 5 -- op tracker -- , seq: 1849, time: 2014-09-07 15:28:58.920871, event: all_read, request: osd_sub_op(mds.0.5:4596685 6.16 93408016/10000326762.00000000/head//6 [] v 770'25857 snapset=0=[]:[] snapc=0=[]) v10 >> -24> 2014-09-07 15:28:58.921035 7f5ad3a92700 5 -- op tracker -- , seq: 1849, time: 2014-09-07 15:28:58.921018, event: dispatched, request: osd_sub_op(mds.0.5:4596685 6.16 93408016/10000326762.00000000/head//6 [] v 770'25857 snapset=0=[]:[] snapc=0=[]) v10 >> -23> 2014-09-07 15:28:58.921040 7f5ad3a92700 5 -- op tracker -- , seq: 1849, time: 2014-09-07 15:28:58.921040, event: waiting_for_osdmap, request: osd_sub_op(mds.0.5:4596685 6.16 93408016/10000326762.00000000/head//6 [] v 770'25857 snapset=0=[]:[] snapc=0=[]) v10 >> -22> 2014-09-07 15:28:58.924567 7f5ad3a92700 1 -- 10.1.0.217:6801/4928 <== osd.13 10.1.0.219:6809/6216 185 ==== osd_sub_op(client.9699.1:3308964 6.49 e80e2349/10000327fc6.00000000/head//6 [] v 770'51561 snapset=0=[]:[] snapc=0=[]) v10 ==== 1295+0+39 (431545863 0 3511520646) 0xe895800 con 0xaa440a0 >> -21> 2014-09-07 15:28:58.924597 7f5ad3a92700 5 -- op tracker -- , seq: 1850, time: 2014-09-07 15:28:58.924468, event: header_read, request: osd_sub_op(client.9699.1:3308964 6.49 e80e2349/10000327fc6.00000000/head//6 [] v 770'51561 snapset=0=[]:[] snapc=0=[]) v10 >> -20> 2014-09-07 15:28:58.924607 7f5ad3a92700 5 -- op tracker -- , seq: 1850, time: 2014-09-07 15:28:58.924469, event: throttled, request: osd_sub_op(client.9699.1:3308964 6.49 e80e2349/10000327fc6.00000000/head//6 [] v 770'51561 snapset=0=[]:[] snapc=0=[]) v10 >> -19> 2014-09-07 15:28:58.924622 7f5ad3a92700 5 -- op tracker -- , seq: 1850, time: 2014-09-07 15:28:58.924521, event: all_read, request: osd_sub_op(client.9699.1:3308964 6.49 e80e2349/10000327fc6.00000000/head//6 [] v 770'51561 snapset=0=[]:[] snapc=0=[]) v10 >> -18> 2014-09-07 15:28:58.924627 7f5ad3a92700 5 -- op tracker -- , seq: 1850, time: 2014-09-07 15:28:58.924583, event: dispatched, request: osd_sub_op(client.9699.1:3308964 6.49 e80e2349/10000327fc6.00000000/head//6 [] v 770'51561 snapset=0=[]:[] snapc=0=[]) v10 >> -17> 2014-09-07 15:28:58.924633 7f5ad3a92700 5 -- op tracker -- , seq: 1850, time: 2014-09-07 15:28:58.924633, event: waiting_for_osdmap, request: osd_sub_op(client.9699.1:3308964 6.49 e80e2349/10000327fc6.00000000/head//6 [] v 770'51561 snapset=0=[]:[] snapc=0=[]) v10 >> -16> 2014-09-07 15:28:58.925717 7f5ad228f700 1 -- 10.1.0.217:6803/4928 <== osd.10 10.1.0.218:0/26512 22 ==== osd_ping(ping e770 stamp 2014-09-07 15:28:26.377981) v2 ==== 47+0+0 (704375965 0 0) 0x3bf0fc0 con 0xafee1a0 >> -15> 2014-09-07 15:28:58.925738 7f5ad228f700 1 -- 10.1.0.217:6803/4928 --> 10.1.0.218:0/26512 -- osd_ping(ping_reply e770 stamp 2014-09-07 15:28:26.377981) v2 -- ?+0 0x138d47c0 con 0xafee1a0 >> -14> 2014-09-07 15:28:58.925740 7f5ad3a92700 1 -- 10.1.0.217:6801/4928 <== osd.7 10.1.0.216:6806/11082 283 ==== osd_sub_op(mds.0.5:4596686 6.bb 3fd39dbb/10000326763.00000000/head//6 [] v 770'25576 snapset=0=[]:[] snapc=0=[]) v10 ==== 1295+0+39 (598905366 0 3511520646) 0xbaa8b00 con 0xaa41760 >> -13> 2014-09-07 15:28:58.925756 7f5ad3a92700 5 -- op tracker -- , seq: 1851, time: 2014-09-07 15:28:58.925679, event: header_read, request: osd_sub_op(mds.0.5:4596686 6.bb 3fd39dbb/10000326763.00000000/head//6 [] v 770'25576 snapset=0=[]:[] snapc=0=[]) v10 >> -12> 2014-09-07 15:28:58.925766 7f5ad3a92700 5 -- op tracker -- , seq: 1851, time: 2014-09-07 15:28:58.925681, event: throttled, request: osd_sub_op(mds.0.5:4596686 6.bb 3fd39dbb/10000326763.00000000/head//6 [] v 770'25576 snapset=0=[]:[] snapc=0=[]) v10 >> -11> 2014-09-07 15:28:58.925771 7f5ad3a92700 5 -- op tracker -- , seq: 1851, time: 2014-09-07 15:28:58.925727, event: all_read, request: osd_sub_op(mds.0.5:4596686 6.bb 3fd39dbb/10000326763.00000000/head//6 [] v 770'25576 snapset=0=[]:[] snapc=0=[]) v10 >> -10> 2014-09-07 15:28:58.925776 7f5ad3a92700 5 -- op tracker -- , seq: 1851, time: 2014-09-07 15:28:58.925754, event: dispatched, request: osd_sub_op(mds.0.5:4596686 6.bb 3fd39dbb/10000326763.00000000/head//6 [] v 770'25576 snapset=0=[]:[] snapc=0=[]) v10 >> -9> 2014-09-07 15:28:58.925782 7f5ad3a92700 5 -- op tracker -- , seq: 1851, time: 2014-09-07 15:28:58.925782, event: waiting_for_osdmap, request: osd_sub_op(mds.0.5:4596686 6.bb 3fd39dbb/10000326763.00000000/head//6 [] v 770'25576 snapset=0=[]:[] snapc=0=[]) v10 >> -8> 2014-09-07 15:28:58.926320 7f5ad128d700 1 -- 10.1.0.217:6802/4928 <== osd.10 10.1.0.218:0/26512 22 ==== osd_ping(ping e770 stamp 2014-09-07 15:28:26.377981) v2 ==== 47+0+0 (704375965 0 0) 0x3bf1180 con 0xafed960 >> -7> 2014-09-07 15:28:58.926341 7f5ad128d700 1 -- 10.1.0.217:6802/4928 --> 10.1.0.218:0/26512 -- osd_ping(ping_reply e770 stamp 2014-09-07 15:28:26.377981) v2 -- ?+0 0x3bf5940 con 0xafed960 >> -6> 2014-09-07 15:28:58.931258 7f5ad3a92700 1 -- 10.1.0.217:6801/4928 <== osd.13 10.1.0.219:6809/6216 186 ==== osd_sub_op(client.9699.1:3308993 6.49 4dcb5049/10000327fe4.00000000/head//6 [] v 770'51562 snapset=0=[]:[] snapc=0=[]) v10 ==== 1295+0+39 (1614676323 0 3511520646) 0xe892c00 con 0xaa440a0 >> -5> 2014-09-07 15:28:58.931288 7f5ad3a92700 5 -- op tracker -- , seq: 1852, time: 2014-09-07 15:28:58.931149, event: header_read, request: osd_sub_op(client.9699.1:3308993 6.49 4dcb5049/10000327fe4.00000000/head//6 [] v 770'51562 snapset=0=[]:[] snapc=0=[]) v10 >> -4> 2014-09-07 15:28:58.931305 7f5ad3a92700 5 -- op tracker -- , seq: 1852, time: 2014-09-07 15:28:58.931150, event: throttled, request: osd_sub_op(client.9699.1:3308993 6.49 4dcb5049/10000327fe4.00000000/head//6 [] v 770'51562 snapset=0=[]:[] snapc=0=[]) v10 >> -3> 2014-09-07 15:28:58.931310 7f5ad3a92700 5 -- op tracker -- , seq: 1852, time: 2014-09-07 15:28:58.931201, event: all_read, request: osd_sub_op(client.9699.1:3308993 6.49 4dcb5049/10000327fe4.00000000/head//6 [] v 770'51562 snapset=0=[]:[] snapc=0=[]) v10 >> -2> 2014-09-07 15:28:58.931316 7f5ad3a92700 5 -- op tracker -- , seq: 1852, time: 2014-09-07 15:28:58.931274, event: dispatched, request: osd_sub_op(client.9699.1:3308993 6.49 4dcb5049/10000327fe4.00000000/head//6 [] v 770'51562 snapset=0=[]:[] snapc=0=[]) v10 >> -1> 2014-09-07 15:28:58.931322 7f5ad3a92700 5 -- op tracker -- , seq: 1852, time: 2014-09-07 15:28:58.931322, event: waiting_for_osdmap, request: osd_sub_op(client.9699.1:3308993 6.49 4dcb5049/10000327fe4.00000000/head//6 [] v 770'51562 snapset=0=[]:[] snapc=0=[]) v10 >> 0> 2014-09-07 15:28:58.936633 7f5adb2de700 -1 *** Caught signal (Aborted) ** >> in thread 7f5adb2de700 >> >> ceph version 0.80.5 (38b73c67d375a2552d8ed67843c8a65c2c0feba6) >> 1: /usr/bin/ceph-osd() [0x9ae061] >> 2: (()+0xf710) [0x7f5ae78ba710] >> 3: (gsignal()+0x35) [0x7f5ae678c925] >> 4: (abort()+0x175) [0x7f5ae678e105] >> 5: (__gnu_cxx::__verbose_terminate_handler()+0x12d) [0x7f5ae7046a5d] >> 6: (()+0xbcbe6) [0x7f5ae7044be6] >> 7: (()+0xbcc13) [0x7f5ae7044c13] >> 8: (()+0xbcd0e) [0x7f5ae7044d0e] >> 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x7f2) [0xaef522] >> 10: (KeyValueStore::_do_transaction(ObjectStore::Transaction&, KeyValueStore::BufferTransaction&, SequencerPosition&, ThreadPool::TPHandle*)+0x86f) [0x75d3df] >> 11: (KeyValueStore::_do_transactions(std::list<ObjectStore::Transaction*, std::allocator<ObjectStore::Transaction*> >&, unsigned long, ThreadPool::TPHandle*)+0x16a) [0x75fc0a] >> 12: (KeyValueStore::_do_op(KeyValueStore::OpSequencer*, ThreadPool::TPHandle&)+0x18a) [0x75feaa] >> 13: (ThreadPool::worker(ThreadPool::WorkThread*)+0x551) [0xab8561] >> 14: (ThreadPool::WorkThread::entry()+0x10) [0xabb5a0] >> 15: (()+0x79d1) [0x7f5ae78b29d1] >> 16: (clone()+0x6d) [0x7f5ae6842b6d] >> NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> ________________________________________ >> ???: ceph-users [ceph-users-bounces at lists.ceph.com] ?? ??? [Derek at f-club.cn] >> ????: 2014?9?7? 12:33 >> ?: Haomai Wang >> Cc: ceph-devel; ceph-users >> ??: ??: ??: ceph osd unexpected error >> >> it happend this morning, i can not wait, so I remove and add osd again >> next time I will set debug level up when it happend again >> thanks very much >> ________________________________________ >> ???: Haomai Wang [haomaiwang at gmail.com] >> ????: 2014?9?7? 12:08 >> ?: ??? >> Cc: Somnath Roy; ceph-users; ceph-devel >> ??: Re: ??: ceph osd unexpected error >> >> Yes, if you still meet this error, please add >> "debug_keyvaluestore=20/20" to your config and catch the debug output >> >> On Sun, Sep 7, 2014 at 11:11 AM, ??? <Derek at f-club.cn> wrote: >>> I use latest version 0.80.6 >>> I am setting the limitation now, and watching? >>> >>> >>> ________________________________________ >>> ???: Somnath Roy [Somnath.Roy at sandisk.com] >>> ????: 2014?9?7? 1:12 >>> ?: Haomai Wang; ??? >>> Cc: ceph-users; ceph-devel >>> ??: RE: ceph osd unexpected error >>> >>> Have you set the open file descriptor limit in the OSD node ? >>> Try setting it like 'ulimit -n 65536" >>> >>> -----Original Message----- >>> From: ceph-devel-owner at vger.kernel.org [mailto:ceph-devel-owner at vger.kernel.org] On Behalf Of Haomai Wang >>> Sent: Saturday, September 06, 2014 7:44 AM >>> To: ??? >>> Cc: ceph-users; ceph-devel >>> Subject: Re: ceph osd unexpected error >>> >>> Hi, >>> >>> Could you give some more detail infos such as operation before occur errors? >>> >>> And what's your ceph version? >>> >>> On Fri, Sep 5, 2014 at 3:16 PM, ??? <Derek at f-club.cn> wrote: >>>> Dear CEPH , >>>> Urgent question, I met a "FAILED assert(0 == "unexpected error")" >>>> yesterday , Now i have not way to start this OSDS I have attached my >>>> logs in the attachment, and some ceph configurations as below >>>> >>>> >>>> osd_pool_default_pgp_num = 300 >>>> osd_pool_default_size = 2 >>>> osd_pool_default_min_size = 1 >>>> osd_pool_default_pg_num = 300 >>>> mon_host = 10.1.0.213,10.1.0.214 >>>> osd_crush_chooseleaf_type = 1 >>>> mds_cache_size = 500000 >>>> osd objectstore = keyvaluestore-dev >>>> >>>> >>>> >>>> Detailed error information : >>>> >>>> >>>> -13> 2014-09-05 15:07:35.279863 7f4d988b9700 2 waiting 51 > 50 ops >>>> || >>>> 11642907 > 104857600 >>>> -12> 2014-09-05 15:07:35.279899 7f4d978b7700 2 waiting 51 > 50 ops || >>>> 11642899 > 104857600 >>>> -11> 2014-09-05 15:07:35.279919 7f4d990ba700 2 waiting 51 > 50 ops || >>>> 11642901 > 104857600 >>>> -10> 2014-09-05 15:07:35.326803 7f4d9a8bd700 10 monclient: tick >>>> -9> 2014-09-05 15:07:35.326837 7f4d9a8bd700 10 monclient: >>>> _check_auth_rotating have uptodate secrets (they expire after >>>> 2014-09-05 >>>> 15:07:05.326835) >>>> -8> 2014-09-05 15:07:35.326871 7f4d9a8bd700 10 monclient: renew subs? (now: >>>> 2014-09-05 15:07:35.326871; renew after: 2014-09-05 15:10:02.464341) >>>> -- no >>>> -7> 2014-09-05 15:07:35.343657 7f4d978b7700 2 waiting 51 > 50 ops || >>>> 11044551 > 104857600 >>>> -6> 2014-09-05 15:07:35.343654 7f4e1ee72700 1 -- 10.1.0.221:6801/4013 >>>> -6> --> >>>> osd.12 10.1.0.219:6810/32654 -- pg_info(1 pgs e1267:0.f1) v4 -- ?+0 >>>> 0x18dcf000 >>>> -5> 2014-09-05 15:07:35.343680 7f4d990ba700 2 waiting 51 > 50 ops || >>>> 11044553 > 104857600 >>>> -4> 2014-09-05 15:07:35.343686 7f4d988b9700 2 waiting 51 > 50 ops || >>>> 11044579 > 104857600 >>>> -3> 2014-09-05 15:07:35.344875 7f4e1fe74700 0 error (22) Invalid >>>> -3> argument >>>> not handled on operation 9 (336.0.3, or op 3, counting from 0) >>>> -2> 2014-09-05 15:07:35.344902 7f4e1fe74700 0 unexpected error code >>>> -1> 2014-09-05 15:07:35.344903 7f4e1fe74700 0 transaction dump: >>>> { "ops": [ >>>> { "op_num": 0, >>>> "op_name": "remove", >>>> "collection": "0.a9_head", >>>> "oid": "4b0fea9\/1000053b885.00000000\/head\/\/0"}, >>>> { "op_num": 1, >>>> "op_name": "mkcoll", >>>> "collection": "0.a9_TEMP"}, >>>> { "op_num": 2, >>>> "op_name": "remove", >>>> "collection": "0.a9_TEMP", >>>> "oid": "4b0fea9\/1000053b885.00000000\/head\/\/0"}, >>>> { "op_num": 3, >>>> "op_name": "touch", >>>> "collection": "0.a9_head", >>>> "oid": "4b0fea9\/1000053b885.00000000\/head\/\/0"}, >>>> { "op_num": 4, >>>> "op_name": "omap_setheader", >>>> "collection": "0.a9_head", >>>> "oid": "4b0fea9\/1000053b885.00000000\/head\/\/0", >>>> "header_length": "0"}, >>>> { "op_num": 5, >>>> "op_name": "write", >>>> "collection": "0.a9_head", >>>> "oid": "4b0fea9\/1000053b885.00000000\/head\/\/0", >>>> "length": 1160, >>>> "offset": 0, >>>> "bufferlist length": 1160}, >>>> { "op_num": 6, >>>> "op_name": "omap_setkeys", >>>> "collection": "0.a9_head", >>>> "oid": "4b0fea9\/1000053b885.00000000\/head\/\/0", >>>> "attr_lens": {}}, >>>> { "op_num": 7, >>>> "op_name": "setattrs", >>>> "collection": "0.a9_head", >>>> "oid": "4b0fea9\/1000053b885.00000000\/head\/\/0", >>>> "attr_lens": { "_": 239, >>>> "_parent": 250, >>>> "snapset": 31}}, >>>> { "op_num": 8, >>>> "op_name": "omap_setkeys", >>>> "collection": "meta", >>>> "oid": "16ef7597\/infos\/head\/\/-1", >>>> "attr_lens": { "0.a9_epoch": 4, >>>> "0.a9_info": 684}}, >>>> { "op_num": 9, >>>> "op_name": "remove", >>>> "collection": "0.a9_head", >>>> "oid": "4c56f2a9\/10000c04096.00000000\/head\/\/0"}, >>>> { "op_num": 10, >>>> "op_name": "remove", >>>> "collection": "0.a9_TEMP", >>>> "oid": "4c56f2a9\/10000c04096.00000000\/head\/\/0"}, >>>> { "op_num": 11, >>>> "op_name": "touch", >>>> "collection": "0.a9_head", >>>> "oid": "4c56f2a9\/10000c04096.00000000\/head\/\/0"}, >>>> { "op_num": 12, >>>> "op_name": "omap_setheader", >>>> "collection": "0.a9_head", >>>> "oid": "4c56f2a9\/10000c04096.00000000\/head\/\/0", >>>> "header_length": "0"}, >>>> { "op_num": 13, >>>> "op_name": "write", >>>> "collection": "0.a9_head", >>>> "oid": "4c56f2a9\/10000c04096.00000000\/head\/\/0", >>>> "length": 507284, >>>> "offset": 0, >>>> "bufferlist length": 507284}, >>>> { "op_num": 14, >>>> "op_name": "omap_setkeys", >>>> "collection": "0.a9_head", >>>> "oid": "4c56f2a9\/10000c04096.00000000\/head\/\/0", >>>> "attr_lens": {}}, >>>> { "op_num": 15, >>>> "op_name": "setattrs", >>>> "collection": "0.a9_head", >>>> "oid": "4c56f2a9\/10000c04096.00000000\/head\/\/0", >>>> "attr_lens": { "_": 239, >>>> "snapset": 31}}, >>>> { "op_num": 16, >>>> "op_name": "omap_setkeys", >>>> "collection": "meta", >>>> "oid": "16ef7597\/infos\/head\/\/-1", >>>> "attr_lens": { "0.a9_epoch": 4, >>>> "0.a9_info": 684}}, >>>> { "op_num": 17, >>>> "op_name": "remove", >>>> "collection": "0.a9_head", >>>> "oid": "794064a9\/10000c040e0.00000000\/head\/\/0"}, >>>> { "op_num": 18, >>>> "op_name": "remove", >>>> "collection": "0.a9_TEMP", >>>> "oid": "794064a9\/10000c040e0.00000000\/head\/\/0"}, >>>> { "op_num": 19, >>>> "op_name": "touch", >>>> "collection": "0.a9_head", >>>> "oid": "794064a9\/10000c040e0.00000000\/head\/\/0"}, >>>> { "op_num": 20, >>>> "op_name": "omap_setheader", >>>> "collection": "0.a9_head", >>>> "oid": "794064a9\/10000c040e0.00000000\/head\/\/0", >>>> "header_length": "0"}, >>>> { "op_num": 21, >>>> "op_name": "write", >>>> "collection": "0.a9_head", >>>> "oid": "794064a9\/10000c040e0.00000000\/head\/\/0", >>>> "length": 3495, >>>> "offset": 0, >>>> "bufferlist length": 3495}, >>>> { "op_num": 22, >>>> "op_name": "omap_setkeys", >>>> "collection": "0.a9_head", >>>> "oid": "794064a9\/10000c040e0.00000000\/head\/\/0", >>>> "attr_lens": {}}, >>>> { "op_num": 23, >>>> "op_name": "setattrs", >>>> "collection": "0.a9_head", >>>> "oid": "794064a9\/10000c040e0.00000000\/head\/\/0", >>>> "attr_lens": { "_": 239, >>>> "snapset": 31}}, >>>> { "op_num": 24, >>>> "op_name": "omap_setkeys", >>>> "collection": "meta", >>>> "oid": "16ef7597\/infos\/head\/\/-1", >>>> "attr_lens": { "0.a9_epoch": 4, >>>> "0.a9_info": 684}}, >>>> { "op_num": 25, >>>> "op_name": "remove", >>>> "collection": "0.a9_head", >>>> "oid": "b4f73ea9\/10000c04209.00000000\/head\/\/0"}, >>>> { "op_num": 26, >>>> "op_name": "remove", >>>> "collection": "0.a9_TEMP", >>>> "oid": "b4f73ea9\/10000c04209.00000000\/head\/\/0"}, >>>> { "op_num": 27, >>>> "op_name": "touch", >>>> "collection": "0.a9_head", >>>> "oid": "b4f73ea9\/10000c04209.00000000\/head\/\/0"}, >>>> { "op_num": 28, >>>> "op_name": "omap_setheader", >>>> "collection": "0.a9_head", >>>> "oid": "b4f73ea9\/10000c04209.00000000\/head\/\/0", >>>> "header_length": "0"}, >>>> { "op_num": 29, >>>> "op_name": "write", >>>> "collection": "0.a9_head", >>>> "oid": "b4f73ea9\/10000c04209.00000000\/head\/\/0", >>>> "length": 21502, >>>> "offset": 0, >>>> "bufferlist length": 21502}, >>>> { "op_num": 30, >>>> "op_name": "omap_setkeys", >>>> "collection": "0.a9_head", >>>> "oid": "b4f73ea9\/10000c04209.00000000\/head\/\/0", >>>> "attr_lens": {}}, >>>> { "op_num": 31, >>>> "op_name": "setattrs", >>>> "collection": "0.a9_head", >>>> "oid": "b4f73ea9\/10000c04209.00000000\/head\/\/0", >>>> "attr_lens": { "_": 239, >>>> "snapset": 31}}, >>>> { "op_num": 32, >>>> "op_name": "omap_setkeys", >>>> "collection": "meta", >>>> "oid": "16ef7597\/infos\/head\/\/-1", >>>> "attr_lens": { "0.a9_epoch": 4, >>>> "0.a9_info": 684}}, >>>> { "op_num": 33, >>>> "op_name": "remove", >>>> "collection": "0.a9_head", >>>> "oid": "f6ea1ea9\/10000c04238.00000000\/head\/\/0"}, >>>> { "op_num": 34, >>>> "op_name": "remove", >>>> "collection": "0.a9_TEMP", >>>> "oid": "f6ea1ea9\/10000c04238.00000000\/head\/\/0"}, >>>> { "op_num": 35, >>>> "op_name": "touch", >>>> "collection": "0.a9_head", >>>> "oid": "f6ea1ea9\/10000c04238.00000000\/head\/\/0"}, >>>> { "op_num": 36, >>>> "op_name": "omap_setheader", >>>> "collection": "0.a9_head", >>>> "oid": "f6ea1ea9\/10000c04238.00000000\/head\/\/0", >>>> "header_length": "0"}, >>>> { "op_num": 37, >>>> "op_name": "write", >>>> "collection": "0.a9_head", >>>> "oid": "f6ea1ea9\/10000c04238.00000000\/head\/\/0", >>>> "length": 456155, >>>> "offset": 0, >>>> "bufferlist length": 456155}, >>>> { "op_num": 38, >>>> "op_name": "omap_setkeys", >>>> "collection": "0.a9_head", >>>> "oid": "f6ea1ea9\/10000c04238.00000000\/head\/\/0", >>>> "attr_lens": {}}, >>>> { "op_num": 39, >>>> "op_name": "setattrs", >>>> "collection": "0.a9_head", >>>> "oid": "f6ea1ea9\/10000c04238.00000000\/head\/\/0", >>>> "attr_lens": { "_": 239, >>>> "snapset": 31}}, >>>> { "op_num": 40, >>>> "op_name": "omap_setkeys", >>>> "collection": "meta", >>>> "oid": "16ef7597\/infos\/head\/\/-1", >>>> "attr_lens": { "0.a9_epoch": 4, >>>> "0.a9_info": 684}}]} >>>> 0> 2014-09-05 15:07:35.346659 7f4e1fe74700 -1 os/KeyValueStore.cc: In >>>> function 'unsigned int >>>> KeyValueStore::_do_transaction(ObjectStore::Transaction&, >>>> KeyValueStore::BufferTransaction&, SequencerPosition&, >>>> ThreadPool::TPHandle*)' thread 7f4e1fe74700 time 2014-09-05 >>>> 15:07:35.345273 >>>> os/KeyValueStore.cc: 1500: FAILED assert(0 == "unexpected error") >>>> >>>> >>>> _______________________________________________ >>>> ceph-users mailing list >>>> ceph-users at lists.ceph.com >>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>>> >>> >>> >>> >>> -- >>> Best Regards, >>> >>> Wheat >>> -- >>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo at vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html >>> >>> ________________________________ >>> >>> PLEASE NOTE: The information contained in this electronic mail message is intended only for the use of the designated recipient(s) named above. If the reader of this message is not the intended recipient, you are hereby notified that you have received this message in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify the sender by telephone or e-mail (as shown above) immediately and destroy any and all copies of this message in your possession (whether hard copies or electronically stored copies). >>> >> >> >> >> -- >> Best Regards, >> >> Wheat >> _______________________________________________ >> ceph-users mailing list >> ceph-users at lists.ceph.com >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > > > -- > Best Regards, > > Wheat -- Best Regards, Wheat