I doubt the tcmalloc trace will go away permanently with the env variable set. Depending on your workload it may come back. Giving more memory as a thread cache will definitely help. BTW, in case of any confusion, the patch was to make the env variable in effect (and alleviate the traces) not to resolve the traces. Thanks & Regards Somnath -----Original Message----- From: Milosz Tanski [mailto:milosz@xxxxxxxxx] Sent: Monday, April 27, 2015 7:53 AM To: Alexandre DERUMIER; ceph-devel; Somnath Roy Subject: Re: Hitting tcmalloc bug even with patch applied On 4/27/15 9:21 AM, Alexandre DERUMIER wrote: > Seem that starting osd with: > > TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES=128M /usr/bin/ceph-osd > > fix it. > > I don't known if it's the right way ? Do you know what the default is if you don't specify it? > > > > ----- Mail original ----- > De: "aderumier" <aderumier@xxxxxxxxx> > À: "ceph-devel" <ceph-devel@xxxxxxxxxxxxxxx>, "Somnath Roy" > <somnath.roy@xxxxxxxxxxx> > Envoyé: Lundi 27 Avril 2015 14:06:22 > Objet: Hitting tcmalloc bug even with patch applied > > Hi, > > I'm hitting the tcmalloc even with patch apply. > It's mainly occur when I try to bench fio with a lot jobs (20 - 40 > jobs) > > Does It need to tuned something in osd environnement variable ? > > > I double check it with > > #g++ -o gperftest gperftest.c -ltcmalloc # export > TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES=67108864 > # ./gperftest > Tcmalloc OK! Internal and Env cache size are same:67108864 > > > perf top > ------- > 10.04% libtcmalloc.so.4.1.2 [.] > tcmalloc::ThreadCache::ReleaseToCentralCache > 8.19% libtcmalloc.so.4.1.2 [.] > tcmalloc::CentralFreeList::FetchFromSpans > 3.89% libtcmalloc.so.4.1.2 [.] > tcmalloc::CentralFreeList::ReleaseToSpans > 2.04% libtcmalloc.so.4.1.2 [.] > tcmalloc::CentralFreeList::ReleaseListToSpans > 1.79% libtcmalloc.so.4.1.2 [.] operator new 1.25% ceph-osd [.] > ConfFile::load_from_buffer 1.21% libtcmalloc.so.4.1.2 [.] operator > delete 1.14% [kernel] [k] _raw_spin_lock 1.08% libstdc++.so.6.0.19 [.] > std::basic_string<char, std::char_traits<char>, std::allocator<char> > >::basic_string 1.04% [kernel] [k] __schedule 1.00% libpthread-2.17.so > [.] pthread_mutex_trylock 0.90% [kernel] [k] native_write_msr_safe > 0.89% [kernel] [k] __switch_to 0.79% [kernel] [k] > _raw_spin_lock_irqsave 0.73% [kernel] [k] > copy_user_enhanced_fast_string > > > > Regards, > > Alexandre ________________________________ PLEASE NOTE: The information contained in this electronic mail message is intended only for the use of the designated recipient(s) named above. If the reader of this message is not the intended recipient, you are hereby notified that you have received this message in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify the sender by telephone or e-mail (as shown above) immediately and destroy any and all copies of this message in your possession (whether hard copies or electronically stored copies). -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
