Has anyone attempted to use gdbpmp since 14.2.6 to grab data? I have not been able to successfully do it on my clusters. It has just been hanging at attaching to process. If you have been able to, would you be available for a discussion regarding your configuration? Thanks, Joe Bardgett Storage Operations jbardgett@xxxxxxxxxxx Cell - 480-221-7337 Office - 602-420-4403 This email message and any attachments hereto is intended for use only by the addressee(s) named herein and may contain legally privileged and/or confidential information. If you have received this email in error, please immediately notify the sender and permanently delete the original and any copy of this message and its attachments. -----Original Message----- From: Neha Ojha <nojha@xxxxxxxxxx> Sent: Wednesday, January 29, 2020 12:29 PM To: Joe Bardgett <jbardgett@xxxxxxxxxxx> Cc: ceph-users@xxxxxxx Subject: Re: Re: High CPU usage by ceph-mgr in 14.2.6 Notice: This email is from an external sender. Hi Joe, Can you grab a wallclock profiler dump from the mgr process and share it with us? This was useful for us to get to the root cause of the issue in 14.2.5. Quoting Mark's suggestion from " High CPU usage by ceph-mgr in 14.2.5" below. If you can get a wallclock profiler on the mgr process we might be able to figure out specifics of what's taking so much time (ie processing pg_summary or something else). Assuming you have gdb with the python bindings and the ceph debug packages installed, if you (are anyone) could try gdbpmp on the 100% mgr process that would be fantastic. https://github.com/markhpc/gdbpmp gdbpmp.py -p`pidof ceph-mgr` -n 1000 -o mgr.gdbpmp If you want to view the results: gdbpmp.py -i mgr.gdbpmp -t 1 Thanks, Neha On Wed, Jan 29, 2020 at 7:35 AM <jbardgett@xxxxxxxxxxx> wrote: > > Modules that are normally enabled: > > ceph mgr module ls | jq -r '.enabled_modules' > [ > "dashboard", > "prometheus", > "restful" > ] > > We did test with all modules disabled, restarted the mgrs and saw no difference. > > Joe > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an > email to ceph-users-leave@xxxxxxx > _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |