Re: OSD up takes 15 minutes after machine restarts

Igor Fedotov <ifedotov@xxxxxxx> · Sun, 19 Jan 2020 13:41:03 +0300



    Hi Samuel,
    

    wondering if you have bluestore_fsck_on_mount option set to true?
      Can you see high read load over OSD device(s) during the startup?

    
    If so it might be fsck running which takes that long. 

    
    Thanks,
    Igor

    
    On 1/19/2020 11:53 AM,
      huxiaoyu@xxxxxxxxxxxx wrote:

    
      Dear folks,
      

      I had a strange situation with 3-node Ceph cluster on
        Luminous 12.2.12 with bluestore. Each machine has 5 OSDs on HDD,
        and each OSD uses a 30GB DB/WAL partition on SSD. At the
        beginning without much data, OSDs can quickly up if one node
        restarts. 
      

      Then I ran 4-day long stress tests with vdbench, and then I
        restarts one node, and to my surprise, OSDs on that node takes
        ca 15 minutes to turn into up state. How can i speed up the OSD
        UP process ?
      

      thanks,
      

      Samuel
      

            huxiaoyu@xxxxxxxxxxxx
          
        
      _______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

    
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com