Re: jbod + SMART : how to identify failing disks ?

Cedric Lemarchand <cedric@xxxxxxxxxxx> · Tue, 18 Nov 2014 00:23:52 +0100



    Sorry, I forgot to say that in "Slot X/device/block" you could find
    the device name, like "sdc".

    
    Cheers

    
    Le 18/11/2014 00:15, Cedric Lemarchand
      a écrit :

    
      Hi,

      
      Try looking for file "locate" in a folder named "Slot X" where X
      in the number of the slot, then echoing 1 in the "locate" file
      will make the led blink. :

      
      # find /sys -name "locate"  |grep Slot

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      01/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      02/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      03/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      04/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      05/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      06/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      07/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      08/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      09/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      10/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      11/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      12/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      13/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      14/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      15/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      16/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      17/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      18/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      19/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      20/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      21/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      22/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      23/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      24/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      25/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      26/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      27/locate

      /sys/devices/pci0000:00/0000:00:03.0/0000:06:00.0/host6/port-6:0/expander-6:0/port-6:0:28/end_device-6:0:28/target6:0:28/6:0:28:0/enclosure/6:0:28:0/Slot

      28/locate

      
      LSI 9200-8e with a Supermicro JBOD 28 slots, Ubuntu 12.04, 3.13
      kernel.

      
      Cheers

      
      Le 12/11/2014 14:05, SCHAER Frederic
        a écrit :

      
          Hi,
           
          I’m used to RAID
              software giving me the failing disks  slots, and most
              often blinking the disks on the disk bays.
          I recently installed a
               DELL “6GB HBA SAS” JBOD card, said to be an LSI 2008 one,
              and I now have to identify 3 pre-failed disks (so says
              S.M.A.R.T) .
           
          Since this is an LSI,
              I thought I’d use MegaCli to identify the disks slot, but
              MegaCli does not see the HBA card.
          Then I found the LSI
              “sas2ircu” utility, but again, this one fails at giving me
              the disk slots (it finds the disks, serials and others,
              but slot is always 0)
          Because of this, I’m
              going to head over to the disk bay and unplug the disk
              which I think corresponds to the alphabetical order in
              linux, and see if it’s the correct one…. But even if this
              is correct this time, it might not be next time.
           
          But this makes me
              wonder : how do you guys, Ceph users, manage your disks if
              you really have JBOD servers ?
          I can’t imagine having
              to guess slots that each time, and I can’t imagine neither
              creating serial number stickers for every single disk I
              could have to manage … 
          Is there any specific
              advice reguarding JBOD cards people should (not) use in
              their systems ?
          Any magical way to
              “blink” a drive in linux ?
           
          Thanks &&
              regards
        
        
        _______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

      
      -- 
Cédric
      

      _______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

    
    -- 
Cédric
  

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com