Re: OSDs not starting up

["Stephen J. Thompson" <stephen@xxxxxxxxxxxxxxxxxxxxx>]

Hello all,

I am still digging into this.  I disabled this osd from starting at boot, then 
rebooted the node.

I then tried doing the following:

sudo cephadm shell

And the following was the result. To me it seems to indicate that the OSD 
drive is ok and can be decrypted but does still not run.

Inferring fsid d82ced8c-1f6e-11ec-a2e4-00fd45fcaf9c
Using recent ceph image quay.io/ceph/
ceph@sha256:285d2abb6e74bdc6e15e1af585aa19f132045651b7a80eb77b9cec8a785ff330
root@cephnode02:/# ceph-volume lvm activate 0 
2f5d17d3-3308-4f42-867c-7ec8639bde18
Running command: /usr/bin/mount -t tmpfs tmpfs /var/lib/ceph/osd/ceph-0
Running command: /usr/bin/ceph-authtool /var/lib/ceph/osd/ceph-0/
lockbox.keyring --create-keyring --name client.osd-lockbox.
2f5d17d3-3308-4f42-867c-7ec8639bde18 --add-key AQDNzFFh11ooIRAAru8xYXAXL1/n/
75AOJm2KA==
 stdout: creating /var/lib/ceph/osd/ceph-0/lockbox.keyring
added entity client.osd-lockbox.2f5d17d3-3308-4f42-867c-7ec8639bde18 
auth(key=AQDNzFFh11ooIRAAru8xYXAXL1/n/75AOJm2KA==)
Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0/
lockbox.keyring
Running command: /usr/bin/ceph --cluster ceph --name client.osd-lockbox.
2f5d17d3-3308-4f42-867c-7ec8639bde18 --keyring /var/lib/ceph/osd/ceph-0/
lockbox.keyring config-key get dm-crypt/osd/
2f5d17d3-3308-4f42-867c-7ec8639bde18/luks
Running command: /usr/sbin/cryptsetup --key-file - --allow-discards luksOpen /
dev/ceph-779b00ee-dbb5-4542-859c-b6338b01efe0/osd-
block-2f5d17d3-3308-4f42-867c-7ec8639bde18 6oP2t6-fuMx-25XU-KiIt-A28Q-fzng-
K7ouf6
Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0
Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --
dev /dev/mapper/6oP2t6-fuMx-25XU-KiIt-A28Q-fzng-K7ouf6 --path /var/lib/ceph/
osd/ceph-0 --no-mon-config
Running command: /usr/bin/ln -snf /dev/mapper/6oP2t6-fuMx-25XU-KiIt-A28Q-fzng-
K7ouf6 /var/lib/ceph/osd/ceph-0/block
Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block
Running command: /usr/bin/chown -R ceph:ceph /dev/dm-7
Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0
Running command: /usr/bin/systemctl enable ceph-
volume@lvm-0-2f5d17d3-3308-4f42-867c-7ec8639bde18
 stderr: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-
volume@lvm-0-2f5d17d3-3308-4f42-867c-7ec8639bde18.service -> /usr/lib/systemd/
system/ceph-volume@.service.
Running command: /usr/bin/systemctl enable --runtime ceph-osd@0
 stderr: Created symlink /run/systemd/system/ceph-osd.target.wants/ceph-
osd@0.service -> /usr/lib/systemd/system/ceph-osd@.service.
Running command: /usr/bin/systemctl start ceph-osd@0
 stderr: Failed to connect to bus: No such file or directory
-->  RuntimeError: command returned non-zero exit status: 1

Any ideas?

Thanks, 

Stephen



On Friday, 12 November 2021 21:32:41 GMT Stephen J. Thompson wrote:
> Hello Igor,
> 
> The OSD logs a empty.
> 
> Enclosed is the end of the ceph-volume.log
> 
> Regards,
> 
> Stephen
> 
> [2021-11-12 21:23:54,191][ceph_volume.main][INFO  ] Running command: ceph-
> volume  inventory --format=json --filter-for-batch
> [2021-11-12 21:23:54,194][ceph_volume.process][INFO  ] Running command:
> /usr/ bin/lsblk -plno KNAME,NAME,TYPE
> [2021-11-12 21:23:54,202][ceph_volume.process][INFO  ] stdout /dev/sda 
> /dev/ sda
> disk
> [2021-11-12 21:23:54,202][ceph_volume.process][INFO  ] stdout /dev/sdb 
> /dev/ sdb
> disk
> [2021-11-12 21:23:54,202][ceph_volume.process][INFO  ] stdout /dev/sdc 
> /dev/ sdc
> disk
> [2021-11-12 21:23:54,203][ceph_volume.process][INFO  ] stdout /dev/sdd 
> /dev/ sdd
> disk
> [2021-11-12 21:23:54,203][ceph_volume.process][INFO  ] stdout /dev/sdd1
> /dev/ sdd1
> part
> [2021-11-12 21:23:54,203][ceph_volume.process][INFO  ] stdout /dev/sdd2
> /dev/ sdd2
> part
> [2021-11-12 21:23:54,203][ceph_volume.process][INFO  ] stdout /dev/sdd5
> /dev/ sdd5
> part
> [2021-11-12 21:23:54,203][ceph_volume.process][INFO  ] stdout /dev/dm-0
> /dev/ mapper/ceph--779b00ee--dbb5--4542--859c--b6338b01efe0-osd--
> block--2f5d17d3--3308--4f42--867c--7ec8639bde18 lvm
> [2021-11-12 21:23:54,203][ceph_volume.process][INFO  ] stdout /dev/dm-1
> /dev/ mapper/ceph--41cbaf58--d703--4bae--9095--f1b590b8337b-osd--
> block--99e1e1b2--3cfe--48e0--8627--acfe5008c1c5 lvm
> [2021-11-12 21:23:54,203][ceph_volume.process][INFO  ] stdout /dev/dm-2
> /dev/ mapper/ceph--09c84540--06e3--496f--bf90--45f59748768a-osd--
> block--60ad9fb3--8144--4d06--83e6--b90e9d52dcaa lvm
> [2021-11-12 21:23:54,203][ceph_volume.process][INFO  ] stdout /dev/dm-3
> /dev/ mapper/sda5_crypt
> crypt
> [2021-11-12 21:23:54,203][ceph_volume.process][INFO  ] stdout /dev/dm-4
> /dev/ mapper/cephnode02--vg-root
> lvm
> [2021-11-12 21:23:54,203][ceph_volume.process][INFO  ] stdout /dev/dm-5
> /dev/ mapper/cephnode02--vg-swap_1
> lvm
> [2021-11-12 21:23:54,203][ceph_volume.process][INFO  ] stdout /dev/dm-6
> /dev/ mapper/fwR6Nz-3DbF-Ac2K-jhVp-DtsV-A1mt-VMUefw
> crypt
> [2021-11-12 21:23:54,210][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/lvs --noheadings --readonly --separator=";" -a --units=b
> --nosuffix -S lv_path=/dev/sda -o
> lv_tags,lv_path,lv_name,vg_name,lv_uuid,lv_size [2021-11-12
> 21:23:54,910][ceph_volume.process][INFO  ] Running command: /usr/ bin/lsblk
> --nodeps -P -o
> NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER
> ,GROUP,MODE,ALIGNMENT,PHY-
> SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-
> ZERO,PKNAME,PARTLABEL /dev/sda
> [2021-11-12 21:23:54,917][ceph_volume.process][INFO  ] stdout NAME="sda"
> KNAME="sda" MAJ:MIN="8:0" FSTYPE="LVM2_member" MOUNTPOINT="" LABEL=""
> UUID="G9naIi-2sgq-FznV-3a5U-8VH6-0G9C-HRQvGf" RO="0" RM="0" MODEL="TOSHIBA
> HDWN180 " SIZE="7.3T" STATE="running" OWNER="root" GROUP="disk" MODE="brw-
> rw----" ALIGNMENT="0" PHY-SEC="4096" LOG-SEC="512" ROTA="1" SCHED="mq-
> deadline" TYPE="disk" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B"
> DISC-ZERO="0" PKNAME="" PARTLABEL=""
> [2021-11-12 21:23:54,918][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/blkid -c /dev/null -p /dev/sda
> [2021-11-12 21:23:54,922][ceph_volume.process][INFO  ] stdout /dev/sda:
> UUID="G9naIi-2sgq-FznV-3a5U-8VH6-0G9C-HRQvGf" VERSION="LVM2 001"
> TYPE="LVM2_member" USAGE="raid"
> [2021-11-12 21:23:54,923][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/pvs --noheadings --readonly --units=b --nosuffix --separator=";"
> -o
> vg_name,pv_count,lv_count,vg_attr,vg_extent_count,vg_free_count,vg_extent_s
> ize /dev/sda
> [2021-11-12 21:23:54,978][ceph_volume.process][INFO  ] stdout ceph-779b00ee-
> dbb5-4542-859c-b6338b01efe0";"1";"1";"wz--n-";"1907721";"0";"4194304
> [2021-11-12 21:23:54,979][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/pvs --noheadings --readonly --separator=";" -a --units=b
> --nosuffix -o lv_tags,lv_path,lv_name,vg_name,lv_uuid,lv_size /dev/sda
> [2021-11-12 21:23:55,118][ceph_volume.process][INFO  ] stdout
> ceph.block_device=/dev/ceph-779b00ee-dbb5-4542-859c-b6338b01efe0/osd-
> block-2f5d17d3-3308-4f42-867c-7ec8639bde18,ceph.block_uuid=6oP2t6-fuMx-25XU-
> KiIt-A28Q-fzng-K7ouf6,ceph.cephx_lockbox_secret=AQDNzFFh11ooIRAAru8xYXAXL1/
> n/ 75AOJm2KA==,ceph.cluster_fsid=d82ced8c-1f6e-11ec-
> a2e4-00fd45fcaf9c,ceph.cluster_name=ceph,ceph.crush_device_class=None,ceph.e
> ncrypted=1,ceph.osd_fsid=2f5d17d3-3308-4f42-867c-7ec8639bde18,ceph.osd_id=0,
> ceph.osdspec_affinity=default_drive_group,ceph.type=block,ceph.vdo=0";"/
> dev/ceph-779b00ee-dbb5-4542-859c-b6338b01efe0/osd-
> block-2f5d17d3-3308-4f42-867c-7ec8639bde18";"osd-
> block-2f5d17d3-3308-4f42-867c-7ec8639bde18";"ceph-779b00ee-dbb5-4542-859c-
> b6338b01efe0";"6oP2t6-fuMx-25XU-KiIt-A28Q-fzng-K7ouf6";"8001561821184
> [2021-11-12 21:23:55,119][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sda to check for BlueStore label
> [2021-11-12 21:23:55,119][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/udevadm info --query=property /dev/sda
> [2021-11-12 21:23:55,131][ceph_volume.process][INFO  ] stdout DEVLINKS=/dev/
> disk/by-path/pci-0000:00:1f.2-ata-1.0
> /dev/disk/by-id/wwn-0x500003998c8012f6 /
> dev/disk/by-id/ata-TOSHIBA_HDWN180_99RZK0PIFAVG /dev/disk/by-path/
> pci-0000:00:1f.2-ata-1 /dev/disk/by-id/lvm-pv-uuid-G9naIi-2sgq-
> FznV-3a5U-8VH6-0G9C-HRQvGf
> [2021-11-12 21:23:55,131][ceph_volume.process][INFO  ] stdout
> DEVNAME=/dev/sda [2021-11-12 21:23:55,131][ceph_volume.process][INFO  ]
> stdout DEVPATH=/
> devices/pci0000:00/0000:00:1f.2/ata1/host0/target0:0:0/0:0:0:0/block/sda
> [2021-11-12 21:23:55,132][ceph_volume.process][INFO  ] stdout DEVTYPE=disk
> [2021-11-12 21:23:55,132][ceph_volume.process][INFO  ] stdout ID_ATA=1
> [2021-11-12 21:23:55,132][ceph_volume.process][INFO  ] stdout
> ID_ATA_DOWNLOAD_MICROCODE=1
> [2021-11-12 21:23:55,132][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM=1
> [2021-11-12 21:23:55,132][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM_CURRENT_VALUE=128
> [2021-11-12 21:23:55,132][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM_ENABLED=1
> [2021-11-12 21:23:55,132][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_HPA=1
> [2021-11-12 21:23:55,132][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_HPA_ENABLED=1
> [2021-11-12 21:23:55,132][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PM=1
> [2021-11-12 21:23:55,132][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PM_ENABLED=1
> [2021-11-12 21:23:55,132][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY=1
> [2021-11-12 21:23:55,133][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ENABLED=0
> [2021-11-12 21:23:55,133][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ENHANCED_ERASE_UNIT_MIN=66362
> [2021-11-12 21:23:55,133][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ERASE_UNIT_MIN=66362
> [2021-11-12 21:23:55,133][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SMART=1
> [2021-11-12 21:23:55,133][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SMART_ENABLED=1
> [2021-11-12 21:23:55,133][ceph_volume.process][INFO  ] stdout
> ID_ATA_ROTATION_RATE_RPM=7200
> [2021-11-12 21:23:55,133][ceph_volume.process][INFO  ] stdout ID_ATA_SATA=1
> [2021-11-12 21:23:55,133][ceph_volume.process][INFO  ] stdout
> ID_ATA_SATA_SIGNAL_RATE_GEN1=1
> [2021-11-12 21:23:55,133][ceph_volume.process][INFO  ] stdout
> ID_ATA_SATA_SIGNAL_RATE_GEN2=1
> [2021-11-12 21:23:55,133][ceph_volume.process][INFO  ] stdout
> ID_ATA_WRITE_CACHE=1
> [2021-11-12 21:23:55,133][ceph_volume.process][INFO  ] stdout
> ID_ATA_WRITE_CACHE_ENABLED=1
> [2021-11-12 21:23:55,134][ceph_volume.process][INFO  ] stdout ID_BUS=ata
> [2021-11-12 21:23:55,134][ceph_volume.process][INFO  ] stdout
> ID_FS_TYPE=LVM2_member
> [2021-11-12 21:23:55,134][ceph_volume.process][INFO  ] stdout
> ID_FS_USAGE=raid [2021-11-12 21:23:55,134][ceph_volume.process][INFO  ]
> stdout
> ID_FS_UUID=G9naIi-2sgq-FznV-3a5U-8VH6-0G9C-HRQvGf
> [2021-11-12 21:23:55,134][ceph_volume.process][INFO  ] stdout
> ID_FS_UUID_ENC=G9naIi-2sgq-FznV-3a5U-8VH6-0G9C-HRQvGf
> [2021-11-12 21:23:55,134][ceph_volume.process][INFO  ] stdout
> ID_FS_VERSION=LVM2 001
> [2021-11-12 21:23:55,134][ceph_volume.process][INFO  ] stdout
> ID_MODEL=TOSHIBA_HDWN180
> [2021-11-12 21:23:55,134][ceph_volume.process][INFO  ] stdout
> ID_MODEL_ENC=TOSHIBA\x20HDWN180\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\
> x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20 [2021-11-12
> 21:23:55,134][ceph_volume.process][INFO  ] stdout
> ID_PATH=pci-0000:00:1f.2-ata-1.0
> [2021-11-12 21:23:55,134][ceph_volume.process][INFO  ] stdout
> ID_PATH_ATA_COMPAT=pci-0000:00:1f.2-ata-1
> [2021-11-12 21:23:55,134][ceph_volume.process][INFO  ] stdout
> ID_PATH_TAG=pci-0000_00_1f_2-ata-1_0
> [2021-11-12 21:23:55,134][ceph_volume.process][INFO  ] stdout
> ID_REVISION=GX2M [2021-11-12 21:23:55,135][ceph_volume.process][INFO  ]
> stdout
> ID_SERIAL=TOSHIBA_HDWN180_99RZK0PIFAVG
> [2021-11-12 21:23:55,135][ceph_volume.process][INFO  ] stdout
> ID_SERIAL_SHORT=99RZK0PIFAVG
> [2021-11-12 21:23:55,135][ceph_volume.process][INFO  ] stdout ID_TYPE=disk
> [2021-11-12 21:23:55,135][ceph_volume.process][INFO  ] stdout
> ID_WWN=0x500003998c8012f6
> [2021-11-12 21:23:55,135][ceph_volume.process][INFO  ] stdout
> ID_WWN_WITH_EXTENSION=0x500003998c8012f6
> [2021-11-12 21:23:55,135][ceph_volume.process][INFO  ] stdout MAJOR=8
> [2021-11-12 21:23:55,135][ceph_volume.process][INFO  ] stdout MINOR=0
> [2021-11-12 21:23:55,135][ceph_volume.process][INFO  ] stdout
> SUBSYSTEM=block [2021-11-12 21:23:55,135][ceph_volume.process][INFO  ]
> stdout SYSTEMD_ALIAS=/ dev/block/8:0
> [2021-11-12 21:23:55,135][ceph_volume.process][INFO  ] stdout
> SYSTEMD_READY=1 [2021-11-12 21:23:55,135][ceph_volume.process][INFO  ]
> stdout
> SYSTEMD_WANTS=lvm2-pvscan@8:0.service
> [2021-11-12 21:23:55,135][ceph_volume.process][INFO  ] stdout TAGS=:systemd:
> [2021-11-12 21:23:55,136][ceph_volume.process][INFO  ] stdout
> USEC_INITIALIZED=4467643
> [2021-11-12 21:23:55,136][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/lvs --noheadings --readonly --separator=";" -a --units=b
> --nosuffix -S lv_path=/dev/sdb -o
> lv_tags,lv_path,lv_name,vg_name,lv_uuid,lv_size [2021-11-12
> 21:23:55,198][ceph_volume.process][INFO  ] Running command: /usr/ bin/lsblk
> --nodeps -P -o
> NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER
> ,GROUP,MODE,ALIGNMENT,PHY-
> SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-
> ZERO,PKNAME,PARTLABEL /dev/sdb
> [2021-11-12 21:23:55,205][ceph_volume.process][INFO  ] stdout NAME="sdb"
> KNAME="sdb" MAJ:MIN="8:16" FSTYPE="LVM2_member" MOUNTPOINT="" LABEL=""
> UUID="SOElW1-Wjj1-TV8Q-TKsa-eRBG-gzGr-aCsNdu" RO="0" RM="0" MODEL="WDC
> WD30EFRX-68E" SIZE="2.7T" STATE="running" OWNER="root" GROUP="disk"
> MODE="brw- rw----" ALIGNMENT="0" PHY-SEC="4096" LOG-SEC="512" ROTA="1"
> SCHED="mq- deadline" TYPE="disk" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B"
> DISC-ZERO="0" PKNAME="" PARTLABEL=""
> [2021-11-12 21:23:55,205][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/blkid -c /dev/null -p /dev/sdb
> [2021-11-12 21:23:55,209][ceph_volume.process][INFO  ] stdout /dev/sdb:
> UUID="SOElW1-Wjj1-TV8Q-TKsa-eRBG-gzGr-aCsNdu" VERSION="LVM2 001"
> TYPE="LVM2_member" USAGE="raid"
> [2021-11-12 21:23:55,209][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/pvs --noheadings --readonly --units=b --nosuffix --separator=";"
> -o
> vg_name,pv_count,lv_count,vg_attr,vg_extent_count,vg_free_count,vg_extent_s
> ize /dev/sdb
> [2021-11-12 21:23:55,266][ceph_volume.process][INFO  ] stdout ceph-41cbaf58-
> d703-4bae-9095-f1b590b8337b";"1";"1";"wz--n-";"715396";"0";"4194304
> [2021-11-12 21:23:55,267][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/pvs --noheadings --readonly --separator=";" -a --units=b
> --nosuffix -o lv_tags,lv_path,lv_name,vg_name,lv_uuid,lv_size /dev/sdb
> [2021-11-12 21:23:55,338][ceph_volume.process][INFO  ] stdout
> ceph.block_device=/dev/ceph-41cbaf58-d703-4bae-9095-f1b590b8337b/osd-
> block-99e1e1b2-3cfe-48e0-8627-acfe5008c1c5,ceph.block_uuid=fwR6Nz-3DbF-Ac2K-
> jhVp-DtsV-A1mt-VMUefw,ceph.cephx_lockbox_secret=AQAyQ45hPpzqDxAAx2vyba/
> tTeQmZl1Sllh8Mg==,ceph.cluster_fsid=d82ced8c-1f6e-11ec-
> a2e4-00fd45fcaf9c,ceph.cluster_name=ceph,ceph.crush_device_class=None,ceph.e
> ncrypted=1,ceph.osd_fsid=99e1e1b2-3cfe-48e0-8627-
> acfe5008c1c5,ceph.osd_id=13,ceph.osdspec_affinity=default_drive_group,ceph.
> type=block,ceph.vdo=0";"/ dev/ceph-41cbaf58-d703-4bae-9095-f1b590b8337b/osd-
> block-99e1e1b2-3cfe-48e0-8627-acfe5008c1c5";"osd-
> block-99e1e1b2-3cfe-48e0-8627-acfe5008c1c5";"ceph-41cbaf58-d703-4bae-9095-
> f1b590b8337b";"fwR6Nz-3DbF-Ac2K-jhVp-DtsV-A1mt-VMUefw";"3000588304384
> [2021-11-12 21:23:55,339][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdb to check for BlueStore label
> [2021-11-12 21:23:55,339][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/udevadm info --query=property /dev/sdb
> [2021-11-12 21:23:55,351][ceph_volume.process][INFO  ] stdout DEVLINKS=/dev/
> disk/by-id/lvm-pv-uuid-SOElW1-Wjj1-TV8Q-TKsa-eRBG-gzGr-aCsNdu
> /dev/disk/by-id/ ata-WDC_WD30EFRX-68EUZN0_WD-WCC4N99Z68Y4 /dev/disk/by-id/
> wwn-0x50014ee20a61fcc0 /dev/disk/by-path/pci-0000:00:1f.2-ata-3
> /dev/disk/by- path/pci-0000:00:1f.2-ata-3.0
> [2021-11-12 21:23:55,351][ceph_volume.process][INFO  ] stdout
> DEVNAME=/dev/sdb [2021-11-12 21:23:55,352][ceph_volume.process][INFO  ]
> stdout DEVPATH=/
> devices/pci0000:00/0000:00:1f.2/ata3/host2/target2:0:0/2:0:0:0/block/sdb
> [2021-11-12 21:23:55,352][ceph_volume.process][INFO  ] stdout DEVTYPE=disk
> [2021-11-12 21:23:55,352][ceph_volume.process][INFO  ] stdout ID_ATA=1
> [2021-11-12 21:23:55,352][ceph_volume.process][INFO  ] stdout
> ID_ATA_DOWNLOAD_MICROCODE=1
> [2021-11-12 21:23:55,352][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_HPA=1
> [2021-11-12 21:23:55,352][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_HPA_ENABLED=1
> [2021-11-12 21:23:55,352][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PM=1
> [2021-11-12 21:23:55,352][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PM_ENABLED=1
> [2021-11-12 21:23:55,352][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PUIS=1
> [2021-11-12 21:23:55,352][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PUIS_ENABLED=0
> [2021-11-12 21:23:55,352][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY=1
> [2021-11-12 21:23:55,353][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ENABLED=0
> [2021-11-12 21:23:55,353][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ENHANCED_ERASE_UNIT_MIN=420
> [2021-11-12 21:23:55,353][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ERASE_UNIT_MIN=420
> [2021-11-12 21:23:55,353][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SMART=1
> [2021-11-12 21:23:55,353][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SMART_ENABLED=1
> [2021-11-12 21:23:55,353][ceph_volume.process][INFO  ] stdout
> ID_ATA_ROTATION_RATE_RPM=5400
> [2021-11-12 21:23:55,353][ceph_volume.process][INFO  ] stdout ID_ATA_SATA=1
> [2021-11-12 21:23:55,353][ceph_volume.process][INFO  ] stdout
> ID_ATA_SATA_SIGNAL_RATE_GEN1=1
> [2021-11-12 21:23:55,353][ceph_volume.process][INFO  ] stdout
> ID_ATA_SATA_SIGNAL_RATE_GEN2=1
> [2021-11-12 21:23:55,353][ceph_volume.process][INFO  ] stdout
> ID_ATA_WRITE_CACHE=1
> [2021-11-12 21:23:55,353][ceph_volume.process][INFO  ] stdout
> ID_ATA_WRITE_CACHE_ENABLED=1
> [2021-11-12 21:23:55,354][ceph_volume.process][INFO  ] stdout ID_BUS=ata
> [2021-11-12 21:23:55,354][ceph_volume.process][INFO  ] stdout
> ID_FS_TYPE=LVM2_member
> [2021-11-12 21:23:55,354][ceph_volume.process][INFO  ] stdout
> ID_FS_USAGE=raid [2021-11-12 21:23:55,354][ceph_volume.process][INFO  ]
> stdout
> ID_FS_UUID=SOElW1-Wjj1-TV8Q-TKsa-eRBG-gzGr-aCsNdu
> [2021-11-12 21:23:55,354][ceph_volume.process][INFO  ] stdout
> ID_FS_UUID_ENC=SOElW1-Wjj1-TV8Q-TKsa-eRBG-gzGr-aCsNdu
> [2021-11-12 21:23:55,354][ceph_volume.process][INFO  ] stdout
> ID_FS_VERSION=LVM2 001
> [2021-11-12 21:23:55,354][ceph_volume.process][INFO  ] stdout
> ID_MODEL=WDC_WD30EFRX-68EUZN0
> [2021-11-12 21:23:55,354][ceph_volume.process][INFO  ] stdout
> ID_MODEL_ENC=WDC\x20WD30EFRX-68EUZN0\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20
> \x20\x20\x20\x20\x20\x20\x20\x20\x20\x20 [2021-11-12
> 21:23:55,354][ceph_volume.process][INFO  ] stdout
> ID_PATH=pci-0000:00:1f.2-ata-3.0
> [2021-11-12 21:23:55,354][ceph_volume.process][INFO  ] stdout
> ID_PATH_ATA_COMPAT=pci-0000:00:1f.2-ata-3
> [2021-11-12 21:23:55,354][ceph_volume.process][INFO  ] stdout
> ID_PATH_TAG=pci-0000_00_1f_2-ata-3_0
> [2021-11-12 21:23:55,354][ceph_volume.process][INFO  ] stdout
> ID_REVISION=80.00A80
> [2021-11-12 21:23:55,355][ceph_volume.process][INFO  ] stdout
> ID_SERIAL=WDC_WD30EFRX-68EUZN0_WD-WCC4N99Z68Y4
> [2021-11-12 21:23:55,355][ceph_volume.process][INFO  ] stdout
> ID_SERIAL_SHORT=WD-WCC4N99Z68Y4
> [2021-11-12 21:23:55,355][ceph_volume.process][INFO  ] stdout ID_TYPE=disk
> [2021-11-12 21:23:55,355][ceph_volume.process][INFO  ] stdout
> ID_WWN=0x50014ee20a61fcc0
> [2021-11-12 21:23:55,355][ceph_volume.process][INFO  ] stdout
> ID_WWN_WITH_EXTENSION=0x50014ee20a61fcc0
> [2021-11-12 21:23:55,355][ceph_volume.process][INFO  ] stdout MAJOR=8
> [2021-11-12 21:23:55,355][ceph_volume.process][INFO  ] stdout MINOR=16
> [2021-11-12 21:23:55,355][ceph_volume.process][INFO  ] stdout
> SUBSYSTEM=block [2021-11-12 21:23:55,355][ceph_volume.process][INFO  ]
> stdout SYSTEMD_ALIAS=/ dev/block/8:16
> [2021-11-12 21:23:55,355][ceph_volume.process][INFO  ] stdout
> SYSTEMD_READY=1 [2021-11-12 21:23:55,355][ceph_volume.process][INFO  ]
> stdout
> SYSTEMD_WANTS=lvm2-pvscan@8:16.service
> [2021-11-12 21:23:55,355][ceph_volume.process][INFO  ] stdout TAGS=:systemd:
> [2021-11-12 21:23:55,356][ceph_volume.process][INFO  ] stdout
> USEC_INITIALIZED=4535845
> [2021-11-12 21:23:55,356][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/lvs --noheadings --readonly --separator=";" -a --units=b
> --nosuffix -S lv_path=/dev/sdc -o
> lv_tags,lv_path,lv_name,vg_name,lv_uuid,lv_size [2021-11-12
> 21:23:55,406][ceph_volume.process][INFO  ] Running command: /usr/ bin/lsblk
> --nodeps -P -o
> NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER
> ,GROUP,MODE,ALIGNMENT,PHY-
> SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-
> ZERO,PKNAME,PARTLABEL /dev/sdc
> [2021-11-12 21:23:55,412][ceph_volume.process][INFO  ] stdout NAME="sdc"
> KNAME="sdc" MAJ:MIN="8:32" FSTYPE="LVM2_member" MOUNTPOINT="" LABEL=""
> UUID="ywCsJt-kk1E-rTKp-eBLr-ffSo-IF0j-3ntdjZ" RO="0" RM="0" MODEL="TOSHIBA
> HDWD130 " SIZE="2.7T" STATE="running" OWNER="root" GROUP="disk" MODE="brw-
> rw----" ALIGNMENT="0" PHY-SEC="4096" LOG-SEC="512" ROTA="1" SCHED="mq-
> deadline" TYPE="disk" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B"
> DISC-ZERO="0" PKNAME="" PARTLABEL=""
> [2021-11-12 21:23:55,413][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/blkid -c /dev/null -p /dev/sdc
> [2021-11-12 21:23:55,416][ceph_volume.process][INFO  ] stdout /dev/sdc:
> UUID="ywCsJt-kk1E-rTKp-eBLr-ffSo-IF0j-3ntdjZ" VERSION="LVM2 001"
> TYPE="LVM2_member" USAGE="raid"
> [2021-11-12 21:23:55,417][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/pvs --noheadings --readonly --units=b --nosuffix --separator=";"
> -o
> vg_name,pv_count,lv_count,vg_attr,vg_extent_count,vg_free_count,vg_extent_s
> ize /dev/sdc
> [2021-11-12 21:23:55,466][ceph_volume.process][INFO  ] stdout
> ceph-09c84540-06e3-496f-bf90-45f59748768a";"1";"1";"wz--
> n-";"715396";"0";"4194304
> [2021-11-12 21:23:55,466][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/pvs --noheadings --readonly --separator=";" -a --units=b
> --nosuffix -o lv_tags,lv_path,lv_name,vg_name,lv_uuid,lv_size /dev/sdc
> [2021-11-12 21:23:55,542][ceph_volume.process][INFO  ] stdout
> ceph.block_device=/dev/ceph-09c84540-06e3-496f-bf90-45f59748768a/osd-
> block-60ad9fb3-8144-4d06-83e6-b90e9d52dcaa,ceph.block_uuid=h352xv-O3aB-qRAQ-
> rWUa-alhz-7b9H-o30rfs,ceph.cephx_lockbox_secret=AQB+/
> FFhtwkAIxAAWVWk87T5duTfEIDtQGGqjg==,ceph.cluster_fsid=d82ced8c-1f6e-11ec-
> a2e4-00fd45fcaf9c,ceph.cluster_name=ceph,ceph.crush_device_class=None,ceph.e
> ncrypted=1,ceph.osd_fsid=60ad9fb3-8144-4d06-83e6-
> b90e9d52dcaa,ceph.osd_id=4,ceph.osdspec_affinity=default_drive_group,ceph.t
> ype=block,ceph.vdo=0";"/ dev/ceph-09c84540-06e3-496f-bf90-45f59748768a/osd-
> block-60ad9fb3-8144-4d06-83e6-b90e9d52dcaa";"osd-
> block-60ad9fb3-8144-4d06-83e6-b90e9d52dcaa";"ceph-09c84540-06e3-496f-
> bf90-45f59748768a";"h352xv-O3aB-qRAQ-rWUa-alhz-7b9H-o30rfs";"3000588304384
> [2021-11-12 21:23:55,543][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdc to check for BlueStore label
> [2021-11-12 21:23:55,543][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/udevadm info --query=property /dev/sdc
> [2021-11-12 21:23:55,555][ceph_volume.process][INFO  ] stdout DEVLINKS=/dev/
> disk/by-id/lvm-pv-uuid-ywCsJt-kk1E-rTKp-eBLr-ffSo-IF0j-3ntdjZ
> /dev/disk/by-id/ wwn-0x5000039fe6d5d3d9
> /dev/disk/by-path/pci-0000:00:1f.2-ata-4.0 /dev/disk/
> by-path/pci-0000:00:1f.2-ata-4
> /dev/disk/by-id/ata-TOSHIBA_HDWD130_674K0JUAS [2021-11-12
> 21:23:55,556][ceph_volume.process][INFO  ] stdout DEVNAME=/dev/sdc
> [2021-11-12 21:23:55,556][ceph_volume.process][INFO  ] stdout DEVPATH=/
> devices/pci0000:00/0000:00:1f.2/ata4/host3/target3:0:0/3:0:0:0/block/sdc
> [2021-11-12 21:23:55,556][ceph_volume.process][INFO  ] stdout DEVTYPE=disk
> [2021-11-12 21:23:55,556][ceph_volume.process][INFO  ] stdout ID_ATA=1
> [2021-11-12 21:23:55,556][ceph_volume.process][INFO  ] stdout
> ID_ATA_DOWNLOAD_MICROCODE=1
> [2021-11-12 21:23:55,556][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM=1
> [2021-11-12 21:23:55,556][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM_ENABLED=0
> [2021-11-12 21:23:55,557][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_HPA=1
> [2021-11-12 21:23:55,557][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_HPA_ENABLED=1
> [2021-11-12 21:23:55,557][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PM=1
> [2021-11-12 21:23:55,557][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PM_ENABLED=1
> [2021-11-12 21:23:55,557][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PUIS=1
> [2021-11-12 21:23:55,557][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PUIS_ENABLED=0
> [2021-11-12 21:23:55,557][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY=1
> [2021-11-12 21:23:55,557][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ENABLED=0
> [2021-11-12 21:23:55,558][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ERASE_UNIT_MIN=492
> [2021-11-12 21:23:55,558][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SMART=1
> [2021-11-12 21:23:55,558][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SMART_ENABLED=1
> [2021-11-12 21:23:55,558][ceph_volume.process][INFO  ] stdout
> ID_ATA_ROTATION_RATE_RPM=7200
> [2021-11-12 21:23:55,558][ceph_volume.process][INFO  ] stdout ID_ATA_SATA=1
> [2021-11-12 21:23:55,558][ceph_volume.process][INFO  ] stdout
> ID_ATA_SATA_SIGNAL_RATE_GEN1=1
> [2021-11-12 21:23:55,558][ceph_volume.process][INFO  ] stdout
> ID_ATA_SATA_SIGNAL_RATE_GEN2=1
> [2021-11-12 21:23:55,558][ceph_volume.process][INFO  ] stdout
> ID_ATA_WRITE_CACHE=1
> [2021-11-12 21:23:55,558][ceph_volume.process][INFO  ] stdout
> ID_ATA_WRITE_CACHE_ENABLED=1
> [2021-11-12 21:23:55,558][ceph_volume.process][INFO  ] stdout ID_BUS=ata
> [2021-11-12 21:23:55,558][ceph_volume.process][INFO  ] stdout
> ID_FS_TYPE=LVM2_member
> [2021-11-12 21:23:55,558][ceph_volume.process][INFO  ] stdout
> ID_FS_USAGE=raid [2021-11-12 21:23:55,559][ceph_volume.process][INFO  ]
> stdout
> ID_FS_UUID=ywCsJt-kk1E-rTKp-eBLr-ffSo-IF0j-3ntdjZ
> [2021-11-12 21:23:55,559][ceph_volume.process][INFO  ] stdout
> ID_FS_UUID_ENC=ywCsJt-kk1E-rTKp-eBLr-ffSo-IF0j-3ntdjZ
> [2021-11-12 21:23:55,559][ceph_volume.process][INFO  ] stdout
> ID_FS_VERSION=LVM2 001
> [2021-11-12 21:23:55,559][ceph_volume.process][INFO  ] stdout
> ID_MODEL=TOSHIBA_HDWD130
> [2021-11-12 21:23:55,559][ceph_volume.process][INFO  ] stdout
> ID_MODEL_ENC=TOSHIBA\x20HDWD130\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\
> x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20 [2021-11-12
> 21:23:55,559][ceph_volume.process][INFO  ] stdout
> ID_PATH=pci-0000:00:1f.2-ata-4.0
> [2021-11-12 21:23:55,559][ceph_volume.process][INFO  ] stdout
> ID_PATH_ATA_COMPAT=pci-0000:00:1f.2-ata-4
> [2021-11-12 21:23:55,559][ceph_volume.process][INFO  ] stdout
> ID_PATH_TAG=pci-0000_00_1f_2-ata-4_0
> [2021-11-12 21:23:55,559][ceph_volume.process][INFO  ] stdout
> ID_REVISION=MX6OACF0
> [2021-11-12 21:23:55,559][ceph_volume.process][INFO  ] stdout
> ID_SERIAL=TOSHIBA_HDWD130_674K0JUAS
> [2021-11-12 21:23:55,559][ceph_volume.process][INFO  ] stdout
> ID_SERIAL_SHORT=674K0JUAS
> [2021-11-12 21:23:55,560][ceph_volume.process][INFO  ] stdout ID_TYPE=disk
> [2021-11-12 21:23:55,560][ceph_volume.process][INFO  ] stdout
> ID_WWN=0x5000039fe6d5d3d9
> [2021-11-12 21:23:55,560][ceph_volume.process][INFO  ] stdout
> ID_WWN_WITH_EXTENSION=0x5000039fe6d5d3d9
> [2021-11-12 21:23:55,560][ceph_volume.process][INFO  ] stdout MAJOR=8
> [2021-11-12 21:23:55,560][ceph_volume.process][INFO  ] stdout MINOR=32
> [2021-11-12 21:23:55,560][ceph_volume.process][INFO  ] stdout
> SUBSYSTEM=block [2021-11-12 21:23:55,560][ceph_volume.process][INFO  ]
> stdout SYSTEMD_ALIAS=/ dev/block/8:32
> [2021-11-12 21:23:55,560][ceph_volume.process][INFO  ] stdout
> SYSTEMD_READY=1 [2021-11-12 21:23:55,560][ceph_volume.process][INFO  ]
> stdout
> SYSTEMD_WANTS=lvm2-pvscan@8:32.service
> [2021-11-12 21:23:55,560][ceph_volume.process][INFO  ] stdout TAGS=:systemd:
> [2021-11-12 21:23:55,560][ceph_volume.process][INFO  ] stdout
> USEC_INITIALIZED=4505597
> [2021-11-12 21:23:55,561][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/lvs --noheadings --readonly --separator=";" -a --units=b
> --nosuffix -S lv_path=/dev/sdd -o
> lv_tags,lv_path,lv_name,vg_name,lv_uuid,lv_size [2021-11-12
> 21:23:55,622][ceph_volume.process][INFO  ] Running command: /usr/ bin/lsblk
> --nodeps -P -o
> NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER
> ,GROUP,MODE,ALIGNMENT,PHY-
> SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-
> ZERO,PKNAME,PARTLABEL /dev/sdd
> [2021-11-12 21:23:55,630][ceph_volume.process][INFO  ] stdout NAME="sdd"
> KNAME="sdd" MAJ:MIN="8:48" FSTYPE="" MOUNTPOINT="" LABEL="" UUID="" RO="0"
> RM="0" MODEL="CT240BX500SSD1  " SIZE="223.6G" STATE="running" OWNER="root"
> GROUP="disk" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512"
> ROTA="0" SCHED="mq-deadline" TYPE="disk" DISC-ALN="0" DISC-GRAN="512B" DISC-
> MAX="2G" DISC-ZERO="0" PKNAME="" PARTLABEL=""
> [2021-11-12 21:23:55,631][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/blkid -c /dev/null -p /dev/sdd
> [2021-11-12 21:23:55,636][ceph_volume.process][INFO  ] stdout /dev/sdd:
> PTUUID="9a4155cb" PTTYPE="dos"
> [2021-11-12 21:23:55,636][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/pvs --noheadings --readonly --units=b --nosuffix --separator=";"
> -o
> vg_name,pv_count,lv_count,vg_attr,vg_extent_count,vg_free_count,vg_extent_s
> ize /dev/sdd
> [2021-11-12 21:23:55,689][ceph_volume.process][INFO  ] stderr Cannot use
> /dev/ sdd: device is partitioned
> [2021-11-12 21:23:55,690][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/pvs --noheadings --readonly --units=b --nosuffix --separator=";"
> -o
> vg_name,pv_count,lv_count,vg_attr,vg_extent_count,vg_free_count,vg_extent_s
> ize /dev/sdd2
> [2021-11-12 21:23:55,750][ceph_volume.process][INFO  ] stderr Cannot use
> /dev/ sdd2: device is too small (pv_min_size)
> [2021-11-12 21:23:55,750][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/pvs --noheadings --readonly --units=b --nosuffix --separator=";"
> -o
> vg_name,pv_count,lv_count,vg_attr,vg_extent_count,vg_free_count,vg_extent_s
> ize /dev/sdd5
> [2021-11-12 21:23:55,818][ceph_volume.process][INFO  ] stderr Failed to find
> physical volume "/dev/sdd5".
> [2021-11-12 21:23:55,818][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/pvs --noheadings --readonly --units=b --nosuffix --separator=";"
> -o
> vg_name,pv_count,lv_count,vg_attr,vg_extent_count,vg_free_count,vg_extent_s
> ize /dev/sdd1
> [2021-11-12 21:23:55,882][ceph_volume.process][INFO  ] stderr Failed to find
> physical volume "/dev/sdd1".
> [2021-11-12 21:23:55,883][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/lvs --noheadings --readonly --separator=";" -a --units=b
> --nosuffix -S lv_path=/dev/sdd2 -o
> lv_tags,lv_path,lv_name,vg_name,lv_uuid,lv_size [2021-11-12
> 21:23:55,958][ceph_volume.process][INFO  ] Running command: /usr/ bin/lsblk
> --nodeps -P -o
> NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER
> ,GROUP,MODE,ALIGNMENT,PHY-
> SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-
> ZERO,PKNAME,PARTLABEL /dev/sdd2
> [2021-11-12 21:23:55,966][ceph_volume.process][INFO  ] stdout NAME="sdd2"
> KNAME="sdd2" MAJ:MIN="8:50" FSTYPE="" MOUNTPOINT="" LABEL="" UUID="" RO="0"
> RM="0" MODEL="" SIZE="1K" STATE="" OWNER="root" GROUP="disk"
> MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="0"
> SCHED="mq-deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="512B" DISC-MAX="2G"
> DISC-ZERO="0" PKNAME="sdd" PARTLABEL=""
> [2021-11-12 21:23:55,967][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/blkid -c /dev/null -p /dev/sdd2
> [2021-11-12 21:23:55,971][ceph_volume.process][INFO  ] stdout /dev/sdd2:
> PTUUID="4808244c" PTTYPE="dos" PART_ENTRY_SCHEME="dos"
> PART_ENTRY_UUID="9a4155cb-02" PART_ENTRY_TYPE="0x5" PART_ENTRY_NUMBER="2"
> PART_ENTRY_OFFSET="1001470" PART_ENTRY_SIZE="467859458"
> PART_ENTRY_DISK="8:48" [2021-11-12 21:23:55,973][ceph_volume.process][INFO 
> ] Running command: /usr/ sbin/pvs --noheadings --readonly --units=b
> --nosuffix --separator=";" -o
> vg_name,pv_count,lv_count,vg_attr,vg_extent_count,vg_free_count,vg_extent_s
> ize /dev/sdd2
> [2021-11-12 21:23:56,029][ceph_volume.process][INFO  ] stderr Cannot use
> /dev/ sdd2: device is too small (pv_min_size)
> [2021-11-12 21:23:56,030][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd2 to check for BlueStore label
> [2021-11-12 21:23:56,031][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd to check for BlueStore label
> [2021-11-12 21:23:56,031][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd2 to check for BlueStore label
> [2021-11-12 21:23:56,031][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd to check for BlueStore label
> [2021-11-12 21:23:56,032][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/udevadm info --query=property /dev/sdd2
> [2021-11-12 21:23:56,042][ceph_volume.process][INFO  ] stdout DEVLINKS=/dev/
> disk/by-path/pci-0000:00:1f.2-ata-5.0-part2 /dev/disk/by-id/ata-
> CT240BX500SSD1_1944E3D4E7BB-part2 /dev/disk/by-partuuid/9a4155cb-02
> /dev/disk/ by-path/pci-0000:00:1f.2-ata-5-part2
> [2021-11-12 21:23:56,043][ceph_volume.process][INFO  ] stdout DEVNAME=/dev/
> sdd2
> [2021-11-12 21:23:56,043][ceph_volume.process][INFO  ] stdout DEVPATH=/
> devices/pci0000:00/0000:00:1f.2/ata5/host4/target4:0:0/4:0:0:0/block/sdd/sdd
> 2 [2021-11-12 21:23:56,043][ceph_volume.process][INFO  ] stdout
> DEVTYPE=partition
> [2021-11-12 21:23:56,043][ceph_volume.process][INFO  ] stdout ID_ATA=1
> [2021-11-12 21:23:56,043][ceph_volume.process][INFO  ] stdout
> ID_ATA_DOWNLOAD_MICROCODE=1
> [2021-11-12 21:23:56,043][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM=1
> [2021-11-12 21:23:56,043][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM_CURRENT_VALUE=254
> [2021-11-12 21:23:56,043][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM_ENABLED=1
> [2021-11-12 21:23:56,043][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_HPA=1
> [2021-11-12 21:23:56,044][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_HPA_ENABLED=1
> [2021-11-12 21:23:56,044][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PM=1
> [2021-11-12 21:23:56,044][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PM_ENABLED=1
> [2021-11-12 21:23:56,044][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY=1
> [2021-11-12 21:23:56,045][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ENABLED=0
> [2021-11-12 21:23:56,045][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ENHANCED_ERASE_UNIT_MIN=2
> [2021-11-12 21:23:56,045][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ERASE_UNIT_MIN=2
> [2021-11-12 21:23:56,045][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SMART=1
> [2021-11-12 21:23:56,045][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SMART_ENABLED=1
> [2021-11-12 21:23:56,045][ceph_volume.process][INFO  ] stdout
> ID_ATA_ROTATION_RATE_RPM=0
> [2021-11-12 21:23:56,045][ceph_volume.process][INFO  ] stdout ID_ATA_SATA=1
> [2021-11-12 21:23:56,045][ceph_volume.process][INFO  ] stdout
> ID_ATA_SATA_SIGNAL_RATE_GEN1=1
> [2021-11-12 21:23:56,045][ceph_volume.process][INFO  ] stdout
> ID_ATA_SATA_SIGNAL_RATE_GEN2=1
> [2021-11-12 21:23:56,045][ceph_volume.process][INFO  ] stdout
> ID_ATA_WRITE_CACHE=1
> [2021-11-12 21:23:56,045][ceph_volume.process][INFO  ] stdout
> ID_ATA_WRITE_CACHE_ENABLED=1
> [2021-11-12 21:23:56,045][ceph_volume.process][INFO  ] stdout ID_BUS=ata
> [2021-11-12 21:23:56,046][ceph_volume.process][INFO  ] stdout
> ID_MODEL=CT240BX500SSD1
> [2021-11-12 21:23:56,046][ceph_volume.process][INFO  ] stdout
> ID_MODEL_ENC=CT240BX500SSD1\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\
> x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20 [2021-11-12
> 21:23:56,046][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_DISK=8:48
> [2021-11-12 21:23:56,046][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_NUMBER=2
> [2021-11-12 21:23:56,046][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_OFFSET=1001470
> [2021-11-12 21:23:56,046][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_SCHEME=dos
> [2021-11-12 21:23:56,046][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_SIZE=467859458
> [2021-11-12 21:23:56,046][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_TYPE=0x5
> [2021-11-12 21:23:56,046][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_UUID=9a4155cb-02
> [2021-11-12 21:23:56,046][ceph_volume.process][INFO  ] stdout
> ID_PART_TABLE_TYPE=dos
> [2021-11-12 21:23:56,046][ceph_volume.process][INFO  ] stdout
> ID_PART_TABLE_UUID=4808244c
> [2021-11-12 21:23:56,046][ceph_volume.process][INFO  ] stdout
> ID_PATH=pci-0000:00:1f.2-ata-5.0
> [2021-11-12 21:23:56,046][ceph_volume.process][INFO  ] stdout
> ID_PATH_ATA_COMPAT=pci-0000:00:1f.2-ata-5
> [2021-11-12 21:23:56,046][ceph_volume.process][INFO  ] stdout
> ID_PATH_TAG=pci-0000_00_1f_2-ata-5_0
> [2021-11-12 21:23:56,047][ceph_volume.process][INFO  ] stdout
> ID_REVISION=M6CR013
> [2021-11-12 21:23:56,047][ceph_volume.process][INFO  ] stdout
> ID_SERIAL=CT240BX500SSD1_1944E3D4E7BB
> [2021-11-12 21:23:56,047][ceph_volume.process][INFO  ] stdout
> ID_SERIAL_SHORT=1944E3D4E7BB
> [2021-11-12 21:23:56,047][ceph_volume.process][INFO  ] stdout ID_TYPE=disk
> [2021-11-12 21:23:56,047][ceph_volume.process][INFO  ] stdout MAJOR=8
> [2021-11-12 21:23:56,047][ceph_volume.process][INFO  ] stdout MINOR=50
> [2021-11-12 21:23:56,047][ceph_volume.process][INFO  ] stdout PARTN=2
> [2021-11-12 21:23:56,047][ceph_volume.process][INFO  ] stdout
> SUBSYSTEM=block [2021-11-12 21:23:56,047][ceph_volume.process][INFO  ]
> stdout TAGS=:systemd: [2021-11-12 21:23:56,047][ceph_volume.process][INFO 
> ] stdout
> USEC_INITIALIZED=4428059
> [2021-11-12 21:23:56,048][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/lvs --noheadings --readonly --separator=";" -a --units=b
> --nosuffix -S lv_path=/dev/sdd5 -o
> lv_tags,lv_path,lv_name,vg_name,lv_uuid,lv_size [2021-11-12
> 21:23:56,118][ceph_volume.process][INFO  ] Running command: /usr/ bin/lsblk
> --nodeps -P -o
> NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER
> ,GROUP,MODE,ALIGNMENT,PHY-
> SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-
> ZERO,PKNAME,PARTLABEL /dev/sdd5
> [2021-11-12 21:23:56,126][ceph_volume.process][INFO  ] stdout NAME="sdd5"
> KNAME="sdd5" MAJ:MIN="8:53" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL=""
> UUID="fbfc2e93-1c31-469b-80ce-0805c065be6f" RO="0" RM="0" MODEL=""
> SIZE="223.1G" STATE="" OWNER="root" GROUP="disk" MODE="brw-rw----"
> ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="0" SCHED="mq-deadline"
> TYPE="part" DISC-ALN="0" DISC-GRAN="512B" DISC-MAX="2G" DISC-ZERO="0"
> PKNAME="sdd" PARTLABEL=""
> [2021-11-12 21:23:56,127][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/blkid -c /dev/null -p /dev/sdd5
> [2021-11-12 21:23:56,131][ceph_volume.process][INFO  ] stdout /dev/sdd5:
> VERSION="2" UUID="fbfc2e93-1c31-469b-80ce-0805c065be6f" TYPE="crypto_LUKS"
> USAGE="crypto" PART_ENTRY_SCHEME="dos" PART_ENTRY_UUID="9a4155cb-05"
> PART_ENTRY_TYPE="0x83" PART_ENTRY_NUMBER="5" PART_ENTRY_OFFSET="1001472"
> PART_ENTRY_SIZE="467859456" PART_ENTRY_DISK="8:48"
> [2021-11-12 21:23:56,132][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/pvs --noheadings --readonly --units=b --nosuffix --separator=";"
> -o
> vg_name,pv_count,lv_count,vg_attr,vg_extent_count,vg_free_count,vg_extent_s
> ize /dev/sdd5
> [2021-11-12 21:23:56,198][ceph_volume.process][INFO  ] stderr Failed to find
> physical volume "/dev/sdd5".
> [2021-11-12 21:23:56,198][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd5 to check for BlueStore label
> [2021-11-12 21:23:56,199][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd to check for BlueStore label
> [2021-11-12 21:23:56,199][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd5 to check for BlueStore label
> [2021-11-12 21:23:56,199][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd to check for BlueStore label
> [2021-11-12 21:23:56,199][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/udevadm info --query=property /dev/sdd5
> [2021-11-12 21:23:56,212][ceph_volume.process][INFO  ] stdout DEVLINKS=/dev/
> disk/by-uuid/fbfc2e93-1c31-469b-80ce-0805c065be6f /dev/disk/by-partuuid/
> 9a4155cb-05 /dev/disk/by-path/pci-0000:00:1f.2-ata-5.0-part5 /dev/disk/by-
> path/pci-0000:00:1f.2-ata-5-part5 /dev/disk/by-id/ata-
> CT240BX500SSD1_1944E3D4E7BB-part5
> [2021-11-12 21:23:56,213][ceph_volume.process][INFO  ] stdout DEVNAME=/dev/
> sdd5
> [2021-11-12 21:23:56,213][ceph_volume.process][INFO  ] stdout DEVPATH=/
> devices/pci0000:00/0000:00:1f.2/ata5/host4/target4:0:0/4:0:0:0/block/sdd/sdd
> 5 [2021-11-12 21:23:56,213][ceph_volume.process][INFO  ] stdout
> DEVTYPE=partition
> [2021-11-12 21:23:56,213][ceph_volume.process][INFO  ] stdout ID_ATA=1
> [2021-11-12 21:23:56,213][ceph_volume.process][INFO  ] stdout
> ID_ATA_DOWNLOAD_MICROCODE=1
> [2021-11-12 21:23:56,213][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM=1
> [2021-11-12 21:23:56,213][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM_CURRENT_VALUE=254
> [2021-11-12 21:23:56,214][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM_ENABLED=1
> [2021-11-12 21:23:56,214][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_HPA=1
> [2021-11-12 21:23:56,214][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_HPA_ENABLED=1
> [2021-11-12 21:23:56,214][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PM=1
> [2021-11-12 21:23:56,214][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PM_ENABLED=1
> [2021-11-12 21:23:56,214][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY=1
> [2021-11-12 21:23:56,214][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ENABLED=0
> [2021-11-12 21:23:56,214][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ENHANCED_ERASE_UNIT_MIN=2
> [2021-11-12 21:23:56,214][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ERASE_UNIT_MIN=2
> [2021-11-12 21:23:56,214][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SMART=1
> [2021-11-12 21:23:56,214][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SMART_ENABLED=1
> [2021-11-12 21:23:56,215][ceph_volume.process][INFO  ] stdout
> ID_ATA_ROTATION_RATE_RPM=0
> [2021-11-12 21:23:56,215][ceph_volume.process][INFO  ] stdout ID_ATA_SATA=1
> [2021-11-12 21:23:56,215][ceph_volume.process][INFO  ] stdout
> ID_ATA_SATA_SIGNAL_RATE_GEN1=1
> [2021-11-12 21:23:56,215][ceph_volume.process][INFO  ] stdout
> ID_ATA_SATA_SIGNAL_RATE_GEN2=1
> [2021-11-12 21:23:56,215][ceph_volume.process][INFO  ] stdout
> ID_ATA_WRITE_CACHE=1
> [2021-11-12 21:23:56,215][ceph_volume.process][INFO  ] stdout
> ID_ATA_WRITE_CACHE_ENABLED=1
> [2021-11-12 21:23:56,215][ceph_volume.process][INFO  ] stdout ID_BUS=ata
> [2021-11-12 21:23:56,215][ceph_volume.process][INFO  ] stdout
> ID_FS_TYPE=crypto_LUKS
> [2021-11-12 21:23:56,215][ceph_volume.process][INFO  ] stdout
> ID_FS_USAGE=crypto
> [2021-11-12 21:23:56,215][ceph_volume.process][INFO  ] stdout
> ID_FS_UUID=fbfc2e93-1c31-469b-80ce-0805c065be6f
> [2021-11-12 21:23:56,215][ceph_volume.process][INFO  ] stdout
> ID_FS_UUID_ENC=fbfc2e93-1c31-469b-80ce-0805c065be6f
> [2021-11-12 21:23:56,215][ceph_volume.process][INFO  ] stdout
> ID_FS_VERSION=2 [2021-11-12 21:23:56,216][ceph_volume.process][INFO  ]
> stdout
> ID_MODEL=CT240BX500SSD1
> [2021-11-12 21:23:56,216][ceph_volume.process][INFO  ] stdout
> ID_MODEL_ENC=CT240BX500SSD1\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\
> x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20 [2021-11-12
> 21:23:56,216][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_DISK=8:48
> [2021-11-12 21:23:56,216][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_NUMBER=5
> [2021-11-12 21:23:56,216][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_OFFSET=1001472
> [2021-11-12 21:23:56,216][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_SCHEME=dos
> [2021-11-12 21:23:56,216][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_SIZE=467859456
> [2021-11-12 21:23:56,216][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_TYPE=0x83
> [2021-11-12 21:23:56,216][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_UUID=9a4155cb-05
> [2021-11-12 21:23:56,216][ceph_volume.process][INFO  ] stdout
> ID_PART_TABLE_TYPE=dos
> [2021-11-12 21:23:56,216][ceph_volume.process][INFO  ] stdout
> ID_PART_TABLE_UUID=9a4155cb
> [2021-11-12 21:23:56,217][ceph_volume.process][INFO  ] stdout
> ID_PATH=pci-0000:00:1f.2-ata-5.0
> [2021-11-12 21:23:56,217][ceph_volume.process][INFO  ] stdout
> ID_PATH_ATA_COMPAT=pci-0000:00:1f.2-ata-5
> [2021-11-12 21:23:56,217][ceph_volume.process][INFO  ] stdout
> ID_PATH_TAG=pci-0000_00_1f_2-ata-5_0
> [2021-11-12 21:23:56,217][ceph_volume.process][INFO  ] stdout
> ID_REVISION=M6CR013
> [2021-11-12 21:23:56,217][ceph_volume.process][INFO  ] stdout
> ID_SERIAL=CT240BX500SSD1_1944E3D4E7BB
> [2021-11-12 21:23:56,217][ceph_volume.process][INFO  ] stdout
> ID_SERIAL_SHORT=1944E3D4E7BB
> [2021-11-12 21:23:56,217][ceph_volume.process][INFO  ] stdout ID_TYPE=disk
> [2021-11-12 21:23:56,217][ceph_volume.process][INFO  ] stdout MAJOR=8
> [2021-11-12 21:23:56,217][ceph_volume.process][INFO  ] stdout MINOR=53
> [2021-11-12 21:23:56,217][ceph_volume.process][INFO  ] stdout PARTN=5
> [2021-11-12 21:23:56,217][ceph_volume.process][INFO  ] stdout
> SUBSYSTEM=block [2021-11-12 21:23:56,217][ceph_volume.process][INFO  ]
> stdout TAGS=:systemd: [2021-11-12 21:23:56,218][ceph_volume.process][INFO 
> ] stdout
> USEC_INITIALIZED=4429765
> [2021-11-12 21:23:56,218][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/lvs --noheadings --readonly --separator=";" -a --units=b
> --nosuffix -S lv_path=/dev/sdd1 -o
> lv_tags,lv_path,lv_name,vg_name,lv_uuid,lv_size [2021-11-12
> 21:23:56,282][ceph_volume.process][INFO  ] Running command: /usr/ bin/lsblk
> --nodeps -P -o
> NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER
> ,GROUP,MODE,ALIGNMENT,PHY-
> SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-
> ZERO,PKNAME,PARTLABEL /dev/sdd1
> [2021-11-12 21:23:56,288][ceph_volume.process][INFO  ] stdout NAME="sdd1"
> KNAME="sdd1" MAJ:MIN="8:49" FSTYPE="ext2" MOUNTPOINT="" LABEL=""
> UUID="47c8d1ee-1c50-4af6-8fd5-001583a6f71f" RO="0" RM="0" MODEL=""
> SIZE="487M" STATE="" OWNER="root" GROUP="disk" MODE="brw-rw----"
> ALIGNMENT="0" PHY- SEC="512" LOG-SEC="512" ROTA="0" SCHED="mq-deadline"
> TYPE="part" DISC-ALN="0" DISC-GRAN="512B" DISC-MAX="2G" DISC-ZERO="0"
> PKNAME="sdd" PARTLABEL="" [2021-11-12
> 21:23:56,289][ceph_volume.process][INFO  ] Running command: /usr/
> sbin/blkid -c /dev/null -p /dev/sdd1
> [2021-11-12 21:23:56,293][ceph_volume.process][INFO  ] stdout /dev/sdd1:
> UUID="47c8d1ee-1c50-4af6-8fd5-001583a6f71f" VERSION="1.0" BLOCK_SIZE="1024"
> TYPE="ext2" USAGE="filesystem" PART_ENTRY_SCHEME="dos"
> PART_ENTRY_UUID="9a4155cb-01" PART_ENTRY_TYPE="0x83" PART_ENTRY_FLAGS="0x80"
> PART_ENTRY_NUMBER="1" PART_ENTRY_OFFSET="2048" PART_ENTRY_SIZE="997376"
> PART_ENTRY_DISK="8:48"
> [2021-11-12 21:23:56,294][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/pvs --noheadings --readonly --units=b --nosuffix --separator=";"
> -o
> vg_name,pv_count,lv_count,vg_attr,vg_extent_count,vg_free_count,vg_extent_s
> ize /dev/sdd1
> [2021-11-12 21:23:56,350][ceph_volume.process][INFO  ] stderr Failed to find
> physical volume "/dev/sdd1".
> [2021-11-12 21:23:56,350][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd1 to check for BlueStore label
> [2021-11-12 21:23:56,350][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd to check for BlueStore label
> [2021-11-12 21:23:56,351][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd1 to check for BlueStore label
> [2021-11-12 21:23:56,351][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd to check for BlueStore label
> [2021-11-12 21:23:56,351][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/udevadm info --query=property /dev/sdd1
> [2021-11-12 21:23:56,364][ceph_volume.process][INFO  ] stdout DEVLINKS=/dev/
> disk/by-partuuid/9a4155cb-01
> /dev/disk/by-id/ata-CT240BX500SSD1_1944E3D4E7BB- part1
> /dev/disk/by-path/pci-0000:00:1f.2-ata-5.0-part1 /dev/disk/by-uuid/
> 47c8d1ee-1c50-4af6-8fd5-001583a6f71f
> /dev/disk/by-path/pci-0000:00:1f.2-ata-5- part1
> [2021-11-12 21:23:56,364][ceph_volume.process][INFO  ] stdout DEVNAME=/dev/
> sdd1
> [2021-11-12 21:23:56,364][ceph_volume.process][INFO  ] stdout DEVPATH=/
> devices/pci0000:00/0000:00:1f.2/ata5/host4/target4:0:0/4:0:0:0/block/sdd/sdd
> 1 [2021-11-12 21:23:56,364][ceph_volume.process][INFO  ] stdout
> DEVTYPE=partition
> [2021-11-12 21:23:56,364][ceph_volume.process][INFO  ] stdout ID_ATA=1
> [2021-11-12 21:23:56,365][ceph_volume.process][INFO  ] stdout
> ID_ATA_DOWNLOAD_MICROCODE=1
> [2021-11-12 21:23:56,365][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM=1
> [2021-11-12 21:23:56,365][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM_CURRENT_VALUE=254
> [2021-11-12 21:23:56,365][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM_ENABLED=1
> [2021-11-12 21:23:56,365][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_HPA=1
> [2021-11-12 21:23:56,365][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_HPA_ENABLED=1
> [2021-11-12 21:23:56,365][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PM=1
> [2021-11-12 21:23:56,365][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PM_ENABLED=1
> [2021-11-12 21:23:56,365][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY=1
> [2021-11-12 21:23:56,365][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ENABLED=0
> [2021-11-12 21:23:56,365][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ENHANCED_ERASE_UNIT_MIN=2
> [2021-11-12 21:23:56,366][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ERASE_UNIT_MIN=2
> [2021-11-12 21:23:56,366][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SMART=1
> [2021-11-12 21:23:56,366][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SMART_ENABLED=1
> [2021-11-12 21:23:56,366][ceph_volume.process][INFO  ] stdout
> ID_ATA_ROTATION_RATE_RPM=0
> [2021-11-12 21:23:56,366][ceph_volume.process][INFO  ] stdout ID_ATA_SATA=1
> [2021-11-12 21:23:56,366][ceph_volume.process][INFO  ] stdout
> ID_ATA_SATA_SIGNAL_RATE_GEN1=1
> [2021-11-12 21:23:56,366][ceph_volume.process][INFO  ] stdout
> ID_ATA_SATA_SIGNAL_RATE_GEN2=1
> [2021-11-12 21:23:56,366][ceph_volume.process][INFO  ] stdout
> ID_ATA_WRITE_CACHE=1
> [2021-11-12 21:23:56,366][ceph_volume.process][INFO  ] stdout
> ID_ATA_WRITE_CACHE_ENABLED=1
> [2021-11-12 21:23:56,366][ceph_volume.process][INFO  ] stdout ID_BUS=ata
> [2021-11-12 21:23:56,366][ceph_volume.process][INFO  ] stdout
> ID_FS_TYPE=ext2 [2021-11-12 21:23:56,366][ceph_volume.process][INFO  ]
> stdout
> ID_FS_USAGE=filesystem
> [2021-11-12 21:23:56,367][ceph_volume.process][INFO  ] stdout
> ID_FS_UUID=47c8d1ee-1c50-4af6-8fd5-001583a6f71f
> [2021-11-12 21:23:56,367][ceph_volume.process][INFO  ] stdout
> ID_FS_UUID_ENC=47c8d1ee-1c50-4af6-8fd5-001583a6f71f
> [2021-11-12 21:23:56,367][ceph_volume.process][INFO  ] stdout
> ID_FS_VERSION=1.0
> [2021-11-12 21:23:56,367][ceph_volume.process][INFO  ] stdout
> ID_MODEL=CT240BX500SSD1
> [2021-11-12 21:23:56,367][ceph_volume.process][INFO  ] stdout
> ID_MODEL_ENC=CT240BX500SSD1\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\
> x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20 [2021-11-12
> 21:23:56,367][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_DISK=8:48
> [2021-11-12 21:23:56,367][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_FLAGS=0x80
> [2021-11-12 21:23:56,367][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_NUMBER=1
> [2021-11-12 21:23:56,367][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_OFFSET=2048
> [2021-11-12 21:23:56,367][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_SCHEME=dos
> [2021-11-12 21:23:56,367][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_SIZE=997376
> [2021-11-12 21:23:56,367][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_TYPE=0x83
> [2021-11-12 21:23:56,368][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_UUID=9a4155cb-01
> [2021-11-12 21:23:56,368][ceph_volume.process][INFO  ] stdout
> ID_PART_TABLE_TYPE=dos
> [2021-11-12 21:23:56,368][ceph_volume.process][INFO  ] stdout
> ID_PART_TABLE_UUID=9a4155cb
> [2021-11-12 21:23:56,368][ceph_volume.process][INFO  ] stdout
> ID_PATH=pci-0000:00:1f.2-ata-5.0
> [2021-11-12 21:23:56,368][ceph_volume.process][INFO  ] stdout
> ID_PATH_ATA_COMPAT=pci-0000:00:1f.2-ata-5
> [2021-11-12 21:23:56,368][ceph_volume.process][INFO  ] stdout
> ID_PATH_TAG=pci-0000_00_1f_2-ata-5_0
> [2021-11-12 21:23:56,368][ceph_volume.process][INFO  ] stdout
> ID_REVISION=M6CR013
> [2021-11-12 21:23:56,368][ceph_volume.process][INFO  ] stdout
> ID_SERIAL=CT240BX500SSD1_1944E3D4E7BB
> [2021-11-12 21:23:56,368][ceph_volume.process][INFO  ] stdout
> ID_SERIAL_SHORT=1944E3D4E7BB
> [2021-11-12 21:23:56,368][ceph_volume.process][INFO  ] stdout ID_TYPE=disk
> [2021-11-12 21:23:56,368][ceph_volume.process][INFO  ] stdout MAJOR=8
> [2021-11-12 21:23:56,369][ceph_volume.process][INFO  ] stdout MINOR=49
> [2021-11-12 21:23:56,369][ceph_volume.process][INFO  ] stdout PARTN=1
> [2021-11-12 21:23:56,369][ceph_volume.process][INFO  ] stdout
> SUBSYSTEM=block [2021-11-12 21:23:56,369][ceph_volume.process][INFO  ]
> stdout TAGS=:systemd: [2021-11-12 21:23:56,369][ceph_volume.process][INFO 
> ] stdout
> USEC_INITIALIZED=4437580
> [2021-11-12 21:23:56,369][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd to check for BlueStore label
> [2021-11-12 21:23:56,370][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/lvs --noheadings --readonly --separator=";" -a --units=b
> --nosuffix -S lv_path=/dev/sdd2 -o
> lv_tags,lv_path,lv_name,vg_name,lv_uuid,lv_size [2021-11-12
> 21:23:56,426][ceph_volume.process][INFO  ] Running command: /usr/ bin/lsblk
> --nodeps -P -o
> NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER
> ,GROUP,MODE,ALIGNMENT,PHY-
> SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-
> ZERO,PKNAME,PARTLABEL /dev/sdd2
> [2021-11-12 21:23:56,434][ceph_volume.process][INFO  ] stdout NAME="sdd2"
> KNAME="sdd2" MAJ:MIN="8:50" FSTYPE="" MOUNTPOINT="" LABEL="" UUID="" RO="0"
> RM="0" MODEL="" SIZE="1K" STATE="" OWNER="root" GROUP="disk"
> MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="0"
> SCHED="mq-deadline" TYPE="part" DISC-ALN="0" DISC-GRAN="512B" DISC-MAX="2G"
> DISC-ZERO="0" PKNAME="sdd" PARTLABEL=""
> [2021-11-12 21:23:56,435][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/blkid -c /dev/null -p /dev/sdd2
> [2021-11-12 21:23:56,439][ceph_volume.process][INFO  ] stdout /dev/sdd2:
> PTUUID="4808244c" PTTYPE="dos" PART_ENTRY_SCHEME="dos"
> PART_ENTRY_UUID="9a4155cb-02" PART_ENTRY_TYPE="0x5" PART_ENTRY_NUMBER="2"
> PART_ENTRY_OFFSET="1001470" PART_ENTRY_SIZE="467859458"
> PART_ENTRY_DISK="8:48" [2021-11-12 21:23:56,440][ceph_volume.process][INFO 
> ] Running command: /usr/ sbin/pvs --noheadings --readonly --units=b
> --nosuffix --separator=";" -o
> vg_name,pv_count,lv_count,vg_attr,vg_extent_count,vg_free_count,vg_extent_s
> ize /dev/sdd2
> [2021-11-12 21:23:56,501][ceph_volume.process][INFO  ] stderr Cannot use
> /dev/ sdd2: device is too small (pv_min_size)
> [2021-11-12 21:23:56,502][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd2 to check for BlueStore label
> [2021-11-12 21:23:56,502][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd to check for BlueStore label
> [2021-11-12 21:23:56,503][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd2 to check for BlueStore label
> [2021-11-12 21:23:56,503][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd to check for BlueStore label
> [2021-11-12 21:23:56,503][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/udevadm info --query=property /dev/sdd2
> [2021-11-12 21:23:56,513][ceph_volume.process][INFO  ] stdout DEVLINKS=/dev/
> disk/by-partuuid/9a4155cb-02
> /dev/disk/by-id/ata-CT240BX500SSD1_1944E3D4E7BB- part2
> /dev/disk/by-path/pci-0000:00:1f.2-ata-5.0-part2 /dev/disk/by-path/
> pci-0000:00:1f.2-ata-5-part2
> [2021-11-12 21:23:56,513][ceph_volume.process][INFO  ] stdout DEVNAME=/dev/
> sdd2
> [2021-11-12 21:23:56,513][ceph_volume.process][INFO  ] stdout DEVPATH=/
> devices/pci0000:00/0000:00:1f.2/ata5/host4/target4:0:0/4:0:0:0/block/sdd/sdd
> 2 [2021-11-12 21:23:56,513][ceph_volume.process][INFO  ] stdout
> DEVTYPE=partition
> [2021-11-12 21:23:56,513][ceph_volume.process][INFO  ] stdout ID_ATA=1
> [2021-11-12 21:23:56,513][ceph_volume.process][INFO  ] stdout
> ID_ATA_DOWNLOAD_MICROCODE=1
> [2021-11-12 21:23:56,514][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM=1
> [2021-11-12 21:23:56,514][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM_CURRENT_VALUE=254
> [2021-11-12 21:23:56,514][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM_ENABLED=1
> [2021-11-12 21:23:56,514][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_HPA=1
> [2021-11-12 21:23:56,514][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_HPA_ENABLED=1
> [2021-11-12 21:23:56,514][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PM=1
> [2021-11-12 21:23:56,514][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PM_ENABLED=1
> [2021-11-12 21:23:56,514][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY=1
> [2021-11-12 21:23:56,514][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ENABLED=0
> [2021-11-12 21:23:56,514][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ENHANCED_ERASE_UNIT_MIN=2
> [2021-11-12 21:23:56,514][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ERASE_UNIT_MIN=2
> [2021-11-12 21:23:56,515][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SMART=1
> [2021-11-12 21:23:56,515][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SMART_ENABLED=1
> [2021-11-12 21:23:56,515][ceph_volume.process][INFO  ] stdout
> ID_ATA_ROTATION_RATE_RPM=0
> [2021-11-12 21:23:56,515][ceph_volume.process][INFO  ] stdout ID_ATA_SATA=1
> [2021-11-12 21:23:56,515][ceph_volume.process][INFO  ] stdout
> ID_ATA_SATA_SIGNAL_RATE_GEN1=1
> [2021-11-12 21:23:56,515][ceph_volume.process][INFO  ] stdout
> ID_ATA_SATA_SIGNAL_RATE_GEN2=1
> [2021-11-12 21:23:56,515][ceph_volume.process][INFO  ] stdout
> ID_ATA_WRITE_CACHE=1
> [2021-11-12 21:23:56,515][ceph_volume.process][INFO  ] stdout
> ID_ATA_WRITE_CACHE_ENABLED=1
> [2021-11-12 21:23:56,515][ceph_volume.process][INFO  ] stdout ID_BUS=ata
> [2021-11-12 21:23:56,515][ceph_volume.process][INFO  ] stdout
> ID_MODEL=CT240BX500SSD1
> [2021-11-12 21:23:56,515][ceph_volume.process][INFO  ] stdout
> ID_MODEL_ENC=CT240BX500SSD1\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\
> x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20 [2021-11-12
> 21:23:56,515][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_DISK=8:48
> [2021-11-12 21:23:56,516][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_NUMBER=2
> [2021-11-12 21:23:56,516][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_OFFSET=1001470
> [2021-11-12 21:23:56,516][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_SCHEME=dos
> [2021-11-12 21:23:56,516][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_SIZE=467859458
> [2021-11-12 21:23:56,516][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_TYPE=0x5
> [2021-11-12 21:23:56,516][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_UUID=9a4155cb-02
> [2021-11-12 21:23:56,516][ceph_volume.process][INFO  ] stdout
> ID_PART_TABLE_TYPE=dos
> [2021-11-12 21:23:56,516][ceph_volume.process][INFO  ] stdout
> ID_PART_TABLE_UUID=4808244c
> [2021-11-12 21:23:56,516][ceph_volume.process][INFO  ] stdout
> ID_PATH=pci-0000:00:1f.2-ata-5.0
> [2021-11-12 21:23:56,516][ceph_volume.process][INFO  ] stdout
> ID_PATH_ATA_COMPAT=pci-0000:00:1f.2-ata-5
> [2021-11-12 21:23:56,516][ceph_volume.process][INFO  ] stdout
> ID_PATH_TAG=pci-0000_00_1f_2-ata-5_0
> [2021-11-12 21:23:56,517][ceph_volume.process][INFO  ] stdout
> ID_REVISION=M6CR013
> [2021-11-12 21:23:56,517][ceph_volume.process][INFO  ] stdout
> ID_SERIAL=CT240BX500SSD1_1944E3D4E7BB
> [2021-11-12 21:23:56,517][ceph_volume.process][INFO  ] stdout
> ID_SERIAL_SHORT=1944E3D4E7BB
> [2021-11-12 21:23:56,517][ceph_volume.process][INFO  ] stdout ID_TYPE=disk
> [2021-11-12 21:23:56,517][ceph_volume.process][INFO  ] stdout MAJOR=8
> [2021-11-12 21:23:56,517][ceph_volume.process][INFO  ] stdout MINOR=50
> [2021-11-12 21:23:56,517][ceph_volume.process][INFO  ] stdout PARTN=2
> [2021-11-12 21:23:56,517][ceph_volume.process][INFO  ] stdout
> SUBSYSTEM=block [2021-11-12 21:23:56,517][ceph_volume.process][INFO  ]
> stdout TAGS=:systemd: [2021-11-12 21:23:56,517][ceph_volume.process][INFO 
> ] stdout
> USEC_INITIALIZED=4428059
> [2021-11-12 21:23:56,518][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/lvs --noheadings --readonly --separator=";" -a --units=b
> --nosuffix -S lv_path=/dev/sdd5 -o
> lv_tags,lv_path,lv_name,vg_name,lv_uuid,lv_size [2021-11-12
> 21:23:56,570][ceph_volume.process][INFO  ] Running command: /usr/ bin/lsblk
> --nodeps -P -o
> NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER
> ,GROUP,MODE,ALIGNMENT,PHY-
> SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-
> ZERO,PKNAME,PARTLABEL /dev/sdd5
> [2021-11-12 21:23:56,576][ceph_volume.process][INFO  ] stdout NAME="sdd5"
> KNAME="sdd5" MAJ:MIN="8:53" FSTYPE="crypto_LUKS" MOUNTPOINT="" LABEL=""
> UUID="fbfc2e93-1c31-469b-80ce-0805c065be6f" RO="0" RM="0" MODEL=""
> SIZE="223.1G" STATE="" OWNER="root" GROUP="disk" MODE="brw-rw----"
> ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="0" SCHED="mq-deadline"
> TYPE="part" DISC-ALN="0" DISC-GRAN="512B" DISC-MAX="2G" DISC-ZERO="0"
> PKNAME="sdd" PARTLABEL=""
> [2021-11-12 21:23:56,577][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/blkid -c /dev/null -p /dev/sdd5
> [2021-11-12 21:23:56,580][ceph_volume.process][INFO  ] stdout /dev/sdd5:
> VERSION="2" UUID="fbfc2e93-1c31-469b-80ce-0805c065be6f" TYPE="crypto_LUKS"
> USAGE="crypto" PART_ENTRY_SCHEME="dos" PART_ENTRY_UUID="9a4155cb-05"
> PART_ENTRY_TYPE="0x83" PART_ENTRY_NUMBER="5" PART_ENTRY_OFFSET="1001472"
> PART_ENTRY_SIZE="467859456" PART_ENTRY_DISK="8:48"
> [2021-11-12 21:23:56,581][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/pvs --noheadings --readonly --units=b --nosuffix --separator=";"
> -o
> vg_name,pv_count,lv_count,vg_attr,vg_extent_count,vg_free_count,vg_extent_s
> ize /dev/sdd5
> [2021-11-12 21:23:56,650][ceph_volume.process][INFO  ] stderr Failed to find
> physical volume "/dev/sdd5".
> [2021-11-12 21:23:56,650][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd5 to check for BlueStore label
> [2021-11-12 21:23:56,651][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd to check for BlueStore label
> [2021-11-12 21:23:56,651][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd5 to check for BlueStore label
> [2021-11-12 21:23:56,651][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd to check for BlueStore label
> [2021-11-12 21:23:56,651][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/udevadm info --query=property /dev/sdd5
> [2021-11-12 21:23:56,664][ceph_volume.process][INFO  ] stdout DEVLINKS=/dev/
> disk/by-path/pci-0000:00:1f.2-ata-5-part5 /dev/disk/by-partuuid/9a4155cb-05
> / dev/disk/by-id/ata-CT240BX500SSD1_1944E3D4E7BB-part5 /dev/disk/by-uuid/
> fbfc2e93-1c31-469b-80ce-0805c065be6f /dev/disk/by-path/pci-0000:00:1f.2-
> ata-5.0-part5
> [2021-11-12 21:23:56,664][ceph_volume.process][INFO  ] stdout DEVNAME=/dev/
> sdd5
> [2021-11-12 21:23:56,664][ceph_volume.process][INFO  ] stdout DEVPATH=/
> devices/pci0000:00/0000:00:1f.2/ata5/host4/target4:0:0/4:0:0:0/block/sdd/sdd
> 5 [2021-11-12 21:23:56,665][ceph_volume.process][INFO  ] stdout
> DEVTYPE=partition
> [2021-11-12 21:23:56,665][ceph_volume.process][INFO  ] stdout ID_ATA=1
> [2021-11-12 21:23:56,665][ceph_volume.process][INFO  ] stdout
> ID_ATA_DOWNLOAD_MICROCODE=1
> [2021-11-12 21:23:56,665][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM=1
> [2021-11-12 21:23:56,665][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM_CURRENT_VALUE=254
> [2021-11-12 21:23:56,665][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM_ENABLED=1
> [2021-11-12 21:23:56,665][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_HPA=1
> [2021-11-12 21:23:56,665][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_HPA_ENABLED=1
> [2021-11-12 21:23:56,665][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PM=1
> [2021-11-12 21:23:56,665][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PM_ENABLED=1
> [2021-11-12 21:23:56,665][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY=1
> [2021-11-12 21:23:56,665][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ENABLED=0
> [2021-11-12 21:23:56,666][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ENHANCED_ERASE_UNIT_MIN=2
> [2021-11-12 21:23:56,666][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ERASE_UNIT_MIN=2
> [2021-11-12 21:23:56,666][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SMART=1
> [2021-11-12 21:23:56,666][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SMART_ENABLED=1
> [2021-11-12 21:23:56,666][ceph_volume.process][INFO  ] stdout
> ID_ATA_ROTATION_RATE_RPM=0
> [2021-11-12 21:23:56,666][ceph_volume.process][INFO  ] stdout ID_ATA_SATA=1
> [2021-11-12 21:23:56,666][ceph_volume.process][INFO  ] stdout
> ID_ATA_SATA_SIGNAL_RATE_GEN1=1
> [2021-11-12 21:23:56,666][ceph_volume.process][INFO  ] stdout
> ID_ATA_SATA_SIGNAL_RATE_GEN2=1
> [2021-11-12 21:23:56,666][ceph_volume.process][INFO  ] stdout
> ID_ATA_WRITE_CACHE=1
> [2021-11-12 21:23:56,666][ceph_volume.process][INFO  ] stdout
> ID_ATA_WRITE_CACHE_ENABLED=1
> [2021-11-12 21:23:56,666][ceph_volume.process][INFO  ] stdout ID_BUS=ata
> [2021-11-12 21:23:56,666][ceph_volume.process][INFO  ] stdout
> ID_FS_TYPE=crypto_LUKS
> [2021-11-12 21:23:56,667][ceph_volume.process][INFO  ] stdout
> ID_FS_USAGE=crypto
> [2021-11-12 21:23:56,667][ceph_volume.process][INFO  ] stdout
> ID_FS_UUID=fbfc2e93-1c31-469b-80ce-0805c065be6f
> [2021-11-12 21:23:56,667][ceph_volume.process][INFO  ] stdout
> ID_FS_UUID_ENC=fbfc2e93-1c31-469b-80ce-0805c065be6f
> [2021-11-12 21:23:56,667][ceph_volume.process][INFO  ] stdout
> ID_FS_VERSION=2 [2021-11-12 21:23:56,667][ceph_volume.process][INFO  ]
> stdout
> ID_MODEL=CT240BX500SSD1
> [2021-11-12 21:23:56,667][ceph_volume.process][INFO  ] stdout
> ID_MODEL_ENC=CT240BX500SSD1\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\
> x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20 [2021-11-12
> 21:23:56,667][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_DISK=8:48
> [2021-11-12 21:23:56,667][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_NUMBER=5
> [2021-11-12 21:23:56,667][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_OFFSET=1001472
> [2021-11-12 21:23:56,667][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_SCHEME=dos
> [2021-11-12 21:23:56,667][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_SIZE=467859456
> [2021-11-12 21:23:56,667][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_TYPE=0x83
> [2021-11-12 21:23:56,668][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_UUID=9a4155cb-05
> [2021-11-12 21:23:56,668][ceph_volume.process][INFO  ] stdout
> ID_PART_TABLE_TYPE=dos
> [2021-11-12 21:23:56,668][ceph_volume.process][INFO  ] stdout
> ID_PART_TABLE_UUID=9a4155cb
> [2021-11-12 21:23:56,668][ceph_volume.process][INFO  ] stdout
> ID_PATH=pci-0000:00:1f.2-ata-5.0
> [2021-11-12 21:23:56,668][ceph_volume.process][INFO  ] stdout
> ID_PATH_ATA_COMPAT=pci-0000:00:1f.2-ata-5
> [2021-11-12 21:23:56,668][ceph_volume.process][INFO  ] stdout
> ID_PATH_TAG=pci-0000_00_1f_2-ata-5_0
> [2021-11-12 21:23:56,668][ceph_volume.process][INFO  ] stdout
> ID_REVISION=M6CR013
> [2021-11-12 21:23:56,668][ceph_volume.process][INFO  ] stdout
> ID_SERIAL=CT240BX500SSD1_1944E3D4E7BB
> [2021-11-12 21:23:56,668][ceph_volume.process][INFO  ] stdout
> ID_SERIAL_SHORT=1944E3D4E7BB
> [2021-11-12 21:23:56,668][ceph_volume.process][INFO  ] stdout ID_TYPE=disk
> [2021-11-12 21:23:56,668][ceph_volume.process][INFO  ] stdout MAJOR=8
> [2021-11-12 21:23:56,669][ceph_volume.process][INFO  ] stdout MINOR=53
> [2021-11-12 21:23:56,669][ceph_volume.process][INFO  ] stdout PARTN=5
> [2021-11-12 21:23:56,669][ceph_volume.process][INFO  ] stdout
> SUBSYSTEM=block [2021-11-12 21:23:56,669][ceph_volume.process][INFO  ]
> stdout TAGS=:systemd: [2021-11-12 21:23:56,669][ceph_volume.process][INFO 
> ] stdout
> USEC_INITIALIZED=4429765
> [2021-11-12 21:23:56,670][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/lvs --noheadings --readonly --separator=";" -a --units=b
> --nosuffix -S lv_path=/dev/sdd1 -o
> lv_tags,lv_path,lv_name,vg_name,lv_uuid,lv_size [2021-11-12
> 21:23:56,730][ceph_volume.process][INFO  ] Running command: /usr/ bin/lsblk
> --nodeps -P -o
> NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER
> ,GROUP,MODE,ALIGNMENT,PHY-
> SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-
> ZERO,PKNAME,PARTLABEL /dev/sdd1
> [2021-11-12 21:23:56,738][ceph_volume.process][INFO  ] stdout NAME="sdd1"
> KNAME="sdd1" MAJ:MIN="8:49" FSTYPE="ext2" MOUNTPOINT="" LABEL=""
> UUID="47c8d1ee-1c50-4af6-8fd5-001583a6f71f" RO="0" RM="0" MODEL=""
> SIZE="487M" STATE="" OWNER="root" GROUP="disk" MODE="brw-rw----"
> ALIGNMENT="0" PHY- SEC="512" LOG-SEC="512" ROTA="0" SCHED="mq-deadline"
> TYPE="part" DISC-ALN="0" DISC-GRAN="512B" DISC-MAX="2G" DISC-ZERO="0"
> PKNAME="sdd" PARTLABEL="" [2021-11-12
> 21:23:56,738][ceph_volume.process][INFO  ] Running command: /usr/
> sbin/blkid -c /dev/null -p /dev/sdd1
> [2021-11-12 21:23:56,744][ceph_volume.process][INFO  ] stdout /dev/sdd1:
> UUID="47c8d1ee-1c50-4af6-8fd5-001583a6f71f" VERSION="1.0" BLOCK_SIZE="1024"
> TYPE="ext2" USAGE="filesystem" PART_ENTRY_SCHEME="dos"
> PART_ENTRY_UUID="9a4155cb-01" PART_ENTRY_TYPE="0x83" PART_ENTRY_FLAGS="0x80"
> PART_ENTRY_NUMBER="1" PART_ENTRY_OFFSET="2048" PART_ENTRY_SIZE="997376"
> PART_ENTRY_DISK="8:48"
> [2021-11-12 21:23:56,745][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/pvs --noheadings --readonly --units=b --nosuffix --separator=";"
> -o
> vg_name,pv_count,lv_count,vg_attr,vg_extent_count,vg_free_count,vg_extent_s
> ize /dev/sdd1
> [2021-11-12 21:23:56,814][ceph_volume.process][INFO  ] stderr Failed to find
> physical volume "/dev/sdd1".
> [2021-11-12 21:23:56,814][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd1 to check for BlueStore label
> [2021-11-12 21:23:56,815][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd to check for BlueStore label
> [2021-11-12 21:23:56,815][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd1 to check for BlueStore label
> [2021-11-12 21:23:56,815][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd to check for BlueStore label
> [2021-11-12 21:23:56,815][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/udevadm info --query=property /dev/sdd1
> [2021-11-12 21:23:56,828][ceph_volume.process][INFO  ] stdout DEVLINKS=/dev/
> disk/by-id/ata-CT240BX500SSD1_1944E3D4E7BB-part1 /dev/disk/by-path/
> pci-0000:00:1f.2-ata-5.0-part1
> /dev/disk/by-path/pci-0000:00:1f.2-ata-5-part1
> /dev/disk/by-uuid/47c8d1ee-1c50-4af6-8fd5-001583a6f71f
> /dev/disk/by-partuuid/ 9a4155cb-01
> [2021-11-12 21:23:56,828][ceph_volume.process][INFO  ] stdout DEVNAME=/dev/
> sdd1
> [2021-11-12 21:23:56,828][ceph_volume.process][INFO  ] stdout DEVPATH=/
> devices/pci0000:00/0000:00:1f.2/ata5/host4/target4:0:0/4:0:0:0/block/sdd/sdd
> 1 [2021-11-12 21:23:56,828][ceph_volume.process][INFO  ] stdout
> DEVTYPE=partition
> [2021-11-12 21:23:56,829][ceph_volume.process][INFO  ] stdout ID_ATA=1
> [2021-11-12 21:23:56,829][ceph_volume.process][INFO  ] stdout
> ID_ATA_DOWNLOAD_MICROCODE=1
> [2021-11-12 21:23:56,829][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM=1
> [2021-11-12 21:23:56,829][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM_CURRENT_VALUE=254
> [2021-11-12 21:23:56,829][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM_ENABLED=1
> [2021-11-12 21:23:56,829][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_HPA=1
> [2021-11-12 21:23:56,829][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_HPA_ENABLED=1
> [2021-11-12 21:23:56,829][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PM=1
> [2021-11-12 21:23:56,829][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PM_ENABLED=1
> [2021-11-12 21:23:56,829][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY=1
> [2021-11-12 21:23:56,829][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ENABLED=0
> [2021-11-12 21:23:56,830][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ENHANCED_ERASE_UNIT_MIN=2
> [2021-11-12 21:23:56,830][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ERASE_UNIT_MIN=2
> [2021-11-12 21:23:56,830][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SMART=1
> [2021-11-12 21:23:56,830][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SMART_ENABLED=1
> [2021-11-12 21:23:56,830][ceph_volume.process][INFO  ] stdout
> ID_ATA_ROTATION_RATE_RPM=0
> [2021-11-12 21:23:56,830][ceph_volume.process][INFO  ] stdout ID_ATA_SATA=1
> [2021-11-12 21:23:56,830][ceph_volume.process][INFO  ] stdout
> ID_ATA_SATA_SIGNAL_RATE_GEN1=1
> [2021-11-12 21:23:56,830][ceph_volume.process][INFO  ] stdout
> ID_ATA_SATA_SIGNAL_RATE_GEN2=1
> [2021-11-12 21:23:56,830][ceph_volume.process][INFO  ] stdout
> ID_ATA_WRITE_CACHE=1
> [2021-11-12 21:23:56,830][ceph_volume.process][INFO  ] stdout
> ID_ATA_WRITE_CACHE_ENABLED=1
> [2021-11-12 21:23:56,830][ceph_volume.process][INFO  ] stdout ID_BUS=ata
> [2021-11-12 21:23:56,830][ceph_volume.process][INFO  ] stdout
> ID_FS_TYPE=ext2 [2021-11-12 21:23:56,831][ceph_volume.process][INFO  ]
> stdout
> ID_FS_USAGE=filesystem
> [2021-11-12 21:23:56,831][ceph_volume.process][INFO  ] stdout
> ID_FS_UUID=47c8d1ee-1c50-4af6-8fd5-001583a6f71f
> [2021-11-12 21:23:56,831][ceph_volume.process][INFO  ] stdout
> ID_FS_UUID_ENC=47c8d1ee-1c50-4af6-8fd5-001583a6f71f
> [2021-11-12 21:23:56,831][ceph_volume.process][INFO  ] stdout
> ID_FS_VERSION=1.0
> [2021-11-12 21:23:56,831][ceph_volume.process][INFO  ] stdout
> ID_MODEL=CT240BX500SSD1
> [2021-11-12 21:23:56,831][ceph_volume.process][INFO  ] stdout
> ID_MODEL_ENC=CT240BX500SSD1\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\
> x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20 [2021-11-12
> 21:23:56,831][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_DISK=8:48
> [2021-11-12 21:23:56,831][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_FLAGS=0x80
> [2021-11-12 21:23:56,831][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_NUMBER=1
> [2021-11-12 21:23:56,831][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_OFFSET=2048
> [2021-11-12 21:23:56,831][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_SCHEME=dos
> [2021-11-12 21:23:56,832][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_SIZE=997376
> [2021-11-12 21:23:56,832][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_TYPE=0x83
> [2021-11-12 21:23:56,832][ceph_volume.process][INFO  ] stdout
> ID_PART_ENTRY_UUID=9a4155cb-01
> [2021-11-12 21:23:56,832][ceph_volume.process][INFO  ] stdout
> ID_PART_TABLE_TYPE=dos
> [2021-11-12 21:23:56,832][ceph_volume.process][INFO  ] stdout
> ID_PART_TABLE_UUID=9a4155cb
> [2021-11-12 21:23:56,832][ceph_volume.process][INFO  ] stdout
> ID_PATH=pci-0000:00:1f.2-ata-5.0
> [2021-11-12 21:23:56,832][ceph_volume.process][INFO  ] stdout
> ID_PATH_ATA_COMPAT=pci-0000:00:1f.2-ata-5
> [2021-11-12 21:23:56,832][ceph_volume.process][INFO  ] stdout
> ID_PATH_TAG=pci-0000_00_1f_2-ata-5_0
> [2021-11-12 21:23:56,832][ceph_volume.process][INFO  ] stdout
> ID_REVISION=M6CR013
> [2021-11-12 21:23:56,832][ceph_volume.process][INFO  ] stdout
> ID_SERIAL=CT240BX500SSD1_1944E3D4E7BB
> [2021-11-12 21:23:56,832][ceph_volume.process][INFO  ] stdout
> ID_SERIAL_SHORT=1944E3D4E7BB
> [2021-11-12 21:23:56,832][ceph_volume.process][INFO  ] stdout ID_TYPE=disk
> [2021-11-12 21:23:56,833][ceph_volume.process][INFO  ] stdout MAJOR=8
> [2021-11-12 21:23:56,833][ceph_volume.process][INFO  ] stdout MINOR=49
> [2021-11-12 21:23:56,833][ceph_volume.process][INFO  ] stdout PARTN=1
> [2021-11-12 21:23:56,833][ceph_volume.process][INFO  ] stdout
> SUBSYSTEM=block [2021-11-12 21:23:56,833][ceph_volume.process][INFO  ]
> stdout TAGS=:systemd: [2021-11-12 21:23:56,833][ceph_volume.process][INFO 
> ] stdout
> USEC_INITIALIZED=4437580
> [2021-11-12 21:23:56,833][ceph_volume.util.disk][INFO  ] opening device
> /dev/ sdd to check for BlueStore label
> [2021-11-12 21:23:56,834][ceph_volume.process][INFO  ] Running command:
> /usr/ sbin/udevadm info --query=property /dev/sdd
> [2021-11-12 21:23:56,846][ceph_volume.process][INFO  ] stdout DEVLINKS=/dev/
> disk/by-path/pci-0000:00:1f.2-ata-5.0
> /dev/disk/by-path/pci-0000:00:1f.2-ata-5
> /dev/disk/by-id/ata-CT240BX500SSD1_1944E3D4E7BB
> [2021-11-12 21:23:56,846][ceph_volume.process][INFO  ] stdout
> DEVNAME=/dev/sdd [2021-11-12 21:23:56,847][ceph_volume.process][INFO  ]
> stdout DEVPATH=/
> devices/pci0000:00/0000:00:1f.2/ata5/host4/target4:0:0/4:0:0:0/block/sdd
> [2021-11-12 21:23:56,847][ceph_volume.process][INFO  ] stdout DEVTYPE=disk
> [2021-11-12 21:23:56,847][ceph_volume.process][INFO  ] stdout ID_ATA=1
> [2021-11-12 21:23:56,847][ceph_volume.process][INFO  ] stdout
> ID_ATA_DOWNLOAD_MICROCODE=1
> [2021-11-12 21:23:56,847][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM=1
> [2021-11-12 21:23:56,847][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM_CURRENT_VALUE=254
> [2021-11-12 21:23:56,847][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_APM_ENABLED=1
> [2021-11-12 21:23:56,847][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_HPA=1
> [2021-11-12 21:23:56,847][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_HPA_ENABLED=1
> [2021-11-12 21:23:56,847][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PM=1
> [2021-11-12 21:23:56,847][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_PM_ENABLED=1
> [2021-11-12 21:23:56,847][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY=1
> [2021-11-12 21:23:56,848][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ENABLED=0
> [2021-11-12 21:23:56,848][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ENHANCED_ERASE_UNIT_MIN=2
> [2021-11-12 21:23:56,848][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SECURITY_ERASE_UNIT_MIN=2
> [2021-11-12 21:23:56,848][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SMART=1
> [2021-11-12 21:23:56,848][ceph_volume.process][INFO  ] stdout
> ID_ATA_FEATURE_SET_SMART_ENABLED=1
> [2021-11-12 21:23:56,848][ceph_volume.process][INFO  ] stdout
> ID_ATA_ROTATION_RATE_RPM=0
> [2021-11-12 21:23:56,848][ceph_volume.process][INFO  ] stdout ID_ATA_SATA=1
> [2021-11-12 21:23:56,848][ceph_volume.process][INFO  ] stdout
> ID_ATA_SATA_SIGNAL_RATE_GEN1=1
> [2021-11-12 21:23:56,848][ceph_volume.process][INFO  ] stdout
> ID_ATA_SATA_SIGNAL_RATE_GEN2=1
> [2021-11-12 21:23:56,848][ceph_volume.process][INFO  ] stdout
> ID_ATA_WRITE_CACHE=1
> [2021-11-12 21:23:56,848][ceph_volume.process][INFO  ] stdout
> ID_ATA_WRITE_CACHE_ENABLED=1
> [2021-11-12 21:23:56,848][ceph_volume.process][INFO  ] stdout ID_BUS=ata
> [2021-11-12 21:23:56,849][ceph_volume.process][INFO  ] stdout
> ID_MODEL=CT240BX500SSD1
> [2021-11-12 21:23:56,849][ceph_volume.process][INFO  ] stdout
> ID_MODEL_ENC=CT240BX500SSD1\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\
> x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20\x20 [2021-11-12
> 21:23:56,849][ceph_volume.process][INFO  ] stdout
> ID_PART_TABLE_TYPE=dos
> [2021-11-12 21:23:56,849][ceph_volume.process][INFO  ] stdout
> ID_PART_TABLE_UUID=9a4155cb
> [2021-11-12 21:23:56,849][ceph_volume.process][INFO  ] stdout
> ID_PATH=pci-0000:00:1f.2-ata-5.0
> [2021-11-12 21:23:56,849][ceph_volume.process][INFO  ] stdout
> ID_PATH_ATA_COMPAT=pci-0000:00:1f.2-ata-5
> [2021-11-12 21:23:56,849][ceph_volume.process][INFO  ] stdout
> ID_PATH_TAG=pci-0000_00_1f_2-ata-5_0
> [2021-11-12 21:23:56,849][ceph_volume.process][INFO  ] stdout
> ID_REVISION=M6CR013
> [2021-11-12 21:23:56,849][ceph_volume.process][INFO  ] stdout
> ID_SERIAL=CT240BX500SSD1_1944E3D4E7BB
> [2021-11-12 21:23:56,849][ceph_volume.process][INFO  ] stdout
> ID_SERIAL_SHORT=1944E3D4E7BB
> [2021-11-12 21:23:56,849][ceph_volume.process][INFO  ] stdout ID_TYPE=disk
> [2021-11-12 21:23:56,849][ceph_volume.process][INFO  ] stdout MAJOR=8
> [2021-11-12 21:23:56,849][ceph_volume.process][INFO  ] stdout MINOR=48
> [2021-11-12 21:23:56,850][ceph_volume.process][INFO  ] stdout
> SUBSYSTEM=block [2021-11-12 21:23:56,850][ceph_volume.process][INFO  ]
> stdout TAGS=:systemd: [2021-11-12 21:23:56,850][ceph_volume.process][INFO 
> ] stdout
> USEC_INITIALIZED=4425899
> [2021-11-12 21:23:56,854][ceph_volume.util.system][INFO  ] /dev/sda was not
> found as mounted
> [2021-11-12 21:23:56,861][ceph_volume.util.system][INFO  ] /dev/sdb was not
> found as mounted
> [2021-11-12 21:23:56,865][ceph_volume.util.system][INFO  ] /dev/sdc was not
> found as mounted
> 
> On Friday, 12 November 2021 21:13:05 GMT Igor Fedotov wrote:
> > Hi Stephen,
> > 
> > it would be nice to see failing OSD startup log...
> > 
> > 
> > Thanks,
> > 
> > Igor
> > 
> > On 11/12/2021 11:37 PM, Stephen J. Thompson wrote:
> > > Before shutting down
> 
> _______________________________________________
> ceph-users mailing list -- ceph-users@xxxxxxx
> To unsubscribe send an email to ceph-users-leave@xxxxxxx




_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx