Hi,
I recently upgraded my system from Fedora 37 to 39. During boot into the
upgraded system I was thrown into emergency mode. It turned out two MD
arrays had not been assembled. Unfortunately, I could not find any
information in the logs as to what went wrong where.
A third array, which shares the spinning rust with the other two arrays,
came up fine and showed as 'active' in /proc/mdstat.
Subsequently, I tried to assemble the two missing arrays manually. At
first, I used `mdadm --assemble --scan --no-degraded`. That lead to a
complete freeze of the system. Although, the last message on screen
reported the array to be up:
mdadm: /dev/md/5 has been started with 3 drives.
I rebooted again and instead of having mdadm scan for members, I brought
up the arrays one by one with `mdadm --assemble --readonly`. That worked
and the arrays showed as 'active (read-only)' and 'clean'.
However, when putting the two arrays into readwrite mode with `mdadm -w`
the system hung for a while when doing so for /dev/md1. After a few
seconds I'm thrown back into the authentication prompt. After
authenticating again, sure enough md1 is 'active'. On to md5, issuing
the same command, the system freezes again completely.
Since I couldn't get it to work in emergency mode, I booted from USB
into a Fedora 39 live ISO. After boot, /proc/mdstat reports one array
being 'active (auto-read-only)'. That's the same array that was
assembled successfully booting from hard disk. Again, I couldn't find
any log entries regarding any attempt to bring up the other two arrays.
This time I was able to assemble the arrays manually in readwrite mode.
Moreover, I could activate the LVM volumes on top and mount them
read-only to inspect the contents. I also checked the file systems and
no errors were reported for any of the volumes. None of the disks
reported any errors in smartctl. They all passed a long selftest.
Yet, I'm still puzzled as to why md1 and md5 are not assembled during
boot and what to do about it. I tried booting into an older kernel from
Fedora 37) still installed on the system, but the system behaved exactly
the same.
I also asked for help on Fedora's forum [1] and on the mailing list [2].
A few steps were suggested, e.g. adding `level` and `num-devices` to
/etc/mdadm.conf. But none of it solved the problem.
If you read through the posts, you will see that I did have duplicate
UUIDs. I fixed that issue and converted sda from mbr to gpt in the
process. However, since I didn't experience any issues rebooting the
system while still on Fedora 37 with the duplicate UUIDs present, I
don't think that is / was a problem for mdadm. Moreover, md54 always
showed up - with or without duplicate UUIDs.
Last but not least, I followed the instructions on the wiki and gathered
all the information I could. I put it in a file (attached) for better
readability.
Besides getting my system up and running, I'd also be willing to invest
some time troubleshooting the issue, if this remotely resembles a bug.
However, I would need some guidance doing so.
[1]
https://discussion.fedoraproject.org/t/system-fails-to-boot-after-dnf-system-upgrade-due-to-missing-md-raid-devices/100218
[2]
https://lists.fedoraproject.org/archives/list/devel@xxxxxxxxxxxxxxxxxxxxxxx/thread/UDPQMHZYUQZRODTYIHFYX55JE5EGMLTN/
Cheers,
Sandro
Installed system has kernel 6.6.8 (Fedora 39)
# uname -a
Linux localhost-live 6.5.6-300.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Oct 6 19:57:21 UTC 2023 x86_64 GNU/Linux
# mdadm --version
mdadm - v4.2 - 2021-12-30
# smartctl -H -i -l scterc /dev/sda
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.5.6-300.fc39.x86_64] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Model Family: Seagate IronWolf Pro
Device Model: ST4000NE001-2MA101
Serial Number: WS24WPQ6
LU WWN Device Id: 5 000c50 0e792aeb1
Firmware Version: EN01
User Capacity: 4,000,787,030,016 bytes [4.00 TB]
Sector Sizes: 512 bytes logical, 4096 bytes physical
Rotation Rate: 7200 rpm
Form Factor: 3.5 inches
Device is: In smartctl database 7.3/5528
ATA Version is: ACS-4 (minor revision not indicated)
SATA Version is: SATA 3.3, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is: Thu Dec 28 14:53:20 2023 EST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
SCT Error Recovery Control:
Read: 70 (7.0 seconds)
Write: 70 (7.0 seconds)
# smartctl -H -i -l scterc /dev/sdb
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.5.6-300.fc39.x86_64] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Model Family: Western Digital Purple (Pro)
Device Model: WDC WD20PURZ-85AKKY0
Serial Number: WD-WX42D3173D2P
LU WWN Device Id: 5 0014ee 2141ef07e
Firmware Version: 80.00B80
User Capacity: 2,000,398,934,016 bytes [2.00 TB]
Sector Sizes: 512 bytes logical, 4096 bytes physical
Rotation Rate: 5400 rpm
Form Factor: 3.5 inches
Device is: In smartctl database 7.3/5528
ATA Version is: ACS-3 T13/2161-D revision 5
SATA Version is: SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is: Thu Dec 28 14:54:07 2023 EST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
SCT Error Recovery Control:
Read: 70 (7.0 seconds)
Write: 70 (7.0 seconds)
# smartctl -H -i -l scterc /dev/sdc
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.5.6-300.fc39.x86_64] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Model Family: Western Digital Caviar Green (AF)
Device Model: WDC WD20EARS-00MVWB0
Serial Number: WD-WCAZA6783530
LU WWN Device Id: 5 0014ee 205c359bc
Firmware Version: 51.0AB51
User Capacity: 2,000,398,934,016 bytes [2.00 TB]
Sector Sizes: 512 bytes logical, 4096 bytes physical
Device is: In smartctl database 7.3/5528
ATA Version is: ATA8-ACS (minor revision not indicated)
SATA Version is: SATA 2.6, 3.0 Gb/s
Local Time is: Thu Dec 28 14:54:29 2023 EST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
SCT Error Recovery Control command not supported
# mdadm --examine /dev/sd[abc]
/dev/sda:
MBR Magic : aa55
Partition[0] : 4294967295 sectors at 1 (type ee)
/dev/sdb:
MBR Magic : aa55
Partition[0] : 12580864 sectors at 2048 (type 82)
Partition[1] : 1048576000 sectors at 12582912 (type fd)
Partition[2] : 1048576000 sectors at 1061158912 (type fd)
Partition[3] : 1797294080 sectors at 2109734912 (type fd)
/dev/sdc:
MBR Magic : aa55
Partition[0] : 12580864 sectors at 2048 (type 82)
Partition[1] : 1048576000 sectors at 12582912 (type fd)
Partition[2] : 1048576000 sectors at 1061158912 (type fd)
Partition[3] : 1797294080 sectors at 2109734912 (type fd)
# mdadm --examine /dev/sd[abc]2
/dev/sda2:
Magic : a92b4efc
Version : 1.1
Feature Map : 0x1
Array UUID : 39295d93:e5a75797:b72287f3:51563755
Name : urras.penguinpee.nl:5
Creation Time : Sun Jun 15 17:11:41 2014
Raid Level : raid5
Raid Devices : 3
Avail Dev Size : 1048573952 sectors (500.00 GiB 536.87 GB)
Array Size : 1048573952 KiB (1000.00 GiB 1073.74 GB)
Data Offset : 2048 sectors
Super Offset : 0 sectors
Unused Space : before=1976 sectors, after=0 sectors
State : clean
Device UUID : 4bed6fca:21ecefb3:c1eec35f:0254ff2b
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Dec 27 11:13:21 2023
Bad Block Log : 512 entries available at offset 16 sectors
Checksum : 2d2992a0 - correct
Events : 630858
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 0
Array State : AAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdb2:
Magic : a92b4efc
Version : 1.1
Feature Map : 0x1
Array UUID : 39295d93:e5a75797:b72287f3:51563755
Name : urras.penguinpee.nl:5
Creation Time : Sun Jun 15 17:11:41 2014
Raid Level : raid5
Raid Devices : 3
Avail Dev Size : 1048573952 sectors (500.00 GiB 536.87 GB)
Array Size : 1048573952 KiB (1000.00 GiB 1073.74 GB)
Data Offset : 2048 sectors
Super Offset : 0 sectors
Unused Space : before=1976 sectors, after=0 sectors
State : clean
Device UUID : 27b15be2:7aa23334:11eb748b:d7e57df1
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Dec 27 11:13:21 2023
Bad Block Log : 512 entries available at offset 16 sectors
Checksum : b6889afc - correct
Events : 630858
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 1
Array State : AAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdc2:
Magic : a92b4efc
Version : 1.1
Feature Map : 0x1
Array UUID : 39295d93:e5a75797:b72287f3:51563755
Name : urras.penguinpee.nl:5
Creation Time : Sun Jun 15 17:11:41 2014
Raid Level : raid5
Raid Devices : 3
Avail Dev Size : 1048573952 sectors (500.00 GiB 536.87 GB)
Array Size : 1048573952 KiB (1000.00 GiB 1073.74 GB)
Data Offset : 2048 sectors
Super Offset : 0 sectors
Unused Space : before=1976 sectors, after=0 sectors
State : clean
Device UUID : af87a72c:1cb77e54:fa388f1c:30d18b8e
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Dec 27 11:13:21 2023
Bad Block Log : 512 entries available at offset 16 sectors
Checksum : 4f47bf66 - correct
Events : 630858
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 2
Array State : AAA ('A' == active, '.' == missing, 'R' == replacing)
# mdadm --examine /dev/sd[abc]3
/dev/sda3:
Magic : a92b4efc
Version : 1.1
Feature Map : 0x1
Array UUID : 4a2c44b5:25f2a6c9:0e7f6cae:37a8a9cc
Name : urras.penguinpee.nl:1
Creation Time : Sun Jun 15 17:14:43 2014
Raid Level : raid1
Raid Devices : 2
Avail Dev Size : 1048573952 sectors (500.00 GiB 536.87 GB)
Array Size : 524286976 KiB (500.00 GiB 536.87 GB)
Data Offset : 2048 sectors
Super Offset : 0 sectors
Unused Space : before=1976 sectors, after=0 sectors
State : clean
Device UUID : b5ab5a58:2c958982:f1628e64:8048b6a8
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Dec 27 08:00:58 2023
Bad Block Log : 512 entries available at offset 16 sectors
Checksum : 91afbc2a - correct
Events : 11917
Device Role : spare
Array State : AA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdb3:
Magic : a92b4efc
Version : 1.1
Feature Map : 0x1
Array UUID : 4a2c44b5:25f2a6c9:0e7f6cae:37a8a9cc
Name : urras.penguinpee.nl:1
Creation Time : Sun Jun 15 17:14:43 2014
Raid Level : raid1
Raid Devices : 2
Avail Dev Size : 1048573952 sectors (500.00 GiB 536.87 GB)
Array Size : 524286976 KiB (500.00 GiB 536.87 GB)
Data Offset : 2048 sectors
Super Offset : 0 sectors
Unused Space : before=1976 sectors, after=0 sectors
State : clean
Device UUID : e89a1593:d3a39398:54ce414d:ae37d801
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Dec 27 08:00:58 2023
Bad Block Log : 512 entries available at offset 16 sectors
Checksum : 244a1494 - correct
Events : 11917
Device Role : Active device 0
Array State : AA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdc3:
Magic : a92b4efc
Version : 1.1
Feature Map : 0x1
Array UUID : 4a2c44b5:25f2a6c9:0e7f6cae:37a8a9cc
Name : urras.penguinpee.nl:1
Creation Time : Sun Jun 15 17:14:43 2014
Raid Level : raid1
Raid Devices : 2
Avail Dev Size : 1048573952 sectors (500.00 GiB 536.87 GB)
Array Size : 524286976 KiB (500.00 GiB 536.87 GB)
Data Offset : 2048 sectors
Super Offset : 0 sectors
Unused Space : before=1968 sectors, after=0 sectors
State : clean
Device UUID : 3dc2ac9a:95cf7103:8ebc0582:0f3bed6f
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Dec 27 08:00:58 2023
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 39985980 - correct
Events : 11917
Device Role : Active device 1
Array State : AA ('A' == active, '.' == missing, 'R' == replacing)
# mdadm --examine /dev/sd[abc]4
/dev/sda4:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : fb919273:c6bfb891:ea1ca83c:0a8b3ad7
Name : urras.penguinpee.nl:54
Creation Time : Fri Oct 13 09:56:17 2017
Raid Level : raid5
Raid Devices : 3
Avail Dev Size : 1797031936 sectors (856.89 GiB 920.08 GB)
Array Size : 1797031936 KiB (1713.78 GiB 1840.16 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262064 sectors, after=0 sectors
State : clean
Device UUID : f0245de8:5d1730f6:200d3267:1744ffed
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Dec 27 16:21:58 2023
Bad Block Log : 512 entries available at offset 16 sectors
Checksum : 5bfae2d1 - correct
Events : 229700
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 0
Array State : AAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdb4:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : fb919273:c6bfb891:ea1ca83c:0a8b3ad7
Name : urras.penguinpee.nl:54
Creation Time : Fri Oct 13 09:56:17 2017
Raid Level : raid5
Raid Devices : 3
Avail Dev Size : 1797031936 sectors (856.89 GiB 920.08 GB)
Array Size : 1797031936 KiB (1713.78 GiB 1840.16 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262064 sectors, after=0 sectors
State : clean
Device UUID : af10814d:0950ad5f:3cdfeffe:7a4c97c6
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Dec 27 16:21:58 2023
Bad Block Log : 512 entries available at offset 16 sectors
Checksum : 9af1e1b9 - correct
Events : 229700
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 1
Array State : AAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdc4:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : fb919273:c6bfb891:ea1ca83c:0a8b3ad7
Name : urras.penguinpee.nl:54
Creation Time : Fri Oct 13 09:56:17 2017
Raid Level : raid5
Raid Devices : 3
Avail Dev Size : 1797031936 sectors (856.89 GiB 920.08 GB)
Array Size : 1797031936 KiB (1713.78 GiB 1840.16 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262064 sectors, after=0 sectors
State : clean
Device UUID : 60defeb5:e1fd3807:521124e7:3927ee3a
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Dec 27 16:21:58 2023
Bad Block Log : 512 entries available at offset 16 sectors
Checksum : 7866a16 - correct
Events : 229700
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 2
Array State : AAA ('A' == active, '.' == missing, 'R' == replacing)
# mdadm --assemble --verbose --readonly /dev/md5 /dev/sda2 /dev/sdb2 /dev/sdc2
mdadm: looking for devices for /dev/md5
mdadm: /dev/sda2 is identified as a member of /dev/md5, slot 0.
mdadm: /dev/sdb2 is identified as a member of /dev/md5, slot 1.
mdadm: /dev/sdc2 is identified as a member of /dev/md5, slot 2.
mdadm: added /dev/sdb2 to /dev/md5 as 1
mdadm: added /dev/sdc2 to /dev/md5 as 2
mdadm: added /dev/sda2 to /dev/md5 as 0
mdadm: /dev/md5 has been started with 3 drives.
# mdadm --assemble --verbose --readonly /dev/md1 /dev/sda3 /dev/sdb3 /dev/sdc3
mdadm: looking for devices for /dev/md1
mdadm: /dev/sda3 is identified as a member of /dev/md1, slot -1.
mdadm: /dev/sdb3 is identified as a member of /dev/md1, slot 0.
mdadm: /dev/sdc3 is identified as a member of /dev/md1, slot 1.
mdadm: added /dev/sdc3 to /dev/md1 as 1
mdadm: added /dev/sda3 to /dev/md1 as -1
mdadm: added /dev/sdb3 to /dev/md1 as 0
mdadm: /dev/md1 has been started with 2 drives and 1 spare.
# mdadm --assemble --verbose --readonly /dev/md54 /dev/sda4 /dev/sdb4 /dev/sdc4
mdadm: looking for devices for /dev/md54
mdadm: /dev/sda4 is identified as a member of /dev/md54, slot 0.
mdadm: /dev/sdb4 is identified as a member of /dev/md54, slot 1.
mdadm: /dev/sdc4 is identified as a member of /dev/md54, slot 2.
mdadm: added /dev/sdb4 to /dev/md54 as 1
mdadm: added /dev/sdc4 to /dev/md54 as 2
mdadm: added /dev/sda4 to /dev/md54 as 0
mdadm: /dev/md54 has been started with 3 drives.
# mdadm --detail /dev/md5
/dev/md5:
Version : 1.1
Creation Time : Sun Jun 15 17:11:41 2014
Raid Level : raid5
Array Size : 1048573952 (1000.00 GiB 1073.74 GB)
Used Dev Size : 524286976 (500.00 GiB 536.87 GB)
Raid Devices : 3
Total Devices : 3
Persistence : Superblock is persistent
Intent Bitmap : Internal
Update Time : Wed Dec 27 11:13:21 2023
State : clean
Active Devices : 3
Working Devices : 3
Failed Devices : 0
Spare Devices : 0
Layout : left-symmetric
Chunk Size : 512K
Consistency Policy : bitmap
Name : urras.penguinpee.nl:5
UUID : 39295d93:e5a75797:b72287f3:51563755
Events : 630858
Number Major Minor RaidDevice State
3 8 2 0 active sync /dev/sda2
5 8 18 1 active sync /dev/sdb2
4 8 34 2 active sync /dev/sdc2
# mdadm --detail /dev/md1
/dev/md1:
Version : 1.1
Creation Time : Sun Jun 15 17:14:43 2014
Raid Level : raid1
Array Size : 524286976 (500.00 GiB 536.87 GB)
Used Dev Size : 524286976 (500.00 GiB 536.87 GB)
Raid Devices : 2
Total Devices : 3
Persistence : Superblock is persistent
Intent Bitmap : Internal
Update Time : Wed Dec 27 08:00:58 2023
State : clean
Active Devices : 2
Working Devices : 3
Failed Devices : 0
Spare Devices : 1
Consistency Policy : bitmap
Name : urras.penguinpee.nl:1
UUID : 4a2c44b5:25f2a6c9:0e7f6cae:37a8a9cc
Events : 11917
Number Major Minor RaidDevice State
2 8 19 0 active sync /dev/sdb3
4 8 35 1 active sync /dev/sdc3
3 8 3 - spare /dev/sda3
# mdadm --detail /dev/md54
/dev/md54:
Version : 1.2
Creation Time : Fri Oct 13 09:56:17 2017
Raid Level : raid5
Array Size : 1797031936 (1713.78 GiB 1840.16 GB)
Used Dev Size : 898515968 (856.89 GiB 920.08 GB)
Raid Devices : 3
Total Devices : 3
Persistence : Superblock is persistent
Intent Bitmap : Internal
Update Time : Wed Dec 27 16:21:58 2023
State : clean
Active Devices : 3
Working Devices : 3
Failed Devices : 0
Spare Devices : 0
Layout : left-symmetric
Chunk Size : 512K
Consistency Policy : bitmap
Name : urras.penguinpee.nl:54
UUID : fb919273:c6bfb891:ea1ca83c:0a8b3ad7
Events : 229700
Number Major Minor RaidDevice State
5 8 4 0 active sync /dev/sda4
4 8 20 1 active sync /dev/sdb4
3 8 36 2 active sync /dev/sdc4
# ./lsdrv
# Wants to probe logical volumes via /dev/mapper, but the volumes aren't mounted currently (running from live ISO)
# cat /proc/mdstat
Personalities : [raid6] [raid5] [raid4] [raid1]
md54 : active (read-only) raid5 sda4[5] sdc4[3] sdb4[4]
1797031936 blocks super 1.2 level 5, 512k chunk, algorithm 2 [3/3] [UUU]
bitmap: 0/7 pages [0KB], 65536KB chunk
md1 : active (read-only) raid1 sdb3[2] sda3[3](S) sdc3[4]
524286976 blocks super 1.1 [2/2] [UU]
bitmap: 0/4 pages [0KB], 65536KB chunk
md5 : active (read-only) raid5 sda2[3] sdc2[4] sdb2[5]
1048573952 blocks super 1.1 level 5, 512k chunk, algorithm 2 [3/3] [UUU]
bitmap: 0/4 pages [0KB], 65536KB chunk
unused devices: <none>
# lsblk -f
NAME FSTYPE FSVER LABEL UUID FSAVAIL FSUSE% MOUNTPOINTS
loop0 squashfs 4.0
loop1 ext4 1.0 Anaconda 7f02b6a5-f393-44ef-a4a1-27cdd90377e7
├─live-rw ext4 1.0 Anaconda 7f02b6a5-f393-44ef-a4a1-27cdd90377e7 1.1G 86% /
└─live-base ext4 1.0 Anaconda 7f02b6a5-f393-44ef-a4a1-27cdd90377e7
loop2 DM_snapshot_cow
└─live-rw ext4 1.0 Anaconda 7f02b6a5-f393-44ef-a4a1-27cdd90377e7 1.1G 86% /
sda
├─sda1 swap 1 d9d88c35-eb44-446b-b65c-d831a19daeac
├─sda2
│ └─md5 LVM2_member LVM2 001 b2nOV2-SYbK-N5WT-gi1p-99rp-Fvf6-QmhflM
├─sda3
│ └─md1 LVM2_member LVM2 001 fOI3Jw-cmsm-w5dN-pwYS-SpZ7-UhUF-2y34Wg
│ ├─vg_urras_raid1-pop
│ ├─vg_urras_raid1-manjaro
│ ├─vg_urras_raid1-solus
│ ├─vg_urras_raid1-zorin
│ ├─vg_urras_raid1-pop_uefi
│ └─vg_urras_raid1-fedora
└─sda4 linux_raid_member 1.2 urras.penguinpee.nl:54 fb919273-c6bf-b891-ea1c-a83c0a8b3ad7
└─md54 LVM2_member LVM2 001 JaewFP-8Dx9-JakO-En0g-onza-Dhve-Oq3gfZ
sdb
├─sdb1 swap 1 f4cc72d2-6c8c-4a5e-9da9-60863dce0242
├─sdb2
│ └─md5 LVM2_member LVM2 001 b2nOV2-SYbK-N5WT-gi1p-99rp-Fvf6-QmhflM
├─sdb3
│ └─md1 LVM2_member LVM2 001 fOI3Jw-cmsm-w5dN-pwYS-SpZ7-UhUF-2y34Wg
│ ├─vg_urras_raid1-pop
│ ├─vg_urras_raid1-manjaro
│ ├─vg_urras_raid1-solus
│ ├─vg_urras_raid1-zorin
│ ├─vg_urras_raid1-pop_uefi
│ └─vg_urras_raid1-fedora
└─sdb4 linux_raid_member 1.2 urras.penguinpee.nl:54 fb919273-c6bf-b891-ea1c-a83c0a8b3ad7
└─md54 LVM2_member LVM2 001 JaewFP-8Dx9-JakO-En0g-onza-Dhve-Oq3gfZ
sdc
├─sdc1 swap 1 56a79918-0806-4c67-9898-e141c9d51dc4
├─sdc2
│ └─md5 LVM2_member LVM2 001 b2nOV2-SYbK-N5WT-gi1p-99rp-Fvf6-QmhflM
├─sdc3
│ └─md1 LVM2_member LVM2 001 fOI3Jw-cmsm-w5dN-pwYS-SpZ7-UhUF-2y34Wg
│ ├─vg_urras_raid1-pop
│ ├─vg_urras_raid1-manjaro
│ ├─vg_urras_raid1-solus
│ ├─vg_urras_raid1-zorin
│ ├─vg_urras_raid1-pop_uefi
│ └─vg_urras_raid1-fedora
└─sdc4 linux_raid_member 1.2 urras.penguinpee.nl:54 fb919273-c6bf-b891-ea1c-a83c0a8b3ad7
└─md54 LVM2_member LVM2 001 JaewFP-8Dx9-JakO-En0g-onza-Dhve-Oq3gfZ
sdd
├─sdd1 ext4 1.0 boot 8fd046b2-bcc0-4ab1-8642-e019c68beded 533.6M 38% /run/media/liveuser/boot
└─sdd2 LVM2_member LVM2 001 BHSLjX-C7Cy-f1UF-haum-J0Wf-iZls-kesOM7
└─system-root ext4 1.0 root 90727396-1a3c-46c8-84ea-834c179590b0
sde
sdf
sdg
sdh
sdi iso9660 Joliet Extension Fedora-Cinn-Live-39-1-5 2023-11-01-01-33-40-00
├─sdi1 iso9660 Joliet Extension Fedora-Cinn-Live-39-1-5 2023-11-01-01-33-40-00 0 100% /run/initramfs/live
├─sdi2 vfat FAT16 ANACONDA AF2E-9552
└─sdi3
sdj
└─sdj1 vfat FAT32 MICRO2G 7FE0-E5A9 1.6G 15% /run/media/liveuser/MICRO2G
zram0 [SWAP]
# blkid /dev/sd[abc]*
/dev/sda: PTUUID="d21dac5b-9c24-4343-961d-234cf42433ab" PTTYPE="gpt"
/dev/sda1: UUID="d9d88c35-eb44-446b-b65c-d831a19daeac" TYPE="swap" PARTLABEL="Linux swap" PARTUUID="a62e8bbe-99bc-4a80-8890-5fcd5c833c9b"
/dev/sda2: PARTLABEL="Linux RAID" PARTUUID="f6f1aa67-4057-49a9-aad9-c86d08ad1936"
/dev/sda3: PARTLABEL="Linux RAID" PARTUUID="dc76e2b3-02e4-4bfc-b260-c7a2ec8bc103"
/dev/sda4: UUID="fb919273-c6bf-b891-ea1c-a83c0a8b3ad7" UUID_SUB="f0245de8-5d17-30f6-200d-32671744ffed" LABEL="urras.penguinpee.nl:54" TYPE="linux_raid_member" PARTLABEL="Linux RAID" PARTUUID="16d46970-7302-427b-ab54-36c774a006a0"
/dev/sdb: PTUUID="d2b6d202" PTTYPE="dos"
/dev/sdb1: UUID="f4cc72d2-6c8c-4a5e-9da9-60863dce0242" TYPE="swap" PARTUUID="d2b6d202-01"
/dev/sdb2: PARTUUID="d2b6d202-02"
/dev/sdb3: PARTUUID="d2b6d202-03"
/dev/sdb4: UUID="fb919273-c6bf-b891-ea1c-a83c0a8b3ad7" UUID_SUB="af10814d-0950-ad5f-3cdf-effe7a4c97c6" LABEL="urras.penguinpee.nl:54" TYPE="linux_raid_member" PARTUUID="d2b6d202-04"
/dev/sdc: PTUUID="9c3d16cb" PTTYPE="dos"
/dev/sdc1: UUID="56a79918-0806-4c67-9898-e141c9d51dc4" TYPE="swap" PARTUUID="9c3d16cb-01"
/dev/sdc2: PARTUUID="9c3d16cb-02"
/dev/sdc3: PARTUUID="9c3d16cb-03"
/dev/sdc4: UUID="fb919273-c6bf-b891-ea1c-a83c0a8b3ad7" UUID_SUB="60defeb5-e1fd-3807-5211-24e73927ee3a" LABEL="urras.penguinpee.nl:54" TYPE="linux_raid_member" PARTUUID="9c3d16cb-04"