Re: Bypassing LVM Restrictions - RAID6 With Less Than 5 Disks

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



John> Can you tell me what you mean by "per-disk host-managed integrity-checking"?  Are you running dm-integrity in your setup?

Yes, that’s what I meant. I know that I could manually use IntegritySetup for each RAID member, but that seems very unappealing.

John> Can you post the output of:
John> lsblk
John> so we understand better what you have?

Please see the attached text files, although it’s a bit convoluted. “Postulate” devices are part of the RAID that I’d like to transform. If anyone has any recommendations for my setup, I’d be interested to hear them. Maybe I’ll switch to LVMCache someday. :P

John> But in any case, good luck with getting RAID6 solid and working as a pure LVM setup. I don’t think you're going to make it happen any time soon, and I honestly prefer to have seperate layers for my setup so that each layer does it's own think and does it well.

Thanks. I really don’t want to give up the DM-Integrity management. Less complexity is just a bonus.

Alex

NAME                                       MAJ:MIN RM   SIZE RO TYPE  MOUNTPOINT
sda                                          8:0    0   1.8T  0 disk  
└─sda4                                       8:4    0   1.8T  0 part  
  └─Postulate_Double-1                     254:2    0   3.6T  0 lvm   
sdb                                          8:16   0   3.6T  0 disk  
└─sdb4                                       8:20   0   3.6T  0 part  
  ├─Postulate_Outer-Primary_rmeta_0        254:5    0     1M  0 lvm   
  │ └─Postulate_Outer-Primary              254:25   0   7.2T  0 lvm   
  │   └─bcache1                            253:128  0   7.2T  0 disk  
  │     └─main_crypt_5                     254:26   0   7.2T  0 crypt 
  │       ├─Postulate_Inner-Primary        254:27   0     5T  0 lvm   /
  │       └─Postulate_Inner-Swap           254:28   0    24G  0 lvm   [SWAP]
  ├─Postulate_Outer-Primary_rimage_0_imeta 254:6    0  29.6G  0 lvm   
  │ └─Postulate_Outer-Primary_rimage_0     254:10   0   3.6T  0 lvm   
  │   └─Postulate_Outer-Primary            254:25   0   7.2T  0 lvm   
  │     └─bcache1                          253:128  0   7.2T  0 disk  
  │       └─main_crypt_5                   254:26   0   7.2T  0 crypt 
  │         ├─Postulate_Inner-Primary      254:27   0     5T  0 lvm   /
  │         └─Postulate_Inner-Swap         254:28   0    24G  0 lvm   [SWAP]
  └─Postulate_Outer-Primary_rimage_0_iorig 254:9    0   3.6T  0 lvm   
    └─Postulate_Outer-Primary_rimage_0     254:10   0   3.6T  0 lvm   
      └─Postulate_Outer-Primary            254:25   0   7.2T  0 lvm   
        └─bcache1                          253:128  0   7.2T  0 disk  
          └─main_crypt_5                   254:26   0   7.2T  0 crypt 
            ├─Postulate_Inner-Primary      254:27   0     5T  0 lvm   /
            └─Postulate_Inner-Swap         254:28   0    24G  0 lvm   [SWAP]
sdc                                          8:32   0   3.6T  0 disk  
├─sdc1                                       8:33   0    10M  0 part  
├─sdc2                                       8:34   0   200M  0 part  
├─sdc3                                       8:35   0   809M  0 part  
└─sdc4                                       8:36   0   3.6T  0 part  
  ├─Postulate_Outer-Primary_rmeta_2        254:20   0     1M  0 lvm   
  │ └─Postulate_Outer-Primary              254:25   0   7.2T  0 lvm   
  │   └─bcache1                            253:128  0   7.2T  0 disk  
  │     └─main_crypt_5                     254:26   0   7.2T  0 crypt 
  │       ├─Postulate_Inner-Primary        254:27   0     5T  0 lvm   /
  │       └─Postulate_Inner-Swap           254:28   0    24G  0 lvm   [SWAP]
  ├─Postulate_Outer-Primary_rimage_2_imeta 254:21   0  29.6G  0 lvm   
  │ └─Postulate_Outer-Primary_rimage_2     254:23   0   3.6T  0 lvm   
  │   └─Postulate_Outer-Primary            254:25   0   7.2T  0 lvm   
  │     └─bcache1                          253:128  0   7.2T  0 disk  
  │       └─main_crypt_5                   254:26   0   7.2T  0 crypt 
  │         ├─Postulate_Inner-Primary      254:27   0     5T  0 lvm   /
  │         └─Postulate_Inner-Swap         254:28   0    24G  0 lvm   [SWAP]
  └─Postulate_Outer-Primary_rimage_2_iorig 254:22   0   3.6T  0 lvm   
    └─Postulate_Outer-Primary_rimage_2     254:23   0   3.6T  0 lvm   
      └─Postulate_Outer-Primary            254:25   0   7.2T  0 lvm   
        └─bcache1                          253:128  0   7.2T  0 disk  
          └─main_crypt_5                   254:26   0   7.2T  0 crypt 
            ├─Postulate_Inner-Primary      254:27   0     5T  0 lvm   /
            └─Postulate_Inner-Swap         254:28   0    24G  0 lvm   [SWAP]
sdd                                          8:48   0   3.6T  0 disk  
└─sdd4                                       8:52   0   3.6T  0 part  
  ├─Postulate_Outer-Primary_rmeta_1        254:12   0     1M  0 lvm   
  │ └─Postulate_Outer-Primary              254:25   0   7.2T  0 lvm   
  │   └─bcache1                            253:128  0   7.2T  0 disk  
  │     └─main_crypt_5                     254:26   0   7.2T  0 crypt 
  │       ├─Postulate_Inner-Primary        254:27   0     5T  0 lvm   /
  │       └─Postulate_Inner-Swap           254:28   0    24G  0 lvm   [SWAP]
  ├─Postulate_Outer-Primary_rimage_1_imeta 254:13   0  29.6G  0 lvm   
  │ └─Postulate_Outer-Primary_rimage_1     254:15   0   3.6T  0 lvm   
  │   └─Postulate_Outer-Primary            254:25   0   7.2T  0 lvm   
  │     └─bcache1                          253:128  0   7.2T  0 disk  
  │       └─main_crypt_5                   254:26   0   7.2T  0 crypt 
  │         ├─Postulate_Inner-Primary      254:27   0     5T  0 lvm   /
  │         └─Postulate_Inner-Swap         254:28   0    24G  0 lvm   [SWAP]
  └─Postulate_Outer-Primary_rimage_1_iorig 254:14   0   3.6T  0 lvm   
    └─Postulate_Outer-Primary_rimage_1     254:15   0   3.6T  0 lvm   
      └─Postulate_Outer-Primary            254:25   0   7.2T  0 lvm   
        └─bcache1                          253:128  0   7.2T  0 disk  
          └─main_crypt_5                   254:26   0   7.2T  0 crypt 
            ├─Postulate_Inner-Primary      254:27   0     5T  0 lvm   /
            └─Postulate_Inner-Swap         254:28   0    24G  0 lvm   [SWAP]
sde                                          8:64   0   4.5T  0 disk  
└─sde4                                       8:68   0   4.5T  0 part  
  ├─Axiom_Outer-Primary_rmeta_0            254:4    0     4M  0 lvm   
  │ └─Axiom_Outer-Primary                  254:24   0   4.5T  0 lvm   
  │   └─bcache0                            253:0    0   4.5T  0 disk  
  │     └─main_crypt_2                     254:29   0   4.5T  0 crypt 
  │       └─Axiom_Inner-New                254:30   0   3.6T  0 lvm   
  ├─Axiom_Outer-Primary_rimage_0_imeta     254:7    0  36.8G  0 lvm   
  │ └─Axiom_Outer-Primary_rimage_0         254:11   0   4.5T  0 lvm   
  │   └─Axiom_Outer-Primary                254:24   0   4.5T  0 lvm   
  │     └─bcache0                          253:0    0   4.5T  0 disk  
  │       └─main_crypt_2                   254:29   0   4.5T  0 crypt 
  │         └─Axiom_Inner-New              254:30   0   3.6T  0 lvm   
  └─Axiom_Outer-Primary_rimage_0_iorig     254:8    0   4.5T  0 lvm   
    └─Axiom_Outer-Primary_rimage_0         254:11   0   4.5T  0 lvm   
      └─Axiom_Outer-Primary                254:24   0   4.5T  0 lvm   
        └─bcache0                          253:0    0   4.5T  0 disk  
          └─main_crypt_2                   254:29   0   4.5T  0 crypt 
            └─Axiom_Inner-New              254:30   0   3.6T  0 lvm   
sdf                                          8:80   0 931.5G  0 disk  
└─sdf4                                       8:84   0 930.5G  0 part  
sdg                                          8:96   0 931.5G  0 disk  
└─sdg4                                       8:100  0 930.5G  0 part  
sdh                                          8:112  0   5.5T  0 disk  
└─sdh4                                       8:116  0   5.5T  0 part  
  ├─Postulate_Backup-Primary               254:0    0     5T  0 lvm   
  │ └─backup_crypt_3                       254:31   0     5T  0 crypt /mnt/bk/3
  └─Postulate_Backup-Old                   254:1    0   128G  0 lvm   
sdi                                          8:128  0   1.8T  0 disk  
└─sdi4                                       8:132  0   1.8T  0 part  
  └─Postulate_Double-1                     254:2    0   3.6T  0 lvm   
sdj                                          8:144  0   4.5T  0 disk  
└─sdj4                                       8:148  0   4.5T  0 part  
  ├─Axiom_Outer-Primary_rmeta_1            254:16   0     4M  0 lvm   
  │ └─Axiom_Outer-Primary                  254:24   0   4.5T  0 lvm   
  │   └─bcache0                            253:0    0   4.5T  0 disk  
  │     └─main_crypt_2                     254:29   0   4.5T  0 crypt 
  │       └─Axiom_Inner-New                254:30   0   3.6T  0 lvm   
  ├─Axiom_Outer-Primary_rimage_1_imeta     254:17   0  36.8G  0 lvm   
  │ └─Axiom_Outer-Primary_rimage_1         254:19   0   4.5T  0 lvm   
  │   └─Axiom_Outer-Primary                254:24   0   4.5T  0 lvm   
  │     └─bcache0                          253:0    0   4.5T  0 disk  
  │       └─main_crypt_2                   254:29   0   4.5T  0 crypt 
  │         └─Axiom_Inner-New              254:30   0   3.6T  0 lvm   
  └─Axiom_Outer-Primary_rimage_1_iorig     254:18   0   4.5T  0 lvm   
    └─Axiom_Outer-Primary_rimage_1         254:19   0   4.5T  0 lvm   
      └─Axiom_Outer-Primary                254:24   0   4.5T  0 lvm   
        └─bcache0                          253:0    0   4.5T  0 disk  
          └─main_crypt_2                   254:29   0   4.5T  0 crypt 
            └─Axiom_Inner-New              254:30   0   3.6T  0 lvm   
sdk                                          8:160  0 223.6G  0 disk  
└─sdk4                                       8:164  0 189.6G  0 part  
nvme0n1                                    259:0    0 931.5G  0 disk  
├─nvme0n1p2                                259:1    0   200M  0 part  /boot/efi
├─nvme0n1p3                                259:2    0   814M  0 part  /boot
├─nvme0n1p4                                259:3    0   832G  0 part  
│ └─Postulate_Outer-Cache                  254:3    0   800G  0 lvm   
│   └─bcache1                              253:128  0   7.2T  0 disk  
│     └─main_crypt_5                       254:26   0   7.2T  0 crypt 
│       ├─Postulate_Inner-Primary          254:27   0     5T  0 lvm   /
│       └─Postulate_Inner-Swap             254:28   0    24G  0 lvm   [SWAP]
└─nvme0n1p8                                259:4    0    54G  0 part  
  └─recovery_crypt                         254:32   0    54G  0 crypt /mnt/recovery
             NAME                                       MAJ:MIN RM   SIZE RO TYPE  MOUNTPOINT
             sda                                          8:0    0   1.8T  0 disk  
         ┌┈▶ └─sda4                                       8:4    0   1.8T  0 part  
         ┆   sdb                                          8:16   0   3.6T  0 disk  
         ┆   └─sdb4                                       8:20   0   3.6T  0 part  
      ┌┈▶┆     ├─Postulate_Outer-Primary_rmeta_0        254:5    0     1M  0 lvm   
   ┌┈▶┆  ┆     ├─Postulate_Outer-Primary_rimage_0_imeta 254:6    0  29.6G  0 lvm   
   └┬▶┆  ┆     └─Postulate_Outer-Primary_rimage_0_iorig 254:9    0   3.6T  0 lvm   
    └┈├┈▶┆┈┈┈Postulate_Outer-Primary_rimage_0           254:10   0   3.6T  0 lvm   
      ┆  ┆   sdc                                          8:32   0   3.6T  0 disk  
      ┆  ┆   ├─sdc1                                       8:33   0    10M  0 part  
      ┆  ┆   ├─sdc2                                       8:34   0   200M  0 part  
      ┆  ┆   ├─sdc3                                       8:35   0   809M  0 part  
      ┆  ┆   └─sdc4                                       8:36   0   3.6T  0 part  
      ├┈▶┆     ├─Postulate_Outer-Primary_rmeta_2        254:20   0     1M  0 lvm   
   ┌┈▶┆  ┆     ├─Postulate_Outer-Primary_rimage_2_imeta 254:21   0  29.6G  0 lvm   
   └┬▶┆  ┆     └─Postulate_Outer-Primary_rimage_2_iorig 254:22   0   3.6T  0 lvm   
    └┈├┈▶┆┈┈┈Postulate_Outer-Primary_rimage_2           254:23   0   3.6T  0 lvm   
      ┆  ┆   sdd                                          8:48   0   3.6T  0 disk  
      ┆  ┆   └─sdd4                                       8:52   0   3.6T  0 part  
      ├┈▶┆     ├─Postulate_Outer-Primary_rmeta_1        254:12   0     1M  0 lvm   
   ┌┈▶┆  ┆     ├─Postulate_Outer-Primary_rimage_1_imeta 254:13   0  29.6G  0 lvm   
   └┬▶┆  ┆     └─Postulate_Outer-Primary_rimage_1_iorig 254:14   0   3.6T  0 lvm   
    └┈└┬▶┆┈┈┈Postulate_Outer-Primary_rimage_1           254:15   0   3.6T  0 lvm   
   ┌┈▶ └┈┆┈┈┈Postulate_Outer-Primary                    254:25   0   7.2T  0 lvm   
   ┆     ┆   sde                                          8:64   0   4.5T  0 disk  
   ┆     ┆   └─sde4                                       8:68   0   4.5T  0 part  
   ┆  ┌┈▶┆     ├─Axiom_Outer-Primary_rmeta_0            254:4    0     4M  0 lvm   
┌┈▶┆  ┆  ┆     ├─Axiom_Outer-Primary_rimage_0_imeta     254:7    0  36.8G  0 lvm   
└┬▶┆  ┆  ┆     └─Axiom_Outer-Primary_rimage_0_iorig     254:8    0   4.5T  0 lvm   
 └┈┆┈┈├┈▶┆┈┈┈Axiom_Outer-Primary_rimage_0               254:11   0   4.5T  0 lvm   
   ┆  ┆  ┆   sdf                                          8:80   0 931.5G  0 disk  
   ┆  ┆  ┆   └─sdf4                                       8:84   0 930.5G  0 part  
   ┆  ┆  ┆   sdg                                          8:96   0 931.5G  0 disk  
   ┆  ┆  ┆   └─sdg4                                       8:100  0 930.5G  0 part  
   ┆  ┆  ┆   sdh                                          8:112  0   5.5T  0 disk  
   ┆  ┆  ┆   └─sdh4                                       8:116  0   5.5T  0 part  
   ┆  ┆  ┆     ├─Postulate_Backup-Primary               254:0    0     5T  0 lvm   
   ┆  ┆  ┆     │ └─backup_crypt_3                       254:31   0     5T  0 crypt /mnt/bk/3
   ┆  ┆  ┆     └─Postulate_Backup-Old                   254:1    0   128G  0 lvm   
   ┆  ┆  ┆   sdi                                          8:128  0   1.8T  0 disk  
   ┆  ┆  └┬▶ └─sdi4                                       8:132  0   1.8T  0 part  
   ┆  ┆   └┈┈Postulate_Double-1                         254:2    0   3.6T  0 lvm   
   ┆  ┆      sdj                                          8:144  0   4.5T  0 disk  
   ┆  ┆      └─sdj4                                       8:148  0   4.5T  0 part  
   ┆  ├┈▶      ├─Axiom_Outer-Primary_rmeta_1            254:16   0     4M  0 lvm   
   ┆  ┆  ┌┈▶   ├─Axiom_Outer-Primary_rimage_1_imeta     254:17   0  36.8G  0 lvm   
   ┆  ┆  └┬▶   └─Axiom_Outer-Primary_rimage_1_iorig     254:18   0   4.5T  0 lvm   
   ┆  └┬▶ └┈┈Axiom_Outer-Primary_rimage_1               254:19   0   4.5T  0 lvm   
   ┆   └┈┈┈┈┈Axiom_Outer-Primary                        254:24   0   4.5T  0 lvm   
   ┆         └─bcache0                                  253:0    0   4.5T  0 disk  
   ┆           └─main_crypt_2                           254:29   0   4.5T  0 crypt 
   ┆             └─Axiom_Inner-New                      254:30   0   3.6T  0 lvm   
   ┆         sdk                                          8:160  0 223.6G  0 disk  
   ┆         └─sdk4                                       8:164  0 189.6G  0 part  
   ┆         nvme0n1                                    259:0    0 931.5G  0 disk  
   ┆         ├─nvme0n1p2                                259:1    0   200M  0 part  /boot/efi
   ┆         ├─nvme0n1p3                                259:2    0   814M  0 part  /boot
   ┆         ├─nvme0n1p4                                259:3    0   832G  0 part  
   └┬▶       │ └─Postulate_Outer-Cache                  254:3    0   800G  0 lvm   
    ┆        └─nvme0n1p8                                259:4    0    54G  0 part  
    ┆          └─recovery_crypt                         254:32   0    54G  0 crypt /mnt/recovery
    └┈┈┈┈┈┈┈┈bcache1                                    253:128  0   7.2T  0 disk  
             └─main_crypt_5                             254:26   0   7.2T  0 crypt 
               ├─Postulate_Inner-Primary                254:27   0     5T  0 lvm   /
               └─Postulate_Inner-Swap                   254:28   0    24G  0 lvm   [SWAP]
_______________________________________________
linux-lvm mailing list
linux-lvm@xxxxxxxxxx
https://listman.redhat.com/mailman/listinfo/linux-lvm
read the LVM HOW-TO at http://tldp.org/HOWTO/LVM-HOWTO/

[Index of Archives]     [Gluster Users]     [Kernel Development]     [Linux Clusters]     [Device Mapper]     [Security]     [Bugtraq]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Linux RAID]

  Powered by Linux