See attached. I should mention that the last drive i added is on a new
controller that is separate from the other drives, but seemed to work
fine for a bit, so kinda doubt that's the issue...
thanks,
allie
On 3/30/2020 6:21 PM, Roger Heflin wrote:
> do this against each partition that had it:
>
> mdadm --examine /dev/sd***
>
> It seems like it is not seeing it as a md-raid.
>
> On Mon, Mar 30, 2020 at 11:13 AM Alexander Shenkin <al@xxxxxxxxxxx> wrote:
>> Thanks Roger,
>>
>> The only line that isn't commented out in /etc/mdadm.conf is "DEVICE
>> partitions"...
>>
>> Thanks,
>>
>> Allie
>>
>> On 3/30/2020 4:53 PM, Roger Heflin wrote:
>>> That seems really odd. Is the raid456 module loaded?
>>>
>>> On mine I see messages like this for each disk it scanned and
>>> considered as maybe possibly being an array member.
>>> kernel: [ 83.468700] md/raid:md13: device sdi3 operational as raid disk 5
>>> and messages like this:
>>> md/raid:md14: not clean -- starting background reconstruction
>>>
>>> You might look at /etc/mdadm.conf on the rescue cd and see if it has a
>>> DEVICE line that limits what is being scanned.
>>>
>>> On Mon, Mar 30, 2020 at 10:13 AM Alexander Shenkin <al@xxxxxxxxxxx> wrote:
>>>> Thanks Roger,
>>>>
>>>> that grep just returns the detection of the raid1 (md127). See dmesg
>>>> and mdadm --detail results attached.
>>>>
>>>> Many thanks,
>>>> allie
>>>>
>>>> On 3/28/2020 1:36 PM, Roger Heflin wrote:
>>>>> Try this grep:
>>>>> dmesg | grep "md/raid", if that returns nothing if you can just send
>>>>> the entire dmesg.
>>>>>
>>>>> On Sat, Mar 28, 2020 at 2:47 AM Alexander Shenkin <al@xxxxxxxxxxx> wrote:
>>>>>> Thanks Roger. dmesg has nothing in it referring to md126 or md127....
>>>>>> any other thoughts on how to investigate?
>>>>>>
>>>>>> thanks,
>>>>>> allie
>>>>>>
>>>>>> On 3/27/2020 3:55 PM, Roger Heflin wrote:
>>>>>>> A non-assembled array always reports raid1.
>>>>>>>
>>>>>>> I would run "dmesg | grep md126" to start with and see what it reports it saw.
>>>>>>>
>>>>>>> On Fri, Mar 27, 2020 at 10:29 AM Alexander Shenkin <al@xxxxxxxxxxx> wrote:
>>>>>>>> Thanks Wol,
>>>>>>>>
>>>>>>>> Booting in SystemRescueCD and looking in /proc/mdstat, two arrays are
>>>>>>>> reported. The first (md126) in reported as inactive with all 7 disks
>>>>>>>> listed as spares. The second (md127) is reported as active
>>>>>>>> auto-read-only with all 7 disks operational. Also, the only
>>>>>>>> "personality" reported is Raid1. I could go ahead with your suggestion
>>>>>>>> of mdadm --stop array and then mdadm --assemble, but I thought the
>>>>>>>> reporting of just the Raid1 personality was a bit strange, so wanted to
>>>>>>>> check in before doing that...
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Allie
>>>>>>>>
>>>>>>>> On 3/26/2020 10:00 PM, antlists wrote:
>>>>>>>>> On 26/03/2020 17:07, Alexander Shenkin wrote:
>>>>>>>>>> I surely need to boot with a rescue disk of some sort, but from there,
>>>>>>>>>> I'm not sure exactly when I should do. Any suggestions are very welcome!
>>>>>>>>> Okay. Find a liveCD that supports raid (hopefully something like
>>>>>>>>> SystemRescueCD). Make sure it has a very recent kernel and the latest
>>>>>>>>> mdadm.
>>>>>>>>>
>>>>>>>>> All being well, the resync will restart, and when it's finished your
>>>>>>>>> system will be fine. If it doesn't restart on its own, do an "mdadm
>>>>>>>>> --stop array", followed by an "mdadm --assemble"
>>>>>>>>>
>>>>>>>>> If that doesn't work, then
>>>>>>>>>
>>>>>>>>> https://raid.wiki.kernel.org/index.php/Linux_Raid#When_Things_Go_Wrogn
>>>>>>>>>
>>>>>>>>> Cheers,
>>>>>>>>> Wol
/dev/sda3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x5
Array UUID : c7303f62:d848d424:269581c8:83a045ec
Name : ubuntu:2
Creation Time : Sun Feb 5 23:39:58 2017
Raid Level : raid6
Raid Devices : 7
Avail Dev Size : 5840377856 (2784.91 GiB 2990.27 GB)
Array Size : 14600944640 (13924.55 GiB 14951.37 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262056 sectors, after=0 sectors
State : active
Device UUID : 10bdbed5:cb70c8a9:566c384d:ec4c926e
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : 1 (6->7)
Update Time : Tue Feb 25 09:21:27 2020
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 300f6945 - correct
Events : 316485
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 0
Array State : AAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdb3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x5
Array UUID : c7303f62:d848d424:269581c8:83a045ec
Name : ubuntu:2
Creation Time : Sun Feb 5 23:39:58 2017
Raid Level : raid6
Raid Devices : 7
Avail Dev Size : 5840377856 (2784.91 GiB 2990.27 GB)
Array Size : 14600944640 (13924.55 GiB 14951.37 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262056 sectors, after=0 sectors
State : active
Device UUID : cf70dad5:0c9ff5f6:ede689f2:ccee2eb0
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : 1 (6->7)
Update Time : Tue Feb 25 09:21:27 2020
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 644667bb - correct
Events : 316485
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 1
Array State : AAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdc3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x5
Array UUID : c7303f62:d848d424:269581c8:83a045ec
Name : ubuntu:2
Creation Time : Sun Feb 5 23:39:58 2017
Raid Level : raid6
Raid Devices : 7
Avail Dev Size : 5840377856 (2784.91 GiB 2990.27 GB)
Array Size : 14600944640 (13924.55 GiB 14951.37 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262056 sectors, after=0 sectors
State : active
Device UUID : f8839952:eaba2e9c:c2c401d4:3e0592a5
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : 1 (6->7)
Update Time : Tue Feb 25 09:21:27 2020
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 5d198b06 - correct
Events : 316485
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 2
Array State : AAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdd3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x5
Array UUID : c7303f62:d848d424:269581c8:83a045ec
Name : ubuntu:2
Creation Time : Sun Feb 5 23:39:58 2017
Raid Level : raid6
Raid Devices : 7
Avail Dev Size : 5840377856 (2784.91 GiB 2990.27 GB)
Array Size : 14600944640 (13924.55 GiB 14951.37 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262056 sectors, after=0 sectors
State : active
Device UUID : 875a0dbd:965a9986:1b78eb3d:e15fee50
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : 1 (6->7)
Update Time : Tue Feb 25 09:21:27 2020
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : c73e0f3f - correct
Events : 316485
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 3
Array State : AAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sde3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x5
Array UUID : c7303f62:d848d424:269581c8:83a045ec
Name : ubuntu:2
Creation Time : Sun Feb 5 23:39:58 2017
Raid Level : raid6
Raid Devices : 7
Avail Dev Size : 5840377856 (2784.91 GiB 2990.27 GB)
Array Size : 14600944640 (13924.55 GiB 14951.37 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262056 sectors, after=0 sectors
State : active
Device UUID : 635ef71b:e4add925:30ae4f0a:f6b46611
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : 1 (6->7)
Update Time : Tue Feb 25 09:21:27 2020
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 5244f196 - correct
Events : 316485
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 6
Array State : AAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdf3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x5
Array UUID : c7303f62:d848d424:269581c8:83a045ec
Name : ubuntu:2
Creation Time : Sun Feb 5 23:39:58 2017
Raid Level : raid6
Raid Devices : 7
Avail Dev Size : 5840377856 (2784.91 GiB 2990.27 GB)
Array Size : 14600944640 (13924.55 GiB 14951.37 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262056 sectors, after=0 sectors
State : active
Device UUID : dc0bda8c:2457fb4c:f87a4bec:8d5b58ed
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : 1 (6->7)
Update Time : Tue Feb 25 09:21:27 2020
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : a836bbae - correct
Events : 316485
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 5
Array State : AAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdg3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x5
Array UUID : c7303f62:d848d424:269581c8:83a045ec
Name : ubuntu:2
Creation Time : Sun Feb 5 23:39:58 2017
Raid Level : raid6
Raid Devices : 7
Avail Dev Size : 5840377856 (2784.91 GiB 2990.27 GB)
Array Size : 14600944640 (13924.55 GiB 14951.37 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262056 sectors, after=0 sectors
State : active
Device UUID : dc842dc3:09c910c7:c351c307:e2383d13
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : 1 (6->7)
Update Time : Tue Feb 25 09:21:27 2020
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 99fc5ab3 - correct
Events : 316485
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 4
Array State : AAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
