RE: Large RAID volume issues

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]



 
I would seriously start thinking about using LVM on such a large storage unit.
 
You can't use an MBR partition table on a volume that large there is a max 2TB disk size limit and 2TB partition size limit for MBR, so you must use GPT.
 
There is a real lack of reliable and easy GPT tools under Linux, parted can read GPT partition tables, but I do not believe it can create them AFAIK.
 
LVM can handle volumes of extremely large size (64-bit), so you shouldn't run into any problems there and you can create file systems directly in LVs of 2TB+.
 
-Ross
 


From: centos-bounces@xxxxxxxxxx [mailto:centos-bounces@xxxxxxxxxx] On Behalf Of Rob Lines
Sent: Monday, February 04, 2008 11:34 AM
To: CentOS mailing list
Subject: Large RAID volume issues

I have just finished creating an array on our new enclosure and our CentOS 5 server has recognized it.  It shows as the full 6tb in the LSI configuration utility as well as when I ran fdisk:

[root@HOST sbin]# fdisk /dev/sdb
Note: sector size is 2048 (not 512)

The number of cylinders for this disk is set to 182292.
There is nothing wrong with that, but this is larger than 1024,
and could in certain setups cause problems with:
1) software that runs at boot time (e.g., old versions of LILO)
2) booting and partitioning software from other OSs
   (e.g., DOS FDISK, OS/2 FDISK)

Command (m for help): p

Disk /dev/sdb: 5997.6 GB, 5997628227584 bytes
255 heads, 63 sectors/track, 182292 cylinders
Units = cylinders of 16065 * 2048 = 32901120 bytes

   Device Boot      Start         End      Blocks   Id  System

I was then created a parition in fdisk and it appeared to work until I formated it (here is the output of the formating)

[root@HOST ~]# mkfs -t ext2 -j /dev/sdb1
mke2fs 1.39 (29-May-2006)
Filesystem label=
OS type: Linux
Block size=4096 (log=2)
Fragment size=4096 (log=2)
195264512 inodes, 390518634 blocks
19525931 blocks (5.00%) reserved for the super user
First data block=0
Maximum filesystem blocks=4294967296
11918 block groups
32768 blocks per group, 32768 fragments per group
16384 inodes per group
Superblock backups stored on blocks:
        32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,
        4096000, 7962624, 11239424, 20480000, 23887872, 71663616, 78675968,
        102400000, 214990848

Writing inode tables: done
Creating journal (32768 blocks): done
Writing superblocks and filesystem accounting information: done

When I did a df I got the following (only included the array entry)

[root@HOST etc]# df -h
Filesystem            Size  Used Avail Use% Mounted on
...
/dev/sdb1             1.5T  198M  1.5T   1% /home1

I then tried removing it and working with parted. 


[root@HOST etc]# parted /dev/sdb
Warning: Device /dev/sdb has a logical sector size of 2048.  Not all parts of GNU Parted support this at
the moment, and the working code is HIGHLY EXPERIMENTAL.

GNU Parted 1.8.1
Using /dev/sdb
Welcome to GNU Parted! Type 'help' to view a list of commands.
(parted) p
Error: Unable to open /dev/sdb - unrecognised disk label.
(parted) mklabel gpt
*** glibc detected *** <unknown>: double free or corruption (!prev): 0x0000000016760800 ***
======= Backtrace: =========
/lib64/libc.so.6[0x3435c6f4f4]
/lib64/libc.so.6(cfree+0x8c)[0x3435c72b1c]
/usr/lib64/libparted-1.8.so.0[0x3436c1a5c5]
/usr/lib64/libparted-1.8.so.0[0x3436c48a54]
======= Memory map: ========
00400000-00410000 r-xp 00000000 08:05 130761                             /sbin/parted
00610000-00611000 rw-p 00010000 08:05 130761                             /sbin/parted
00611000-00612000 rw-p 00611000 00:00 0
00810000-00812000 rw-p 00010000 08:05 130761                             /sbin/parted
1673d000-1677f000 rw-p 1673d000 00:00 0
3435800000-343581a000 r-xp 00000000 08:05 4765445                        /lib64/ld-2.5.so
3435a19000-3435a1a000 r--p 00019000 08:05 4765445                        /lib64/ld-2.5.so
3435a1a000-3435a1b000 rw-p 0001a000 08:05 4765445                        /lib64/ld-2.5.so
3435c00000-3435d46000 r-xp 00000000 08:05 4765452                        /lib64/libc-2.5.so
3435d46000-3435f46000 ---p 00146000 08:05 4765452                        /lib64/libc-2.5.so
3435f46000-3435f4a000 r--p 00146000 08:05 4765452                        /lib64/libc-2.5.so
3435f4a000-3435f4b000 rw-p 0014a000 08:05 4765452                        /lib64/libc-2.5.so
3435f4b000-3435f50000 rw-p 3435f4b000 00:00 0
3436000000-3436013000 r-xp 00000000 08:05 4765602                        /lib64/libdevmapper.so.1.02
3436013000-3436213000 ---p 00013000 08:05 4765602                        /lib64/libdevmapper.so.1.02
3436213000-3436215000 rw-p 00013000 08:05 4765602                        /lib64/libdevmapper.so.1.02
3436400000-3436402000 r-xp 00000000 08:05 4765458                        /lib64/libdl-2.5.so
3436402000-3436602000 ---p 00002000 08:05 4765458                        /lib64/libdl-2.5.so
3436602000-3436603000 r--p 00002000 08:05 4765458                        /lib64/libdl-2.5.so
3436603000-3436604000 rw-p 00003000 08:05 4765458                        /lib64/libdl-2.5.so
3436800000-3436802000 r-xp 00000000 08:05 4765478                        /lib64/libuuid.so.1.2
3436802000-3436a02000 ---p 00002000 08:05 4765478                        /lib64/libuuid.so.1.2
3436a02000-3436a03000 rw-p 00002000 08:05 4765478                        /lib64/libuuid.so.1.2
3436c00000-3436c5c000 r-xp 00000000 08:05 464724                         /usr/lib64/libparted-1.8.so.0.0.                                                   1
3436c5c000-3436e5b000 ---p 0005c000 08:05 464724                         /usr/lib64/libparted-1.8.so.0.0.                                                   1
3436e5b000-3436e5f000 rw-p 0005b000 08:05 464724                         /usr/lib64/libparted-1.8.so.0.0.                                                   1
3436e5f000-3436e60000 rw-p 3436e5f000 00:00 0
3437000000-3437035000 r-xp 00000000 08:05 463236                         /usr/lib64/libreadline.so.5.1
3437035000-3437234000 ---p 00035000 08:05 463236                         /usr/lib64/libreadline.so.5.1
3437234000-343723c000 rw-p 00034000 08:05 463236                         /usr/lib64/libreadline.so.5.1
343723c000-343723d000 rw-p 343723c000 00:00 0
343b000000-343b00d000 r-xp 00000000 08:05 4765466                        /lib64/libgcc_s-4.1.2-20070626.s                                                   o.1
343b00d000-343b20d000 ---p 0000d000 08:05 4765466                        /lib64/libgcc_s-4.1.2-20070626.s                                                   o.1
343b20d000-343b20e000 rw-p 0000d000 08:05 4765466                        /lib64/libgcc_s-4.1.2-20070626.s                                                   o.1
343c000000-343c03b000 r-xp 00000000 08:05 4765743                        /lib64/libsepol.so.1
343c03b000-343c23b000 ---p 0003b000 08:05 4765743                        /lib64/libsepol.so.1
343c23b000-343c23c000 rw-p 0003b000 08:05 4765743                        /lib64/libsepol.so.1
343c23c000-343c246000 rw-p 343c23c000 00:00 0
343c400000-343c415000 r-xp 00000000 08:05 4765744                        /lib64/libselinux.so.1
343c415000-343c615000 ---p 00015000 08:05 4765744                        /lib64/libselinux.so.1
343c615000-343c617000 rw-p 00015000 08:05 4765744                        /lib64/libselinux.so.1
343c617000-343c618000 rw-p 343c617000 00:00 0
3448e00000-3448e4e000 r-xp 00000000 08:05 464701                         /usr/lib64/libncurses.so.5.5
3448e4e000-344904e000 ---p 0004e000 08:05 464701                      Aborted

Any suggestions or direction would be appreciated.

Thank you,
Rob


This e-mail, and any attachments thereto, is intended only for use by the addressee(s) named herein and may contain legally privileged and/or confidential information. If you are not the intended recipient of this e-mail, you are hereby notified that any dissemination, distribution or copying of this e-mail, and any attachments thereto, is strictly prohibited. If you have received this e-mail in error, please immediately notify the sender and permanently delete the original and any copy or printout thereof.
_______________________________________________
CentOS mailing list
CentOS@xxxxxxxxxx
http://lists.centos.org/mailman/listinfo/centos

[Index of Archives]     [CentOS]     [CentOS Announce]     [CentOS Development]     [CentOS ARM Devel]     [CentOS Docs]     [CentOS Virtualization]     [Carrier Grade Linux]     [Linux Media]     [Asterisk]     [DCCP]     [Netdev]     [Xorg]     [Linux USB]
  Powered by Linux