On Thursday 24 July 2008 15:59, gordan@xxxxxxxxxx wrote: > So, shd machines are actually SANs. You will need to use something like > DRBD if you want shd machines mirrored Hello Gordan, I am confused because i didn't do this job in a past and have no experience with this service. I would like to parse this task using small steps, in order to be able to understand what to do..., so my questions comes below: Actually, i want just to have hdb1 from shd1 and hdc1 from shd2 joided in one volume. No mirror for this volume at that momment. Is possible? If yes, how? Using ATAoE? After that, i would like to know, how to install GFS on this volume and use it as documennt root on our real web servers (rs1, rs2, rs3). Is possible? If yes, how? I don't understand from your explanation, how to group machines: shd1 and shd2 should be in one cluster and rs1, rs2 and rs3 in other cluster or: shd1 and shd2 shoud be regular servers which is just exporting their HDD using ATAoE and rs1, rs2 and rs2 to be grouped in one cluster which are importing a GFS volume from somwhere? If yes, from where? How can i configure a GFS volume on ATAoE disks and from where will be accesible? I need another one machine which will act as agregator for ATAoE disks or our real web servers (rs1, rs2, rs3) will responsible to import directly these disks? > and ATAoE or iSCSI to export the > volumes for the rs machines to mount. In our lab we are using regular hard disks, so iSCSI is excluded. I read an article here (http://www.linuxjournal.com/article/8149) about ATAoE and i have some questions: - on our centos 5.2 boxes, we already have aoe kernel module but we don't have aoe-stat command. Is any packet shoud i install via yum to have this command (or other command to hadle aoe disks) or is required do download aoetools-26.tar.gz and compile from source (http://sourceforge.net/projects/aoetools/) - in above article they are talking about RAID10, LVM and JFS. They are not teaching me about GFS and clustering. They choose JFS and not GFS saying that "JFS is a filesystem that can grow dynamically to large sizes, so he is going to put a JFS filesystem on a logical volume". I want that but using GFS, is possible or not? They are saying that: "using a cluster filesystem such as GFS, it is possible for multiple hosts on the Ethernet network to access the same block storage using ATA over Ethernet. There's no need for anything like an NFS server" "But there's a snag. Any time you're using a lot of disks, you're increasing the chances that one of the disks will fail. Usually you use RAID to take care of this issue by introducing some redundancy. Unfortunately, Linux software RAID is not cluster-aware. That means each host on the network cannot do RAID 10 using mdadm and have things simply work out." So, finally, what should i do? Can you or anybody suggest me some howtos and what is the correct order to group machines and implement clustering? Regards, Alx > > Then create a shared GFS on the ATAoE/iSCSI device. > You may, however, find that for web servers (lots of small files, frequent > access to same files from all nodes) NFS/NAS gives you better performance, > with shds configured mirrored for fail-over by not load balanced (warm > standby). > > If you need very high performance / low latencies from storage, you may > want to look into something like seznamfs for replicating content from a > single master server to multiple slaves (DAS). > > Gordan > > On Thu, 24 Jul 2008, Alex wrote: > > Hello cluster experts, > > > > I'm new here and new to cluster world too... I need some help, in order > > to setup a cluster in our organization. > > > > Shortly, our schema is: > > > > 2 routers for HA and load balancing > > - ar (active router) > > - br (backup router) > > > > 3 http servers located internaly acting as real web servers (rs1, rs2, > > rs3) behind > > ar and br routers. > > rs1=192.168.113.3/24 > > rs2=192.168.113.4/24 > > rs3=192.168.113.5/24 > > > > 2 shared data servers (shd1, shd2) > > shd1=192.168.113.6/24 > > shd1=192.168.113.7/24 > > > > 1 server for cluster management (rhclm) > > rhclm=192.168.113.8/24 > > > > I've configured ar and br routers for high availability and load banacing > > and everything is ok. Active router (ar) are forwarding http requests to > > VIP (floating) external ip address to internaly ip addresses of rs1, rs2, > > rs3 webservers. > > > > Now, i don't know how to: > > - configure and group some hard disks on our shd1 and sdh2 servers to > > form a shared volume for our rs1, rs2, rs3 real servers (i suppose that > > the correct topic should be shared volume using GFS...) > > - make usable this volume and act as DOCUMENT ROOT on our rs1, rs2 and > > rs3 webservers. > > > > All our servers are running centos 5.2 and has all updates installed. > > > > On rhclm (192.168.113.8) i installed cana and created a cluster with 2 > > nodes: shd1 and shd2. > > > > Cana, generated the following cluster.conf on shd1 and shd2 servers: > > > > [root@shd1 ~]# cat /etc/cluster/cluster.conf > > <?xml version="1.0"?> > > <cluster alias="wwwdata" config_version="2" name="wwwdata"> > > <fence_daemon clean_start="0" post_fail_delay="0" > > post_join_delay="3"/> > > <clusternodes> > > <clusternode name="192.168.113.7" nodeid="1" votes="1"> > > <fence/> > > </clusternode> > > <clusternode name="192.168.113.6" nodeid="2" votes="1"> > > <fence/> > > </clusternode> > > </clusternodes> > > <cman expected_votes="1" two_node="1"/> > > <fencedevices/> > > <rm> > > <failoverdomains/> > > <resources/> > > </rm> > > <totem consensus="4800" join="60" token="10000" > > token_retransmits_before_loss_const="20"/> > > </cluster> > > > > Now, on shd1 i am using hda for centos OS and hdb (1,2) i want to make it > > available to be used on shared volume: > > > > [root@shd1 ~]# cat /proc/partitions > > major minor #blocks name > > 3 64 39082680 hdb > > 3 65 19541056 hdb1 > > 3 66 19541592 hdb2 > > [root@shd1 ~]# > > > > on shd2 i have hda for centos and hdc (1,2) i want it available to be > > used on shared volume: > > [root@shd2 ~]# cat /proc/partitions > > major minor #blocks name > > 22 0 78150744 hdc > > 22 1 39075088 hdc1 > > 22 2 39075624 hdc2 > > [root@shd2 ~]# > > > > Using cana, i couldn't find a way to create a volume, grouping hdb1 (from > > shd1) together with hdc1 (from sdh2) in one volume. I want to do this for > > 2 reasons: > > - i want that volume to be mounted as document root on rs1, rs2, rs3 real > > webservers > > - i want that volume to be easy to extend adding new hdd on the fly of > > other computers to this volume (new hdd slices of other new computers). > > > > Can anybody tell me how can i do it? > > > > I don't know that for this design if correct to have: > > - all 5 servers (rs1, rs2, rs3, shd1, shd2) to be configured as nodes in > > the same cluster > > or > > - rs1, rs2, rs3 to be part of one cluster and shd1 and shd2 to form > > another cluster > > > > I read section: A.2. Configuring Shared Storage in this document > > http://www.centos.org/docs/5/html/Cluster_Administration/ap-httpd-service > >-CA.html but is not what i want. > > > > Can anybody help me. A link pointing me to the correct direction or a > > howto will be appreciated. > > > > Regards, > > Alx > > > > -- > > Linux-cluster mailing list > > Linux-cluster@xxxxxxxxxx > > https://www.redhat.com/mailman/listinfo/linux-cluster > > -- > Linux-cluster mailing list > Linux-cluster@xxxxxxxxxx > https://www.redhat.com/mailman/listinfo/linux-cluster -- Linux-cluster mailing list Linux-cluster@xxxxxxxxxx https://www.redhat.com/mailman/listinfo/linux-cluster