Re: Failed to create volume in OVirt with gluster

Punit Dambiwal <hypunit@xxxxxxxxx> · Mon, 12 Jan 2015 12:54:10 +0800

Hi,
Is there any one from gluster can help me here :- 

Engine logs :- 

2015-01-12 12:50:33,841 INFO  [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:34,725 INFO  [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:36,824 INFO  [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:36,853 INFO  [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:36,866 INFO  [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:37,751 INFO  [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:39,849 INFO  [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:39,878 INFO  [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:39,890 INFO  [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:40,776 INFO  [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:42,878 INFO  [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:42,903 INFO  [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:42,916 INFO  [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]
2015-01-12 12:50:43,771 INFO  [org.ovirt.engine.core.vdsbroker.gluster.CreateGlusterVolumeVDSCommand] (ajp--127.0.0.1-8702-1) [330ace48] FINISH, CreateGlusterVolumeVDSCommand, log id: 303e70a4
2015-01-12 12:50:43,780 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-1) [330ace48] Correlation ID: 330ace48, Job ID: 896a69b3-a678-40a7-bceb-3635e4062aa0, Call Stack: null, Custom Event ID: -1, Message: Creation of Gluster Volume vol01 failed.
2015-01-12 12:50:43,785 INFO  [org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand] (ajp--127.0.0.1-8702-1) [330ace48] Lock freed to object EngineLock [exclusiveLocks= key: 00000001-0001-0001-0001-000000000300 value: GLUSTER
, sharedLocks= ]

On Sun, Jan 11, 2015 at 6:48 PM, Martin Pavlík <mpavlik@xxxxxxxxxx> wrote:
Hi Punit,
unfortunately I’am not that good with the gluster, I was just following the obvious clue from the log. Could you try on the nodes if the packages are even available for installation 

yum install gluster-swift gluster-swift-object gluster-swift-plugin gluster-swift-account gluster-swift-proxy gluster-swift-doc gluster-swift-container glusterfs-geo-replication

if not you could try to get them in official gluster repo. http://download.gluster.org/pub/gluster/glusterfs/LATEST/CentOS/glusterfs-epel.repo

HTH

M.

On 10 Jan 2015, at 04:35, Punit Dambiwal <hypunit@xxxxxxxxx> wrote:

Hi Martin,
I installed gluster from ovirt repo....is it require to install those packages manually ??

On Fri, Jan 9, 2015 at 7:19 PM, Martin Pavlík <mpavlik@xxxxxxxxxx> wrote:
Hi Punit,
can you verify that nodes contain cluster packages from the following log?
Thread-14::DEBUG::2015-01-09 18:06:28,823::caps::716::root::(_getKeyPackages) rpm package ('gluster-swift',) not found
Thread-14::DEBUG::2015-01-09 18:06:28,825::caps::716::root::(_getKeyPackages) rpm package ('gluster-swift-object',) not found
Thread-14::DEBUG::2015-01-09 18:06:28,826::caps::716::root::(_getKeyPackages) rpm package ('gluster-swift-plugin',) not found
Thread-14::DEBUG::2015-01-09 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package ('gluster-swift-account',) not found
Thread-14::DEBUG::2015-01-09 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package ('gluster-swift-proxy',) not found
Thread-14::DEBUG::2015-01-09 18:06:28,829::caps::716::root::(_getKeyPackages) rpm package ('gluster-swift-doc',) not found
Thread-14::DEBUG::2015-01-09 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package ('gluster-swift-container',) not found
Thread-14::DEBUG::2015-01-09 18:06:28,830::caps::716::root::(_getKeyPackages) rpm package ('glusterfs-geo-replication',) not found

M.

On 09 Jan 2015, at 11:13, Punit Dambiwal <hypunit@xxxxxxxxx> wrote:

Hi Kanagaraj,
Please find the attached logs :- 

Engine Logs :- http://ur1.ca/jdopt
VDSM Logs :- http://ur1.ca/jdoq9

On Thu, Jan 8, 2015 at 6:05 PM, Kanagaraj <kmayilsa@xxxxxxxxxx> wrote:

    Do you see any errors in the UI?

    Also please provide the engine.log and vdsm.log when the failure
    occured.

    Thanks,

    Kanagaraj

    On 01/08/2015 02:25 PM, Punit Dambiwal
      wrote:

      Hi Martin,

        The steps are below :- 

        1. Step the ovirt engine on the one server...
        2. Installed centos 7 on 4 host node servers..
        3. I am using host node (compute+storage)....now i have
          added all 4 nodes to engine...
        4. Create the gluster volume from GUI...

        Network :- 
        eth0 :- public network (1G)
        eth1+eth2=bond0= VM public network (1G)
        eth3+eth4=bond1=ovirtmgmt+storage (10G private network)

        every hostnode has 24 bricks=24*4(distributed replicated)

        Thanks,
        Punit

        On Thu, Jan 8, 2015 at 3:20 PM, Martin
          Pavlík <mpavlik@xxxxxxxxxx>
          wrote:

          Hi Punit,

            can you please provide also errors from
            /var/log/vdsm/vdsm.log and /var/log/vdsm/vdsmd.log

            it would be really helpful if you provided exact steps how
            to reproduce the problem.

            regards

            Martin Pavlik - rhev QE

              > On 08 Jan 2015, at 03:06, Punit
                Dambiwal <hypunit@xxxxxxxxx>
                wrote:

                >

                > Hi,

                >

                > I try to add gluster volume but it failed...

                >

                > Ovirt :- 3.5

                > VDSM :- vdsm-4.16.7-1.gitdb83943.el7

                > KVM :- 1.5.3 - 60.el7_0.2

                > libvirt-1.1.1-29.el7_0.4

                > Glusterfs :- glusterfs-3.5.3-1.el7

                >

                > Engine Logs :-

                >

                > 2015-01-08 09:57:52,569 INFO 
                [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
                (DefaultQuartzScheduler_Worker-16) Failed to acquire
                lock and wait lock EngineLock [exclusiveLocks= key:
                00000001-0001-0001-0001-000000000300 value: GLUSTER

                > , sharedLocks= ]

                > 2015-01-08 09:57:52,609 INFO 
                [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
                (DefaultQuartzScheduler_Worker-16) Failed to acquire
                lock and wait lock EngineLock [exclusiveLocks= key:
                00000001-0001-0001-0001-000000000300 value: GLUSTER

                > , sharedLocks= ]

                > 2015-01-08 09:57:55,582 INFO 
                [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
                (DefaultQuartzScheduler_Worker-16) Failed to acquire
                lock and wait lock EngineLock [exclusiveLocks= key:
                00000001-0001-0001-0001-000000000300 value: GLUSTER

                > , sharedLocks= ]

                > 2015-01-08 09:57:55,591 INFO 
                [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
                (DefaultQuartzScheduler_Worker-16) Failed to acquire
                lock and wait lock EngineLock [exclusiveLocks= key:
                00000001-0001-0001-0001-000000000300 value: GLUSTER

                > , sharedLocks= ]

                > 2015-01-08 09:57:55,596 INFO 
                [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
                (DefaultQuartzScheduler_Worker-16) Failed to acquire
                lock and wait lock EngineLock [exclusiveLocks= key:
                00000001-0001-0001-0001-000000000300 value: GLUSTER

                > , sharedLocks= ]

                > 2015-01-08 09:57:55,633 INFO 
                [org.ovirt.engine.core.bll.lock.InMemoryLockManager]
                (DefaultQuartzScheduler_Worker-16) Failed to acquire
                lock and wait lock EngineLock [exclusiveLocks= key:
                00000001-0001-0001-0001-000000000300 value: GLUSTER

                > , sharedLocks= ]

                > ^C

                >

                >

<216 09-Jan-15.jpg><217 09-Jan-15.jpg>

_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://www.gluster.org/mailman/listinfo/gluster-users