Re: Gluster 5.10 rebalance stuck

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



I think I've been in a similar situation.
"Solved" by creating a new volume on a new set of bricks on the same disks and moving data to new volume. Then just deleted old volume and relative bricks. Quite sure there's a better way, but that was nearly-static data and the move was a faster fix.

Diego

Il 02/11/2022 08:05, Shreyansh Shah ha scritto:
Hi,
I Would really appreciate it if someone would be able to help on the above issue. We are stuck as we cannot run rebalance due to this and thus are not able to extract peak performance from the setup due to unbalanced data. Adding gluster info (without the bricks) below. Please let me know if any other details/logs are needed.

    Volume Name: data
    Type: Distribute
    Volume ID: 75410231-bb25-4f14-bcde-caf18fce1d31
    Status: Started
    Snapshot Count: 0
    Number of Bricks: 41
    Transport-type: tcp
    Options Reconfigured:
    server.event-threads: 4
    network.ping-timeout: 90
    client.keepalive-time: 60
    server.keepalive-time: 60
    storage.health-check-interval: 60
    performance.client-io-threads: on
    nfs.disable: on
    transport.address-family: inet
    performance.cache-size: 8GB
    performance.cache-refresh-timeout: 60
    cluster.min-free-disk: 3%
    client.event-threads: 4
    performance.io-thread-count: 16



On Fri, Oct 28, 2022 at 11:40 AM Shreyansh Shah <shreyansh.shah@xxxxxxxxxxxxxx <mailto:shreyansh.shah@xxxxxxxxxxxxxx>> wrote:

    Hi,
    We are running glusterfs 5.10 server volume. Recently we added a few
    new bricks and started a rebalance operation. After a couple of days
    the rebalance operation was just stuck, with one of the peers
    showing In-Progress with no file being read/transferred and the rest
    showing Failed/Completed, so we stopped it using "gluster volume
    rebalance data stop". Now when we are trying to start it again, we
    get the below error. Any assistance would be appreciated

        root@gluster-11:~# gluster volume rebalance data status
        volume rebalance: data: failed: Rebalance not started for volume
        data.
        root@gluster-11:~# gluster volume rebalance data start
        volume rebalance: data: failed: Rebalance on data is already started
        root@gluster-11:~# gluster volume rebalance data stop
        volume rebalance: data: failed: Rebalance not started for volume
        data.

-- Regards,
    Shreyansh Shah
    AlphaGrep* Securities Pvt. Ltd.*



--
Regards,
Shreyansh Shah
AlphaGrep* Securities Pvt. Ltd.*

________



Community Meeting Calendar:

Schedule -
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
Bridge: https://meet.google.com/cpu-eiue-hvk
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
https://lists.gluster.org/mailman/listinfo/gluster-users

--
Diego Zuccato
DIFA - Dip. di Fisica e Astronomia
Servizi Informatici
Alma Mater Studiorum - Università di Bologna
V.le Berti-Pichat 6/2 - 40127 Bologna - Italy
tel.: +39 051 20 95786
________



Community Meeting Calendar:

Schedule -
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
Bridge: https://meet.google.com/cpu-eiue-hvk
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
https://lists.gluster.org/mailman/listinfo/gluster-users




[Index of Archives]     [Gluster Development]     [Linux Filesytems Development]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Bugtraq]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]

  Powered by Linux