Re: Cephfs: Migrating Data to a new Data Pool

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



yeah, but you don't want to have those reference objects in an EC pool,
that's iiuc been explicitly disallowed in newer versions, as it's a
performance suck. so leaving them in the replicated pool is good :)

On Mon, Apr 5, 2021 at 2:55 PM Oliver Freyermuth <
freyermuth@xxxxxxxxxxxxxxxxxx> wrote:

> Hi,
>
> that really looks like a useful tool, thanks for mentioning this on the
> list :-).
>
> However, I'd also love to learn about a different way ­— as documentation
> states:
>   "You may notice that object counts in your primary data pool (the one
> passed to fs new) continue to increase, even if files are being created in
> the pool you added."
>   https://docs.ceph.com/en/latest/cephfs/file-layouts/
> So I think while this will migrate the bulk of the data, it will never be
> a full migration the way CephFS seems to be implemented.
> Especially for growing EC clusters, it would be helpful to be able to
> migrate to a different, more space-efficient EC profile as the number of
> hosts increases.
>
> We're not at this point yet, but one day we'll surely be. Right now, the
> only "complete migration" approach seems to be to create a new FS, and
> migrate things over...
> Am I right?
>
> Cheers,
>         Oliver
>
>
> Am 05.04.21 um 19:22 schrieb Peter Woodman:
> > hi, i made a tool to do this. it’s rough around the edges and has some
> > known bugs with symlinks as parent paths but it checks all file layouts
> to
> > see if they match the directory layout they’re in, and if not, makes them
> > so by copying and replacing. so to ‘migrate’ set your directory layouts
> and
> > then run this tool to move everything to the right places.
> >
> > i’m unaware of another way of doing this so if there is someone
> tell me!
> >
> > https://git.sr.ht/~pjjw/cephfs-layout-tool
> >
> > On Sun, Apr 4, 2021 at 5:43 PM <ceph@xxxxxxxxxx> wrote:
> >
> >> Hello everyone,
> >>
> >> I currently have a CephFS running with about 60TB of Data. I created it
> >> with a replicated pool as default pool, an erasure coded one as
> >> additional data pool like it is described in the docs. Now I want to
> >> migrate the data from the replicated pool, to the new erasure coded one.
> >> I couldn't find any docs and was wondering if its even possible
> >> currently.
> >>
> >> Thank you very much,
> >> Fionera
> >> _______________________________________________
> >> ceph-users mailing list -- ceph-users@xxxxxxx
> >> To unsubscribe send an email to ceph-users-leave@xxxxxxx
> >>
> > _______________________________________________
> > ceph-users mailing list -- ceph-users@xxxxxxx
> > To unsubscribe send an email to ceph-users-leave@xxxxxxx
> >
>
>
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux