Are directory moves cheap?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi gluster!

Are move/rename ops over directories in fuse mounted gluster generally fast when there are TBs of data in the underlying dirs?

...Context follows...

One of the common operations in hive data manipulation is "load data", where you move a set of files from one place to another when ETLing a data set into a cluster.

In our hadoop implementation (GlusterFileSystem), we use the fuse mount to do renames using local posix commands.

I'm wondering this because In hadoop (hdfs), moving directories is (iirc) a relatively cheap metadata operation.  
_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://supercolony.gluster.org/mailman/listinfo/gluster-users




[Index of Archives]     [Gluster Development]     [Linux Filesytems Development]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Bugtraq]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]

  Powered by Linux