Re: Most Efficient Network File sharing protocol?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



use nfs...but make sure you *read* from a nfs mount of the data and
write to local disk.

Note that to make a network filesystem safe during writing that it is
going to usually be slower, and because of that reading is
significantly faster than writing.

And in general if you are using small files all of the transfer
method's speeds will be horrible (mb/second), and the rates will break
down to files per second rather than mb/second, and if you are really
lucky you will get 100files/second...

On Mon, Mar 3, 2014 at 8:58 PM, Dan Mossor <dan.mossor@xxxxxxxxxxx> wrote:
>
>
> On 02/28/2014 01:02 PM, Patrick O'Callaghan wrote:
>>
>> On Fri, Feb 28, 2014 at 5:13 PM, Mark Haney <mhaney@xxxxxxxxxxxxxx> wrote:
>>>
>>> On 02/28/14 12:07, Dan Mossor wrote:
>>>>
>>>> What do y'all consider the most efficient network file system? NFS?
>>>> SMB? SFTP?
>>
>>
>> Maybe you should outline your requirements a bit more. For example
>> SFTP is not a filesystem, so are you only concerned about end-to-end
>> transfer rates?
>>
>> poc
>>
> I am building an environment where I am setting up a local mirror for
> Fedora, CentOS, rpmfusion, and Ubuntu. I am using virtual machines to pull
> down the data and storing it on a local NAS device. Once a week, I am
> building a DVD of updates to transfer them to a disconnected system.
>
> I am trying to determine the best access protocol for the VMs to reach the
> NAS. The NAS is not a true NAS device, it is an HP Proliant server with 8TB
> of storage running CentOS 6.5, so it can support any transfer method,
> including iSCSI. It is already running Samba to support our local Windows
> machines, and NFS for my work with Fedora and CentOS.
>
> When the DVD is built, I pull the updates across the local network to my
> machine and build the DVD there. These <4GiB transfers sometimes take close
> to 3 to 4 hours using NFS, and it is a Gigabit network. rsync appeared to be
> a bit faster, but my goal is to find the most efficient transfer method to
> move lots of little -and some big - files across a local network.
>
> I'm wondering about iSCSI - I haven't played with it much, maybe I'll test
> it out for this week's updates.
>
> --
> Dan Mossor
> Systems Engineer at Large
> Fedora QA Team Volunteer FAS: dmossor IRC: danofsatx
> San Antonio, Texas, USA
>
> --
> users mailing list
> users@xxxxxxxxxxxxxxxxxxxxxxx
> To unsubscribe or change subscription options:
> https://admin.fedoraproject.org/mailman/listinfo/users
> Fedora Code of Conduct: http://fedoraproject.org/code-of-conduct
> Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
> Have a question? Ask away: http://ask.fedoraproject.org
-- 
users mailing list
users@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Fedora Code of Conduct: http://fedoraproject.org/code-of-conduct
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Have a question? Ask away: http://ask.fedoraproject.org




[Index of Archives]     [Older Fedora Users]     [Fedora Announce]     [Fedora Package Announce]     [EPEL Announce]     [EPEL Devel]     [Fedora Magazine]     [Fedora Summer Coding]     [Fedora Laptop]     [Fedora Cloud]     [Fedora Advisory Board]     [Fedora Education]     [Fedora Security]     [Fedora Scitech]     [Fedora Robotics]     [Fedora Infrastructure]     [Fedora Websites]     [Anaconda Devel]     [Fedora Devel Java]     [Fedora Desktop]     [Fedora Fonts]     [Fedora Marketing]     [Fedora Management Tools]     [Fedora Mentors]     [Fedora Package Review]     [Fedora R Devel]     [Fedora PHP Devel]     [Kickstart]     [Fedora Music]     [Fedora Packaging]     [Fedora SELinux]     [Fedora Legal]     [Fedora Kernel]     [Fedora OCaml]     [Coolkey]     [Virtualization Tools]     [ET Management Tools]     [Yum Users]     [Yosemite News]     [Gnome Users]     [KDE Users]     [Fedora Art]     [Fedora Docs]     [Fedora Sparc]     [Libvirt Users]     [Fedora ARM]

  Powered by Linux