Re: [LSF/MM/BPF TOPIC] Lustre filesystem upstreaming

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 1/30/25, 9:28 AM, "Theodore Ts'o" <tytso@xxxxxxx <mailto:tytso@xxxxxxx>> wrote:
> On Tue, Jan 28, 2025 at 04:35:46PM +0000, Day, Timothy wrote:
> > My biggest question for LSF is around development model:
> > Our current development model is still orthogonal to what
> > most other subsystems/drivers do. But as we evolve, how do
> > we demonstrate that our development model is reasonable?
> > Sending the initial patches is one thing. Convincing everyone
> > that the model is sustainable is another.
>
> I suspect one of the reasons why most development is happening out-of-tree
> is pretty much all of the users of Lustre are using distro (and very
> often, Enterprise) kernels. Are there any people outside of the core
> Lustre team (most of whom are probably working for DDN?) that use
> Lustre or can even test Lustre using the upstream kernel?

Lustre has a lot of usage and development outside of DDN/Whamcloud [1][2].
HPE, AWS, SuSe, Azure, etc. And at least at AWS, we use Lustre on fairly
up-to-date kernels [3][4]. And I think this is becoming more common - although
I don't have solid data on that.

[1] https://en.wikipedia.org/wiki/Lustre_(file_system)#Commercial_technical_support
[2] https://youtu.be/BE--ySVQb2M?si=YMHitJfcE4ASWQcE&t=960
[3] AL2023 6.1 - https://github.com/amazonlinux/linux/commit/ef9660091712fa9edd137180b8925ea6316c8043
[4] AL2023 6.12 (Soon) - https://github.com/amazonlinux/linux/commits/amazon-6.12.y/mainline/

> I'll let Andreas to comment further, but from my perspective, if we
> want to upstreaming Lustre to be successful, perhaps one strategy
> would be to make it easier for upstream users and developers to use
> Lustre, perhaps in a smaller scale than what a typical DDN customer
> would typically use.

If we upstreamed the server alongside the client - it'd be easy enough
for upstream developers to setup a collocated Lustre client/server
and run xfstests at least. At some point (in the near-ish future), I want
to put together a patch series for xfstests/Lustre support.

And if you have dedicated hardware - setting up a small filesystem over
TCP/IP isn't much harder than an NFS server IMHO. Just a mkfs and
mount per storage target. With a single MDS and OSS, you only need two
disks. So I think we have everything we need to enable upstream
users/devs to use Lustre without too much hassle. I think it's mostly a
matter of documentation and scripting.

Tim Day





[Index of Archives]     [Linux Ext4 Filesystem]     [Union Filesystem]     [Filesystem Testing]     [Ceph Users]     [Ecryptfs]     [NTFS 3]     [AutoFS]     [Kernel Newbies]     [Share Photos]     [Security]     [Netfilter]     [Bugtraq]     [Yosemite News]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Linux Cachefs]     [Reiser Filesystem]     [Linux RAID]     [NTFS 3]     [Samba]     [Device Mapper]     [CEPH Development]

  Powered by Linux