On Sun, 2010-10-17 at 15:51 +0400, Pavel Strashkin wrote:
> Hi all,
>
> I'm learning NFS4 "referral" feature.
> I have 4 machines with installed Ubuntu 10.10 (kernel
> 2.6.35-22-generic): Server-A, Server-B, Server-C and Client-A.
>
> Server-A is the main server in the "cluster" that provides NFS share
> "/exports" with a single referral: "/exports/referral".
> That referral points to 2 servers: Server-B and Server-C.
>
> Client-A is the user of this referral.
>
> When i mount "/exports" NFS share from Server-A on Client-A, i have no
> issues and i can see "referral" directory. After that Client-A have an
> access to that "referral" directory and can see files on Server-B
> because Server-B the first server in referral list. NFS4ERR_MOVED
> works as expected.
>
> ...now let's switch off Server-B...
>
> When Server-B is down (dont forget, we had 2 servers in referral list)
> and i'm trying to do "ls -l" for "referral" directory, the operation
> hangs forever. If i kill -9 "ls" process and remount directory then it
> automatically switches to Server-C (because Server-B is unreachabel).
>
> The question: why there is no migration (fail-over? switch?) to
> another server from referral list when share already mounted and
> current server from referral list is down?
>
> I looked at NFS kernel code and as i understand it keeps information
> about FIRST valid server from referral list in inode. It keeps single
> server information, not a whole list of servers (fs_locations). After
> that all operations related to referral inode will be delegated to
> that server.
>
> RFC says that if client can not access to the first server in referral
> list, it should try the next. One thing i dont undertand here - RFC
> means "try next" when we do mount or when we're working with referral
> inode?
>
> P.S. i also triend another one situation: i removed referral on
> Server-A and replace it by real directory called "referral". After
> that client still trying to access to referral (share on Server-B),
> but not real directory on Server-A. Seems like invalidation does not
> work.
Please don't confuse referrals and migrations; they are very different
events.
A referral is special type of filesystem object that is
discovered at LOOKUP time, and basically acts to automount a new
filesystem from a different server. This is an easy case to
implement, because you are mounting a new filesystem, and so
there is no existing file state to worry about.
A migration is an event that occurs after the client has mounted
a filesystem. It means that particular filesystem has been
removed from the original server, and should now be mounted
through a different server. This is a very difficult case to
implement because the NFS protocol does not specify how the
migration should occur on the back end (i.e. from server to
server). The client therefore may end up having to do a lot of
extra work in order to recover filehandles, file open and
locking state, without the application discovering what is going
on.
The Linux client supports referrals. It does not yet support migration.
Trond
--
To unsubscribe from this list: send the line "unsubscribe linux-nfs" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
