Hi All, We have just got gluster-3.1.4 again. When we upgraded to 3.2.5 the .vol files in /etc/glusterd/vols/... had new features (specifically "type features/marker") that version 3.1.4 was not happy with. Still not certain why version 3.2.5 wasn't working. One other thing we changed was restarting on of the ethernet ports on the brick that was causing the trouble (it didn't solve the issue, but we never tried version 3.2.5 after restarting the port). > Hi Pat, > > I've seen a similar issue, when using the NFS translator, some files > were not visible (hundreds of thousands to millions of files in the > XFS filesystem); but native client systems could see all files. > > This was with a single brick system, I had to revert that system to > old NFS (no gluster) to resolve the issue, as some of my systems can > only NFS mount. > > Hope this helps... > > --Tom > > On Tue, Jan 31, 2012 at 10:44 AM, Pat Haley <phaley at mit.edu> wrote: >> Hi Pranith, >> >> In the logs, the problem brick is 0-gdata-client-2. >> I've put the log files in >> >> http://mseas.mit.edu/download/phaley/GlusterUsers/ >> >> Thanks, >> >> >>> hi Pat, >>> Could you give us the volume info output. Please attach the client >>> node logs. Let us know which brick is giving problems in your volume info >>> output. >>> >>> Pranith >>> On 01/30/2012 11:47 PM, Pat Haley wrote: >>>> >>>> Hi, >>>> >>>> We recently upgraded our version of gluster from 3.1.4 to >>>> 3.2.5. Shortly after I noticed that gluster was not serving >>>> up all of its files, that is if I log onto one of the individual >>>> bricks and do an ls of the underlying nfs directories, I can >>>> see files that I do not see if do an ls from a client node >>>> in the equivalent gluster directory. >>>> >>>> We may have caused this by also running a script that went >>>> through and removed pointer files (this had been how we had >>>> been dealing with bad pointers under gluster 3.1.4). >>>> >>>> So far, we have tried >>>> - running a gluster self-heal under version 3.2.5 >>>> - rolling back to version 3.1.4 >>>> - running a gluster self-heal under version 3.1.4 >>>> - running a rebalance under version 3.1.4 >>>> None of these have solved the problem. The one other >>>> piece of data we have is that all the files which are >>>> not being served appear to reside on a single brick >>>> (at least every file we missed so far has been on >>>> that server and we have not found one missing from >>>> the other servers). >>>> >>>> Any advice you can give us would be greatly appreciated. >>>> >>>> -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- >>>> Pat Haley Email: phaley at mit.edu >>>> Center for Ocean Engineering Phone: (617) 253-6824 >>>> Dept. of Mechanical Engineering Fax: (617) 253-8125 >>>> MIT, Room 5-222B http://web.mit.edu/phaley/www/ >>>> 77 Massachusetts Avenue >>>> Cambridge, MA 02139-4301 >>>> _______________________________________________ >>>> Gluster-users mailing list >>>> Gluster-users at gluster.org >>>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users >>> >>> _______________________________________________ >>> Gluster-users mailing list >>> Gluster-users at gluster.org >>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users >> >> >> -- >> >> -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- >> Pat Haley Email: phaley at mit.edu >> Center for Ocean Engineering Phone: (617) 253-6824 >> Dept. of Mechanical Engineering Fax: (617) 253-8125 >> MIT, Room 5-222B http://web.mit.edu/phaley/www/ >> 77 Massachusetts Avenue >> Cambridge, MA 02139-4301 >> _______________________________________________ >> Gluster-users mailing list >> Gluster-users at gluster.org >> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users > > > -- -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Pat Haley Email: phaley at mit.edu Center for Ocean Engineering Phone: (617) 253-6824 Dept. of Mechanical Engineering Fax: (617) 253-8125 MIT, Room 5-222B http://web.mit.edu/phaley/www/ 77 Massachusetts Avenue Cambridge, MA 02139-4301