Hi Jens; Thanks for your help. As you asked me, I checked again in the benchmark system. Selinux is disabled. Sorry about my careless, Because setting of limit.conf is not work. When I ran fio, only 1600 files have opened. # cat /proc/sys/fs/file-nr 576 0 390196 run fio: #cat /proc/sys/fs/file-nr 1600 0 390196 # cat /proc/sys/fs/file-max 390196 #cd /proc/fio_pid/fd # ls -l | grep -c rw 1003 At this time, I knew, the limit.conf setting is not work. #ulimit -n 1024 I add another line in /etc/security/limits.conf * soft nofile 20480 Now, it 's ok. when I run fio, there are no the error messages. #ulimit -n 20480 -- Homer Li 2011/9/21 Jens Axboe <axboe@xxxxxxxxx>: > On 2011-09-20 12:06, yan li wrote: >> Hi fio users and developers, >> When I run fio benchmark, there are some error in the screen. >> Does someone meet the same circumstances ? >> Thanks, ^_^ >> >> #fio fio.cfg >> ...... >> fio: pid=29128, err=24/file:filesetup.c:529, >> func=open(/mnt/rw1/rw1.168.2), error=Too many open files >> fio: pid=29039, err=24/file:filesetup.c:529, func=open(/mnt/rw.79.2), >> error=Too many open files >> fio: pid=29040, err=24/file:filesetup.c:529, func=open(/mnt/rw.80.2), >> error=Too many open files >> fio: pid=29074, err=24/file:filesetup.c:529, func=open(/mnt/rw.114.2), >> error=Too many open files >> fio: pid=29026, err=24/file:filesetup.c:529, func=open(/mnt/rw.66.2), >> error=Too many open files >> ...... > > Fio keeps all of its data files open, and from the jobs below, you have > > 3*8*128 = 3072 > > in data files alone, add some house keeping, and perhaps you hit the > limit? Seems a bit odd, given that the typical max is somewhat larger, > and your selinux settings allow higher as well. What do > > /proc/sys/fs/file-{nr,max} > > show when this happens? You could also freeze fio at this point and ls > -l /proc/pid-of-fio/fd/ to see if something strange is being held open. > > -- > Jens Axboe > > -- Let one live alone doing no evil, care-free, like an elephant in the elephant forest -- To unsubscribe from this list: send the line "unsubscribe fio" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html