Re: fio libhdfs - loadFileSystems error while running FIO in CDH5.14.0

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



CC'ing Fabrice and Manish...

On 4 June 2018 at 19:36, learn pvt <learnpvt2050@xxxxxxxxx> wrote:
> Hi,
>
> I am trying to configure the 'libhdfs' in my CHD5.14.0 cluster but
> getting some issues.
>
> I have two node CDH-cluster and its working fine as I checked with TestDFSIO.
> I set the FIO_LIBHDFS_INCLUDE, FIO_LIBHDFS_LIB, 'hadoop classpath' in
> environment.
>
> Installed FIO on Master and configured it with enabling libhdfs while
> 'configure'.
>
> Created hdfs.fio file as
> [global]
> runtime=10
> [hdfs]
> rw=read
> namenode=xx.xx.x.xxx
> hostname=server1
> port=9000
> hdfsdirectory=/tmp
> chunk_size=1m
> hdfs_use_direct=1
> ioengine=libhdfs
> size=20m
> bs=256k
> single_instance=1
>
> Ran the fio job(sudo fio hdfs.fio) which resulted into errors as
>
> fio-3.6-33-g540e
> Starting 1 process
> loadFileSystems error
> hdfsBuilderConnect forceNewInstance=0, nn=server1, port=9000,
> kerbTicketCachePath=(NULL), userName=(NULL) error
> hdfsExists: constructNewObjectOfPath error
> hdfs: invalid working directory /tmp: Unknown error 255
> fio: failed to init engine data: 255
> Run status group 0 (all jobs)
>
> I tried many things but could not configure libhdfs to work correctly
> with FIO on my CDH.  Any suggestion would be appreciated!
> Thanks in advance.
> Note: /tmp directory is present at the hdfs level.
>
> Thanks,
> LP

-- 
Sitsofe | http://sucs.org/~sits/
--
To unsubscribe from this list: send the line "unsubscribe fio" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html



[Index of Archives]     [Linux Kernel]     [Linux SCSI]     [Linux IDE]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux SCSI]

  Powered by Linux