Re: guidance with hadoop on ceph

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



No, hadoop data is not located in /mnt/ceph/wc, but now i copied the data into /user/varunc/wc, which cntains the hadoop data. However, the MR-wordcount example still is not working. Its stuck with this output:

varunc@varunc4-virtual-machine:~$ time /usr/local/hadoop/bin/hadoop jar hadoop*examples*.jar wordcount /user/varunc/wc /user/varunc/op
Warning: $HADOOP_HOME is deprecated.

13/03/19 21:08:06 INFO ceph.CephFileSystem: selectDataPool path=ceph://null/app/hadoop/tmp/mapred/staging/varunc/.staging/job_201303192047_0003/job.jar pool:repl=data:2 wanted=3
13/03/19 21:08:06 INFO input.FileInputFormat: Total input paths to process : 3
13/03/19 21:08:06 WARN snappy.LoadSnappy: Snappy native library is available
13/03/19 21:08:06 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
13/03/19 21:08:06 WARN snappy.LoadSnappy: Snappy native library not loaded
13/03/19 21:08:06 INFO ceph.CephFileSystem: selectDataPool path=ceph://null/app/hadoop/tmp/mapred/staging/varunc/.staging/job_201303192047_0003/job.split pool:repl=data:2 wanted=3
13/03/19 21:08:06 INFO ceph.CephFileSystem: selectDataPool path=ceph://null/app/hadoop/tmp/mapred/staging/varunc/.staging/job_201303192047_0003/job.splitmetainfo pool:repl=data:2 wanted=3
13/03/19 21:08:06 INFO ceph.CephFileSystem: selectDataPool path=ceph://null/app/hadoop/tmp/mapred/staging/varunc/.staging/job_201303192047_0003/job.xml pool:repl=data:2 wanted=3
13/03/19 21:08:06 INFO mapred.JobClient: Running job: job_201303192047_0003
13/03/19 21:08:07 INFO mapred.JobClient:  map 0% reduce 0%
^C
real    2m29.068s
user    0m0.988s
sys     0m0.116s
varunc@varunc4-virtual-machine:~$ /usr/local/hadoop/bin/hadoop fs -ls /user/varunc/wc
Warning: $HADOOP_HOME is deprecated.

Found 3 items
-rwxrwxrwx   2 varunc     661808 2013-03-19 21:03 /user/varunc/wc/1
-rwxrwxrwx   2 varunc    1391685 2013-03-19 21:03 /user/varunc/wc/2
-rwxrwxrwx   2 varunc    1540093 2013-03-19 21:03 /user/varunc/wc/3

Thanks
Varun

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux