Re: guidance with hadoop on ceph

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Getting closer! I suggest checking the log files for your job tracker and all of your task tracker nodes to see if any of them are having troubles.

-Noah

On Mar 19, 2013, at 8:42 AM, Varun Chandramouli <varun.c37@xxxxxxxxx> wrote:

> No, hadoop data is not located in /mnt/ceph/wc, but now i copied the data into /user/varunc/wc, which cntains the hadoop data. However, the MR-wordcount example still is not working. Its stuck with this output:
> 
> varunc@varunc4-virtual-machine:~$ time /usr/local/hadoop/bin/hadoop jar hadoop*examples*.jar wordcount /user/varunc/wc /user/varunc/op
> Warning: $HADOOP_HOME is deprecated.
> 
> 13/03/19 21:08:06 INFO ceph.CephFileSystem: selectDataPool path=ceph://null/app/hadoop/tmp/mapred/staging/varunc/.staging/job_201303192047_0003/job.jar pool:repl=data:2 wanted=3
> 13/03/19 21:08:06 INFO input.FileInputFormat: Total input paths to process : 3
> 13/03/19 21:08:06 WARN snappy.LoadSnappy: Snappy native library is available
> 13/03/19 21:08:06 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> 13/03/19 21:08:06 WARN snappy.LoadSnappy: Snappy native library not loaded
> 13/03/19 21:08:06 INFO ceph.CephFileSystem: selectDataPool path=ceph://null/app/hadoop/tmp/mapred/staging/varunc/.staging/job_201303192047_0003/job.split pool:repl=data:2 wanted=3
> 13/03/19 21:08:06 INFO ceph.CephFileSystem: selectDataPool path=ceph://null/app/hadoop/tmp/mapred/staging/varunc/.staging/job_201303192047_0003/job.splitmetainfo pool:repl=data:2 wanted=3
> 13/03/19 21:08:06 INFO ceph.CephFileSystem: selectDataPool path=ceph://null/app/hadoop/tmp/mapred/staging/varunc/.staging/job_201303192047_0003/job.xml pool:repl=data:2 wanted=3
> 13/03/19 21:08:06 INFO mapred.JobClient: Running job: job_201303192047_0003
> 13/03/19 21:08:07 INFO mapred.JobClient:  map 0% reduce 0%
> ^C
> real    2m29.068s
> user    0m0.988s
> sys     0m0.116s
> varunc@varunc4-virtual-machine:~$ /usr/local/hadoop/bin/hadoop fs -ls /user/varunc/wc
> Warning: $HADOOP_HOME is deprecated.
> 
> Found 3 items
> -rwxrwxrwx   2 varunc     661808 2013-03-19 21:03 /user/varunc/wc/1
> -rwxrwxrwx   2 varunc    1391685 2013-03-19 21:03 /user/varunc/wc/2
> -rwxrwxrwx   2 varunc    1540093 2013-03-19 21:03 /user/varunc/wc/3
> 
> Thanks
> Varun
> 

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux