After removing that and running, I get this error:
varunc@varunc4-virtual-machine:~$ time /usr/local/hadoop/bin/hadoop jar hadoop*examples*.jar wordcount /mnt/ceph/wc /mnt/ceph/op2
Warning: $HADOOP_HOME is deprecated.
13/03/19 20:35:03 INFO ceph.CephFileSystem: selectDataPool path=ceph://null/app/hadoop/tmp/mapred/staging/varunc/.staging/job_201303192034_0001/job.jar pool:repl=data:2 wanted=3
13/03/19 20:35:03 INFO mapred.JobClient: Cleaning up the staging area ceph://null/app/hadoop/tmp/mapred/staging/varunc/.staging/job_201303192034_0001
13/03/19 20:35:03 ERROR security.UserGroupInformation: PriviledgedActionException as:varunc cause:org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: ceph://null/mnt/ceph/wc
org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: ceph://null/mnt/ceph/wc
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:235)
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:252)
at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:962)
at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:979)
at org.apache.hadoop.mapred.JobClient.access$600(JobClient.java:174)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:897)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:500)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:530)
at org.apache.hadoop.examples.WordCount.main(WordCount.java:67)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:64)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Any ways to remove this error?
On Tue, Mar 19, 2013 at 7:39 PM, Noah Watkins <jayhawk@xxxxxxxxxxx> wrote:
Hi Varun,
Try removing this configuration option:
Hadoop running on Ceph uses the libcephfs user-space library to talk directly to the file system, as opposed to running through the kernel or FUSE client. This setting is which directory within the Ceph file system to use as a root. It defaults to "/".
> <property>
> <name>ceph.root.dir</name>
> <value>/mnt/ceph</value>
> </property>
Thanks,
-Noah
Thanks
Varun
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
