Varun, Can you post your updated core-site.xml? I've seen this error before when I used the URI: ceph:// as opposed to ceph:///. - Noah On Mar 19, 2013, at 8:10 AM, Varun Chandramouli <varun.c37@xxxxxxxxx> wrote: > Hi Noah, > > After removing that and running, I get this error: > > varunc@varunc4-virtual-machine:~$ time /usr/local/hadoop/bin/hadoop jar hadoop*examples*.jar wordcount /mnt/ceph/wc /mnt/ceph/op2 > Warning: $HADOOP_HOME is deprecated. > > 13/03/19 20:35:03 INFO ceph.CephFileSystem: selectDataPool path=ceph://null/app/hadoop/tmp/mapred/staging/varunc/.staging/job_201303192034_0001/job.jar pool:repl=data:2 wanted=3 > 13/03/19 20:35:03 INFO mapred.JobClient: Cleaning up the staging area ceph://null/app/hadoop/tmp/mapred/staging/varunc/.staging/job_201303192034_0001 > 13/03/19 20:35:03 ERROR security.UserGroupInformation: PriviledgedActionException as:varunc cause:org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: ceph://null/mnt/ceph/wc > org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: ceph://null/mnt/ceph/wc > at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:235) > at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:252) > at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:962) > at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:979) > at org.apache.hadoop.mapred.JobClient.access$600(JobClient.java:174) > at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:897) > at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121) > at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850) > at org.apache.hadoop.mapreduce.Job.submit(Job.java:500) > at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:530) > at org.apache.hadoop.examples.WordCount.main(WordCount.java:67) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:601) > at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68) > at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139) > at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:64) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:601) > at org.apache.hadoop.util.RunJar.main(RunJar.java:156) > > Any ways to remove this error? > > On Tue, Mar 19, 2013 at 7:39 PM, Noah Watkins <jayhawk@xxxxxxxxxxx> wrote: > Hi Varun, > > Try removing this configuration option: > > > <property> > > <name>ceph.root.dir</name> > > <value>/mnt/ceph</value> > > </property> > > Hadoop running on Ceph uses the libcephfs user-space library to talk directly to the file system, as opposed to running through the kernel or FUSE client. This setting is which directory within the Ceph file system to use as a root. It defaults to "/". > > Thanks, > -Noah > > > Thanks > Varun _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |