On Mar 19, 2013, at 8:10 AM, Varun Chandramouli <varun.c37@xxxxxxxxx> wrote: > Hi Noah, > > After removing that and running, I get this error: > > varunc@varunc4-virtual-machine:~$ time /usr/local/hadoop/bin/hadoop jar hadoop*examples*.jar wordcount /mnt/ceph/wc /mnt/ceph/op2 > Warning: $HADOOP_HOME is deprecated. Also, is your data inside Hadoop located at /mnt/ceph/wc? Try running hadoop fs -ls /mnt/ceph/wc. Remember, Hadoop cannot talk to the VFS mount, so /mnt/ceph/op2 won't work. It needs to be within a Ceph URI mount. -Noah > > 13/03/19 20:35:03 INFO ceph.CephFileSystem: selectDataPool path=ceph://null/app/hadoop/tmp/mapred/staging/varunc/.staging/job_201303192034_0001/job.jar pool:repl=data:2 wanted=3 > 13/03/19 20:35:03 INFO mapred.JobClient: Cleaning up the staging area ceph://null/app/hadoop/tmp/mapred/staging/varunc/.staging/job_201303192034_0001 > 13/03/19 20:35:03 ERROR security.UserGroupInformation: PriviledgedActionException as:varunc cause:org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: ceph://null/mnt/ceph/wc > org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: ceph://null/mnt/ceph/wc > at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:235) > at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:252) > at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:962) > at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:979) > at org.apache.hadoop.mapred.JobClient.access$600(JobClient.java:174) > at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:897) > at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121) > at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850) > at org.apache.hadoop.mapreduce.Job.submit(Job.java:500) > at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:530) > at org.apache.hadoop.examples.WordCount.main(WordCount.java:67) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:601) > at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68) > at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139) > at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:64) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:601) > at org.apache.hadoop.util.RunJar.main(RunJar.java:156) > > Any ways to remove this error? > > On Tue, Mar 19, 2013 at 7:39 PM, Noah Watkins <jayhawk@xxxxxxxxxxx> wrote: > Hi Varun, > > Try removing this configuration option: > > > <property> > > <name>ceph.root.dir</name> > > <value>/mnt/ceph</value> > > </property> > > Hadoop running on Ceph uses the libcephfs user-space library to talk directly to the file system, as opposed to running through the kernel or FUSE client. This setting is which directory within the Ceph file system to use as a root. It defaults to "/". > > Thanks, > -Noah > > > Thanks > Varun _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |