{"issue":{"pull_request":{"diff_url":null,"html_url":null,"patch_url":null},"state":"open","user":{"avatar_url":"https://secure.gravatar.com/avatar/3943568466a83d2213029fd6aa535ee1?d=https://a248.e.akamai.net/assets.github.com%2Fimages%2Fgravatars%2Fgravatar-140.png","gravatar_id":"3943568466a83d2213029fd6aa535ee1","url":"https://api.github.com/users/l33twolf","login":"l33twolf","id":583919},"milestone":null,"labels":[],"updated_at":"2011-11-05T03:36:43Z","assignee":null,"comments":1,"closed_at":null,"url":"https://api.github.com/repos/jblomo/oddjob/issues/1","body":"I'm attempting to use this with mrjob on EMR from commit [bc136d37e1](https://github.com/Yelp/mrjob/commit/bc136d37e1d81bceabc7ce4075b417386c5e6452) and steps will not start.\r\n\r\nUsing leiningen 1.6.1.1 I created an oddjob jar from commit [d04dd71297](https://github.com/jblomo/oddjob/commit/d04dd712975d4ea01f932efc03ec7e9d05f17db2), but when attempting to launch any job (even mr_wc.py and other examples) the step using the oddjob jar file fails to start. \r\n\r\nmy command line is, for example:\r\n\r\n`python mr_wc.py -r emr --hadoop-streaming-jar oddjob-*-standalone.jar input.txt`\r\n\r\neven if i am not attempting to use any of the MultipleOutputFormat classes the step failes to start with the following error:\r\n\r\n```\r\nException in thread \"main\" java.lang.ClassNotFoundException: -files\r\n\tat java.net.URLClassLoader$1.run(URLClassLoader.java:202)\r\n\tat java.security.AccessController.doPrivileged(Native Method)\r\n\tat java.net.URLClassLoader.findClass(URLClassLoader.java:190)\r\n\tat java.lang.ClassLoader.loadClass(ClassLoader.java:307)\r\n\tat java.lang.ClassLoader.loadClass(ClassLoader.java:248)\r\n\tat java.lang.Class.forName0(Native Method)\r\n\tat java.lang.Class.forName(Class.java:247)\r\n\tat org.apache.hadoop.util.RunJar.main(RunJar.java:149)\r\n```\r\n\r\nI've only ever used hadoop streaming, so i'm not up on my java tracebacks. Am I right in understanding that this is confusing the -files command line arg with a class specification in the oddjob jar?","html_url":"https://github.com/jblomo/oddjob/issues/1","title":"Steps fail to start using oddjob","number":1,"id":2148202,"created_at":"2011-11-04T20:43:18Z"},"action":"created","comment":{"user":{"avatar_url":"https://secure.gravatar.com/avatar/923bbb4cdeab169358186ff211c38112?d=https://a248.e.akamai.net/assets.github.com%2Fimages%2Fgravatars%2Fgravatar-140.png","gravatar_id":"923bbb4cdeab169358186ff211c38112","url":"https://api.github.com/users/jblomo","login":"jblomo","id":45173},"updated_at":"2011-11-05T03:36:43Z","url":"https://api.github.com/repos/jblomo/oddjob/issues/comments/2638781","body":"Thanks for the detailed report.  That error is misleading (in fact, it may be a regression on that version of mrjob, so I'll look into that).  The full blown command you need is:\r\n\r\n```sh\r\npython examples/mr_wc.py --verbose -r emr  --hadoop-version 0.20  --bootstrap-file oddjob-0.20.0-SNAPSHOT-standalone.jar  --bootstrap-cmd 'cp oddjob-0.20.0-SNAPSHOT-standalone.jar /home/hadoop/' --hadoop-arg -libjars --hadoop-arg '/home/hadoop/oddjob-0.20.0-SNAPSHOT-standalone.jar' input.txt\r\n```\r\n\r\nThe version of oddjob you are using is designed to be used as a -libjar argument with hadoop 0.20.  -libjar arguments must be available to the `hadoop` script when you run the job, so you can use an inline bootstrap-cmd as shown, set it up in your config, or have an AMI with it already installed.\r\n\r\nLet me know if that works for you and I'll update the docs with this example and close the issue.","id":2638781,"created_at":"2011-11-05T03:36:43Z"}}