Cloudera's CDH4 WordCount hadoop tutorial - issues -


i following tutorial: http://www.cloudera.com/content/cloudera-content/cloudera-docs/hadooptutorial/cdh4/hadoop-tutorial/ht_topic_5_2.html

it says following:

javac -cp classpath -d wordcount_classes wordcount.java

where classpath is:

cdh4 - /usr/lib/hadoop/*:/usr/lib/hadoop/client-0.20/* cdh3 - /usr/lib/hadoop-0.20/hadoop-0.20.2-cdh3u4-core.jar

i have downloaded "cloudera-quickstart-demo-vm-4.2.0-vmware" . running user cloudera.

    [cloudera@localhost wordcount]$ javac -cp /usr/lib/hadoop/*:/usr/lib/hadoop/client-0.20/* -d wordcount_classes wordcount.java incorrect classpath: /usr/lib/hadoop/* incorrect classpath: /usr/lib/hadoop/client-0.20/* ---------- 1. error in wordcount.java (at line 8)         import org.apache.hadoop.fs.path;                ^^^^^^^^^^

when checking cp folder: .

[cloudera@localhost wordcount]$ ls -l /usr/lib/hadoop total 3500 drwxr-xr-x. 2 root root    4096 apr 22 14:37 bin drwxr-xr-x. 2 root root    4096 apr 22 14:33 client drwxr-xr-x. 2 root root    4096 apr 22 14:33 client-0.20 drwxr-xr-x. 2 root root    4096 apr 22 14:36 cloudera drwxr-xr-x. 2 root root    4096 apr 22 14:30 etc -rw-r--r--. 1 root root   16536 feb 15 14:24 hadoop-annotations-2.0.0-cdh4.2.0.jar lrwxrwxrwx. 1 root root      37 apr 22 14:30 hadoop-annotations.jar -> hadoop-annotations-2.0.0-cdh4.2.0.jar -rw-r--r--. 1 root root   46855 feb 15 14:24 hadoop-auth-2.0.0-cdh4.2.0.jar lrwxrwxrwx. 1 root root      30 apr 22 14:30 hadoop-auth.jar -> hadoop-auth-2.0.0-cdh4.2.0.jar -rw-r--r--. 1 root root 2266171 feb 15 14:24 hadoop-common-2.0.0-cdh4.2.0.jar -rw-r--r--. 1 root root 1212163 feb 15 14:24 hadoop-common-2.0.0-cdh4.2.0-tests.jar lrwxrwxrwx. 1 root root      32 apr 22 14:30 hadoop-common.jar -> hadoop-common-2.0.0-cdh4.2.0.jar drwxr-xr-x. 3 root root    4096 apr 22 14:36 lib drwxr-xr-x. 2 root root    4096 apr 22 14:33 libexec drwxr-xr-x. 2 root root    4096 apr 22 14:31 sbin

what doing wrong? directly cloudera quickstart vm cdh4 installed. following "hadoop tutorial" . says 

**prerequisites**  ensure cdh installed, configured, , running. easiest way going use cdh4 quickstart vm

which running tutorial - cdh4 quickstart vm.

what doing wrong?

*update version information;

[cloudera@localhost cloudera]$ cat cdh_version.properties  # autogenerated build properties version=2.0.0-cdh4.2.0 git.hash=8bce4bd28a464e0a92950c50ba01a9deb1d85686 cloudera.hash=8bce4bd28a464e0a92950c50ba01a9deb1d85686 cloudera.base-branch=cdh4-base-2.0.0 cloudera.build-branch=cdh4-2.0.0_4.2.0 cloudera.pkg.version=2.0.0+922 cloudera.pkg.release=1.cdh4.2.0.p0.12 cloudera.cdh.release=cdh4.2.0 cloudera.build.time=2013.02.15-18:39:29gmt  cloudera.pkg.name=hadoop

classpath env:

[cloudera@localhost bin]$ echo $classpath :/usr/lib/hadoop/*:/usr/lib/hadoop/client-0.20/*

edit!! think figured out. new issue possibly cloudera cd4 vm quickstart vm: from: this post dated yesterday person having exact same problem. seems javac program not accept wildcards on exported paths. had following:

export classpath=/usr/lib/hadoop/client-0.20/\*:/usr/lib/hadoop/\*

then javac -d [without -cp override] 

javac -d wordcount_classes/ wordcount.java

only warnings appear.

i wonder if cloudera has fix quickstart vm.

you need have classpath variable set includes directories in /usr/lib/hadoop if want javac find them. can set env var follows

$: export classpath=$classpath:/usr/lib/hadoop/*:/usr/lib/hadoop/client-0.20/*

javac find libs. if have additional complaining regarding classpath variables can append them above line using colon (:) delimiter

you include in bash script, best practice set correct env variables @ runtime, want. in case word count or cdh4 env setting it, best set yourself.


Comments

Post a Comment

Popular posts from this blog

jquery - How can I dynamically add a browser tab? -

since using iframes house external pages are, accounts "not preferred method" , disallowed sites (flickr, one), want dynamically generate browser tabs. e.g., when user submits form, want dynamically generate tab on browser in response submitted. e.g., might want add new tab url like: http://www.bigsurgarrapata.com/contact how in jquery? you want form target attribute action attribute. http://www.w3schools.com/tags/att_form_target.asp browsers have ultimate control on result of target attribute open new tab value of _blank. <form action="contact_submit.php" target="_blank" method="post">
Read more

keyboard - C++ GetAsyncKeyState alternative -

i using windows.h library's getasynckeystate function define key pushed on keyboard . here program returns int value of pushed key example. #include <iostream> #include <windows.h> using namespace std; int main (){ char i; for(i=8;i<190;i++){ if(getasynckeystate(i)== -32767){ cout<<int (i)<<endl; } } return 0; } but trying make opengl simple game , function appeared slow . there function not need cycle 180 times , if statement . thanks you're trying make opengl game, you're going use glfw. if that's case can away using glfwgetkey() such: if (glfwgetkey(glfw_key_up) == glfw_press) {...} if (glfwgetkey(glfw_key_down) == glfw_press) {...} that method nicely explained in tutorial 6 opengl-tutorial.org . should start first tutorial of beginners tutorials , later intermediate tutorials . if you're going make win32 window can listen wm_keydown or wm_keyup messages , virtua...
Read more

android - java.net.UnknownHostException(Unable to resolve host “URL”: No address associated with hostname) -

i developing app testing asp.net webservice in android.for simple webservice adding 2 numbers used.where numbers passed parameters.the result in dialogue.the webserver works in local. when application runs following result exception.i provided internet permission in manifest. java.net.unknownhostexception(unable resolve host “ http://url.com/ ”: no address associated hostname) my code given below main activity public static string rslt=""; /** called when activity first created. */ @override public void oncreate(bundle savedinstancestate) { super.oncreate(savedinstancestate); setcontentview(r.layout.activity_main); button b1=(button)findviewbyid(r.id.button1); final alertdialog ad=new alertdialog.builder(this).create(); b1.setonclicklistener(new onclicklistener() { @override public void onclick(view arg0) { // todo auto-generated method stub try { ...
Read more