Hi,
I am submitting map reduce job a word count example but getting an error message. Can some one provide the fix around it.
proc hadoop username='cloudera' password='cloudera' verbose;
mapreduce
input="/user/cloudera/hamlet.txt"
output="/user/sas/outputs"
jar="C:\Users\ajain59\Desktop\abc\WordCount\Hadoop.jar"
map="org.apache.hadoop.examples.WordCount$TokenizerMapper"
reduce="org.apache.hadoop.examples.WordCount$IntSumReducer"
combine="org.apache.hadoop.examples.WordCount$IntSumReducer"
outputvalue="org.apache.hadoop.io.IntWritable"
outputkey="org.apache.hadoop.io.Text"
;
run;
NOTE: Hadoop Job (HDP_JOB_ID), job_1489673305643_0008, SAS Map/Reduce Job,
http://quickstart.cloudera:8088/proxy/application_1489673305643_0008/
ERROR: Job job_1489673305643_0008 has failed. Please, see job log for details. Job tracking URL :
http://quickstart.cloudera:8088/cluster/app/application_1489673305643_0008
Also, I checkd the hadoop log and got the following error message:
http://quickstart.cloudera:8088/cluster/app/application_1489673305643_0008
------ Error Log----
----------------------
Hi ajain59,
Thanks for your question! I suggest opening a track with Technical Support for this scenario. Check out this page for information on other ways to contact Tech Support.
Best,
Anna
Hi @ajain59
@AnnaBrown's answer here is solid.
What I am about to say may not be your issue, but I have encounter it numerous times.
When using the CDH Quickstart VM is that you have to ensure that it has enough resources (I use 16GB RAM and 2 processors - I have a fairly robust desktop PC). Pay special attention to the Cloudera recommendations regarding resources and exceed them if you can. Back to a potential solutionn...
Once you have the resources then you need patience. I find that it takes a long time for the CDH services to start. It takes patience. Something I have little of.
Pro Tip: Go into Cloudera Manager and stop unnecessary services. this frees up resources and allows the quickstart to run better in a constrained environment.
Best wishes,
Jeff
Are you ready for the spotlight? We're accepting content ideas for SAS Innovate 2025 to be held May 6-9 in Orlando, FL. The call is open until September 25. Read more here about why you should contribute and what is in it for you!
Need to connect to databases in SAS Viya? SAS’ David Ghan shows you two methods – via SAS/ACCESS LIBNAME and SAS Data Connector SASLIBS – in this video.
Find more tutorials on the SAS Users YouTube channel.