Hi,
I am submitting map reduce job a word count example but getting an error message. Can some one provide the fix around it.
proc hadoop username='cloudera' password='cloudera' verbose;
mapreduce
input="/user/cloudera/hamlet.txt"
output="/user/sas/outputs"
jar="C:\Users\ajain59\Desktop\abc\WordCount\Hadoop.jar"
map="org.apache.hadoop.examples.WordCount$TokenizerMapper"
reduce="org.apache.hadoop.examples.WordCount$IntSumReducer"
combine="org.apache.hadoop.examples.WordCount$IntSumReducer"
outputvalue="org.apache.hadoop.io.IntWritable"
outputkey="org.apache.hadoop.io.Text"
;
run;
NOTE: Hadoop Job (HDP_JOB_ID), job_1489673305643_0008, SAS Map/Reduce Job,
http://quickstart.cloudera:8088/proxy/application_1489673305643_0008/
ERROR: Job job_1489673305643_0008 has failed. Please, see job log for details. Job tracking URL :
http://quickstart.cloudera:8088/cluster/app/application_1489673305643_0008
Also, I checkd the hadoop log and got the following error message:
http://quickstart.cloudera:8088/cluster/app/application_1489673305643_0008
------ Error Log----
----------------------
Hi ajain59,
Thanks for your question! I suggest opening a track with Technical Support for this scenario. Check out this page for information on other ways to contact Tech Support.
Best,
Anna
Join us for SAS Community Trivia
SAS Bowl XXIX, The SAS Hackathon
Wednesday, March 8, 2023, at 10 AM ET | #SASBowl
Hi @ajain59
@AnnaBrown's answer here is solid.
What I am about to say may not be your issue, but I have encounter it numerous times.
When using the CDH Quickstart VM is that you have to ensure that it has enough resources (I use 16GB RAM and 2 processors - I have a fairly robust desktop PC). Pay special attention to the Cloudera recommendations regarding resources and exceed them if you can. Back to a potential solutionn...
Once you have the resources then you need patience. I find that it takes a long time for the CDH services to start. It takes patience. Something I have little of.
Pro Tip: Go into Cloudera Manager and stop unnecessary services. this frees up resources and allows the quickstart to run better in a constrained environment.
Best wishes,
Jeff
Don't miss out on SAS Innovate - Register now for the FREE Livestream!
Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.
Need to connect to databases in SAS Viya? SAS’ David Ghan shows you two methods – via SAS/ACCESS LIBNAME and SAS Data Connector SASLIBS – in this video.
Find more tutorials on the SAS Users YouTube channel.