BookmarkSubscribeRSS Feed
ajain59
Calcite | Level 5

Hi,

 

I am submitting map reduce job a word count example but getting an error message. Can some one provide the fix around it.


proc hadoop username='cloudera' password='cloudera' verbose;
mapreduce
input="/user/cloudera/hamlet.txt"
output="/user/sas/outputs"
jar="C:\Users\ajain59\Desktop\abc\WordCount\Hadoop.jar"
map="org.apache.hadoop.examples.WordCount$TokenizerMapper"
reduce="org.apache.hadoop.examples.WordCount$IntSumReducer"
combine="org.apache.hadoop.examples.WordCount$IntSumReducer"
outputvalue="org.apache.hadoop.io.IntWritable"
outputkey="org.apache.hadoop.io.Text"
;
run;

 

NOTE: Hadoop Job (HDP_JOB_ID), job_1489673305643_0008, SAS Map/Reduce Job,
http://quickstart.cloudera:8088/proxy/application_1489673305643_0008/

ERROR: Job job_1489673305643_0008 has failed. Please, see job log for details. Job tracking URL :
http://quickstart.cloudera:8088/cluster/app/application_1489673305643_0008

 

Also, I checkd the hadoop log and got the following error message:

http://quickstart.cloudera:8088/cluster/app/application_1489673305643_0008

 

 

------ Error Log----

Application application_1489673305643_0008 failed 2 times due to AM Container for appattempt_1489673305643_0008_000002 exited with exitCode: 1
For more detailed output, check application tracking page:http://quickstart.cloudera:8088/proxy/application_1489673305643_0008/Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1489673305643_0008_02_000001
Exit code: 1
Exception message: /bin/bash: line 0: fg: no job control
 
Stack trace: ExitCodeException exitCode=1: /bin/bash: line 0: fg: no job control
 
at org.apache.hadoop.util.Shell.runCommand(Shell.java:578)
at org.apache.hadoop.util.Shell.run(Shell.java:481)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:763)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:213)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
 
 
Container exited with a non-zero exit code 1
Failing this attempt. Failing the application.

----------------------

 

2 REPLIES 2
AnnaBrown
Community Manager

Hi ajain59,

 

Thanks for your question! I suggest opening a track with Technical Support for this scenario. Check out this page for information on other ways to contact Tech Support.

 

Best,

Anna


Join us for SAS Community Trivia
SAS Bowl XXIX, The SAS Hackathon
Wednesday, March 8, 2023, at 10 AM ET | #SASBowl

JBailey
Barite | Level 11

Hi @ajain59

 

@AnnaBrown's answer here is solid.

 

What I am about to say may not be your issue, but I have encounter it numerous times.

 

When using the CDH Quickstart VM is that you have to ensure that it has enough resources (I use 16GB RAM and 2 processors - I have a fairly robust desktop PC). Pay special attention to the Cloudera recommendations regarding resources and exceed them if you can. Back to a potential solutionn...

 

Once you have the resources then you need patience. I find that it takes a long time for the CDH services to start. It takes patience. Something I have little of.

 

Pro Tip:  Go into Cloudera Manager and stop unnecessary services. this frees up resources and allows the quickstart to run better in a constrained environment.

 

Best wishes,

Jeff 

sas-innovate-2024.png

Join us for SAS Innovate April 16-19 at the Aria in Las Vegas. Bring the team and save big with our group pricing for a limited time only.

Pre-conference courses and tutorials are filling up fast and are always a sellout. Register today to reserve your seat.

 

Register now!

How to connect to databases in SAS Viya

Need to connect to databases in SAS Viya? SAS’ David Ghan shows you two methods – via SAS/ACCESS LIBNAME and SAS Data Connector SASLIBS – in this video.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 2 replies
  • 909 views
  • 0 likes
  • 3 in conversation