SAS® Data Loader for Hadoop - Error Message on Configuration.

[netaji]

I tried to configure and work on SAS Data Loader for Hadoop and it failed. The Log is as follows. Can someone help me out here to make necessary corrections and configure the same.

2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: hive found on 192.168.75.129:10000
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/wizard.py", line 122, in scancluster
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: trying to map: 0.0.0.0 ...
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: check hive pid owner on 192.168.75.129
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: No scan is needed
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Using cdh quickstart rule
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: check hive2:10000 on 192.168.75.129
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: done
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: testcmd: timeout -s SIGKILL 60s sas-sshpass -p cloudera ssh cloudera@192.168.75.129 'id'
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: RARGS: sas-sshpass -p cloudera ssh cloudera@192.168.75.129 'sudo lsof -i :10000'
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: resolvable: True
>rc: 0
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/hadoopscanner.py", line 155, in scanclient
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: User cloudera may run the following commands on this host:
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Checking hdfs on 192.168.75.129
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: for jar in v['jarfiles']:
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: resolvable: True
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: (ALL) NOPASSWD: ALL
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: mapped quickstart.cloudera to 192.168.75.129
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: check hive2:10000 on 192.168.75.129
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Testing connection to 192.168.75.129 ...
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Testing sudo capabilities for cloudera on 192.168.75.129
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/sitexmls/classpathgenerators.py", line 52, in generate_mapreduce_application_classpath
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Checking yarn on 192.168.75.129
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: trying to map: quickstart.cloudera ...
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: 
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: 
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: ERROR: client configuration failed
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/wizard.py", line 88, in Run
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: RARGS: sas-sshpass -p cloudera ssh cloudera@192.168.75.129 'sudo lsof -i :10000'
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: trying to map: quickstart.cloudera ...
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: 879c4c29-b861-4416-a9e1-c790e68a6f44
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: removing symlink and recreating it later
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: cloudera@192.168.75.129's password: 
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: remotereverselookup: 127.0.0.1
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: cansudo? True
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: remotereverselookup: 0.0.0.0
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: remotereverselookup: 127.0.0.1
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: resolvable: True
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: version: cdh5.7.0
>LocalExec: ********
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: resolvable: True
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: {'192.168.75.129': {'cloudera': {'sudo': True}}}
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: failonmissing=HC['overwrite_mapred_app_class_path'])
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: 
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Checking yarn on 192.168.75.129
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Matching Defaults entries for cloudera on this host:
2016-06-01 12:32:29 USER[Unauthenticated] - ipaddress 192.168.75.130
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: trying to map: 0.0.0.0 ...
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Traceback (most recent call last):
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: remotereverselookup: 0.0.0.0
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/bin/sas-hadoop-tool", line 134, in main
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: TypeError: 'NoneType' object is not iterable
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: remotereverselookup: 0.0.0.0
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
>stderr:
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Checking hdfs on 192.168.75.129
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: check hive pid owner on 192.168.75.129
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: remotereverselookup: 0.0.0.0
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: resolvable: True
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: cloudera@192.168.75.129's password: 
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/wizard.py", line 88, in Run
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: mapped 0.0.0.0 to 192.168.75.129
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: self.args.svckey)
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: sys.exit(main())
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: trying to map: 0.0.0.0 ...
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/bin/sas-hadoop-tool", line 140, in 
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/bin/sas-hadoop-tool", line 134, in main
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: self.scancluster()
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: 
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Parsing hive information ...
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: hive found on 192.168.75.129:10000
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: sudo returned all: True
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: trying to map: 0.0.0.0 ...
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: remotereverselookup: 127.0.0.1
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: self.scancluster()
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: trying to map: quickstart.cloudera ...
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Testing connection to 192.168.75.129 ...
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: ERROR: sas-hadoop-tool init --clienthost="192.168.75.129" --clientuser="cloudera" --clientpass="cloudera" --svckey=hivejdbc --svckey=hadoop --svckey=mapreduce --svckey=hcatapi --nojartrace failed:
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: mapped quickstart.cloudera to 192.168.75.129
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Checking hive2:10000 on all hosts
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: for jar in v['jarfiles']:
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: resolvable: True
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: 
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Checking hive -e 'set -v' information ...
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: self.args.svckey)
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Testing sudo capabilities for cloudera on 192.168.75.129
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: ec = x.Run()
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: resolvable: True
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: remotereverselookup: 0.0.0.0
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: !requiretty, !visiblepw, always_set_home, env_reset, env_keep="COLORS DISPLAY HOSTNAME HISTSIZE INPUTRC KDEDIR LS_COLORS", env_keep+="MAIL PS1 PS2 QTDIR USERNAME LANG LC_ADDRESS LC_CTYPE", env_keep+="LC_COLLATE LC_IDENTIFICATION LC_MEASUREMENT LC_MESSAGES", env_keep+="LC_MONETARY LC_NAME LC_NUMERIC LC_PAPER LC_TELEPHONE", env_keep+="LC_TIME LC_ALL LANGUAGE LINGUAS _XKB_CHARSET XAUTHORITY", secure_path=/sbin:/bin:/usr/sbin:/usr/bin, !secure_path
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: mapped 0.0.0.0 to 192.168.75.129
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: remotereverselookup: 0.0.0.0
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: testcmd: timeout -s SIGKILL 60s sas-sshpass -p cloudera ssh cloudera@192.168.75.129 'id'
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: ec = x.Run()
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: cansudo? True
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: trying to map: 0.0.0.0 ...
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Finding Hadoop distro and version
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: distro: cloudera
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: sys.exit(main())
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: 
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Using cdh quickstart rule
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: remotereverselookup: 127.0.0.1
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/sitexmls/classpathgenerators.py", line 52, in generate_mapreduce_application_classpath
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/hadoopscanner.py", line 155, in scanclient
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/wizard.py", line 122, in scancluster
2016-06-01 12:32:29 USER[Unauthenticated] - Notice: Running hadoopconfigure on 192.168.75.130 with arguments: ********
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: trying to map: 0.0.0.0 ...
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: !requiretty, !visiblepw, always_set_home, env_reset, env_keep="COLORS DISPLAY HOSTNAME HISTSIZE INPUTRC KDEDIR LS_COLORS", env_keep+="MAIL PS1 PS2 QTDIR USERNAME LANG LC_ADDRESS LC_CTYPE", env_keep+="LC_COLLATE LC_IDENTIFICATION LC_MEASUREMENT LC_MESSAGES", env_keep+="LC_MONETARY LC_NAME LC_NUMERIC LC_PAPER LC_TELEPHONE", env_keep+="LC_TIME LC_ALL LANGUAGE LINGUAS _XKB_CHARSET XAUTHORITY", secure_path=/sbin:/bin:/usr/sbin:/usr/bin, !secure_path
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: running command: sas-hadoop-tool init --clienthost="192.168.75.129" --clientuser="cloudera" --clientpass="cloudera" --svckey=hivejdbc --svckey=hadoop --svckey=mapreduce --svckey=hcatapi --nojartrace
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: testcmd: timeout -s SIGKILL 60s sas-sshpass -p cloudera ssh cloudera@192.168.75.129 'id'
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: 
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Checking hive pid owner on all hosts
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Matching Defaults entries for cloudera on this host:
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: distro: cloudera
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: failonmissing=HC['overwrite_mapred_app_class_path'])
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: version: cdh5.7.0
>stdout: Writing to /opt/sasinside/var/log/sva.execute/execute_task.2016.06.01.12.32.28.874721876.log
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: resolvable: True
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: User cloudera may run the following commands on this host:
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: testcmd: timeout -s SIGKILL 60s sas-sshpass -p cloudera ssh cloudera@192.168.75.129 'id'
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Checking hive2:10000 on all hosts
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Checking hive -e 'set -v' information ...
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: exit_code=1
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/bin/sas-hadoop-tool", line 140, in 
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: link /opt/sasinside/hadoop
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: resolvable: True
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Hadoop directory exists so attempting to reuse
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: sudo returned all: True
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Parsing hive information ...
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: TypeError: 'NoneType' object is not iterable
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: trying to map: quickstart.cloudera ...
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Checking hive pid owner on all hosts
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: (ALL) NOPASSWD: ALL
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: 879c4c29-b861-4416-a9e1-c790e68a6f44
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Running sas-hadoop-tool to configure the hadoop client
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Traceback (most recent call last):
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: {'192.168.75.129': {'cloudera': {'sudo': True}}}
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: resolvable: True
2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Finding Hadoop distro and version

[AnnaBrown]

Hi netaji,

Welcome to the SAS Data Management Community! This scenario is best directed to Technical Support. Feel free to open a track. For information on other ways to contact Tech Support, refer to:http://support.sas.com/techsup/contact/index.html.

Best,

Anna

[JBailey · Accepted solution]

Hi,

You may need to wait for the CDH Quickstart to fully come to life. Since it is a VM it can take a while. It also helps if your machine has a lot of RAM (32 GB is nice) since you will be running two VMs.

Best wishes,

Jeff