cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
netaji
‎01-12-2024
  • 1 Posts
  • 0 Likes Given
  • 0 Solutions
  • 0 Likes Received

SAS® Data Loader for Hadoop - Error Message on Configuration.

by Calcite | Level 5 in SAS Data Management
‎06-01-2016 01:12 PM
‎06-01-2016 01:12 PM
I tried to configure and work on SAS Data Loader for Hadoop and it failed. The Log is as follows. Can someone help me out here to make necessary corrections and configure the same.   2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: hive found on 192.168.75.129:10000 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/wizard.py", line 122, in scancluster 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: trying to map: 0.0.0.0 ... 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: check hive pid owner on 192.168.75.129 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: No scan is needed 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Using cdh quickstart rule 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: check hive2:10000 on 192.168.75.129 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: done 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: testcmd: timeout -s SIGKILL 60s sas-sshpass -p cloudera ssh cloudera@192.168.75.129 'id' 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: RARGS: sas-sshpass -p cloudera ssh cloudera@192.168.75.129 'sudo lsof -i :10000' 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: resolvable: True >rc: 0 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/hadoopscanner.py", line 155, in scanclient 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: User cloudera may run the following commands on this host: 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Checking hdfs on 192.168.75.129 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: for jar in v['jarfiles']: 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: resolvable: True 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: (ALL) NOPASSWD: ALL 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: mapped quickstart.cloudera to 192.168.75.129 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: check hive2:10000 on 192.168.75.129 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Testing connection to 192.168.75.129 ... 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Testing sudo capabilities for cloudera on 192.168.75.129 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/sitexmls/classpathgenerators.py", line 52, in generate_mapreduce_application_classpath 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Checking yarn on 192.168.75.129 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: trying to map: quickstart.cloudera ... 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local:  2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local:  2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: ERROR: client configuration failed 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/wizard.py", line 88, in Run 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: RARGS: sas-sshpass -p cloudera ssh cloudera@192.168.75.129 'sudo lsof -i :10000' 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: trying to map: quickstart.cloudera ... 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: 879c4c29-b861-4416-a9e1-c790e68a6f44 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: removing symlink and recreating it later 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: cloudera@192.168.75.129's password:  2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: remotereverselookup: 127.0.0.1 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: cansudo? True 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: remotereverselookup: 0.0.0.0 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: remotereverselookup: 127.0.0.1 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: resolvable: True 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: version: cdh5.7.0 >LocalExec: ******** 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: resolvable: True 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: {'192.168.75.129': {'cloudera': {'sudo': True}}} 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: failonmissing=HC['overwrite_mapred_app_class_path']) 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local:  2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Checking yarn on 192.168.75.129 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Matching Defaults entries for cloudera on this host: 2016-06-01 12:32:29 USER[Unauthenticated] - ipaddress 192.168.75.130 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: trying to map: 0.0.0.0 ... 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Traceback (most recent call last): 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: remotereverselookup: 0.0.0.0 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/bin/sas-hadoop-tool", line 134, in main 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: TypeError: 'NoneType' object is not iterable 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: remotereverselookup: 0.0.0.0 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 >stderr: 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Checking hdfs on 192.168.75.129 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: check hive pid owner on 192.168.75.129 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: remotereverselookup: 0.0.0.0 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: resolvable: True 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: cloudera@192.168.75.129's password:  2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/wizard.py", line 88, in Run 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: mapped 0.0.0.0 to 192.168.75.129 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: self.args.svckey) 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: sys.exit(main()) 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: trying to map: 0.0.0.0 ... 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/bin/sas-hadoop-tool", line 140, in  2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/bin/sas-hadoop-tool", line 134, in main 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: self.scancluster() 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local:  2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Parsing hive information ... 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: hive found on 192.168.75.129:10000 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: sudo returned all: True 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: trying to map: 0.0.0.0 ... 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: remotereverselookup: 127.0.0.1 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: self.scancluster() 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: trying to map: quickstart.cloudera ... 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Testing connection to 192.168.75.129 ... 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: ERROR: sas-hadoop-tool init --clienthost="192.168.75.129" --clientuser="cloudera" --clientpass="cloudera" --svckey=hivejdbc --svckey=hadoop --svckey=mapreduce --svckey=hcatapi --nojartrace failed: 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: mapped quickstart.cloudera to 192.168.75.129 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Checking hive2:10000 on all hosts 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: for jar in v['jarfiles']: 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: resolvable: True 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local:  2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Checking hive -e 'set -v' information ... 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: self.args.svckey) 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Testing sudo capabilities for cloudera on 192.168.75.129 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: ec = x.Run() 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: resolvable: True 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: remotereverselookup: 0.0.0.0 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: !requiretty, !visiblepw, always_set_home, env_reset, env_keep="COLORS DISPLAY HOSTNAME HISTSIZE INPUTRC KDEDIR LS_COLORS", env_keep+="MAIL PS1 PS2 QTDIR USERNAME LANG LC_ADDRESS LC_CTYPE", env_keep+="LC_COLLATE LC_IDENTIFICATION LC_MEASUREMENT LC_MESSAGES", env_keep+="LC_MONETARY LC_NAME LC_NUMERIC LC_PAPER LC_TELEPHONE", env_keep+="LC_TIME LC_ALL LANGUAGE LINGUAS _XKB_CHARSET XAUTHORITY", secure_path=/sbin:/bin:/usr/sbin:/usr/bin, !secure_path 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: mapped 0.0.0.0 to 192.168.75.129 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: remotereverselookup: 0.0.0.0 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: testcmd: timeout -s SIGKILL 60s sas-sshpass -p cloudera ssh cloudera@192.168.75.129 'id' 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: ec = x.Run() 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: cansudo? True 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: trying to map: 0.0.0.0 ... 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Finding Hadoop distro and version 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: distro: cloudera 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: sys.exit(main()) 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local:  2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Using cdh quickstart rule 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: remotereverselookup: 127.0.0.1 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/sitexmls/classpathgenerators.py", line 52, in generate_mapreduce_application_classpath 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/hadoopscanner.py", line 155, in scanclient 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/wizard.py", line 122, in scancluster 2016-06-01 12:32:29 USER[Unauthenticated] - Notice: Running hadoopconfigure on 192.168.75.130 with arguments: ******** 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: trying to map: 0.0.0.0 ... 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: !requiretty, !visiblepw, always_set_home, env_reset, env_keep="COLORS DISPLAY HOSTNAME HISTSIZE INPUTRC KDEDIR LS_COLORS", env_keep+="MAIL PS1 PS2 QTDIR USERNAME LANG LC_ADDRESS LC_CTYPE", env_keep+="LC_COLLATE LC_IDENTIFICATION LC_MEASUREMENT LC_MESSAGES", env_keep+="LC_MONETARY LC_NAME LC_NUMERIC LC_PAPER LC_TELEPHONE", env_keep+="LC_TIME LC_ALL LANGUAGE LINGUAS _XKB_CHARSET XAUTHORITY", secure_path=/sbin:/bin:/usr/sbin:/usr/bin, !secure_path 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: running command: sas-hadoop-tool init --clienthost="192.168.75.129" --clientuser="cloudera" --clientpass="cloudera" --svckey=hivejdbc --svckey=hadoop --svckey=mapreduce --svckey=hcatapi --nojartrace 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: testcmd: timeout -s SIGKILL 60s sas-sshpass -p cloudera ssh cloudera@192.168.75.129 'id' 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local:  2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Checking hive pid owner on all hosts 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Matching Defaults entries for cloudera on this host: 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: distro: cloudera 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: failonmissing=HC['overwrite_mapred_app_class_path']) 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: version: cdh5.7.0 >stdout: Writing to /opt/sasinside/var/log/sva.execute/execute_task.2016.06.01.12.32.28.874721876.log 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: resolvable: True 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: User cloudera may run the following commands on this host: 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: testcmd: timeout -s SIGKILL 60s sas-sshpass -p cloudera ssh cloudera@192.168.75.129 'id' 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Checking hive2:10000 on all hosts 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Checking hive -e 'set -v' information ... 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: exit_code=1 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: File "/usr/bin/sas-hadoop-tool", line 140, in  2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: link /opt/sasinside/hadoop 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: resolvable: True 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Hadoop directory exists so attempting to reuse 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: sudo returned all: True 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Parsing hive information ... 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: TypeError: 'NoneType' object is not iterable 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: trying to map: quickstart.cloudera ... 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Checking hive pid owner on all hosts 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: (ALL) NOPASSWD: ALL 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: 879c4c29-b861-4416-a9e1-c790e68a6f44 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Running sas-hadoop-tool to configure the hadoop client 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Traceback (most recent call last): 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: {'192.168.75.129': {'cloudera': {'sudo': True}}} 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: resolvable: True 2016-06-01 12:33:16 USER[Unauthenticated] - Debug: CMD local: Finding Hadoop distro and version ... View more
Contact Me
Online Status
Offline
Date Last Visited
‎01-12-2024 08:12 AM
Group Hubs for netaji
View All
Quick links