topic Re: SAS Data Loader for Hadoop - configuration problem in SAS Data Management

SAS Data Loader for Hadoop - configuration problem

pj23295 — Tue, 12 Jan 2016 11:42:11 GMT

Hi,

When I try to initiate SAS Data Loader for Hadoop I'm getting an error mesage from configuration step 1 (Hadoop configuration), please find below an error log:

2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: [0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: 82ae9ba3-36f0-4021-930b-504b420a0194[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/wizard.py", line 122, in scancluster[0m
2016-01-12 06:35:53 USER[Unauthenticated] - ipaddress 192.168.28.128
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: for jar in v['jarfiles']:[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Testing sudo capabilities for root on 192.168.28.129[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: User root may run the following commands on this host:[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 0.0.0.0[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: RARGS: sas-sshpass -p cloudera ssh root@192.168.28.129 'lsof -i :10000'[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Hadoop directory exists so attempting to reuse[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: cansudo? False[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: exit_code=1[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: [0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Matching Defaults entries for root on this host:[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: check hive2:10000 on 192.168.28.129[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/wizard.py", line 88, in Run[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: {'192.168.28.129': {'root': {'sudo': False}}}[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: TypeError: 'NoneType' object is not iterable[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: True[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hive pid owner on all hosts[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: running command: sas-hadoop-tool init --clienthost="192.168.28.129" --clientuser="root" --clientpass="cloudera" --svckey=hivejdbc --svckey=hadoop --svckey=mapreduce --svckey=hcatapi --nojartrace[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: !requiretty, !visiblepw, always_set_home, env_reset, env_keep="COLORS DISPLAY HOSTNAME HISTSIZE INPUTRC KDEDIR LS_COLORS", env_keep+="MAIL PS1 PS2 QTDIR USERNAME LANG LC_ADDRESS LC_CTYPE", env_keep+="LC_COLLATE LC_IDENTIFICATION LC_MEASUREMENT LC_MESSAGES", env_keep+="LC_MONETARY LC_NAME LC_NUMERIC LC_PAPER LC_TELEPHONE", env_keep+="LC_TIME LC_ALL LANGUAGE LINGUAS _XKB_CHARSET XAUTHORITY", secure_path=/sbin:/bin:/usr/sbin:/usr/bin, !secure_path[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hive -e 'set -v' information ...[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: root@192.168.28.129's password: [0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: done[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 127.0.0.1[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: distro: cloudera[0m
>stderr:
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/bin/sas-hadoop-tool", line 134, in main[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/bin/sas-hadoop-tool", line 140, in [0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: True[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 0.0.0.0[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: testcmd: timeout -s SIGKILL 60s sas-sshpass -p cloudera ssh root@192.168.28.129 'id'[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/wizard.py", line 122, in scancluster[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/bin/sas-hadoop-tool", line 134, in main[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: True[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: mapped quickstart.cloudera to 192.168.28.129[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: mapped 0.0.0.0 to 192.168.28.129[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: testcmd: timeout -s SIGKILL 60s sas-sshpass -p cloudera ssh root@192.168.28.129 'id'[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: User root may run the following commands on this host:[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: RARGS: sas-sshpass -p cloudera ssh root@192.168.28.129 'lsof -i :10000'[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 0.0.0.0[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: quickstart.cloudera ...[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Traceback (most recent call last):[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: sudo returned all: False[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: root@192.168.28.129's password: [0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: distro: cloudera[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: for jar in v['jarfiles']:[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hdfs on 192.168.28.129[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: quickstart.cloudera ...[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: self.scancluster()[0m
>LocalExec: ********
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Testing sudo capabilities for root on 192.168.28.129[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/sitexmls/classpathgenerators.py", line 52, in generate_mapreduce_application_classpath[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: testcmd: timeout -s SIGKILL 60s sas-sshpass -p cloudera ssh root@192.168.28.129 'id'[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: TypeError: 'NoneType' object is not iterable[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: 0.0.0.0 ...[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: link /opt/sasinside/hadoop[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/hadoopscanner.py", line 155, in scanclient[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: No scan is needed[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: (ALL) ALL[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: False[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: [0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: [0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hive2:10000 on all hosts[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: 0.0.0.0 ...[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: self.scancluster()[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Traceback (most recent call last):[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: version: cdh5.4.2[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: sys.exit(main())[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 0.0.0.0[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Finding Hadoop distro and version[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/sitexmls/classpathgenerators.py", line 52, in generate_mapreduce_application_classpath[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: {'192.168.28.129': {'root': {'sudo': False}}}[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: sys.exit(main())[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: cansudo? False[0m
>rc: 0
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: check hive2:10000 on 192.168.28.129[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: mapped quickstart.cloudera to 192.168.28.129[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: False[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Running sas-hadoop-tool to configure the hadoop client[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Parsing hive information ...[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: 0.0.0.0 ...[0m
>stdout: Writing to /opt/sasinside/var/log/sva.execute/execute_task.2016.01.12.06.35.53.107770638.log
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: sudo returned all: False[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/wizard.py", line 88, in Run[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: mapped 0.0.0.0 to 192.168.28.129[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: 0.0.0.0 ...[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: ec = x.Run()[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: False[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: ERROR: client configuration failed[0m
2016-01-12 06:35:53 USER[Unauthenticated] - [mNotice: Running hadoopconfigure on 192.168.28.128 with arguments: ********[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Testing connection to 192.168.28.129 ...[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/hadoopscanner.py", line 155, in scanclient[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hdfs on 192.168.28.129[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: testcmd: timeout -s SIGKILL 60s sas-sshpass -p cloudera ssh root@192.168.28.129 'id'[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: failonmissing=HC['overwrite_mapred_app_class_path'])[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 127.0.0.1[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Testing connection to 192.168.28.129 ...[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: self.args.svckey)[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: False[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking yarn on 192.168.28.129[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: 0.0.0.0 ...[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: !requiretty, !visiblepw, always_set_home, env_reset, env_keep="COLORS DISPLAY HOSTNAME HISTSIZE INPUTRC KDEDIR LS_COLORS", env_keep+="MAIL PS1 PS2 QTDIR USERNAME LANG LC_ADDRESS LC_CTYPE", env_keep+="LC_COLLATE LC_IDENTIFICATION LC_MEASUREMENT LC_MESSAGES", env_keep+="LC_MONETARY LC_NAME LC_NUMERIC LC_PAPER LC_TELEPHONE", env_keep+="LC_TIME LC_ALL LANGUAGE LINGUAS _XKB_CHARSET XAUTHORITY", secure_path=/sbin:/bin:/usr/sbin:/usr/bin, !secure_path[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Parsing hive information ...[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/bin/sas-hadoop-tool", line 140, in [0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: ERROR: sas-hadoop-tool init --clienthost="192.168.28.129" --clientuser="root" --clientpass="cloudera" --svckey=hivejdbc --svckey=hadoop --svckey=mapreduce --svckey=hcatapi --nojartrace failed:[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: check hive pid owner on 192.168.28.129[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hive -e 'set -v' information ...[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: (ALL) ALL[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: removing symlink and recreating it later[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Finding Hadoop distro and version[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: version: cdh5.4.2[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: [0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: check hive pid owner on 192.168.28.129[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: 82ae9ba3-36f0-4021-930b-504b420a0194[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Using cdh quickstart rule[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: True[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: failonmissing=HC['overwrite_mapred_app_class_path'])[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hive pid owner on all hosts[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: hive found on 192.168.28.129:10000[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: quickstart.cloudera ...[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: self.args.svckey)[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hive2:10000 on all hosts[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: [0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 0.0.0.0[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: True[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: quickstart.cloudera ...[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 127.0.0.1[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: 0.0.0.0 ...[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: True[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking yarn on 192.168.28.129[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Using cdh quickstart rule[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: ec = x.Run()[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 0.0.0.0[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: hive found on 192.168.28.129:10000[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: Matching Defaults entries for root on this host:[0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: [0m
2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 127.0.0.1[0m

Re: SAS Data Loader for Hadoop - configuration problem

ACBradley — Wed, 13 Jan 2016 16:31:44 GMT

Hi PJ,

This appears to be the Single-Node Trial of SAS Data Loader for Hadoop running on Cloudera Quickstart 5.4.2, is that correct?

What do you see on the webpage when you access the IP address for the vApp?

Clark

Re: SAS Data Loader for Hadoop - configuration problem

JBailey — Wed, 13 Jan 2016 17:52:37 GMT

Hi PJ,

From the traceback I see that you are using the CDH 5.4.2 Quickstart. Unfortunately, that is not a supported CDH version.

Here is the line from the traceback.

2016-01-12 06:36:44 USER[Unauthenticated] - [0;36mDebug: CMD local: version: cdh5.4.2[0m

CDH 5.3 is the supported version. Unfortunately the CDH 5.3 Quickstart isn't available from the Cloudera page. I am going to contact the Data Loader product manager and let them know. I will also reach out to Cloudera and see if the 5.3 Quickstart is still available for download. I will let you know what I find.

Best wishes,

Jeff

Re: SAS Data Loader for Hadoop - configuration problem

JBailey — Wed, 13 Jan 2016 18:20:05 GMT

OK, a little birdy told me that the 5.3 link is still there; it is not surfaced.

https://downloads.cloudera.com/demo_vm/vmware/cloudera-quickstart-vm-5.3.0-0-vmware.7z

You will need 7-zip to unpack it.

Hope this helps,

Jeff

Re: SAS Data Loader for Hadoop - configuration problem

pj23295 — Thu, 14 Jan 2016 07:13:45 GMT

Many thanks guys for help. Let me try out the 5.3 version, hopefuly it will solve it,

Re: SAS Data Loader for Hadoop - configuration problem

chenzhang — Wed, 27 Jan 2016 17:04:06 GMT

I did download CDH 5.3 but there is still configuration error. My system is also Window 8.1 x64 single-node (16 cores) running the SAS Data Loader at 192.168.137.129 and Cloudera CDH 5.3 at 192.168.137.130 with VMWare Player.

Hadoop Configuration Log

2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/hadoopscanner.py", line 155, in scanclient[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 0.0.0.0[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: e87e26ef-72b7-48c6-a4bd-931bd86f419c[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 127.0.0.1[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: True[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Using cdh quickstart rule[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: testcmd: timeout -s SIGKILL 60s sas-sshpass -p cloudera ssh root@192.168.137.130 'id'[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 127.0.0.1[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: running command: sas-hadoop-tool init --clienthost="192.168.137.130" --clientuser="root" --clientpass="cloudera" --svckey=hivejdbc --svckey=hadoop --svckey=mapreduce --svckey=hcatapi --nojartrace[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: root@192.168.137.130's password: [0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: link /opt/sasinside/hadoop[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: sys.exit(main())[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Parsing hive information ...[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Finding Hadoop distro and version[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: cansudo? False[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: True[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: self.args.svckey)[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: True[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/wizard.py", line 122, in scancluster[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: quickstart.cloudera ...[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/bin/sas-hadoop-tool", line 134, in main[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: removing symlink and recreating it later[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: TypeError: 'NoneType' object is not iterable[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: for jar in v['jarfiles']:[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 0.0.0.0[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: quickstart.cloudera ...[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: mapped 0.0.0.0 to 192.168.137.130[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: [0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Matching Defaults entries for root on this host:[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: RARGS: sas-sshpass -p cloudera ssh root@192.168.137.130 'lsof -i :10000'[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking yarn on 192.168.137.130[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: check hive pid owner on 192.168.137.130[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/hadoopscanner.py", line 155, in scanclient[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hive -e 'set -v' information ...[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: True[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hdfs on 192.168.137.130[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: No scan is needed[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: [0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: {'192.168.137.130': {'root': {'sudo': False}}}[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: testcmd: timeout -s SIGKILL 60s sas-sshpass -p cloudera ssh root@192.168.137.130 'id'[0m
2016-01-27 11:55:39 USER[Unauthenticated] - [mNotice: Running hadoopconfigure on 192.168.137.129 with arguments: ********[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hive2:10000 on all hosts[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: sudo returned all: False[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hive pid owner on all hosts[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/sitexmls/classpathgenerators.py", line 52, in generate_mapreduce_application_classpath[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: 0.0.0.0 ...[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: False[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: !requiretty, !visiblepw, always_set_home, env_reset, env_keep="COLORS DISPLAY HOSTNAME HISTSIZE INPUTRC KDEDIR LS_COLORS", env_keep+="MAIL PS1 PS2 QTDIR USERNAME LANG LC_ADDRESS LC_CTYPE", env_keep+="LC_COLLATE LC_IDENTIFICATION LC_MEASUREMENT LC_MESSAGES", env_keep+="LC_MONETARY LC_NAME LC_NUMERIC LC_PAPER LC_TELEPHONE", env_keep+="LC_TIME LC_ALL LANGUAGE LINGUAS _XKB_CHARSET XAUTHORITY", secure_path=/sbin:/bin:/usr/sbin:/usr/bin, !secure_path[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/wizard.py", line 88, in Run[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: quickstart.cloudera ...[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: check hive pid owner on 192.168.137.130[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: version: cdh5.3.0[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hive pid owner on all hosts[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: False[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Testing connection to 192.168.137.130 ...[0m
>stdout: Writing to /opt/sasinside/var/log/sva.execute/execute_task.2016.01.27.11.55.38.908087418.log
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: root@192.168.137.130's password: [0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: True[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: cansudo? False[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Traceback (most recent call last):[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: [0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Finding Hadoop distro and version[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: testcmd: timeout -s SIGKILL 60s sas-sshpass -p cloudera ssh root@192.168.137.130 'id'[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: quickstart.cloudera ...[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Testing sudo capabilities for root on 192.168.137.130[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: exit_code=1[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: [0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: self.scancluster()[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: hive found on 192.168.137.130:10000[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: False[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: TypeError: 'NoneType' object is not iterable[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 0.0.0.0[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: {'192.168.137.130': {'root': {'sudo': False}}}[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: mapped quickstart.cloudera to 192.168.137.130[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: User root may run the following commands on this host:[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: sudo returned all: False[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Using cdh quickstart rule[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: ec = x.Run()[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: User root may run the following commands on this host:[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Parsing hive information ...[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 127.0.0.1[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Testing sudo capabilities for root on 192.168.137.130[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 0.0.0.0[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 0.0.0.0[0m
>stderr:
>rc: 0
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: 0.0.0.0 ...[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Matching Defaults entries for root on this host:[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/bin/sas-hadoop-tool", line 140, in [0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Hadoop directory exists so attempting to reuse[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/wizard.py", line 88, in Run[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/bin/sas-hadoop-tool", line 140, in [0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: (ALL) ALL[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: mapped 0.0.0.0 to 192.168.137.130[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: sys.exit(main())[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: 0.0.0.0 ...[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hive2:10000 on all hosts[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: testcmd: timeout -s SIGKILL 60s sas-sshpass -p cloudera ssh root@192.168.137.130 'id'[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: 0.0.0.0 ...[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: ERROR: client configuration failed[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: ERROR: sas-hadoop-tool init --clienthost="192.168.137.130" --clientuser="root" --clientpass="cloudera" --svckey=hivejdbc --svckey=hadoop --svckey=mapreduce --svckey=hcatapi --nojartrace failed:[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: False[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Testing connection to 192.168.137.130 ...[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: e87e26ef-72b7-48c6-a4bd-931bd86f419c[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/sitexmls/classpathgenerators.py", line 52, in generate_mapreduce_application_classpath[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: (ALL) ALL[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/wizard.py", line 122, in scancluster[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: distro: cloudera[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: self.scancluster()[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 127.0.0.1[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: ec = x.Run()[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: check hive2:10000 on 192.168.137.130[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hive -e 'set -v' information ...[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: [0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: 0.0.0.0 ...[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: done[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: version: cdh5.3.0[0m
>LocalExec: ********
2016-01-27 11:55:39 USER[Unauthenticated] - ipaddress 192.168.137.129
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: hive found on 192.168.137.130:10000[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: check hive2:10000 on 192.168.137.130[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: 0.0.0.0 ...[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Running sas-hadoop-tool to configure the hadoop client[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: RARGS: sas-sshpass -p cloudera ssh root@192.168.137.130 'lsof -i :10000'[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hdfs on 192.168.137.130[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: failonmissing=HC['overwrite_mapred_app_class_path'])[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking yarn on 192.168.137.130[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: failonmissing=HC['overwrite_mapred_app_class_path'])[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: [0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: mapped quickstart.cloudera to 192.168.137.130[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/bin/sas-hadoop-tool", line 134, in main[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: !requiretty, !visiblepw, always_set_home, env_reset, env_keep="COLORS DISPLAY HOSTNAME HISTSIZE INPUTRC KDEDIR LS_COLORS", env_keep+="MAIL PS1 PS2 QTDIR USERNAME LANG LC_ADDRESS LC_CTYPE", env_keep+="LC_COLLATE LC_IDENTIFICATION LC_MEASUREMENT LC_MESSAGES", env_keep+="LC_MONETARY LC_NAME LC_NUMERIC LC_PAPER LC_TELEPHONE", env_keep+="LC_TIME LC_ALL LANGUAGE LINGUAS _XKB_CHARSET XAUTHORITY", secure_path=/sbin:/bin:/usr/sbin:/usr/bin, !secure_path[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: distro: cloudera[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: self.args.svckey)[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: True[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 0.0.0.0[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: for jar in v['jarfiles']:[0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: [0m
2016-01-27 11:56:04 USER[Unauthenticated] - [0;36mDebug: CMD local: Traceback (most recent call last):[0m

Re: SAS Data Loader for Hadoop - configuration problem

ACBradley — Wed, 27 Jan 2016 17:09:38 GMT

Hi chenzhang,

I've seen this if the Cloudera Quickstart is not fully started or if there was a service issue on Quickstart. When you open the Cloudera Manager on Quickstart, are all the services up and running?

Clark

Re: SAS Data Loader for Hadoop - configuration problem

JBailey — Wed, 27 Jan 2016 17:33:11 GMT

Hi,

I think Clark is on the right track here. I have seen problems like this when services were not running on the Quickstart VM. You can use Cloudera Manager to make sure things are running. Oozie is required for the configuration wizard.

Make sure you give the CDH VM enough RAM (Cloudera says 10GB minimum) and 2 processes (if possible). I typically give it 8GB - if you are planning on leaving all the Hadoop services running it will need more. I typically stop things that I don't need: HBase, Solr, Spark, and others.

Re: SAS Data Loader for Hadoop - configuration problem

chenzhang — Wed, 27 Jan 2016 19:12:35 GMT

Hi, Clark:

I increased the VM memory to 8GB (from 4GB) per the Cloudera Manager's suggestion. The errors are different. I also attached the Hue Server log FYI. Please note that Cloudera clock is 3 hours behind SAS Data Loader if you want to compare time stamps.

Thanks,

Chen

2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: failonmissing=HC['overwrite_mapred_app_class_path']) [0m
2016-01-27 13:57:48 USER[Unauthenticated] - ipaddress 192.168.137.129
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: check hive2:10000 on 192.168.137.130 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/bin/sas-hadoop-tool", line 140, in [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: failonmissing=HC['overwrite_mapred_app_class_path']) [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: WARNING: Hive is not functional on this host/cluster ... [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/wizard.py", line 122, in scancluster [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: check hive2:10000 on 192.168.137.130 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: ERROR: sas-hadoop-tool init --clienthost="192.168.137.130" --clientuser="root" --clientpass="cloudera" --svckey=hivejdbc --svckey=hadoop --svckey=mapreduce --svckey=hcatapi --nojartrace failed: [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: testcmd: timeout -s SIGKILL 60s sas-sshpass -p cloudera ssh root@192.168.137.130 'id' [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Finding Hadoop distro and version [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/wizard.py", line 88, in Run [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: True [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: hive not found on 192.168.137.130:10000 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: self.scancluster() [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: for jar in v['jarfiles']: [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 0.0.0.0 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: version: cdh5.3.0 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: WARNING: Hive is not functional on this host/cluster ... [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: mapped 0.0.0.0 to 192.168.137.130 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: exit_code=1 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/hadoopscanner.py", line 155, in scanclient [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 0.0.0.0 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/bin/sas-hadoop-tool", line 134, in main [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hive -e 'set -v' information ... [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 127.0.0.1 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Caused by: java.net.ConnectException: Connection refused [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: done [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: removing symlink and recreating it later [0m
>rc: 0
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: True [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hdfs on 192.168.137.130 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/wizard.py", line 88, in Run [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Caused by: MetaException(message:Could not connect to meta store using any of the URIs provided. Most recent failure: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 127.0.0.1 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Testing connection to 192.168.137.130 ... [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: mapped quickstart.cloudera to 192.168.137.130 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: sys.exit(main()) [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: ec = x.Run() [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking yarn on 192.168.137.130 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 127.0.0.1 [0m
2016-01-27 13:57:48 USER[Unauthenticated] - [mNotice: Running hadoopconfigure on 192.168.137.129 with arguments: ******** [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: hive not found on 192.168.137.130:10000 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hive2:10000 on all hosts [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Testing connection to 192.168.137.130 ... [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: distro: cloudera [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: quickstart.cloudera ... [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: 0.0.0.0 ... [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: testcmd: timeout -s SIGKILL 60s sas-sshpass -p cloudera ssh root@192.168.137.130 'id' [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/bin/sas-hadoop-tool", line 140, in [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Caused by: MetaException(message:Could not connect to meta store using any of the URIs provided. Most recent failure: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: quickstart.cloudera ... [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Caused by: java.lang.reflect.InvocationTargetException [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Running sas-hadoop-tool to configure the hadoop client [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: remotereverselookup: 127.0.0.1 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: quickstart.cloudera ... [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: self.args.svckey) [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking yarn on 192.168.137.130 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/hadoopscanner.py", line 155, in scanclient [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Caused by: java.net.ConnectException: Connection refused [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hive pid owner on all hosts [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: ERROR: client configuration failed [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/sitexmls/classpathgenerators.py", line 52, in generate_mapreduce_application_classpath [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Using cdh quickstart rule [0m
>stdout: Writing to /opt/sasinside/var/log/sva.execute/execute_task.2016.01.27.13.57.47.647091419.log
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hdfs on 192.168.137.130 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: mapped quickstart.cloudera to 192.168.137.130 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hive2:10000 on all hosts [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: self.args.svckey) [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Using cdh quickstart rule [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: distro: cloudera [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Caused by: java.lang.reflect.InvocationTargetException [0m
>LocalExec: ********
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: version: cdh5.3.0 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: self.scancluster() [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: False [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: False [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: TypeError: 'NoneType' object is not iterable [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: 0.0.0.0 ... [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: No scan is needed [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: ec = x.Run() [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: False [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: link /opt/sasinside/hadoop [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: TypeError: 'NoneType' object is not iterable [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: for jar in v['jarfiles']: [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Finding Hadoop distro and version [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: sys.exit(main()) [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Traceback (most recent call last): [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hive pid owner on all hosts [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: resolvable: False [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Checking hive -e 'set -v' information ... [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Hadoop directory exists so attempting to reuse [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: Traceback (most recent call last): [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/wizard.py", line 122, in scancluster [0m
>stderr:
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: trying to map: quickstart.cloudera ... [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/bin/sas-hadoop-tool", line 134, in main [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: mapped 0.0.0.0 to 192.168.137.130 [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: File "/usr/lib64/python2.6/site-packages/sashadooptool/sitexmls/classpathgenerators.py", line 52, in generate_mapreduce_application_classpath [0m
2016-01-27 14:00:27 USER[Unauthenticated] - [0;36mDebug: CMD local: running command: sas-hadoop-tool init --clienthost="192.168.137.130" --clientuser="root" --clientpass="cloudera" --svckey=hivejdbc --svckey=hadoop --svckey=mapreduce --svckey=hcatapi --nojartrace [0m

[27/Jan/2016 11:05:45 -0800] access WARNING 127.0.0.1 cloudera - "GET /logs HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] resource DEBUG GET Got response: {"apps":null}

[27/Jan/2016 11:05:38 -0800] connectionpool DEBUG "GET /ws/v1/cluster/apps?user=cloudera&finalStatus=UNDEFINED HTTP/1.1" 200 None

[27/Jan/2016 11:05:38 -0800] connectionpool DEBUG Setting read timeout to None

[27/Jan/2016 11:05:38 -0800] access INFO 127.0.0.1 cloudera - "GET /jobbrowser/ HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/ext/fonts/fontawesome-webfont.woff HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/ext/js/fileuploader.js HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/js/popover-extra-placements.js HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/js/jquery.datatables.sorting.js HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/ext/js/jquery/plugins/jquery.placeholder.min.js HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/ext/js/bootstrap-better-typeahead.min.js HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/ext/js/jquery/plugins/jquery.total-storage.min.js HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/ext/js/bootstrap.min.js HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/ext/js/jquery/plugins/jquery.dataTables.1.8.2.min.js HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/js/jquery.tour.js HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/ext/js/jquery/plugins/jquery.cookie.js HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/js/jquery.tablescroller.js HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/js/jquery.tableextender.js HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/js/jquery.titleupdater.js HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/js/jquery.scrollup.js HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/js/jquery.notify.js HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/js/jquery.rowselector.js HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/js/jquery.delayedinput.js HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/js/jquery.migration.js HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/js/jquery.filechooser.js HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/js/jquery.selector.js HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/ext/css/fileuploader.css HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/js/hue.utils.js HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/css/hue3.css HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/ext/css/bootplus.css HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/ext/js/jquery/jquery-2.1.1.min.js HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access DEBUG 127.0.0.1 cloudera - "GET /static/ext/css/font-awesome.min.css HTTP/1.1"

[27/Jan/2016 11:05:38 -0800] access INFO 127.0.0.1 cloudera - "GET /desktop/dump_config HTTP/1.1"

[27/Jan/2016 11:05:12 -0800] resource DEBUG GET Got response: {"systemMode":"NORMAL"}

[27/Jan/2016 11:05:12 -0800] connectionpool DEBUG "GET /oozie/v1/admin/status?timezone=America%2FLos_Angeles&user.name=hue&doAs=cloudera HTTP/1.1" 200 23

[27/Jan/2016 11:05:12 -0800] connectionpool DEBUG Setting read timeout to None

[27/Jan/2016 11:05:12 -0800] resource DEBUG GET Got response: {"systemMode":"NORMAL"}

[27/Jan/2016 11:05:12 -0800] connectionpool DEBUG "GET /oozie/v1/admin/status?timezone=America%2FLos_Angeles&user.name=hue&doAs=cloudera HTTP/1.1" 200 23

[27/Jan/2016 11:05:12 -0800] connectionpool DEBUG Setting read timeout to None

[27/Jan/2016 11:05:12 -0800] thrift_util DEBUG Thrift call <class 'TCLIService.TCLIService.Client'>.CloseOperation returned in 4ms: TCloseOperationResp(status=TStatus(errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0))

[27/Jan/2016 11:05:12 -0800] thrift_util DEBUG Thrift call: <class 'TCLIService.TCLIService.Client'>.CloseOperation(args=(TCloseOperationReq(operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=3, operationId=THandleIdentifier(secret='W\xb2.\tE\xa2F\xc3\xa7\x8fs\xc9<v\xc8P', guid='W\xb2.\tE\xa2F\xc3\xa7\x8fs\xc9<v\xc8P'))),), kwargs={})

[27/Jan/2016 11:05:12 -0800] thrift_util DEBUG Thrift call <class 'TCLIService.TCLIService.Client'>.GetResultSetMetadata returned in 0ms: TGetResultSetMetadataResp(status=TStatus(errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0), schema=TTableSchema(columns=[TColumnDesc(comment=None, columnName='TABLE_SCHEM', typeDesc=TTypeDesc(types=[TTypeEntry(mapEntry=None, unionEntry=None, arrayEntry=None, userDefinedTypeEntry=None, structEntry=None, primitiveEntry=TPrimitiveTypeEntry(typeQualifiers=None, type=7))]), position=0), TColumnDesc(comment=None, columnName='TABLE_CATALOG', typeDesc=TTypeDesc(types=[TTypeEntry(mapEntry=None, unionEntry=None, arrayEntry=None, userDefinedTypeEntry=None, structEntry=None, primitiveEntry=TPrimitiveTypeEntry(typeQualifiers=None, type=7))]), position=1)]))

[27/Jan/2016 11:05:12 -0800] thrift_util DEBUG Thrift call: <class 'TCLIService.TCLIService.Client'>.GetResultSetMetadata(args=(TGetResultSetMetadataReq(operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=3, operationId=THandleIdentifier(secret='W\xb2.\tE\xa2F\xc3\xa7\x8fs\xc9<v\xc8P', guid='W\xb2.\tE\xa2F\xc3\xa7\x8fs\xc9<v\xc8P'))),), kwargs={})

[27/Jan/2016 11:05:12 -0800] thrift_util DEBUG Thrift call <class 'TCLIService.TCLIService.Client'>.FetchResults returned in 0ms: TFetchResultsResp(status=TStatus(errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0), results=TRowSet(rows=[TRow(colVals=[TColumnValue(i32Val=None, byteVal=None, i16Val=None, i64Val=None, stringVal=TStringValue(value='_impala_builtins'), boolVal=None, doubleVal=None), TColumnValue(i32Val=None, byteVal=None, i16Val=None, i64Val=None, stringVal=TStringValue(value=''), boolVal=None, doubleVal=None)]), TRow(colVals=[TColumnValue(i32Val=None, byteVal=None, i16Val=None, i64Val=None, stringVal=TStringValue(value='default'), boolVal=None, doubleVal=None), TColumnValue(i32Val=None, byteVal=None, i16Val=None, i64Val=None, stringVal=TStringValue(value=''), boolVal=None, doubleVal=None)])], columns=None, startRowOffset=0), hasMoreRows=False)

[27/Jan/2016 11:05:12 -0800] thrift_util DEBUG Thrift call: <class 'TCLIService.TCLIService.Client'>.FetchResults(args=(TFetchResultsReq(fetchType=0, operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=3, operationId=THandleIdentifier(secret='W\xb2.\tE\xa2F\xc3\xa7\x8fs\xc9<v\xc8P', guid='W\xb2.\tE\xa2F\xc3\xa7\x8fs\xc9<v\xc8P')), orientation=0, maxRows=1000),), kwargs={})

[27/Jan/2016 11:05:12 -0800] thrift_util DEBUG Thrift call <class 'TCLIService.TCLIService.Client'>.GetSchemas returned in 68ms: TGetSchemasResp(status=TStatus(errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0), operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=3, operationId=THandleIdentifier(secret='W\xb2.\tE\xa2F\xc3\xa7\x8fs\xc9<v\xc8P', guid='W\xb2.\tE\xa2F\xc3\xa7\x8fs\xc9<v\xc8P')))

[27/Jan/2016 11:05:12 -0800] thrift_util DEBUG Thrift call: <class 'TCLIService.TCLIService.Client'>.GetSchemas(args=(TGetSchemasReq(schemaName=None, sessionHandle=TSessionHandle(sessionId=THandleIdentifier(secret='#\xf1[\x02@AI\xbf\xad\xa8\xa3\x0e\xef\xde\x91\x7f', guid='\xad:T\x90r\xc6F\xa2\xabG\xbb\x1b\xfb\xeb\xaaY')), catalogName=None),), kwargs={})

[27/Jan/2016 11:05:12 -0800] hive_server2_lib INFO Opening session THandleIdentifier(secret='#\xf1[\x02@AI\xbf\xad\xa8\xa3\x0e\xef\xde\x91\x7f', guid='\xad:T\x90r\xc6F\xa2\xabG\xbb\x1b\xfb\xeb\xaaY')

[27/Jan/2016 11:05:12 -0800] thrift_util DEBUG Thrift call <class 'TCLIService.TCLIService.Client'>.OpenSession returned in 20ms: TOpenSessionResp(status=TStatus(errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0), sessionHandle=TSessionHandle(sessionId=THandleIdentifier(secret='#\xf1[\x02@AI\xbf\xad\xa8\xa3\x0e\xef\xde\x91\x7f', guid='\xad:T\x90r\xc6F\xa2\xabG\xbb\x1b\xfb\xeb\xaaY')), configuration={'QUERY_TIMEOUT_S': '0', 'RM_INITIAL_MEM': '0', 'HBASE_CACHE_BLOCKS': '0', 'DEFAULT_ORDER_BY_LIMIT': '-1', 'HBASE_CACHING': '0', 'DISABLE_CODEGEN': '0', 'ABORT_ON_ERROR': '0', 'REQUEST_POOL': '', 'MAX_SCAN_RANGE_LENGTH': '0', 'PARQUET_FILE_SIZE': '0', 'DISABLE_CACHED_READS': '0', 'COMPRESSION_CODEC': 'NONE', 'DISABLE_OUTERMOST_TOPN': '0', 'MAX_BLOCK_MGR_MEMORY': '0', 'BATCH_SIZE': '0', 'NUM_NODES': '0', 'ALLOW_UNSUPPORTED_FORMATS': '0', 'MEM_LIMIT': '0', 'NUM_SCANNER_THREADS': '0', 'EXPLAIN_LEVEL': '1', 'SEQ_COMPRESSION_MODE': '0', 'MAX_ERRORS': '0', 'MAX_IO_BUFFERS': '0', 'DEBUG_ACTION': '', 'DISABLE_UNSAFE_SPILLS': '0', 'RESERVATION_REQUEST_TIMEOUT': '0', 'SYNC_DDL': '0', 'ABORT_ON_DEF...

[27/Jan/2016 11:05:12 -0800] thrift_util DEBUG Thrift call: <class 'TCLIService.TCLIService.Client'>.OpenSession(args=(TOpenSessionReq(username=u'cloudera', password=None, client_protocol=4, configuration={}),), kwargs={})

[27/Jan/2016 11:05:12 -0800] hive_server2_lib INFO use_sasl=False, mechanism=GSSAPI, kerberos_principal_short_name=impala, impersonation_enabled=False

[27/Jan/2016 11:05:12 -0800] dbms DEBUG Query Server: {'QUERY_TIMEOUT_S': 600, 'server_name': 'impala', 'server_host': 'quickstart.cloudera', 'querycache_rows': 50000, 'server_port': 21050, 'impersonation_enabled': False, 'principal': 'impala/quickstart.cloudera'}

[27/Jan/2016 11:05:12 -0800] resource DEBUG GET Got response: {"FileStatus":{"accessTime":0,"b...

[27/Jan/2016 11:05:12 -0800] connectionpool DEBUG "GET /webhdfs/v1/user/hive/warehouse?op=GETFILESTATUS&user.name=hue&doas=cloudera HTTP/1.1" 200 None

[27/Jan/2016 11:05:12 -0800] connectionpool DEBUG Setting read timeout to None

[27/Jan/2016 11:05:12 -0800] thrift_util DEBUG Thrift call <class 'TCLIService.TCLIService.Client'>.CloseOperation returned in 23ms: TCloseOperationResp(status=TStatus(errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0))

[27/Jan/2016 11:05:12 -0800] thrift_util DEBUG Thrift call: <class 'TCLIService.TCLIService.Client'>.CloseOperation(args=(TCloseOperationReq(operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=3, operationId=THandleIdentifier(secret='\xea\x86KnF\x1fN^\xb5\xb4\xc1\x81\xa9\xd6C\xa6', guid="s\t\xfd\xae\x16BK\xa2\x8e\xb9?\xe6\x0e\xe5'\xc9"))),), kwargs={})

[27/Jan/2016 11:05:12 -0800] thrift_util DEBUG Thrift call <class 'TCLIService.TCLIService.Client'>.GetResultSetMetadata returned in 29ms: TGetResultSetMetadataResp(status=TStatus(errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0), schema=TTableSchema(columns=[TColumnDesc(comment='Schema name.', columnName='TABLE_SCHEM', typeDesc=TTypeDesc(types=[TTypeEntry(mapEntry=None, unionEntry=None, arrayEntry=None, userDefinedTypeEntry=None, structEntry=None, primitiveEntry=TPrimitiveTypeEntry(typeQualifiers=None, type=7))]), position=1), TColumnDesc(comment='Catalog name.', columnName='TABLE_CATALOG', typeDesc=TTypeDesc(types=[TTypeEntry(mapEntry=None, unionEntry=None, arrayEntry=None, userDefinedTypeEntry=None, structEntry=None, primitiveEntry=TPrimitiveTypeEntry(typeQualifiers=None, type=7))]), position=2)]))

[27/Jan/2016 11:05:12 -0800] thrift_util DEBUG Thrift call: <class 'TCLIService.TCLIService.Client'>.GetResultSetMetadata(args=(TGetResultSetMetadataReq(operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=3, operationId=THandleIdentifier(secret='\xea\x86KnF\x1fN^\xb5\xb4\xc1\x81\xa9\xd6C\xa6', guid="s\t\xfd\xae\x16BK\xa2\x8e\xb9?\xe6\x0e\xe5'\xc9"))),), kwargs={})

[27/Jan/2016 11:05:12 -0800] thrift_util DEBUG Thrift call <class 'TCLIService.TCLIService.Client'>.FetchResults returned in 19ms: TFetchResultsResp(status=TStatus(errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0), results=TRowSet(rows=[TRow(colVals=[TColumnValue(i32Val=None, byteVal=None, i16Val=None, i64Val=None, stringVal=TStringValue(value='default'), boolVal=None, doubleVal=None), TColumnValue(i32Val=None, byteVal=None, i16Val=None, i64Val=None, stringVal=TStringValue(value=''), boolVal=None, doubleVal=None)])], columns=None, startRowOffset=0), hasMoreRows=False)

[27/Jan/2016 11:05:12 -0800] thrift_util DEBUG Thrift call: <class 'TCLIService.TCLIService.Client'>.FetchResults(args=(TFetchResultsReq(fetchType=0, operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=3, operationId=THandleIdentifier(secret='\xea\x86KnF\x1fN^\xb5\xb4\xc1\x81\xa9\xd6C\xa6', guid="s\t\xfd\xae\x16BK\xa2\x8e\xb9?\xe6\x0e\xe5'\xc9")), orientation=0, maxRows=1000),), kwargs={})

[27/Jan/2016 11:05:12 -0800] thrift_util DEBUG Thrift call <class 'TCLIService.TCLIService.Client'>.GetSchemas returned in 167ms: TGetSchemasResp(status=TStatus(errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0), operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=3, operationId=THandleIdentifier(secret='\xea\x86KnF\x1fN^\xb5\xb4\xc1\x81\xa9\xd6C\xa6', guid="s\t\xfd\xae\x16BK\xa2\x8e\xb9?\xe6\x0e\xe5'\xc9")))

[27/Jan/2016 11:05:12 -0800] thrift_util DEBUG Thrift call: <class 'TCLIService.TCLIService.Client'>.GetSchemas(args=(TGetSchemasReq(schemaName=None, sessionHandle=TSessionHandle(sessionId=THandleIdentifier(secret='m5e\n\xa5#F\xcd\xa1\xc5z\xc7p2\xcd\xc2', guid='\xa9\x1dB\naeB\x02\x80\x19f\xe9\xd6\xef\x06\x8e')), catalogName=None),), kwargs={})

[27/Jan/2016 11:05:12 -0800] hive_server2_lib INFO Opening session THandleIdentifier(secret='m5e\n\xa5#F\xcd\xa1\xc5z\xc7p2\xcd\xc2', guid='\xa9\x1dB\naeB\x02\x80\x19f\xe9\xd6\xef\x06\x8e')

[27/Jan/2016 11:05:12 -0800] thrift_util DEBUG Thrift call <class 'TCLIService.TCLIService.Client'>.OpenSession returned in 155ms: TOpenSessionResp(status=TStatus(errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0), sessionHandle=TSessionHandle(sessionId=THandleIdentifier(secret='m5e\n\xa5#F\xcd\xa1\xc5z\xc7p2\xcd\xc2', guid='\xa9\x1dB\naeB\x02\x80\x19f\xe9\xd6\xef\x06\x8e')), configuration={}, serverProtocolVersion=4)

[27/Jan/2016 11:05:12 -0800] thrift_util DEBUG Thrift call: <class 'TCLIService.TCLIService.Client'>.OpenSession(args=(TOpenSessionReq(username='hue', password=None, client_protocol=4, configuration={'hive.server2.proxy.user': u'cloudera'}),), kwargs={})

[27/Jan/2016 11:05:11 -0800] hive_server2_lib INFO use_sasl=True, mechanism=PLAIN, kerberos_principal_short_name=None, impersonation_enabled=True

[27/Jan/2016 11:05:11 -0800] dbms DEBUG Query Server: {'server_host': 'quickstart.cloudera', 'server_port': 10000, 'server_name': 'beeswax', 'principal': None}

[27/Jan/2016 11:05:11 -0800] resource DEBUG GET Got response: {"FileStatus":{"accessTime":0,"b...

[27/Jan/2016 11:05:11 -0800] connectionpool DEBUG "GET /webhdfs/v1/user/oozie/share/lib?op=GETFILESTATUS&user.name=hue&doas=cloudera HTTP/1.1" 200 None