Proc Hadoop error- VIRTUAL LAB

akpattnaik — Fri, 24 Nov 2017 14:39:25 GMT

Hi,

I'm not sure what's the problem with the virtual lab.

The hue GUI is not working, attached is the error screen shot.

Also when,I executed the below proc hadoop code:

%let std=&SYSUSERID; %let stdpw=Metadata0;

proc hadoop username="&std" verbose;
hdfs mkdir="/user/&std/DIACHD/data";
run;

Got the below error:

ERROR: java.net.ConnectException: Call From server1.demo.sas.com/10.250.86.140 to server2.demo.sas.com:8020 failed on connection
       exception: java.net.ConnectException: Connection refused; For more details see:
       http://wiki.apache.org/hadoop/ConnectionRefused
ERROR: at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
ERROR: at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
ERROR: at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
ERROR: at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
ERROR: at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:791)
ERROR: at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:731)
ERROR: at org.apache.hadoop.ipc.Client.call(Client.java:1472)
ERROR: at org.apache.hadoop.ipc.Client.call(Client.java:1399)
ERROR: at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
ERROR: at com.sun.proxy.$Proxy9.mkdirs(Unknown Source)
ERROR: at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.mkdirs(ClientNamenodeProtocolTranslatorPB.java:539)
ERROR: at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
ERROR: at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
ERROR: at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
ERROR: at java.lang.reflect.Method.invoke(Method.java:606)
ERROR: at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
ERROR: at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
ERROR: at com.sun.proxy.$Proxy10.mkdirs(Unknown Source)
ERROR: at org.apache.hadoop.hdfs.DFSClient.primitiveMkdir(DFSClient.java:2760)
ERROR: at org.apache.hadoop.hdfs.DFSClient.mkdirs(DFSClient.java:2731)
ERROR: at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:870)
ERROR: at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:866)
ERROR: at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
ERROR: at org.apache.hadoop.hdfs.DistributedFileSystem.mkdirsInternal(DistributedFileSystem.java:866)
ERROR: at org.apache.hadoop.hdfs.DistributedFileSystem.mkdirs(DistributedFileSystem.java:859)
ERROR: at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1817)
2                                                          The SAS System                            09:20 Friday, November 24, 2017

ERROR: at com.dataflux.hadoop.DFHDFS$16.run(DFHDFS.java:562)
ERROR: at com.dataflux.hadoop.DFHDFS$16.run(DFHDFS.java:558)
ERROR: at java.security.AccessController.doPrivileged(Native Method)
ERROR: at javax.security.auth.Subject.doAs(Subject.java:415)
ERROR: at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671)
ERROR: at com.dataflux.hadoop.DFHDFS.mkdir(DFHDFS.java:558)
ERROR: Caused by: java.net.ConnectException: Connection refused
ERROR: at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
ERROR: at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
ERROR: at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
ERROR: at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:530)
ERROR: at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:494)
ERROR: at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:607)
ERROR: at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:705)
ERROR: at org.apache.hadoop.ipc.Client$Connection.access$2800(Client.java:368)
ERROR: at org.apache.hadoop.ipc.Client.getConnection(Client.java:1521)
ERROR: at org.apache.hadoop.ipc.Client.call(Client.java:1438)
ERROR: ... 25 more

Appreciate, if someone can suggest what's wrong with my lab. Do, i need to start any services?

Re: Proc Hadoop error- VIRTUAL LAB

TheresaStemler — Fri, 24 Nov 2017 20:24:07 GMT

Hi akpattnaik,

Try restarting your Hadoop cluster. Instructions can be found in Troubleshooting Your SAS-Hadoop Training Environment located on the Academy home page.

Let me know how it goes,

theresa

Re: Proc Hadoop error- VIRTUAL LAB

akpattnaik — Tue, 28 Nov 2017 15:18:26 GMT

Thanks Theresa. Its all sorted.

topic Re: Proc Hadoop error- VIRTUAL LAB in SAS Academy for Data Science

Proc Hadoop error- VIRTUAL LAB

Re: Proc Hadoop error- VIRTUAL LAB

Re: Proc Hadoop error- VIRTUAL LAB