Don't just think like a data scientist. Be one.

Proc Hadoop error- VIRTUAL LAB

Accepted Solution Solved
Reply
Occasional Contributor
Posts: 7
Accepted Solution

Proc Hadoop error- VIRTUAL LAB

Hi,

I'm not sure what's the problem with the virtual lab.

The hue GUI is not working, attached is the error screen shot.

 

Also when,I executed the below proc hadoop code:

%let std=&SYSUSERID; %let stdpw=Metadata0;

proc hadoop  username="&std" verbose;
 hdfs mkdir="/user/&std/DIACHD/data";
run;

  

Got the below error:

 

ERROR: java.net.ConnectException: Call From server1.demo.sas.com/10.250.86.140 to server2.demo.sas.com:8020 failed on connection
       exception: java.net.ConnectException: Connection refused; For more details see: 
       http://wiki.apache.org/hadoop/ConnectionRefused
ERROR:  at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
ERROR:  at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
ERROR:  at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
ERROR:  at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
ERROR:  at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:791)
ERROR:  at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:731)
ERROR:  at org.apache.hadoop.ipc.Client.call(Client.java:1472)
ERROR:  at org.apache.hadoop.ipc.Client.call(Client.java:1399)
ERROR:  at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
ERROR:  at com.sun.proxy.$Proxy9.mkdirs(Unknown Source)
ERROR:  at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.mkdirs(ClientNamenodeProtocolTranslatorPB.java:539)
ERROR:  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
ERROR:  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
ERROR:  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
ERROR:  at java.lang.reflect.Method.invoke(Method.java:606)
ERROR:  at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
ERROR:  at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
ERROR:  at com.sun.proxy.$Proxy10.mkdirs(Unknown Source)
ERROR:  at org.apache.hadoop.hdfs.DFSClient.primitiveMkdir(DFSClient.java:2760)
ERROR:  at org.apache.hadoop.hdfs.DFSClient.mkdirs(DFSClient.java:2731)
ERROR:  at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:870)
ERROR:  at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:866)
ERROR:  at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
ERROR:  at org.apache.hadoop.hdfs.DistributedFileSystem.mkdirsInternal(DistributedFileSystem.java:866)
ERROR:  at org.apache.hadoop.hdfs.DistributedFileSystem.mkdirs(DistributedFileSystem.java:859)
ERROR:  at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1817)
2                                                          The SAS System                            09:20 Friday, November 24, 2017

ERROR:  at com.dataflux.hadoop.DFHDFS$16.run(DFHDFS.java:562)
ERROR:  at com.dataflux.hadoop.DFHDFS$16.run(DFHDFS.java:558)
ERROR:  at java.security.AccessController.doPrivileged(Native Method)
ERROR:  at javax.security.auth.Subject.doAs(Subject.java:415)
ERROR:  at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671)
ERROR:  at com.dataflux.hadoop.DFHDFS.mkdir(DFHDFS.java:558)
ERROR: Caused by: java.net.ConnectException: Connection refused
ERROR:  at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
ERROR:  at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
ERROR:  at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
ERROR:  at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:530)
ERROR:  at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:494)
ERROR:  at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:607)
ERROR:  at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:705)
ERROR:  at org.apache.hadoop.ipc.Client$Connection.access$2800(Client.java:368)
ERROR:  at org.apache.hadoop.ipc.Client.getConnection(Client.java:1521)
ERROR:  at org.apache.hadoop.ipc.Client.call(Client.java:1438)
ERROR:  ... 25 more

 

Appreciate, if someone can suggest what's wrong with my lab. Do, i need to start any services?


Accepted Solutions
Solution
2 weeks ago
SAS Moderator
Posts: 11

Re: Proc Hadoop error- VIRTUAL LAB

Posted in reply to akpattnaik

Hi akpattnaik,

Try restarting your Hadoop cluster. Instructions can be found in Troubleshooting Your SAS-Hadoop Training Environment located on the Academy home page.

Let me know how it goes,

theresa

View solution in original post


All Replies
Solution
2 weeks ago
SAS Moderator
Posts: 11

Re: Proc Hadoop error- VIRTUAL LAB

Posted in reply to akpattnaik

Hi akpattnaik,

Try restarting your Hadoop cluster. Instructions can be found in Troubleshooting Your SAS-Hadoop Training Environment located on the Academy home page.

Let me know how it goes,

theresa

Occasional Contributor
Posts: 7

Re: Proc Hadoop error- VIRTUAL LAB

Posted in reply to TheresaStemler
Thanks Theresa. Its all sorted.
☑ This topic is solved.

Need further help from the community? Please ask a new question.

Discussion stats
  • 2 replies
  • 138 views
  • 0 likes
  • 2 in conversation