BookmarkSubscribeRSS Feed
🔒 This topic is solved and locked. Need further help from the community? Please sign in and ask a new question.
Liz373
Obsidian | Level 7

I'm getting connection issues when I run the cre8data.sas in the Module 2: Creating the Course Data via Enterprise Guide.  The Trouble-shooting document does not tell me how to reset the Hadoop Server (a question from 2017 says that it is in the Course Trouble-Shooting Guide, but I am unable to find it. 

 

The error is java.sql.sqlexception: Could not open client transport with JdBC...

 

 

1 ACCEPTED SOLUTION

Accepted Solutions
Cynthia_sas
SAS Super FREQ
Liz:
If you start over from a FRESH image, you will need to rerun the .BAT and the .SAS programs. But if you keep working with your SAVED image you should not need to run them again.
Cynthia

View solution in original post

7 REPLIES 7
Cynthia_sas
SAS Super FREQ
Hi:
In the setup instructions, did you run the .bat file first? That is the mistake that most students overlook. I believe that the troubleshooting guide is located at the bottom of Chapter 1 or Chapter 2 -- you've got to go inside the chapter and then scroll down. If you go to the top level of the Forum, there's an area on the right side with links to various documents and the troubleshooting document is one of them. Here it is: https://support.sas.com/training/academy/hadoop.pdf .

If you still have issues, then please use the Need Help button inside the class. We need to know exactly which class (of the 4 classes) that you're working in because there's more than one course with a createdata.sas program. Also need to know at what step in the instructions your experience deviated from the instructions for the setup in the class.

Typically, the instructors recommend that you can taken an hour of lab time and restart the servers or you can end that reservation and make a new one for a FRESH image and see what happens in a FRESH image. Typically, server issues and startup problems are fixed by starting a new reservation.

Just make sure that if you're in the class that uses the .BAT file, that you have run that first.

Hope this helps,
Cynthia
Liz373
Obsidian | Level 7

Cynthia,

Thank you.  Yes, I ran the .bat file first.  Then I opened the EG, opened the SAS code and ran it. 

 

FYI: The Trouble-Shooting Guide at the end of Chapter 1 does not match the guide you linked. 

 

This is the link within the course. 

 

https://vle.sas.com/pluginfile.php/48891/mod_scorm/content/15/01/eldiachd01_2_d.pdf

 

 

Cynthia_sas
SAS Super FREQ

Hi, Liz:

   If you open SAS Studio from the browser, after you run the .BAT file, you should automatically be connected to the correct server. However, if you use Enterprise Guide, you have to be sure you're logged onto the correct profile. Otherwise you're connecting to a local server instead of the remote server.

 

 Let me explain. When you are using the Hadoop classes and you need to run code, you need to make a connection to the server. That's why the instructions for class tell you to start SAS Studio from the browser inside the Virtual Lab, and not the Start Menu. There is a particular userID and password that you specify to the browser logon for SAS Studio or for an Enterprise Guide logon that establishes the connection to the right server for your work.

So, if you want to use SAS Studio for code in the Hadoop classes, then access SAS Studio from inside a browser window (not from the Start menu of the Virtual Machine). And, when you log onto SAS Studio, you need to use student as the userID and Metadata0 as the password, so you are connected with the right profile. (If you use the sasdemo userID and the Student1 password, you’ll be logged onto the wrong server.) The instructions in the demo or exercise should list which credentials you need to use.

Or, if you were using Enterprise Guide, you may need to log onto your Profile to connect to the server using the above credentials (student as the userID and Metadata0 as the password). One of the messages you reported is typical of the type of message you might get from Enterprise Guide if you did NOT sign on with a profile to connect to the SASApp server before you submitted your code. There are 2 ways to submit the code for class:
1) Using SAS Studio by starting it from the browser toolbar inside the Virtual Lab. SAS Studio in the browser is automatically set up to connect to the correct server
or
2) Using SAS Enterprise Guide in server mode, not in "local" mode. To make sure you are logged onto an EG and connecting to a server server you will need to exit EG without saving a project if you are already logged on and then try again.

Reopen EG, open the connection profile to connect to SASApp. You should be prompted to login to the server when you first logon to EG. The username is: student with a password of Metadata0. If you accidentally cancel the logon window, you can always logon by manually opening the profile window. In the lower right hand corner of Enterprise Guide, you will see a "No profile selected" message at first if you are NOT logged on. The message should appear at the very bottom of your EG screen on the right side.

 

You click this link to connect to the SASApp server with the credentials I provided.

  The recommendation from the instructors was to have you start from a fresh image (not a saved image) and before you do anything else, check Cloudera Manager to be sure the servers are up. If you save your image so you can come back to it, we expect that the servers will start up as soon as the image starts up, but there could be lag time and so, the first thing to do if your connection to the Hadoop cluster seems broken is to check the servers.

  The consensus among the instructors who teach the class is that they see messages like this for 3 reasons:
1) did not start SAS Studio from a browser
2) did not log onto the right Profile in EG
3) the connection was refused because of an issue with the services not being started on the image or they were started, but then something caused them to go down.

I know that you are working in Module 2 of the Big Data package, but I'm not sure what class you're working on in Module 2. When you are setting up the data in the Introduction to SAS and Hadoop class, you first must run the cre8data.bat file and THEN run the cre8data.sas file. You need to use Windows Explorer, as instructed to run the .bat file. It does sound like you've already done this, so I am guessing that EG was not logged onto the correct Profile. So I would recommend doing that first before you restart the servers.

However, if you experience a lot of file creation errors, then the Troubleshooting document in Chapter 1 of the Introduction to SAS and Hadoop course is what you need to reference. The other document is specifically regarding how to restart the servers.

  

  One thing you might do, when you first log onto the classroom image, since you have been experiencing problems is to try the setup steps again from a fresh image. Normally, we would expect the Hadoop servers to start quickly when your image is first ready. However, if you are experiencing any slowness or lag time, It would be a good idea to start a browser inside the image and click on the link for Cloudera Manager. Any browser in the Virtual Lab should have a Cloudera Manager link.

 

  Some browsers may remember the user ID and password, when we tried Firefox, the userID and password were remembered, when we used IE, you needed to supply the user ID and password. The login for Cloudera Manager is admin for the user ID and Student1 for the password.

 

  Once in Cloudera Manager, it is useful to just check that all the servers are started (green) on the left side of the screen, under the Cluster 1 header. It is OK for the Sqoop 1 Client icon to be gray. That is unused.

 

  However, the other servers should be green. If you see that any of the other servers under Cluster 1 are gray, then you need to follow the instructions in the troubleshooting document https://support.sas.com/training/academy/hadoop.pdf  to restart the servers. It can take up to an hour to start the servers, so you will need to be sure you have a long enough reservation to allow the servers to restart and then do your work.

  

  According to the instructors, it is also possible that ending your reservation and starting over from a FRESH image will result in the servers starting as they should. When instructors encounter server issues in the classroom version of the class using the Virtual Lab, they are more likely to end the session and start over from a fresh session when working in the Virtual Lab -- it can take an hour for the servers to start in a session, but it only takes 35-45 minutes to start a reservation for a FRESH image. And with the new reservation, none of the startup time comes out of your allotment of hours.

 

  Sorry for such a long posting, but I wanted to cover all the possibilities.

 

Cynthia

 

Liz373
Obsidian | Level 7

Cynthia, 

I'm doing the HAD Set-Up Instructions that are in the Module 2, Introduction to SAS and Hadoop, Chapter 1.  Yesterday and today, I started with a fresh image.  I followed the instructions of opening file explorer, and running the cre8data.bat.  I waited for the execution window to close and then opened EG, using the EG icon.  I logged in as student with Metadata0 as the password.  I opened the cre8data.sas file and ran it (not highlighting any lines).  I received the 103 errors again. 

 

I tried logging into the Clodera Manager, but had problems finding the login/password (I didn't see that until I just reread your reply), so I closed that, closed EG, and then re-executed the .bat file again.  I again waited for it to complete, before opening EG, opening the sas file, and rerunning the job.  This time, I got a pop-up error message, which I didn't capture.  When I closed that, my log showed no errors.  I went ahead with the activity that is shown in Chapter 2 and that worked.  I went ahead with Exercise 1 & 2 in Chapter 2 and those worked also.  I was able to verify that Hue had my updates from Exercise 1&2 also.  

 

I did not open SAS Studio and will not use it, since I have access to SAS EG.  My company has SAS EG and I've programmed in it for at least 5 years.  

 

To verify, I don't need to run the .bat file any more, correct?

 

Thank you,

Liz

Cynthia_sas
SAS Super FREQ
Liz:
If you start over from a FRESH image, you will need to rerun the .BAT and the .SAS programs. But if you keep working with your SAVED image you should not need to run them again.
Cynthia
Liz373
Obsidian | Level 7

I used the Saved Image from my last run and I was getting connection errors.  I logged into SASEG.  So, I reran the .Bat file again and got the same connection errors.  I reran the .bat file again and then ran the CRE8DATA.SAS in SASEG and got the connection errors again.  When I went to end my reservation without saving, so I could start a new reservation with a fresh build (to restart everything fresh), it said that I had multiple reservations and could not do it.  I need to be able to get through these activities today, but I anticipate the Help Desk won't get to my issue for at least 12 hours.  This is frustrating.  I was only in the Virtual Lab for 10 minutes and could not make any progress. 

Cynthia_sas
SAS Super FREQ
Hi:
I see where you have opened a track with the Virtual Lab support team about this. You should hear back from them on Monday. It looks like something has gone awry in the reservation system to prevent you from cancelling your reservation. The Virtual Lab support team will adjust your time, as needed, since you could not cancel. Unfortunately, you won't be able to make a new reservation until the first one is over or the cancellation feature starts working.

I'm sorry you are experiencing this issue. You should hear from the Virtual Lab support team directly at your email in response to your ticket.

As a general comment, we have noticed that with the Hadoop classes, it seems to be better to work with a fresh image every time, instead of a saved image. The Hadoop classes need a 4 server image and with a fresh image, it seems that the 4 servers do all start correctly.

If you ARE going to work from a SAVED image, then the first thing you need to do, when you get back on is to check Cloudera Manager to see the status of the servers. If the server icons are NOT all green in Cloudera Manager, then you'll need to restart them, as described in the documents we discussed previously.

Cynthia

 

This is a knowledge-sharing community for learners in the Academy. Find answers to your questions or post here for a reply.
To ensure your success, use these getting-started resources:

Estimating Your Study Time
Reserving Software Lab Time
Most Commonly Asked Questions
Troubleshooting Your SAS-Hadoop Training Environment

SAS Training: Just a Click Away

 Ready to level-up your skills? Choose your own adventure.

Browse our catalog!

Discussion stats
  • 7 replies
  • 1715 views
  • 0 likes
  • 2 in conversation