topic Re: Enterprise Guide performance over a slow network in SAS Enterprise Guide

Enterprise Guide performance over a slow network

Nigel_Pain — Tue, 28 Apr 2020 14:59:34 GMT

Like many organisations, we're primarily working from home at the moment, connecting into our corporate network over a VPN. Our network folk have massively increased the pipe into the network to cope with this, but network performance is probably mostly limited by the speed of users' own home networks. I have an Enterprise Guide project (7.15, connecting to 9.4M5) with a process flow of around 16 task or code items which I run regularly and I've been finding that it is taking maybe 10 to 15 minutes to run (rather than a couple of minutes when in the office). On the other hand, I tried exporting all the code in the flow to a program, and ran that in EG. This way it took less than a minute.

I'm assuming that there's an overhead in uploading the code from each item in the flow, and possibly more so with tasks than programs. Am I correct in this?

I've spent considerable energy (with variable success) trying to persuade users to use process flows to their full extent, breaking up large blocks of code into programs or tasks containing single steps so that it's easier to manage and debug. If I now advise them to go back to monolithic code I'm in danger of undoing all that work!

Re: Enterprise Guide performance over a slow network

ballardw — Tue, 28 Apr 2020 15:19:00 GMT

Are your projects on your computer at home or on the server?

I would expect if the project were on the server then everything except possibly final output would run pretty much the same as when in the office.

Re: Enterprise Guide performance over a slow network

Nigel_Pain — Tue, 28 Apr 2020 15:26:02 GMT

The projects are stored in various places, mainly shared drives, but they are opened and run in Enterprise Guide on users' laptops. We don't have a way for users to work directly off the server.

Re: Enterprise Guide performance over a slow network

ChrisHemedinger — Tue, 28 Apr 2020 15:40:02 GMT

ODS results are one source of latency that becomes exaggerated on a slow network. If you can change your results options to use a more efficient result type, things might be snappier.

If doing traditional SAS/GRAPH graphs, definitely don't use ActiveX (used to be the default). Try PNG or JPG.
If you can by with just text output, try that (ODS LISTING).
Play with HTML5 (EG 8.1/8.2 default) and using SVG vs PNG for ODS graphics (SGPLOT, etc).

Re: Enterprise Guide performance over a slow network

Nigel_Pain — Tue, 28 Apr 2020 15:57:40 GMT

Thanks @ChrisHemedinger, always useful to get information from the horse's mouth (not that I'm suggesting...)!

There are a few good things to try here, and I definitely have a few objects with ActiveX output so I'll try changing these to PNG. Unfortunately, being still with 7.15, HTML5 and SVG don't appear to be options. We have a freeze on system changes at the moment but when things get back closer to normal we are planning an upgrade to M6, mainly to escape Flash in VA 7.4, but that will also include the latest version of EG, I would imagine. Having briefly skimmed through a "what's new" posting here, I'm quite excited by that.

Interestingly, it's not just output which is the problem. My first step is an import of a CSV, using PROC IMPORT in code from a shared drive. This is also very slow to get going. It sits for a minute or two with the message "preparing the server..." in the Task Status.

Re: Enterprise Guide performance over a slow network

ChrisHemedinger — Tue, 28 Apr 2020 17:48:50 GMT

When you say "PROC IMPORT" do you mean a proper code-based import, or the Import Data task? If the latter, you should check the performance options in the task to skip the data "cleanse" and limit the scan.

Even better, if you're willing, use the Copy Files task to copy the file to the server and then run PROC IMPORT directly from there. This will allow you to separate actions for data transfer and the subsequent import.

Re: Enterprise Guide performance over a slow network

MCCL1250 — Tue, 28 Apr 2020 18:20:31 GMT

I am also interested in this conversation as I too am having this issue.

We are running on EG 7.15 and connecting to the server (9.4M5) and am seeing much the same thing.

Things are running much smoother after hours when there is not a lot of usage to the VPN.

But we cannot run all things off hours.

I am seeing this same "preparing the server" being a frequent hang-up. Also if there is a condition on the execution of the node in EG, that seems to take a lot longer than it should.

And exports and "download" or "uploads" seem to be taking a lot of time.

I did turn off the display results option, and that is speeding the development work up. But other things can take 2-5 times as long to run.

Any help or advice would be appreciated since it looks like we may be in this situation more long term.

Re: Enterprise Guide performance over a slow network

SASKiwi — Tue, 28 Apr 2020 20:51:26 GMT

@Nigel_Pain - I suggest you copy a representative EG project onto your laptop hard drive and run it from there. Is it a lot faster than running off a shared drive or not?

I'm in a similar boat to you, working from home over VPN. However we develop mostly in SAS code on EG 8.2 and that performs pretty well as long as VPN isn't overloaded. I would expect running projects to be slower than running code.

I'm also lucky to be able to remotely connect into a PC hosted internally on the company intranet. Not surprisingly that gives you the same performance that you would get in the office. So that is really the best solution for slow networks - have EG hosted internally within your company's intranet either on PCs (virtual or real) or as a Citrix gateway application.

Re: Enterprise Guide performance over a slow network

Kurt_Bremser — Wed, 29 Apr 2020 06:56:04 GMT

EG is very "talkative" over the network, with a lot of back-and-forth for every single operation. This becomes very obvious once the network latencies grow. I have the same long wait for "preparing the server" that you do (same situation as you, VPN over internet to a private ADSL at home), and equally long waits for the results to display.

While developing, I work in small steps, and so take my time. But for "production" purposes, codes are run in batch or quasi-batch from one code node.

Since I am also a pure coder and develop for batch jobs, "developing" means working in a code node and running single steps selectively.

From this POV, I can only suggest that once a project of yours has reached "production" stage, you export all code to a single code node and run that.

Re: Enterprise Guide performance over a slow network

Kurt_Bremser — Wed, 29 Apr 2020 07:09:51 GMT

Oh yes, to clarify: the choke point is not the network speed as such (the amount of data EG fetches when displaying a dataset is actually minuscule compared to all the **** you get from any of today's websites which are overloaded with unnecessary junk), but the latencies introduced by the many hops (firewalls and proxies) in between.

In-house network: 1 ms or less, VPN: 40 ms (just measured here)

So a transfer needing 20 packets will need ~40 ms (packet + ACK) in your company, but 1600 ms (1.6 seconds) at home to finish. And that's what you (and we all) experience.

Re: Enterprise Guide performance over a slow network

Nigel_Pain — Wed, 29 Apr 2020 09:06:45 GMT

By PROC IMPORT, I mean the code. I originally started off with an import task in the project but converted that to straight code. In fact, it's a modification of the data step code generated by the EFI which I've used rather than PROC IMPORT itself.

The file itself is in a shared drive on our network, so there shouldn't be any extra latency in importing it from there, as it's on the same subnet as our compute server.

Some useful/interesting comments from @Kurt_Bremser and @SASKiwi below.

Re: Enterprise Guide performance over a slow network

Nigel_Pain — Wed, 29 Apr 2020 09:15:03 GMT

Some interesting points here. I'm not sure how the location that the project is saved would affect its performance. I'm opening it on my laptop (so I can see that there might be a performance issue in actually doing this) but once it's open, it's running from my laptop, wherever it has been saved (or am I wrong about that?)

Unfortunately, connecting into remote desktops isn't an option for us, as desirable as it might be!

Thanks for your advice.

Re: Enterprise Guide performance over a slow network

Nigel_Pain — Wed, 29 Apr 2020 09:41:27 GMT

That's interesting what you say about the hops being the source of the latency, Kurt. It makes sense given that, as you say, the amount of data being uploaded in a piece of code is pretty small. I have advised users to turn off opening data and output on task completion, and also opening data when it's added to a project.

Being basically a sysadmin, and in SAS terms a platform admin, I don't do a lot of developing myself - the project I was describing is one instance, where I'm actually monitoring and trying to forecast disk usage on a completely separate system. But we have a considerable number of analysts, mainly statisticians, economists and data scientists, for whom EG is their main method of working in SAS. It's these people who I've been trying to advise on the way they work. It's mostly interactive: there's very little batch running.

Re: Enterprise Guide performance over a slow network

SASKiwi — Wed, 29 Apr 2020 20:06:17 GMT

@Nigel_Pain - I was just wondering whether reading and writing the project from or to a shared drive causes any of the slowness, that's all. A test on your local drive would prove that one way or the other.

Re: Enterprise Guide performance over a slow network

Nigel_Pain — Thu, 30 Apr 2020 09:34:33 GMT

Not really seeing any noticeable slowness opening projects from a shared drive.

Re: Enterprise Guide performance over a slow network

SASKiwi — Fri, 01 May 2020 23:55:50 GMT

@Nigel_Pain - It could be worth comparing the latest version of EG which is 8.2 with 7.15. EG 8 is pretty much a complete re-write and this is the version I'm using over VPN. It's possible it might behave better in your environment. Watch out for the fact that EG 8.2 will automatically save 7.15 projects in 8.2 format which can't be read in EG 7.15.

Re: Enterprise Guide performance over a slow network

MCCL1250 — Sat, 02 May 2020 03:01:39 GMT

This was my thought, but getting my employer to upgrade is difficult at
best. We just upgraded to 7.15 less than a year ago. Is there any
documentation of this that I could point to that this would work faster? I
have already pushed for it several times and my manager is taking it to our
IT department on Tuesday.

Re: Enterprise Guide performance over a slow network

SASKiwi — Sat, 02 May 2020 23:25:48 GMT

@Nigel_Pain - I suggest you check out this post: https://communities.sas.com/t5/SAS-Enterprise-Guide/Introducing-SAS-Enterprise-Guide-8-1/m-p/569293#M34061

Have a look at all of the comments, links and videos as that will give you a pretty good idea of the enhancements in EG 8.

I haven't specifically done a lot of comparing of 7.15 versus 8.2 regarding performance as we'd already switched prior to working over VPN. My perception is that 8.2 is similar to 7.15 with regard to network performance. There is one area where EG 8 is a clear winner though and that is the ability to work purely in coding mode with EG project overhead completely switched off. However it sounds like you mostly use EG projects so that is unlikely to be a huge benefit.

Re: Enterprise Guide performance over a slow network

Nigel_Pain — Mon, 04 May 2020 11:00:11 GMT

@SASKiwi An upgrade to 8.2 is planned as part of an overall upgrade of our environment, from M5 to M6. This is primarily to upgrade VA to 7.5 before Flash finally goes out of support. But we have a freeze on all system changes at the moment so it's not going to happen until that is lifted. And, in terms of the client packages, that also won't happen until people are back to working in the office, or are at least able to go to an office. This is because of the size of the deployed package: policy is only to allow this except on a wired ethernet connection.

I'm certainly interested in what EG 8.2 is like. It looks like there will be some functionality that my users will like. In particular, there was a (minor!) outcry when a previous upgrade removed the ability to have multiple items open in tiled windows: one outspoken user described it as a "car-crash of a version"! Can't say I agreed with him, but I can understand that a lot of experienced users will like having this ability again.

I will be doing a lot more reading up on 8.2 before we finally upgrade because I think users will need to be made aware of the way in which it differs from 7.15.

Thanks for your thoughts on this.

Re: Enterprise Guide performance over a slow network

Nigel_Pain — Mon, 04 May 2020 11:06:19 GMT

Just marking this conversation as complete. There's no solution as such but there's been some useful advice.