BookmarkSubscribeRSS Feed
Lenvdb
Quartz | Level 8

We have SAS EG7.1 on WIndows 8 running on Win 2012R2 servers - on SAS 9.4 

Running the SAS Programs are fine but we find Collecting takes ages.

 

How can we resolve this?

8 REPLIES 8
RW9
Diamond | Level 26 RW9
Diamond | Level 26

I had no idea what you were talking about, so I did a quick Google search and this turned up several topics on the matter:

https://communities.sas.com/t5/SAS-Enterprise-Guide/EG-performance-quot-Collecting-quot-takes-very-l...

https://communities.sas.com/t5/SAS-Enterprise-Guide/how-to-avoid-forever-quot-collecting-quot-status...

 

Hope that helps.

Lenvdb
Quartz | Level 8

Thanks for this - Yes I did a Google search as well before posting here and saw these results. But he was using EG 4.3 back in 2011, while we are on SAS9.4 with EG 7.1...

 

So I would need to do some kind of fine tuning I guess, and see why this is happening. It is everyone in our Estate using EG7.1 that have this issue.

 

SASKiwi
PROC Star

Just to clarify - are you just running SAS programs, not EG projects?

 

Also do you have the EG project log switched on or not? If you do, turn it off as it adds to the collecting process.

 

Also try setting the maximum number of  SAS datasets to add to a project from the default of 50 to 0.

 

We run EG 7.11 and don't experience any such problems. 

Lenvdb
Quartz | Level 8

Hi SASKiwi

Nope - just running SAS Progs.

 

I get the impression (from doing a few tests) that the collecting stage is much faster when you check the "Automatically open datasets when generated".

 

Even though it opens the dataset the actual collecting is much faster.

The Project Log is turned off.

Many thanks foir your help.

Kurt_Bremser
Super User

It seems that collecting the results implies a lot of back-and-forth of small packets over the network. Latencies therefore add up very quickly, as the connection keeps waiting for the ACK for each transfer.

While COM works quite well under ideal conditions (because HW and network performance "hide" the design problems), its shortcomings are quickly revealed under stress (=network connections over many hops).

ChrisHemedinger
Community Manager

@Kurt_Bremser - the "chatty" network behavior used to be more of an issue in earlier days of EG, but the "collecting results" phase should not be too bad in modern versions of EG.  However, the volume of ODS results and large numbers of output data sets can have an impact, especially over a slower network.

 

@Lenvdb - you might try the techniques in this blog post to turn off the default ODS output to see what happens.  You can also try deleting unnecessary transient data sets at the end of your program to reduce the "checking" that EG performs to decide what data to add to the project output.  As a trick, you can direct your output data to a libname that you CLEAR at the end of your program, effectively hiding them from EG.  The data files still exist, but EG won't try to add them to the project since the libname isn't present.

 

If you decide to pursue with Tech Support, they will want you to turn on Application Logging (from Tools->Options).  This will generate detailed application logs that Tech Support and R&D know how to read.  You can have a look at these logs yourself and maybe glean an idea of what's slow...but the logs are not designed for a lay person to read.

It's time to register for SAS Innovate! Join your SAS user peers in Las Vegas on April 16-19 2024.
Lenvdb
Quartz | Level 8

Thank you Chris

 

I am recommending to our teams to introduce deleting transcient datasets, but I also find setting the Option in Tools-> Options-> Results : Automatically open data when generated, also somehow reduces the Collecting Stage.

sas-innovate-2024.png

Join us for SAS Innovate April 16-19 at the Aria in Las Vegas. Bring the team and save big with our group pricing for a limited time only.

Pre-conference courses and tutorials are filling up fast and are always a sellout. Register today to reserve your seat.

 

Register now!

SAS Enterprise Guide vs. SAS Studio

What’s the difference between SAS Enterprise Guide and SAS Studio? How are they similar? Just ask SAS’ Danny Modlin.

Find more tutorials on the SAS Users YouTube channel.

Click image to register for webinarClick image to register for webinar

Classroom Training Available!

Select SAS Training centers are offering in-person courses. View upcoming courses for:

View all other training opportunities.

Discussion stats
  • 8 replies
  • 2655 views
  • 4 likes
  • 5 in conversation