BookmarkSubscribeRSS Feed
sasbegginer
Calcite | Level 5
Hello all,

I am having big problems with Data Integration Studio, we have a large number of tables and jobs and our metadata backups are 4GB in size.

Recently we have noticed the following problems:

- DI Studio is often very slow, especially when opening properties of tables or generating code.
- We sometimes receive error messages such as "Error writing metadata" when trying to save jobs. We then have to close the job without saving changes and redo the work.
- Some of our jobs won't open at all anymore. We previously thought this only happened with jobs which were particularly long or complicated, but it has also happened with simpler jobs.
- Sometimes we have problems editing metadata: e.g. when trying to change the library allocation of a table, it reverts back to the library which it was before once the properties have been closed.

We have tried to reduce the size of our metadata by deleting tables and jobs which are no longer needed, then performing a "purge" operation through SAS Management Console, before adding the RUNANALYSIS AND REORG statement in the OMABACKUP script.

Following this we were temporarily able to open jobs which we were previously not able to.

However, this was only short-lived. We have also noticed that the size of our metadata backups has not gone down at all and remains at 4GB.

Does anyone have any experience of dealing with large amounts of metadata and how this affects performance? Also what steps do we need to take to get metadata permanently removed and so reducing the size of our backups.

Thanks in advanced
4 REPLIES 4
Cynthia_sas
SAS Super FREQ
Hi:
You might want to post your question and observations in the forum that is devoted to Data Integration Studio:
http://support.sas.com/forums/forum.jspa?forumID=59

The description of this forum says that "this forum to share your questions, experiences, and ideas with other SAS Data Integration Studio and DataFlux users".

There might not be many DI Studio users in the SAS Procedures forum.

cynthia
twocanbazza
Quartz | Level 8
SASbegginer

Version of SAS and DIS?
Operating System of system where Metadata server lives, OS of DIS Client. Number of developers accessing.

If Metadata server on Windows 32 bit machine you'll have an issue when the process gets to about 2GB...

Cheers

Barry
sasbegginer
Calcite | Level 5
Hi we use 9.1.3 sas and i think DI studio is version 4.3. Metadata data server is on windows servers 2005 32 bit. Each client has xp 32 bit. We have around 10 developers editing the metadata server and another 7 reading from it.
senico82_gmail_com
Calcite | Level 5
Hi,

I guess you can refer to the following document:
http://support.sas.com/resources/papers/proceedings09/334-2009.pdf

sas-innovate-2024.png

Join us for SAS Innovate April 16-19 at the Aria in Las Vegas. Bring the team and save big with our group pricing for a limited time only.

Pre-conference courses and tutorials are filling up fast and are always a sellout. Register today to reserve your seat.

 

Register now!

What is Bayesian Analysis?

Learn the difference between classical and Bayesian statistical approaches and see a few PROC examples to perform Bayesian analysis in this video.

Find more tutorials on the SAS Users YouTube channel.

Click image to register for webinarClick image to register for webinar

Classroom Training Available!

Select SAS Training centers are offering in-person courses. View upcoming courses for:

View all other training opportunities.

Discussion stats
  • 4 replies
  • 1191 views
  • 0 likes
  • 4 in conversation