Help using Base SAS procedures

Performance issues in sorting Large Data Set

Reply
N/A
Posts: 0

Performance issues in sorting Large Data Set

Hi,

I am having performance issues in sorting huge SAS datasets in z/OS.
Options Used:
options compress=yes reuse=yes STATS MEMRPT FULLSTIMER MSGLEVEL=I bufsize=0
bufno=10 SORTSIZE=MAX UBUFNO = 20 THREADS dbsliceparm=(threaded_apps,4);

No of Records: 48 Million.
LRECL= 800
No of columns in proc sort: 9
Sort Utility: z/Os Host DF Sort
proc sort data = work.Source
out = work.Target
NOEQUALS;
by CRED_NO DBTR_GRP_NO SEC_NO CUST_NO REC_ID REC_TYP TRANS_CD TXT_TYPE_ID REC_NO;
run;

Time Taken: 30 mins!!

Can some one please suggest how can I reduce this time.
Frequent Contributor
Posts: 106

Re: Performance issues in sorting Large Data Set

Please post the log messages as well. Considering the options you have set, you should have a plenty of them. Be sure to specify option SORTMSG as well.
Trusted Advisor
Posts: 2,113

Re: Performance issues in sorting Large Data Set

Pratik,

You will probably have to experiment with this as there are so many variables and some of them a host specific.

Try the TAGSORT option; that can sometimes speed up a sort by reducing disk I/O.

Unless you have text with lots of white-space, the compress=yes can actually slow down SAS.

z/OS installations often use non-SAS sort tools (we used SyncSort years ago). You may be able to speed it up by passing parameters directly to the tool. Check SAS's z/OS companion.

Another possibility is to use PROC SQL. I don't know that it would speed it up, but do know that it uses different SAS routines.

Doc Muhlbaier
Duke
Ask a Question
Discussion stats
  • 2 replies
  • 176 views
  • 0 likes
  • 3 in conversation