wherefunctionsHi,
I am trying to apply a user defined format through a put funtion in the where statement while setting the dataset and it it is taking 1 hour, and if i remove the put function, it takes 3 minutes.
What can be the issue , and how can we overcome it ?
Thanks in advance
Well, posting the code would be useful. I wouldn't recommend putting functions like that in a where clause as its called for each row then totaling up time. What are you trying to where, why not use the underlying data, e.g if date then '01JAN2014'd, if number then =1, etc.
Post the proc format code and the data step.
Most probably the user defined format is complex enough to eat CPU cycles.
I am using the cntlin option to create a format for a variable and tehn applying to a bigger dataset.
Aside from the possibilty of overriding an index, POST THE CODE!
With that kind of difference I suspect that your column is indexed.
Putting a function in where clause effectively removes the possibility to use index (with some exceptions, like substr from pos 1).
"Note: Conditions are not optimized with an index for arithmetic operators, a variable-to-variable condition, the sounds-like operator, and any function other than the TRIM and SUBSTR function as listed above."
Understanding SAS Indexes :: SAS(R) 9.4 Language Reference: Concepts, Fourth Edition
If your value is a constant, create is a macro variable prior to the extract step.
If it't in a transaction/look-up table, have the put function in an earlier step.
Don't miss out on SAS Innovate - Register now for the FREE Livestream!
Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.
Learn how use the CAT functions in SAS to join values from multiple variables into a single value.
Find more tutorials on the SAS Users YouTube channel.