topic Re: Run query on large dataset quickly in SAS Programming

Run query on large dataset quickly

tarheel13 — Tue, 02 Feb 2021 00:41:01 GMT

I'm trying to run a query in DM SAS or SAS OnDemand for Academics. Dataset is over 750,000 rows. It takes a really long time to run. Is there a faster way to run this?

Re: Run query on large dataset quickly

ballardw — Tue, 02 Feb 2021 00:53:23 GMT

Show the code of the query you are trying to run.

Best would be to show from the LOG the actual code plus any messages.

That way we have a chance of seeing some of the common inefficiencies in the code.

Also I would expect On Demand for Academics to possibly have performance issues with largish data sets as there are I believe some default file size limits and unless your 750,000 rows consist of very few variables you may be hitting that.

And define "really long time". 5 minutes? 15 minutes? hours?

Re: Run query on large dataset quickly

ChrisNZ — Tue, 02 Feb 2021 04:25:30 GMT

Also show the proc contents for that data set.

Re: Run query on large dataset quickly

tarheel13 — Wed, 03 Feb 2021 12:34:39 GMT

Hey guys I figured it out. Ran faster once I filtered on more things in the where clause.

Re: Run query on large dataset quickly

mkeintz — Wed, 03 Feb 2021 15:37:54 GMT

@tarheel13 wrote:

Hey guys I figured it out. Ran faster once I filtered on more things in the where clause.

Good. Mark your response as a solution - that will let viewers know the status.