BookmarkSubscribeRSS Feed
deleted_user
Not applicable
We get the data from ODIN (oracle database) using proc sql. It got 20M records and indexed by 'acct_id'. I need to pull all the records and I'm forced to not to query them all with a single query for some reasons (memory limitation so on) 🙂

What's the best way to get all the data with, let's say, 20 queries. Ideally, I want to set up a macro program and call it 20 times. I thought if I know the acct_ids for the 1Mth, 2Mth,..., and 19Mth record, then I can condition it on them. Now, the problem is how do I even get those acct_ids using queries?

I was also trying to use 'rownum' and the following conditon does not work here:
//where rownum between 2 and 10//

Is there any standard solution for big queries?

Thanks.

-Nilan
2 REPLIES 2
Cynthia_sas
SAS Super FREQ
Hi:
You may want to consult with Tech Support. This is a big enough file that you need a data-specific and database-specific solution. And also, once you create your various BIG files, there may be efficiency considerations to take into account when you are doing subsequent processing or analysis with SAS.

To contact Tech Support, go to http://support.sas.com/ and in the left-hand navigation pane, click on the link entitled "Submit a Problem".

cynthia
deleted_user
Not applicable
Hi Cynthia,

I'll do that.

Thanks for the direction.

-Nilan

sas-innovate-2024.png

Don't miss out on SAS Innovate - Register now for the FREE Livestream!

Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.

 

Register now!

New Learning Events in April

 

Join us for two new fee-based courses: Administrative Healthcare Data and SAS via Live Web Monday-Thursday, April 24-27 from 1:00 to 4:30 PM ET each day. And Administrative Healthcare Data and SAS: Hands-On Programming Workshop via Live Web on Friday, April 28 from 9:00 AM to 5:00 PM ET.

LEARN MORE

Discussion stats
  • 2 replies
  • 814 views
  • 0 likes
  • 2 in conversation