BookmarkSubscribeRSS Feed
dapenDaniel
Obsidian | Level 7

Hello. I have a data set with more than 1 million observations. I would like to split this data set and submit them in a job array. However, the computer is using Linux system.

 

If I submit the single order, The code is 

 

module load sas
sas /work/sas/code.sas

If I submit the job array, the code is 

module load sas
sas /work/sas/code $SLURM_ARRAY_TASK_ID.sas

However, how can I add a parameter to tell sas that I want sas to read the observation from #1 to #5000, #5001 to #10000 respectively? Thanks.

 

https://hcc-docs.unl.edu/display/HCCDOC/Submitting+a+Job+Array

 

2 REPLIES 2
SASKiwi
PROC Star

A million observations isn't very big, especially for a server. Have you tried a single job and how long did it take to process?

LinusH
Tourmaline | Level 20
No idea how SAS would interact with this, assume it needs some investigation to understand, and majenit work.
You could issue parallelization from within SAS using MP CONNECT.
Data never sleeps

SAS Innovate 2025: Call for Content

Are you ready for the spotlight? We're accepting content ideas for SAS Innovate 2025 to be held May 6-9 in Orlando, FL. The call is open until September 16. Read more here about why you should contribute and what is in it for you!

Submit your idea!

Mastering the WHERE Clause in PROC SQL

SAS' Charu Shankar shares her PROC SQL expertise by showing you how to master the WHERE clause using real winter weather data.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 2 replies
  • 544 views
  • 0 likes
  • 3 in conversation