How to process multiple files through SAS simultaneously? Is there any special concept used for it?

Reply
Occasional Contributor
Posts: 10

How to process multiple files through SAS simultaneously? Is there any special concept used for it?

How to process multiple files through SAS simultaneously? Is there any special concept used for it?

Message was edited by: Himalay Sarma

PROC Star
Posts: 7,363

Re: How to process multiple files in SAS at the ame time? Is there any special concept used for it?

You have to provide more details.  Some possibilities include submitting multiple batch jobs, simultaneously running multiple sessions, creating your own parallel processing driver, and some offers that SAS has as products.

Occasional Contributor
Posts: 10

Re: How to process multiple files in SAS at the ame time? Is there any special concept used for it?

I mean to say, suppose in a directory we have many files of different formats(viz. .sas, .txt) now i want to write a single program to execute these files at the same time, i want to print the time stamp in each files after the execution to get confirmed that they all run in the same time simultaneously.

Moderator
Posts: 238

Re: How to process multiple files in SAS at the ame time? Is there any special concept used for it?

How "same time" - literally simultaneously, sub-second, reasonably?

Would it be okay if each were read IMMEDIATELY after the previous one, until there are none left, or must they be loaded at precisely the same time? (If so, why?)

Reading multiple file formats is reasonably simple, so is applying a timestamp.

Just trying to understand the underlying requirement.

Occasional Contributor
Posts: 10

Re: How to process multiple files in SAS at the ame time? Is there any special concept used for it?

I was trying for the concept of executing many files simultaneously with SAS macro?

Super User
Posts: 5,256

Re: How to process multiple files in SAS at the ame time? Is there any special concept used for it?

Still not clear what your requirements are.

But if you want to kick several SAS steps in parallel, take a look a the MP Connect concept (requires SAS/CONNECT software), and then get back with some more specific questions.

Data never sleeps
Occasional Contributor
Posts: 10

Re: How to process multiple files in SAS at the ame time? Is there any special concept used for it?

it is already cleared in my previous anwers.

Occasional Contributor
Posts: 10

Re: How to process multiple files in SAS at the ame time? Is there any special concept used for it?

you have to write a single program to execute multiple files simultaneously(execute means to do different modifications in different files, but program should bye same, hence macro you have to use). I dont know how to write it, so i am asking!

Occasional Contributor
Posts: 10

Re: How to process multiple files in SAS at the ame time? Is there any special concept used for it?

I mean to say, suppose in a directory we have many files of different formats(viz. .sas, .txt) now i want to write a single program to execute these files at the same time, i want to print the time stamp in each files after the execution to get confirmed that they all run in the same time simultaneously.

Super User
Posts: 10,497

Re: How to process multiple files in SAS at the ame time? Is there any special concept used for it?

And if the issue is reading a bunch of files into one working dataset or if each data set requires separate processing.

Occasional Contributor
Posts: 10

Re: How to process multiple files in SAS at the ame time? Is there any special concept used for it?

I mean to say, suppose in a directory we have many files of different formats(viz. .sas, .txt) now i want to write a single program to execute these files at the same time, i want to print the time stamp in each files after the execution to get confirmed that they all run in the same time simultaneously.

Moderator
Posts: 238

Re: How to process multiple files in SAS at the ame time? Is there any special concept used for it?

Can you be more specific about what "process multiple files in SAS at the same time" means? Is there a specific reason why you want concurrent processing? Also, please shed more light on your SAS infrastructure (client, server, etc, plus version numbers), which will highlight possibilities and/or constraints.

Regards,

Andrew.

Ask a Question
Discussion stats
  • 11 replies
  • 525 views
  • 6 likes
  • 5 in conversation