BookmarkSubscribeRSS Feed
maddysbi
Calcite | Level 5

Hi,

As a part of project,I got the data in CSV file at a certain path.Now,I want to read this file dynamically into SAS DI Studio to process further.How should I design a job which runs periodically reading this file from the respective location and registers the file in SAS DI with full data initially and then incremental in later runs.

I have an idea of External file Wizard,ODBC connectivity and User written code for complex external files.But,what I want here to completely automate the process of reading file from FTP path into SAS DI by scheduling a job.

Please help.

Thanks,

Maddy

3 REPLIES 3
jakarman
Barite | Level 11

https://communities.sas.com/message/213083#213083 being misplaced? it is the same

---->-- ja karman --<-----
maddysbi
Calcite | Level 5

Jaap,

        Thought this is more relevant to data management and posted here.It is the same.I agree that the physical path may not be hardcoded but I wanted an approach on how to automate the process of reading the external csv file.

When I searched for it,I could only get the process through external file wizard which has to be done manually as in below links.

http://support.sas.com/documentation/cdl/en/etlug/62233/HTML/default/viewer.htm#p18he2u3dngiixn1c6go...

https://support.sas.com/documentation/cdl/en/etlug/62233/HTML/default/viewer.htm#p1h7xnr4n6dmown11ce...

May be if I'm successful in bringing the file from the location into DI through automated process,I can use the below process using file reader to get my job done to populate the data into target table.

http://support.sas.com/documentation/cdl/en/etlug/62233/HTML/default/viewer.htm#p1234xgaebca36n1t9r9...

Please let me know if my requirement is not clear and in case of additional information.

Thanks,

Maddy

jakarman
Barite | Level 11

You did not touch this one: SAS(R) Data Integration Studio 4.21: User's Guide (Accessing an External File with an FTP Server or an HTTP Server)
SAS is having FTP/SFTP support using their filename. It is limited by not supporting the most (+3 yeras old) options with identification/authentication/encryption. When you need those and needing them by an external program is requiring xcmd access.  The filename and physical name could be placed in the autoexec_usermods of the related app-server. Having the definitions defined it is scheduling as usual.

When you need a trigger for processing the file. Think about segregation of the file-transfer (being send to you) and the processing.
Most schedulers can trigger a job on existence of a file on the local system. Seeing something happening on a system you have no access is not possible.    

---->-- ja karman --<-----

sas-innovate-2024.png

Join us for SAS Innovate April 16-19 at the Aria in Las Vegas. Bring the team and save big with our group pricing for a limited time only.

Pre-conference courses and tutorials are filling up fast and are always a sellout. Register today to reserve your seat.

 

Register now!

How to connect to databases in SAS Viya

Need to connect to databases in SAS Viya? SAS’ David Ghan shows you two methods – via SAS/ACCESS LIBNAME and SAS Data Connector SASLIBS – in this video.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 3 replies
  • 3731 views
  • 3 likes
  • 2 in conversation