topic Re: Cant' gett the lastest file using SFTP in SAS Programming

Cant' gett the lastest file using SFTP

radhames_gomez — Tue, 27 Jun 2023 21:10:38 GMT

Hello,

I'm connecting throught SFTP to a server using:

filename fileList sftp '/init/folder/' host="hostname.local" user="user" optionsx='-i "E:\SAS WORK\mykey.ppk" -pw "pass" ' lsa;

i'm trying to get the list of all files in the folder, so i can read the lastest one. But the problem is that the remote server contains 35 files and i'm just getting 32. When i connect through Filezilla to the same server with the same user i can see the 35 files.

data Files;

infile fileList ;

input fileName $255. ;

run;

How can i solve this issue, because my process has to look for the last file every one hour?

best regards,.

Juan Radhamess

Re: Cant' gett the lastest file using SFTP

ballardw — Wed, 28 Jun 2023 00:14:32 GMT

It might help to show the names of some of the files your code doesn't find.

IF any of the files you didn't get happen to have names that start with a dot such as .xauthority then use the LS option instead of LSA.

Re: Cant' gett the lastest file using SFTP

radhames_gomez — Wed, 28 Jun 2023 12:27:30 GMT

The files are like this.

1DIARIOCAN.2023178.T060520.txt

1DIARIOCAN.2023178.T092530.txt

1DIARIOCAN.2023178.T110530.txt

if i run the process at 12 pm, the data step only bring: the first to files but the one at 11 am is left out.

Re: Cant' gett the lastest file using SFTP

Tom — Wed, 28 Jun 2023 13:11:17 GMT

How are you reading the output generated by your FILELIST fileref?

Show the data step that you used to read it as there are things that can make the data step skip lines in the file. The most obvious one being not using the TRUNCOVER option on the INFILE statement.

Example:

data test;
  input id string $100.;
cards;
1 abc
2 def
3 ghi
4 jkl
5 mno
;

74   data test;
75     input id string $100.;
76   cards;

NOTE: LOST CARD.
RULE:      ----+----1----+----2----+----3----+----4----+----5----+----6----+----7----+----8----+----9----+----0
82         ;
id=5 string=  _ERROR_=1 _N_=3
NOTE: SAS went to a new line when INPUT statement reached past the end of a line.
NOTE: The data set WORK.TEST has 2 observations and 2 variables.
NOTE: DATA statement used (Total process time):
      real time           0.00 seconds
      cpu time            0.00 seconds

Re: Cant' gett the lastest file using SFTP

radhames_gomez — Wed, 28 Jun 2023 13:21:15 GMT

Hello Tom,

Thanks for your answer. Here is the code

filename fileList sftp '/init/folder/' host="hostname.local" user="user" optionsx='-i "E:\SAS WORK\mykey.ppk" -pw "pass" ' lsa;

data Files;
infile fileList ;
input fileName $255. ;
run;

thanks

Juan R Gomez

Re: Cant' gett the lastest file using SFTP

radhames_gomez — Wed, 28 Jun 2023 13:25:19 GMT

Hello again Tom.

You're right, with the truncover option, i'm getting all the files.

Thanks a lot.

Juan R Gomez