Cant' gett the lastest file using SFTP

[radhames_gomez]

Hello,

I'm connecting throught SFTP to a server using:

filename fileList sftp '/init/folder/' host="hostname.local" user="user" optionsx='-i "E:\SAS WORK\mykey.ppk" -pw "pass" ' lsa;

i'm trying to get the list of all files in the folder, so i can read the lastest one.  But the problem is that the remote server contains 35 files  and i'm just getting 32.  When i connect through Filezilla to the same server with the same user i can see the 35 files.  

data Files;

infile fileList ;

input fileName $255. ;

run;

How can i solve this issue, because my process has to look for the last file every one hour?

best regards,.

Juan Radhamess

[ballardw]

It might help to show the names of some of the files your code doesn't find.

IF any of the files you didn't get happen to have names that start with a dot such as .xauthority then use the LS option instead of LSA.

[radhames_gomez]

The files are like this.

1DIARIOCAN.2023178.T060520.txt

1DIARIOCAN.2023178.T092530.txt

1DIARIOCAN.2023178.T110530.txt

if i run the process at 12 pm, the data step only bring:  the first to files but the one at 11 am is left out.

[Tom · Accepted solution]

How are you reading the output generated by your FILELIST fileref?

Show the data step that you used to read it as there are things that can make the data step skip lines in the file.  The most obvious one being not using the TRUNCOVER option on the INFILE statement.

Example:

data test;
  input id string $100.;
cards;
1 abc
2 def
3 ghi
4 jkl
5 mno
;

74   data test;
75     input id string $100.;
76   cards;

NOTE: LOST CARD.
RULE:      ----+----1----+----2----+----3----+----4----+----5----+----6----+----7----+----8----+----9----+----0
82         ;
id=5 string=  _ERROR_=1 _N_=3
NOTE: SAS went to a new line when INPUT statement reached past the end of a line.
NOTE: The data set WORK.TEST has 2 observations and 2 variables.
NOTE: DATA statement used (Total process time):
      real time           0.00 seconds
      cpu time            0.00 seconds

[radhames_gomez]

Hello Tom, 

Thanks for your answer.  Here is the code

filename fileList sftp '/init/folder/' host="hostname.local" user="user" optionsx='-i "E:\SAS WORK\mykey.ppk" -pw "pass" ' lsa;

data Files;
    infile fileList ;
     input fileName $255. ;
run;

thanks

Juan R Gomez

[radhames_gomez]

Hello again Tom.

You're right, with the truncover option, i'm getting all the files.

Thanks a lot.

Juan R Gomez