topic Re: Unable to pick latest CSV file via File Writer Transformation in SAS Data Management

Unable to pick latest CSV file via File Writer Transformation

Babloo — Wed, 24 Oct 2018 10:13:15 GMT

I have updated (just the data for one field) one CSV file in the UNIX server and that file should be read by File Writer transformation.But for some reasons, file writer transformation taking only the old file as I could see only the data from the old file in the resultant dataset.What would be likely cause for this issue?

Re: Unable to pick latest CSV file via File Writer Transformation

Kurt_Bremser — Wed, 24 Oct 2018 10:28:34 GMT

Inspect the log to see which file was read and which dataset was written. See Maxim 2.

Re: Unable to pick latest CSV file via File Writer Transformation

Babloo — Wed, 24 Oct 2018 10:58:13 GMT

Filename is same and the log also telling the same. I just changed the data
without changing the file name. Dataset was created from the same file. I
want to know why the file which I updated is not being read by file writer
transformation.

Re: Unable to pick latest CSV file via File Writer Transformation

Kurt_Bremser — Wed, 24 Oct 2018 11:02:35 GMT

Look at

the modification times of the file and the dataset as represented by the operating system
the timestamp(s) in the log

to see if the file timestamp < log timestamp <= dataset timestamp. Only then can you expect the dataset to change.

How do you view the dataset? Maybe that needs closing and re-opening.

Re: Unable to pick latest CSV file via File Writer Transformation

Kurt_Bremser — Wed, 24 Oct 2018 11:30:32 GMT

Ummm, wait!

Are you really using the File Writer transformation? That creates a csv or other external file from a dataset, not the other way round. Changes in the csv will simply be overwritten with the unchanged contents of the dataset.