topic Re: getting all files with date and time stamp in SAS Programming

getting all files with date and time stamp

woo — Tue, 08 Nov 2016 14:12:33 GMT

Hello friends, i am using below code to get ALL files + file size + changed (date and time) from specific dir. however, not getting enough data as output - only getting file names. I need file size and changed variable as well...

have

name size changed

sfvjsddvjlsbvaskdv 11/8/2016 10:10:00 AM

sjklvnsvnsvk 11/8/2016 5:15:20 AM

svjnksdivjpifvusvknivuhiv 123456 11/7/2016 15:07:00 PM

code

filename init pipe "dir /test/";

data all_files;

length fname $ 200 size $ 20 time $ 20;

infile init truncover;

input fname size time$;

run;

output

sfvjsddvjlsbvaskdv

sjklvnsvnsvk

svjnksdivjpifvusvknivuhiv

want

name size changed

sfvjsddvjlsbvaskdv 11/8/2016 10:10:00 AM

sjklvnsvnsvk 11/8/2016 5:15:20 AM

svjnksdivjpifvusvknivuhiv 123456 11/7/2016 15:07:00 PM

Re: getting all files with date and time stamp

Kurt_Bremser — Tue, 08 Nov 2016 14:23:09 GMT

If your system is Windows, then doing dir /temp is a bad idea, because the forward slash signals a commandline option to dir, so it will complain because emp (what follows after the /t, which is valid) is invalid.

Use dir c:\temp\ instead.

If you're working on UNIX (Linux), use ls -l instead of dir.

What does your log say?

Re: getting all files with date and time stamp

RW9 — Tue, 08 Nov 2016 14:27:59 GMT

For windows:

filename tmp pipe 'dir "S:\temp\rob" /tc /a-d';

data want;
  infile tmp dlm="¬";
  length buff $2000;
  input buff;
  if _n_ > 3 and index(buff,"File")=0 and index(buff,"Dir")=0 then do;
    date=input(scan(buff,1," "),ddmmyy10.);
    size=...;
    name=...;
  end;
  format date date9.;
run;

Only parsed out creation date indicated by /tc, you can add the other two in, quite simple.

Re: getting all files with date and time stamp

woo — Tue, 08 Nov 2016 17:04:16 GMT

Thank you RW9 - we have Linux - and my ultimate goal is finding unused/orphaned temporary sessions and delete it...

Re: getting all files with date and time stamp

RW9 — Tue, 08 Nov 2016 17:09:42 GMT

Then you would need to manipulate the code to match the OS commands you would use on Linux.

As for removing temporary sessions, how would looking at a dir list show you unused sessions? I would imagine there are better processes out there to do this, however without knowing software/setups etc. I can't really say. Check with your SAS admin, software support to see on options.

Re: getting all files with date and time stamp

woo — Tue, 08 Nov 2016 17:13:50 GMT

thank you "KurtBremser" ,

i tried below and worked fine.

data test;

length access $ 20 files $ 200;

infile "cd /testdir; ls -lt;" pipe firstobs=2;

input access nx $ user $ group $ size $ month $ day $ time $ files;

run;

however, i have day and month are character - and i want to combine in one variable like month_day with appropriate format...what can i do? i tried different way but didn't work...

i can simply combine it like,

month_day=month||day; but want proper format....

Re: getting all files with date and time stamp

woo — Tue, 08 Nov 2016 17:19:46 GMT

@RW - i am planning to prepare spcific variable with x command value for all temp dir like;@RW - i am planning to prepare spcific variable with x command value for all temp dir like;

spec_var

x "rm dir sas_work........"

x" rm dir sas_util......."

and then use filevar to execute to delete it...would that work?

Appreciate your input...

Re: getting all files with date and time stamp

ballardw — Tue, 08 Nov 2016 19:05:42 GMT

You might investigate the SAS external file functions Dopen to "open" a directory for reading, Dnum the number of items in a directory, Dread returns names of directory members, Doptnum and Doptname information items availalbe in a directory, Finfo information abut a file using Foptnum and Foptname gets things like the creation date, file size and such, And Fdelete to remove files or directories.

Unless you are frequently changing operating systems once you know the optnames or optnums you want code isn't terribly long and you need not creat filereferences or use the X command. Or you could build the the X commands and execute using Call Execute.

Re: getting all files with date and time stamp

Kurt_Bremser — Tue, 08 Nov 2016 20:52:28 GMT

To remove the orphaned work locations from crashed SAS sessions, use the cleanwork utility provided by SAS.

Re: getting all files with date and time stamp

woo — Tue, 08 Nov 2016 23:45:39 GMT

somehow, cleanwork utility doens't do all cleanup. still some session left behind...some of them are really old sessions....dont' know why...

Re: getting all files with date and time stamp

ChrisNZ — Wed, 09 Nov 2016 03:11:43 GMT

Have you seen this?

you'll need to replace the commands (with ls and ps) and then this macro may be useful to you.

Re: getting all files with date and time stamp

woo — Wed, 09 Nov 2016 04:42:16 GMT

what macro?

Re: getting all files with date and time stamp

ChrisNZ — Wed, 09 Nov 2016 04:46:23 GMT

oops

http://www.ryslander.com/delete-orphan-sas-work-directories-on-windows/

Re: getting all files with date and time stamp

Kurt_Bremser — Wed, 09 Nov 2016 07:20:36 GMT

cleanwork willl remove directories that have no corresponding process (the process number is hexadecimally coded into the directory name) in the process list. So your problem might not be orphaned data, but orphaned processes. These need to be dealt with by killing them.

Oh yes, and for killing processes and removing data of other users, you need superuser privileges in UNIX.

PS cleanwork works fine here, but my SAS runs not on a Windows toybox, but on an operating system that deserves such a label.

Re: getting all files with date and time stamp

woo — Wed, 09 Nov 2016 17:15:29 GMT

thank you all for your thoughts.

i am still wonder if we have any script or program already written to take care of it for incstance says - sas eg temp session which has active PID and if that session is staying there from long time - how to delete it without any manual process like with script or program.

so i was trying to list all sas_work...or sas_util... directores and try to delete it with OS cmd (by sas program - by making rm dir cmd and executing it with filevar) - if anything is in use - won't delete and if something has left b/h - it would cleared it...

Re: getting all files with date and time stamp

NiyiAwe1 — Wed, 23 Oct 2019 15:28:33 GMT

Try this:

/*MACRO TO GET ALL FILE NAMES AND DETAILS WITHIN A DIRECTORY*/
	%MACRO GET_FILE_NAMES(FILE_DIR	,COMMON_FILE_NAME ,FILE_FORMAT	,DATA_OUT);

		FILENAME LS PIPE "dir &FILE_DIR.&COMMON_FILE_NAME.*.&FILE_FORMAT.";
		DATA FILE_NAMES (KEEP=LIST_FILE); 
			INFILE LS PAD TRUNCOVER EXPANDTABS ; 
			INPUT FILE_NAMES $10000.;
			LIST_FILE = COMPRESS('"'||FILE_NAMES||'"');
		RUN;
		PROC SQL;	SELECT LIST_FILE 	AS LIST_FILE		INTO:	LIST_FILE_1 - 		FROM FILE_NAMES; QUIT;
		PROC SQL; 	SELECT COUNT(*) 	AS NUM_OF_SEARCHES	INTO: 	NUM_OF_SEARCHES		FROM FILE_NAMES;	QUIT;

		%DO Z = 1 %TO &NUM_OF_SEARCHES.;
			DATA RAW_WANT;			
				FILENAME LISA &&LIST_FILE_&Z..; 
				INFILE LISA TRUNCOVER ;
				FORMAT FILE_NAME $20000.;
				FILE_NAME 	= 	&&LIST_FILE_&Z..;
				FLIE_SIZE	=	FINFO(FOPEN('LISA') 		,'FILE SIZE (BYTES)');
				FORMAT MOD_DATE DATETIME.;
   				MOD_DATE	=	INPUT(FINFO(FOPEN('LISA')	,'LAST MODIFIED'), DATETIME.);     
   			    RIGHTS		=	FINFO(FOPEN('LISA')			,'ACCESS PERMISSION');      
		 		OWNER		=	FINFO(FOPEN('LISA')			,'OWNER NAME');      
			RUN;

			PROC APPEND DATA = RAW_WANT BASE = WANT_1 FORCE; RUN;
		%END;
		DATA &DATA_OUT.; 	SET WANT_1; 		RUN;
		PROC DATASETS;		DELETE WANT_1 RAW_WANT FILE_NAMES;	RUN;
	%MEND GET_FILE_NAMES;

/*INPUT PARAMETERS HERE*/
	%GET_FILE_NAMES (FILE_DIR  			= \Users\abc\Desktop\ 		/* SPECIFY THE DIRECTORY LOCATION HERE*/
				   , COMMON_FILE_NAME 	= HAVE_NAME     			/* FILE COMMON NAME, YOU CAN PUT "*" HERE TO SELECT ALL FILE NAMES*/
				   , FILE_FORMAT 		= txt 						/* FILE FORMAT,  YOU CAN PUT "*" HERE TO SELECT ALL FILE FORMATS WITHIN THE DIRECTORY*/
				   , DATA_OUT			= WANT);

Re: getting all files with date and time stamp

ChrisNZ — Wed, 23 Oct 2019 20:40:20 GMT

Are you really trying to delete data -or even kill sessions- of users that have an *active* EG session?

Why on earth would you do this?