topic Re: import xml file compressed into .7z in SAS Programming

topic Re: import xml file compressed into .7z in SAS Programming https://communities.sas.com/t5/SAS-Programming/import-xml-file-compressed-into-7z/m-p/426947#M105245 <P>Looks like nothing has been created/run in this step???? None of the "put" command produce print out. </P><P> </P><P>1    filename inzip ZIP "e:\Users\mhollifi\Desktop\Chotibhak\USA_FO_Active_2016-04.zip";<BR />2<BR />3<BR />4    data contents(keep=memname isFolder);<BR />5     length memname $200 isFolder 8;<BR />6<BR />7     fid=dopen("inzip"); put fid;<BR />8     if fid=0 then<BR />9      stop;<BR />10    memcount=dnum(fid); put memcount;<BR />11    do i=1 to memcount;<BR />12     memname=dread(fid,i); put  fid memcount memname;<BR />13<BR />14     isFolder = (first(reverse(trim(memname)))='.');<BR />15     output;<BR />16    end;<BR />17    rc=dclose(fid);<BR />18   run;</P><P>NOTE: List Handle Creation Failed.<BR />0<BR />NOTE: The data set WORK.CONTENTS has 0 observations and 2 variables.<BR />NOTE: DATA statement used (Total process time):<BR />      real time           0.01 seconds<BR />      cpu time            0.01 seconds</P> Thu, 11 Jan 2018 18:23:50 GMT mhollifi 2018-01-11T18:23:50Z import xml file compressed into .7z https://communities.sas.com/t5/SAS-Programming/import-xml-file-compressed-into-7z/m-p/426271#M105019 <P>I need to read .7z file.  The contents of .7z file are more than thousand xml files.  I tried this but I got error like this.</P><P>118  filename inzip ZIP "e:\Users\mhollifi\Desktop\Chotibhak\USA_FO_Active_2016-04.7z";<BR />119   <BR />120  /* Read the "members" (files) from the ZIP file */<BR />119   <BR />     -<BR />     180<BR />ERROR 180-322: Statement is not valid or it is used out of proper order.</P><P>121  data contents(keep=memname isFolder);</P><P>122   length memname $200 isFolder 8;<BR />      ------<BR />      180</P><P>ERROR 180-322: Statement is not valid or it is used out of proper order.</P><P>123   fid=dopen("inzip");<BR />      ---<BR />      180</P><P>ERROR 180-322: Statement is not valid or it is used out of proper order.</P><P>124   if fid=0 then<BR />      --<BR />      180<BR />ERROR 180-322: Statement is not valid or it is used out of proper order.</P><P>125    stop;</P><P>126   memcount=dnum(fid);<BR />      --------<BR />      180</P><P>ERROR 180-322: Statement is not valid or it is used out of proper order.</P><P>127   do i=1 to memcount;<BR />      --<BR />      180</P><P>ERROR 180-322: Statement is not valid or it is used out of proper order.</P><P>128    memname=dread(fid,i);<BR />       -------<BR />       180</P><P>ERROR 180-322: Statement is not valid or it is used out of proper order.</P><P>129    /* check for trailing / in folder name */<BR />130    isFolder = (first(reverse(trim(memname)))='/');<BR />       --------<BR />       180</P><P>ERROR 180-322: Statement is not valid or it is used out of proper order.</P><P>131    output;<BR />       ------<BR />       180</P><P>ERROR 180-322: Statement is not valid or it is used out of proper order.</P><P>132   end;<BR />      ---<BR />      180</P><P>ERROR 180-322: Statement is not valid or it is used out of proper order.</P><P>133   rc=dclose(fid);<BR />      --<BR />      180</P><P>ERROR 180-322: Statement is not valid or it is used out of proper order.</P><P>134  run;</P><P> </P><P>I suspect SAS cannot read .7z file.  Is it right?</P> Tue, 09 Jan 2018 22:50:25 GMT https://communities.sas.com/t5/SAS-Programming/import-xml-file-compressed-into-7z/m-p/426271#M105019 mhollifi 2018-01-09T22:50:25Z Re: import xml file compressed into .7z https://communities.sas.com/t5/SAS-Programming/import-xml-file-compressed-into-7z/m-p/426274#M105020 <BLOCKQUOTE><HR /><a href="https://communities.sas.com/t5/user/viewprofilepage/user-id/183698">@mhollifi</a> wrote:<BR /> <P> </P> <P> </P> <P>I suspect SAS cannot read .7z file.  Is it right?</P> <HR /></BLOCKQUOTE> <P> </P> <P>It supports GZIP (SAS 9.4 TS1M5)  files and/or files zipped with WINZIP. If you have XCMD enabled, you can always sneak down to your OS to have it unzip and export the file.</P> <P> </P> <P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="delete_winzip.JPG" style="width: 600px;"><img src="https://communities.sas.com/t5/image/serverpage/image-id/17737iC1F39A397EA7F457/image-size/large?v=v2&px=999" role="button" title="delete_winzip.JPG" alt="delete_winzip.JPG" /></span></P> Tue, 09 Jan 2018 22:59:29 GMT https://communities.sas.com/t5/SAS-Programming/import-xml-file-compressed-into-7z/m-p/426274#M105020 Reeza 2018-01-09T22:59:29Z Re: import xml file compressed into .7z https://communities.sas.com/t5/SAS-Programming/import-xml-file-compressed-into-7z/m-p/426332#M105030 <P>When posting logs, use the {i} button. The main posting window removes much of the formatting and changes certain characters and character sequences, which removes a lot of important content of the log (like horizontal spacing, so the underlines of the ERROR message appear in the wrong place).</P> Wed, 10 Jan 2018 08:30:35 GMT https://communities.sas.com/t5/SAS-Programming/import-xml-file-compressed-into-7z/m-p/426332#M105030 Kurt_Bremser 2018-01-10T08:30:35Z Re: import xml file compressed into .7z https://communities.sas.com/t5/SAS-Programming/import-xml-file-compressed-into-7z/m-p/426928#M105235 <P>So, SAS cannot read .7z files, I created a zip file for change.  I got this error message: "list handle creation failed" What is list handle? and Why failed to be created?  Thank you for your help.</P><P> </P><P>45   filename inzip ZIP "e:\Users\mhollifi\Desktop\Chotibhak\USA_FO_Active_2016-04.zip";<BR />46<BR />47<BR />48   data contents(keep=memname isFolder);<BR />49    length memname $200 isFolder 8;<BR />50    fid=dopen("inzip");<BR />51    if fid=0 then<BR />52     stop;<BR />53    memcount=dnum(fid);<BR />54    do i=1 to memcount;<BR />55     memname=dread(fid,i);<BR />56<BR />57     isFolder = (first(reverse(trim(memname)))='/');<BR />58     output;<BR />59    end;<BR />60    rc=dclose(fid);<BR />61   run;</P><P>NOTE: List Handle Creation Failed.<BR />NOTE: The data set WORK.CONTENTS has 0 observations and 2 variables.<BR />NOTE: DATA statement used (Total process time):<BR />      real time           0.02 seconds<BR />      cpu time            0.01 seconds</P><P><BR />62   title "Files in the ZIP file";<BR />63   proc print data=contents noobs N;<BR />64   run;</P><P>NOTE: No observations in data set WORK.CONTENTS.<BR />NOTE: PROCEDURE PRINT used (Total process time):<BR />      real time           0.00 seconds<BR />      cpu time            0.00 seconds</P> Thu, 11 Jan 2018 17:38:06 GMT https://communities.sas.com/t5/SAS-Programming/import-xml-file-compressed-into-7z/m-p/426928#M105235 mhollifi 2018-01-11T17:38:06Z Re: import xml file compressed into .7z https://communities.sas.com/t5/SAS-Programming/import-xml-file-compressed-into-7z/m-p/426933#M105238 <P>What version of SAS do you have?</P> <P>I'm assuming you're using the approach outlined here to list the files in your zipped file.</P> Thu, 11 Jan 2018 17:58:19 GMT https://communities.sas.com/t5/SAS-Programming/import-xml-file-compressed-into-7z/m-p/426933#M105238 Reeza 2018-01-11T17:58:19Z Re: import xml file compressed into .7z https://communities.sas.com/t5/SAS-Programming/import-xml-file-compressed-into-7z/m-p/426934#M105239 <P>SAS 9.4, TS 1M3 is my version.</P><P>Yes, I am trying to get the list of files in the zip file.</P><P> </P><P>Thank you</P> Thu, 11 Jan 2018 18:01:23 GMT https://communities.sas.com/t5/SAS-Programming/import-xml-file-compressed-into-7z/m-p/426934#M105239 mhollifi 2018-01-11T18:01:23Z Re: import xml file compressed into .7z https://communities.sas.com/t5/SAS-Programming/import-xml-file-compressed-into-7z/m-p/426938#M105241 <P><SPAN>isFolder = (first(reverse(trim(memname)))='/'); </SPAN></P> <P> </P> <P><SPAN>The line above doesn't seem to match the code in teh blog post I linked. I would probably just copy that code and see if it worked as is....you only need the second part of the macro because you're not looking to find all zip files.</SPAN></P> Thu, 11 Jan 2018 18:06:03 GMT https://communities.sas.com/t5/SAS-Programming/import-xml-file-compressed-into-7z/m-p/426938#M105241 Reeza 2018-01-11T18:06:03Z Re: import xml file compressed into .7z https://communities.sas.com/t5/SAS-Programming/import-xml-file-compressed-into-7z/m-p/426947#M105245 <P>Looks like nothing has been created/run in this step???? None of the "put" command produce print out. </P><P> </P><P>1    filename inzip ZIP "e:\Users\mhollifi\Desktop\Chotibhak\USA_FO_Active_2016-04.zip";<BR />2<BR />3<BR />4    data contents(keep=memname isFolder);<BR />5     length memname $200 isFolder 8;<BR />6<BR />7     fid=dopen("inzip"); put fid;<BR />8     if fid=0 then<BR />9      stop;<BR />10    memcount=dnum(fid); put memcount;<BR />11    do i=1 to memcount;<BR />12     memname=dread(fid,i); put  fid memcount memname;<BR />13<BR />14     isFolder = (first(reverse(trim(memname)))='.');<BR />15     output;<BR />16    end;<BR />17    rc=dclose(fid);<BR />18   run;</P><P>NOTE: List Handle Creation Failed.<BR />0<BR />NOTE: The data set WORK.CONTENTS has 0 observations and 2 variables.<BR />NOTE: DATA statement used (Total process time):<BR />      real time           0.01 seconds<BR />      cpu time            0.01 seconds</P> Thu, 11 Jan 2018 18:23:50 GMT https://communities.sas.com/t5/SAS-Programming/import-xml-file-compressed-into-7z/m-p/426947#M105245 mhollifi 2018-01-11T18:23:50Z Re: import xml file compressed into .7z https://communities.sas.com/t5/SAS-Programming/import-xml-file-compressed-into-7z/m-p/426950#M105246 <P>Try the macros here: </P> <P><A href="https://blogs.sas.com/content/sasdummy/2017/09/08/filename-zip-details/" target="_blank">https://blogs.sas.com/content/sasdummy/2017/09/08/filename-zip-details/</A></P> <P> </P> <P>Using Chris's code from GitHub here:</P> <P><A href="https://gist.github.com/cjdinger/04384420b1c04bdcd0e894d7950c7652" target="_blank">https://gist.github.com/cjdinger/04384420b1c04bdcd0e894d7950c7652</A></P> Thu, 11 Jan 2018 18:29:17 GMT https://communities.sas.com/t5/SAS-Programming/import-xml-file-compressed-into-7z/m-p/426950#M105246 Reeza 2018-01-11T18:29:17Z Re: import xml file compressed into .7z https://communities.sas.com/t5/SAS-Programming/import-xml-file-compressed-into-7z/m-p/426956#M105248 <P>thank you for your help.  It didn't work. Maybe because the files names in the zip file are numbers?</P><P>741  /* Sample use */<BR />742<BR />743<BR />744<BR />745    %listzipcontents (targdir=e:\Users\mhollifi\Desktop\Chotibhak\USA_FO_Active_2016-04,<BR />745! outlist=work.zipfiles);</P><P>NOTE: Numeric values have been converted to character values at the places given by:<BR />      (Line):(Column).<BR />      3:2<BR />NOTE: Character values have been converted to numeric values at the places given by:<BR />      (Line):(Column).<BR />      2:11<BR />NOTE: The data set WORK._ZIPFILES has 0 observations and 5 variables.<BR />NOTE: DATA statement used (Total process time):<BR />      real time           0.04 seconds<BR />      cpu time            0.04 seconds</P><P><BR />NOTE: Fileref TARGDIR has been deassigned.<BR />NOTE: No rows were selected.<BR />NOTE: PROCEDURE SQL used (Total process time):<BR />      real time           0.00 seconds<BR />      cpu time            0.00 seconds</P><P><BR />ERROR: The data set list (WORK._contents:) does not contain any members.</P><P>NOTE: The SAS System stopped processing this step because of errors.<BR />WARNING: The data set WORK.ZIPFILES may be incomplete.  When this step was stopped there were 0<BR />         observations and 0 variables.<BR />WARNING: Data set WORK.ZIPFILES was not replaced because this step was stopped.<BR />NOTE: DATA statement used (Total process time):<BR />      real time           0.00 seconds<BR />      cpu time            0.00 seconds</P><P><BR />NOTE: The file WORK._CONTENTS: (memtype=DATA) was not found, but appears on a DELETE statement.<BR />NOTE: Deleting WORK._ZIPFILES (memtype=DATA).<BR />746<BR />747    %getZipDetails (inlist=work.zipfiles, outlist=work.zipdetails);</P><P>NOTE: PROCEDURE DATASETS used (Total process time):<BR />      real time           0.01 seconds<BR />      cpu time            0.00 seconds</P><P><BR />ERROR: Table WORK.ZIPFILES doesn't have any columns. PROC SQL requires each of its tables to<BR />       have at least 1 column.<BR />ERROR: The following columns were not found in the contributing tables: memname, zip.<BR />NOTE: The SAS System stopped processing this step because of errors.<BR />NOTE: PROCEDURE SQL used (Total process time):<BR />      real time           0.00 seconds<BR />      cpu time            0.00 seconds</P><P> </P><P>ERROR: The data set list (WORK._deets:) does not contain any members.</P><P>NOTE: The SAS System stopped processing this step because of errors.<BR />WARNING: The data set WORK.ZIPDETAILS may be incomplete.  When this step was stopped there were<BR />         0 observations and 0 variables.<BR />WARNING: Data set WORK.ZIPDETAILS was not replaced because this step was stopped.<BR />NOTE: DATA statement used (Total process time):<BR />      real time           0.01 seconds<BR />      cpu time            0.01 seconds</P><P><BR />NOTE: The file WORK._DEETS: (memtype=DATA) was not found, but appears on a DELETE statement.<BR />NOTE: PROCEDURE DATASETS used (Total process time):<BR />      real time           0.00 seconds<BR />      cpu time            0.00 seconds</P><P><BR />748<BR />749<BR />750<BR />751  */</P><P> </P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="Capture.JPG" style="width: 600px;"><img src="https://communities.sas.com/t5/image/serverpage/image-id/17799i99B934247556553F/image-size/large?v=v2&px=999" role="button" title="Capture.JPG" alt="Capture.JPG" /></span></P> Thu, 11 Jan 2018 18:51:03 GMT https://communities.sas.com/t5/SAS-Programming/import-xml-file-compressed-into-7z/m-p/426956#M105248 mhollifi 2018-01-11T18:51:03Z Re: import xml file compressed into .7z https://communities.sas.com/t5/SAS-Programming/import-xml-file-compressed-into-7z/m-p/428106#M105653 <P>Thank you all for help.</P><P>I found out that both methods works when the number of members in the zip file is small amount.  I bombed because I have over 12thausands files in the zip file.  I don't think SAS can run through. </P><P> </P><P>I guess, I need to print files name to read them all manually...</P> Tue, 16 Jan 2018 17:33:12 GMT https://communities.sas.com/t5/SAS-Programming/import-xml-file-compressed-into-7z/m-p/428106#M105653 mhollifi 2018-01-16T17:33:12Z