topic Line pointers with raw data with inconsistent lines and embedded headers in SAS Enterprise Guide

topic Line pointers with raw data with inconsistent lines and embedded headers in SAS Enterprise Guide https://communities.sas.com/t5/SAS-Enterprise-Guide/Line-pointers-with-raw-data-with-inconsistent-lines-and-embedded/m-p/141155#M11326 <HTML><HEAD></HEAD><BODY><P>The raw data I want to read not only runs across several different lines but also doesn't have the same number of lines per record. To further complicate things it also has headers that appear in the middle of the file after every page that ruin everything. here is code so far in sas studio...</P><P></P><P></P><P></P><P></P><P></P><P></P><P>`libname mylib '/folders/myfolders/';</P><P></P><P></P><P>data myfile;</P><P>  length itm $ 4 itemnum 5 itemdesc $ 40 inac $ 2 assetcl $ 4 invcl 3 dspunit $ 2<SPAN style="font-size: 10pt; line-height: 1.5em;">ordunit $ 2 convr 4 loc $ 4 vndnum 4 manufnum $ 20 vendinfo $ 80; </SPAN></P><P>  infile '/folders/myfolders/ItemstrSM.txt' missover;</P><P>  input  #1 itm $ itemnum itemdesc $ &</P><P>            #2 inac $ assetcl $ invcl dspunit $ ordunit $ convr loc $ vndnum manufnum </P><P>           #3 vendinfo & $ ; </P><P>run;</P><P></P><P></P><P>proc print data=myfile noobs;</P><P>run;</P><P></P><P></P><P>SAMPLE OF RAW DATA.....</P><P></P><P></P><P> Time: 1:47pm                                      Item Master Report For 06/06/2013                                 Report: GMRIMMSB</P><P></P><P></P><P>Item Type: Nonstock</P><P></P><P></P><P>Item  Asset  Inven  Dsp   ---Order---  ---Primary----                           Substute     Contract     Hazd   Count     </P><P>Stat  Class  Class  Unt   Unit   Conv   Loc    Vendor        Manufacturer Nbr   Item Nbr      Number      Flag   Cycle  </P><P>------------------------------------------------------------------------------------------------------------------------------------</P><P>  ITEM     20049 TEST PNEUMONIA S LATEX ZL22 (30859001)</P><P> A    0173    6      PK     PK       1   NSL   2431       R30859001                                                     </P><P>     Vendor  1:      2431 FISHER SCIENTIFIC COMPANY                 2:      2658 REMEL</P><P>             3:       536 ABBOTT LABS - DIAGNOSTIC DIVISION         4:      1404 MUREX DIAGNOSTICS INC.</P><P></P><P></P><P>  ITEM     20051 ANTIGEN BACTER. WELLCOGEN ZL26 B1901-51</P><P> A    0173    6      PK     PK       1   NSL   2431       30859602                                                      </P><P>     Vendor  1:      2431 FISHER SCIENTIFIC COMPANY                 2:      3804 CARDINAL HEALTH-ALLEGIANCE</P><P>             3:      2658 REMEL                                     4:       536 ABBOTT LABS - DIAGNOSTIC DIVISION</P><P>             5:      1404 MUREX DIAGNOSTICS INC.</P><P></P><P></P><P>  ITEM     20053 FILM DUPLICATING 10X12</P><P> I    0173    14     BX     BX       1   NSX   1335       112010                                                        </P><P>     Vendor  1:      1335 AGFA CORPORATION</P><P></P><P></P><P>  ITEM     20055 FILM HTU 10 X 12</P><P> I    0173    14     BX     BX       1   NSX   1335       094010                                                        </P><P>     Vendor  1:      1335 AGFA CORPORATION</P><P></P><P></P><P>  ITEM     20056 FILM HTU 8 X 10</P><P> I    0173    14     BX     BX       1   NSX   1335       094008                                                        </P><P>     Vendor  1:      1335 AGFA CORPORATION</P><P></P><P></P><P>  ITEM     20057 SOL AXSYM FLUIDIES CHECK (09A3401)</P><P> A    0173    119    BX     BX       1   NSL   536                                                                      </P><P>     Vendor  1:       536 ABBOTT LABS - DIAGNOSTIC DIVISION</P><P></P><P></P><P>  ITEM     20058 FILM DUPLICATING 8 X 10</P><P> I    0173    14     BX     BX       1   NSX   1335       112008                                                        </P><P>     Vendor  1:      1335 AGFA CORPORATION</P><P></P><P></P><P>  ITEM     20059 FILM HTU 14 X 17</P><P> I    0173    14     BX     BX       1   NSX   1335       094014                                                        </P><P>     Vendor  1:      1335 AGFA CORPORATION</P><P>Item  Asset  Inven  Dsp   ---Order---  ---Primary----                           Substute     Contract     Hazd   Count     </P><P>Stat  Class  Class  Unt   Unit   Conv   Loc    Vendor        Manufacturer Nbr   Item Nbr      Number      Flag   Cycle  </P><P>------------------------------------------------------------------------------------------------------------------------------------</P><P></P><P></P><P>  ITEM     20060 FILM HTU 30 X 35</P><P> I    0173    14     BX     BX       1   NSX   1335       094030                                                        </P><P>     Vendor  1:      1335 AGFA CORPORATION</P><P></P><P></P><P>  ITEM     20061 FILM HTU 14 X 14</P><P> I    0173    14     BX     BX       1   NSX   1335       094001                                                        </P><P>     Vendor  1:      1335 AGFA CORPORATION</P></BODY></HTML> Wed, 28 Jan 2015 02:04:23 GMT Nyioves 2015-01-28T02:04:23Z Line pointers with raw data with inconsistent lines and embedded headers https://communities.sas.com/t5/SAS-Enterprise-Guide/Line-pointers-with-raw-data-with-inconsistent-lines-and-embedded/m-p/141155#M11326 <HTML><HEAD></HEAD><BODY><P>The raw data I want to read not only runs across several different lines but also doesn't have the same number of lines per record. To further complicate things it also has headers that appear in the middle of the file after every page that ruin everything. here is code so far in sas studio...</P><P></P><P></P><P></P><P></P><P></P><P></P><P>`libname mylib '/folders/myfolders/';</P><P></P><P></P><P>data myfile;</P><P>  length itm $ 4 itemnum 5 itemdesc $ 40 inac $ 2 assetcl $ 4 invcl 3 dspunit $ 2<SPAN style="font-size: 10pt; line-height: 1.5em;">ordunit $ 2 convr 4 loc $ 4 vndnum 4 manufnum $ 20 vendinfo $ 80; </SPAN></P><P>  infile '/folders/myfolders/ItemstrSM.txt' missover;</P><P>  input  #1 itm $ itemnum itemdesc $ &</P><P>            #2 inac $ assetcl $ invcl dspunit $ ordunit $ convr loc $ vndnum manufnum </P><P>           #3 vendinfo & $ ; </P><P>run;</P><P></P><P></P><P>proc print data=myfile noobs;</P><P>run;</P><P></P><P></P><P>SAMPLE OF RAW DATA.....</P><P></P><P></P><P> Time: 1:47pm                                      Item Master Report For 06/06/2013                                 Report: GMRIMMSB</P><P></P><P></P><P>Item Type: Nonstock</P><P></P><P></P><P>Item  Asset  Inven  Dsp   ---Order---  ---Primary----                           Substute     Contract     Hazd   Count     </P><P>Stat  Class  Class  Unt   Unit   Conv   Loc    Vendor        Manufacturer Nbr   Item Nbr      Number      Flag   Cycle  </P><P>------------------------------------------------------------------------------------------------------------------------------------</P><P>  ITEM     20049 TEST PNEUMONIA S LATEX ZL22 (30859001)</P><P> A    0173    6      PK     PK       1   NSL   2431       R30859001                                                     </P><P>     Vendor  1:      2431 FISHER SCIENTIFIC COMPANY                 2:      2658 REMEL</P><P>             3:       536 ABBOTT LABS - DIAGNOSTIC DIVISION         4:      1404 MUREX DIAGNOSTICS INC.</P><P></P><P></P><P>  ITEM     20051 ANTIGEN BACTER. WELLCOGEN ZL26 B1901-51</P><P> A    0173    6      PK     PK       1   NSL   2431       30859602                                                      </P><P>     Vendor  1:      2431 FISHER SCIENTIFIC COMPANY                 2:      3804 CARDINAL HEALTH-ALLEGIANCE</P><P>             3:      2658 REMEL                                     4:       536 ABBOTT LABS - DIAGNOSTIC DIVISION</P><P>             5:      1404 MUREX DIAGNOSTICS INC.</P><P></P><P></P><P>  ITEM     20053 FILM DUPLICATING 10X12</P><P> I    0173    14     BX     BX       1   NSX   1335       112010                                                        </P><P>     Vendor  1:      1335 AGFA CORPORATION</P><P></P><P></P><P>  ITEM     20055 FILM HTU 10 X 12</P><P> I    0173    14     BX     BX       1   NSX   1335       094010                                                        </P><P>     Vendor  1:      1335 AGFA CORPORATION</P><P></P><P></P><P>  ITEM     20056 FILM HTU 8 X 10</P><P> I    0173    14     BX     BX       1   NSX   1335       094008                                                        </P><P>     Vendor  1:      1335 AGFA CORPORATION</P><P></P><P></P><P>  ITEM     20057 SOL AXSYM FLUIDIES CHECK (09A3401)</P><P> A    0173    119    BX     BX       1   NSL   536                                                                      </P><P>     Vendor  1:       536 ABBOTT LABS - DIAGNOSTIC DIVISION</P><P></P><P></P><P>  ITEM     20058 FILM DUPLICATING 8 X 10</P><P> I    0173    14     BX     BX       1   NSX   1335       112008                                                        </P><P>     Vendor  1:      1335 AGFA CORPORATION</P><P></P><P></P><P>  ITEM     20059 FILM HTU 14 X 17</P><P> I    0173    14     BX     BX       1   NSX   1335       094014                                                        </P><P>     Vendor  1:      1335 AGFA CORPORATION</P><P>Item  Asset  Inven  Dsp   ---Order---  ---Primary----                           Substute     Contract     Hazd   Count     </P><P>Stat  Class  Class  Unt   Unit   Conv   Loc    Vendor        Manufacturer Nbr   Item Nbr      Number      Flag   Cycle  </P><P>------------------------------------------------------------------------------------------------------------------------------------</P><P></P><P></P><P>  ITEM     20060 FILM HTU 30 X 35</P><P> I    0173    14     BX     BX       1   NSX   1335       094030                                                        </P><P>     Vendor  1:      1335 AGFA CORPORATION</P><P></P><P></P><P>  ITEM     20061 FILM HTU 14 X 14</P><P> I    0173    14     BX     BX       1   NSX   1335       094001                                                        </P><P>     Vendor  1:      1335 AGFA CORPORATION</P></BODY></HTML> Wed, 28 Jan 2015 02:04:23 GMT https://communities.sas.com/t5/SAS-Enterprise-Guide/Line-pointers-with-raw-data-with-inconsistent-lines-and-embedded/m-p/141155#M11326 Nyioves 2015-01-28T02:04:23Z Re: Line pointers with raw data with inconsistent lines and embedded headers https://communities.sas.com/t5/SAS-Enterprise-Guide/Line-pointers-with-raw-data-with-inconsistent-lines-and-embedded/m-p/141156#M11327 <HTML><HEAD></HEAD><BODY><P>Welcome to the world of fun coding. If a point-and-click interface ever gets to point where it can generate code for such situations (at least without having the code that wrote this type of data) the developer can say they have something.</P><P></P><P>One general approach is to use one of the SAS automatic variables called _infile_, which has the entire current "line" of input data.</P><P>You can search this variable for content of interest.</P><P>A brief example:</P><P>do until (scan(_infile_,1) = "ITEM");</P><P>     input;</P><P>end;</P><P>Else do;</P><P>     /* this where the actual reading would occur*/</P><P>    <STRONG> OUTPUT; </STRONG>/* explicit OUTPUT after successful reading so that is the only output in the dataset*/</P><P>end;</P><P>This advances through the file until it finds a line that starts with ITEM, the header rows that start with Item are ignored due to case difference.</P><P>The meat of your program would be to read that item information. After reading the two lines of data you could then test for the presence of : to find your vendors. The Else block should have a test for 2: , 4: , 6: (guessing here and not sure how many you might have) that might indicate another row of vendors.</P><P></P><P>Have fun.</P></BODY></HTML> Wed, 28 Jan 2015 16:18:28 GMT https://communities.sas.com/t5/SAS-Enterprise-Guide/Line-pointers-with-raw-data-with-inconsistent-lines-and-embedded/m-p/141156#M11327 ballardw 2015-01-28T16:18:28Z