About pkm_edu

pkm_edu · ‎06-09-2023

A call to PRXPOSN in the code snippet below gives me the capture buffer's START value (where regex begins matching) of 30 and the END value (which represents the length of matching string) value of 4 (output below). However, when I count the number of characters from left to right in the output (html_line string), I find the START value to be 22. Question 1: Why do these two numbers not match? Thanks, filename source temp; proc http url = "https://meps.ahrq.gov/data_stats/download_data_files.jsp" out=source; run; data year_values; length year $4; infile source length = reclen lrecl = 32767 end=eof; re = prxparse('/<option value="\d{4}">(\d{4})<\/option>/'); /* Read the HTML line by line */ do while (not eof); input html_line $varying32767. reclen; Len_html_line = length(html_line); /* Match and extract the years using regular expressions */ if prxmatch(re, html_line) > 0 then do; call prxposn(re, 1, start, end); year = substr(html_line, start, end); output year_values; end; end; run; proc print data=year_values noobs; var Len_html_line html_line start end year; run; The Output: Len_ html_ line html_line start end year 42 <option value="2021">2021</option> 30 4 2021 42 <option value="2020">2020</option> 30 4 2020 42 <option value="2019">2019</option> 30 4 2019 42 <option value="2018">2018</option> 30 4 2018 42 <option value="2017">2017</option> 30 4 2017 42 <option value="2016">2016</option> 30 4 2016 42 <option value="2015">2015</option> 30 4 2015 42 <option value="2014">2014</option> 30 4 2014 42 <option value="2013">2013</option> 30 4 2013 42 <option value="2012">2012</option> 30 4 2012 42 <option value="2011">2011</option> 30 4 2011 42 <option value="2010">2010</option> 30 4 2010 42 <option value="2009">2009</option> 30 4 2009 42 <option value="2008">2008</option> 30 4 2008 42 <option value="2007">2007</option> 30 4 2007 42 <option value="2006">2006</option> 30 4 2006 42 <option value="2005">2005</option> 30 4 2005 42 <option value="2004">2004</option> 30 4 2004 42 <option value="2003">2003</option> 30 4 2003 42 <option value="2002">2002</option> 30 4 2002 42 <option value="2001">2001</option> 30 4 2001 42 <option value="2000">2000</option> 30 4 2000 42 <option value="1999">1999</option> 30 4 1999 42 <option value="1998">1998</option> 30 4 1998 42 <option value="1997">1997</option> 30 4 1997 42 <option value="1996">1996</option> 30 4 1996

pkm_edu · ‎05-02-2023

Thank you so much for explaining the code.

pkm_edu · ‎05-01-2023

Thanks to PGStat! This is certainly an interesting solution. Could you please explain the code below if possible? if not id then id + prxParse('|value="(HC-\w+)".*(HC-\w+).*</option>|i'); if prxmatch(id, string) then do; file_id = prxPosn(id, 1, string); file_id_x = prxPosn(id, 2, string);

pkm_edu · ‎05-01-2023

How about replacing the following two statements position = prxmatch('m/"HC-\w+/i',string); if position ^= 0 then do; with this statement below? if find(string,'HC-')>0 then do;

pkm_edu · ‎05-01-2023

Thanks to Qoit and Ballardw. I revised the solution suggested by Qoit to accommodate additional scenarios (the last two records) from the data. My code revisions include the LENGTH() in the third argument of the SUBSTR(). Any other solutions (e.g., regex) are welcome. data test; length file_id $ 10; infile datalines length = reclen; input string $varying32767. reclen; position = prxmatch('m/"HC-\w+/i',string); if position ^= 0 then do; file_id = scan(string, 2, '"'); file_id_x = scan(string, 2, '>'); if file_id_x =: "ME" then file_id_x = substr(file_id_x,6,LENGTH(file_id)); else if file_id_x =: "H" then file_id_x = substr(file_id_x,1,LENGTH(file_id)); output; end; datalines; <option value="HC-220A">MEPS HC-220A: 2020 Prescribed Medicines File</option> <option value="HC-224">MEPS HC-219: 2020 Full Year Population Characteristics File</option> <option value="HC-010I">HC-010I Appendix to MEPS 1996 Event Files</option> <option value="HC-036BRR">MEPS HC-036BRR: MEPS 1996-2020 Replicate File for BRR Variance Estimation</option> <td width="76" height="0"><strong><label for="datatype2"><span class="small">File type:</label></strong></span></td> ; run; proc print data=test; var file_id file_id_x; run; Obs file_id file_id_x 1 HC-220A HC-220A 2 HC-224 HC-219 3 HC-010I HC-010I 4 HC-036BRR HC-036BRR 1 HC-220A HC-220A 2 HC-224 HC-219 3 HC-010I HC-010I 4 HC-036BRR HC-036BRR

pkm_edu · ‎05-01-2023

The program below creates variables using PRXMATCH() and SCAN() in SAS 9.4 M6. The output for the variable FILE_ID seems to be correct while the values for FILE_ID_X are incorrect. data test; length file_id $ 10; infile datalines length = reclen; input string $varying32767. reclen; position = prxmatch('m/"HC-\w+/i',string); position2 = prxmatch('m/[HC]-\w+ /i',string); if position ^= 0 then do; file_id = scan(string, 2, '"'); file_id_x = scan(string, 2, '>'); output; end; datalines; <option value="HC-220A">MEPS HC-220A: 2020 Prescribed Medicines File</option> <option value="HC-224">MEPS HC-219: 2020 Full Year Population Characteristics File</option> <option value="HC-010I">HC-010I Appendix to MEPS 1996 Event Files</option> ; run; options nocenter ls=132; options obs=max; proc print data=test; var file_id: ; run; The current PROC PRINT output: Obs file_id file_id_x 1 HC-220A MEPS HC-220A: 2020 Prescribed Medicines File</option 2 HC-224 MEPS HC-219: 2020 Full Year Population Characteristics File</option 3 HC-010I HC-010I Appendix to MEPS 1996 Event Files</option The desired PROC PRINT output: Obs file_id file_id_x 1 HC-220A HC-220A 2 HC-224 HC-219 3 HC-010I HC-010I Question: What changes would I make to the program to get the desired output for FILE_ID_X? Any help would be appreciated. Thank you,

pkm_edu · ‎03-29-2023

Hello, Thank you so much for your willingness to review the manuscript. How would I send it to you?

pkm_edu · ‎03-29-2023

I am looking for a reviewer willing to review at least the SAS component of the paper (PROC HTTP, DATA Step, PROC SQL, and SAS Macro) and provide me with comments. My co-author and I are considering this paper for possible submission to a SAS Users Group Conference.

pkm_edu · ‎03-29-2023

I'm looking for a reviewer for a paper on Web Scraping with SAS and Python. The SAS component of the paper involves the use of PROC HTTP. SAS macro, and SAS DATA step. The Python part involves the use of Beautiful Soup and requests libraries. Please let me know if you are interested in reviewing at least the SAS part of the manuscript. Thanks.

pkm_edu · ‎02-22-2023

Hi Tom. Thanks for the clarification.

pkm_edu · ‎02-22-2023

Thanks, Tom. Your code has worked. However, I am trying to understand the usage of the DELETE statement within the IF-THEN-DO-END block? Is this statement telling SAS to delete the observations with missing values?

pkm_edu · ‎02-22-2023

Hello, What changes would I make to the DATA step below to get the output appended below? Thanks, data test; infile datalines DSD missover; input name:$13. School: $30.; datalines; ,,Pinecrest Elementary School Craig Smith, Paula Johnson, Chung Wang, ; proc print; run; data test1; set test; retain _school; if not missing(school) then _school=school; else school = _school; drop _school; run; proc print data=test1; run; (Desired output, not generated by the above code blocks) Obs name School 1 Craig Smith Pinecrest Elementary School 2 Paula Johnson Pinecrest Elementary School 3 Chung Wang Pinecrest Elementary School

pkm_edu · ‎02-21-2023

Thanks,

pkm_edu · ‎02-13-2023

Hi ballardw, Thank you for revising my code. Your revised code provides me with desired results. data _null_; input string $char120.; position=prxmatch('m/"HC-\d{3,}/i',string); if find(string,'replaced','i')>0 or find(string,'cd-rom','i')>0 then position=0; put (_ALL_) (=/); datalines;

pkm_edu · ‎02-13-2023

Hi ballardw (Super User), Thanks for your code. Sorry for the typos. I have corrected PARREN and PATERN as POSITION. I aim to create a SAS data set from a PROC HTTP-generated output text file using an IF-THEN DELETE statement. But first, I want to create a POSITION variable using the PRXMATCH function using the variable STRING (Please see the code in the DATA step below). I desire SAS to return a non-zero value for the POSITION variable if the STRING contains text like “HC-226, “HC-085A, or “HC-028 provided the STRING value does not contain Replaced or CD-ROM. Otherwise, I want SAS to return a zero for the POSITION variable. However, if the STRING value contains text like Replaced or CD-ROM, I want a zero for the POSITION variable. My first attempt seems to work if the STRING contains the text like the following: “HC-226, “HC-085A, “HC-028 … and the STRING value does not contain Replaced or CD-ROM. position=prxmatch('m/"HC-\d{3,}/i',string); Issue: I don’t know how to modify the above code to get a zero for the POSITION variable if the STRING value contains text like Replaced or CD-ROM.

Online Status	Offline
Date Last Visited	‎08-18-2024 12:44 AM

Re: proc transpose ID value occurs twice in same BY group

Re: proc transpose ID value occurs twice in same BY group

Re: proc transpose ID value occurs twice in same BY group

Re: How to remove the quotes from a horizontal list of values of a mac...

How to remove the quotes from a horizontal list of values of a macro v...

Re: How to avoid the WARNING: Apparent invocation of macro xx not res...

Re: How to avoid the WARNING: Apparent invocation of macro xx not res...

Re: How to avoid the WARNING: Apparent invocation of macro xx not res...

Re: How to avoid the WARNING: Apparent invocation of macro xx not res...

How to avoid the WARNING: Apparent invocation of macro xx not resolve...

PRXPOSN Capture Buffer Start Value

Re: Creating variables using PRXMATCH() and SCAN()

Re: Creating variables using PRXMATCH() and SCAN()

Re: Creating variables using PRXMATCH() and SCAN()

Re: Creating variables using PRXMATCH() and SCAN()

Creating variables using PRXMATCH() and SCAN()

Re: Request for Paper Review

Wanted: Reviewer for a manuscript on Web Scraping with SAS and Python ...

Request for Paper Review

Re: Fill missing values with the previous values

Re: Fill missing values with the previous values

Re: Fill missing values with the previous values

Re: SASPy and SAS OnDemand for Academics - Connection Issue

Re: Modifying the PRXMARCH Function

Re: Modifying the PRXMARCH Function