Scarping Web Data on District Clerks Website

[watsoninvest]

Hello, 

I am attempting to utilized SAS to created a code that obtain the data from the clerk directory to help make my co-workers job easier and help make it easier to inform them about this important new update regarding vital records. I review several articles and am stuck on the step involving the processing/parse the web page contents to gather the data. I have made some progress but I am not sure how to create a data steps that allows me to actually read formName, formCounty, formJobTitle, and formEMail

I am attempting to to pull Clerk Name, Job Title, County, and Email from this webpage: https://www.cdcatexas.com/Directory/Clerks

* Pull out Clerk Name, Job Title, County, and Email;

filename src temp ; 
proc http
method="GET"
url="https://www.cdcatexas.com/Directory/Clerks"
out=src;
run;

/* Read the entire file and skip the blank lines */
/* the LEN indicator tells us the length of each line */

data rep;
infile src length=len lrecl=32767;
input line $varying32767. len;
line = strip(line);
if len>0;
run;

[JosvanderVelden · Accepted solution]

You'll probably have to study the javascript that runs when clicking on the buttons on the page.
That is what allows you to see the names on the page. The file is https://www.cdcatexas.com/js/clerks.min.js .

Best regards, Jos

[watsoninvest]

Thanks for your tip.