Scarping Web Data on District Clerks Website

watsoninvest — Mon, 28 Mar 2022 16:29:15 GMT

Hello,

I am attempting to utilized SAS to created a code that obtain the data from the clerk directory to help make my co-workers job easier and help make it easier to inform them about this important new update regarding vital records. I review several articles and am stuck on the step involving the processing/parse the web page contents to gather the data. I have made some progress but I am not sure how to create a data steps that allows me to actually read formName, formCounty, formJobTitle, and formEMail

I am attempting to to pull Clerk Name, Job Title, County, and Email from this webpage: https://www.cdcatexas.com/Directory/Clerks

* Pull out Clerk Name, Job Title, County, and Email;

filename src temp ; 
proc http
method="GET"
url="https://www.cdcatexas.com/Directory/Clerks"
out=src;
run;

/* Read the entire file and skip the blank lines */
/* the LEN indicator tells us the length of each line */

data rep;
infile src length=len lrecl=32767;
input line $varying32767. len;
line = strip(line);
if len>0;
run;

Re: Scarping Web Data on District Clerks Website

JosvanderVelden — Mon, 28 Mar 2022 17:18:34 GMT

You'll probably have to study the javascript that runs when clicking on the buttons on the page.
That is what allows you to see the names on the page. The file is https://www.cdcatexas.com/js/clerks.min.js .

Best regards, Jos

Re: Scarping Web Data on District Clerks Website

watsoninvest — Fri, 01 Apr 2022 14:08:44 GMT

Thanks for your tip.

topic Re: Scarping Web Data on District Clerks Website in SAS Programming

Scarping Web Data on District Clerks Website

Re: Scarping Web Data on District Clerks Website

Re: Scarping Web Data on District Clerks Website