topic Re: failing web scraping: proc http in SAS Programming

failing web scraping: proc http

dcortell — Fri, 10 Sep 2021 16:34:00 GMT

Hi all

The following lines are causing the linked errors:

MPRINT(EXTRACT): filename src temp;
MPRINT(EXTRACT): proc http url="http://news.dc-sug.org" out=src;
MPRINT(EXTRACT): run;

ERROR: Host name resolution failed

MPRINT(EXTRACT): filename src temp;
MPRINT(EXTRACT): proc http url="http://cities4pointzero.com/webinar/webinar_page/3336" out=src;
MPRINT(EXTRACT): run;

NOTE: 302 Moved Temporarily
ERROR: Generic HTTP Client Error

Any idea about what is causing them and how to avoid it ?

Bests

Sajid01 — Fri, 10 Sep 2021 18:41:13 GMT

1.Error 1

MPRINT(EXTRACT): proc http url="http://news.dc-sug.org" out=src;
MPRINT(EXTRACT): run;

ERROR: Host name resolution failed.
Basically this means that this address could not be found.( When I clicked the above link the side did not open).

2.Error 2

MPRINT(EXTRACT): proc http url="http://cities4pointzero.com/webinar/webinar_page/3336" out=src;
MPRINT(EXTRACT): run;

NOTE: 302 Moved Temporarily

This means that the site has been moved to a different location. If you click the link, you may be redirected to that location.

dcortell — Fri, 10 Sep 2021 20:06:11 GMT

Mmm…ok, I was taking the redirect url as the initial one, and didn’t notice
it was a different one.

Thanks for clarifying