BookmarkSubscribeRSS Feed
dereck255
Fluorite | Level 6

At work, was asked a question about SAS and not sure of the answer. Basically, we want to SAS to search the internet (maybe just clinicaltrials.gov) or RSS feeds (RSS is probably easier) to see when companies post about their new studies using various search terms (like, hypertension). SAS can run this overnight and would email us the results every morning. I can do the email and overnight code, but I have no clue how to do this potentially text mining procedure with only using SAS 9. Sounds pretty easy, but not sure where to start. Any ideas?

2 REPLIES 2
ChrisNZ
Tourmaline | Level 20

You'll need to use the usual text manipulation functions: find(), scan(), spelling distances, and so on, to analyse the pages.

 

You'll also need to access and read the web sites. Look at : filename method URL & proc http.

AlanC
Barite | Level 11

Consider gathering the data outside of SAS and then use SAS for analysis. Languages such as C# and Python are much better at web technologies such as REST, RSS, etc. Dump to tab-delimited files or an RDBMS then have SAS chug away at it.

 

This is a good case, IMO, or combo technologies vs relying on one or another. There are also existing tools that can do the monitoring vs rolling your own. Command l;ine them then have SAS execute them for you.

 

https://github.com/savian-net

sas-innovate-2024.png

Join us for SAS Innovate April 16-19 at the Aria in Las Vegas. Bring the team and save big with our group pricing for a limited time only.

Pre-conference courses and tutorials are filling up fast and are always a sellout. Register today to reserve your seat.

 

Register now!

How to Concatenate Values

Learn how use the CAT functions in SAS to join values from multiple variables into a single value.

Find more tutorials on the SAS Users YouTube channel.

Click image to register for webinarClick image to register for webinar

Classroom Training Available!

Select SAS Training centers are offering in-person courses. View upcoming courses for:

View all other training opportunities.

Discussion stats
  • 2 replies
  • 638 views
  • 0 likes
  • 3 in conversation