Hi, I have a flat file placed in HDFS file system. I would like to read this file in my SAS program. I want to harness the the power of parellal processing in Hadoop eco system in order to reduce time drastically. Can you please help how I can achieve this. Thanks!!
Filename hadoop will give you the ability to read the file, but the processing will take place on the SAS "client".
One way to go is to register the file into Hive, then you can use SAS/ACCESS to Hadoop to pass through a significant amount of processing to the Hadoop cluster.
Also, there are other options, depending on your requirements and constraints.
What SAS licenses do you have?
Data never sleeps
Don't miss out on SAS Innovate - Register now for the FREE Livestream!
Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.
Need to connect to databases in SAS Viya? SAS’ David Ghan shows you two methods – via SAS/ACCESS LIBNAME and SAS Data Connector SASLIBS – in this video.