BookmarkSubscribeRSS Feed
Renganathan
Calcite | Level 5
Hi, I have a flat file placed in HDFS file system. I would like to read this file in my SAS program. I want to harness the the power of parellal processing in Hadoop eco system in order to reduce time drastically. Can you please help how I can achieve this. Thanks!!
1 REPLY 1
LinusH
Tourmaline | Level 20

Filename hadoop will give you the ability to read the file, but the processing will take place on the SAS "client".

One way to go is to register the file into Hive, then you can use SAS/ACCESS to Hadoop to pass through a significant amount of processing to the Hadoop cluster.

Also, there are other options, depending on your requirements and constraints.

What SAS licenses do you have?

Data never sleeps

sas-innovate-2024.png

Available on demand!

Missed SAS Innovate Las Vegas? Watch all the action for free! View the keynotes, general sessions and 22 breakouts on demand.

 

Register now!

How to connect to databases in SAS Viya

Need to connect to databases in SAS Viya? SAS’ David Ghan shows you two methods – via SAS/ACCESS LIBNAME and SAS Data Connector SASLIBS – in this video.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 1 reply
  • 1693 views
  • 0 likes
  • 2 in conversation