SAS Data Integration Studio, DataFlux Data Management Studio, SAS/ACCESS, SAS Data Loader for Hadoop and others

Reading a flat file present in HDFS (Hadoop)

Reply
New Contributor
Posts: 3

Reading a flat file present in HDFS (Hadoop)

Hi, I have a flat file placed in HDFS file system. I would like to read this file in my SAS program. I want to harness the the power of parellal processing in Hadoop eco system in order to reduce time drastically. Can you please help how I can achieve this. Thanks!!
Super User
Posts: 5,424

Re: Reading a flat file present in HDFS (Hadoop)

Posted in reply to Renganathan

Filename hadoop will give you the ability to read the file, but the processing will take place on the SAS "client".

One way to go is to register the file into Hive, then you can use SAS/ACCESS to Hadoop to pass through a significant amount of processing to the Hadoop cluster.

Also, there are other options, depending on your requirements and constraints.

What SAS licenses do you have?

Data never sleeps
Ask a Question
Discussion stats
  • 1 reply
  • 509 views
  • 0 likes
  • 2 in conversation