BookmarkSubscribeRSS Feed
mliem
Calcite | Level 5

Does data need to be ingested through SAS data loader in order to provide all the features listed here: (browse data, DQ profiling, etcC)

 

https://communities.sas.com/t5/SAS-Data-Management-Library/You-can-do-what-with-SAS-Data-Loader-for-...

 

Or can it just be integrated on an existing hadoop platform with data in hdfs. We already have an ingestion/ETL tool for all our data in and out of hadoop so not looking for another one. 

 

 

2 REPLIES 2
LinusH
Tourmaline | Level 20

Short answer: yes.

More elaborately: ETL is usefully a tool for a centrally managed repository, such as a data warehouse- A place where everything is integrated, and possible to audit. Big Data on the other hand is a more free environment, where you should be able to quickly analyze different kind of data. Ad hoc analysis and, perhaps even ad hoc loading of data. So this is where I think Data Loader is positioned. It's not positioned as an ETL tool (but technically, it is kinda).

Data never sleeps
RonAgresta
SAS Employee

Assuming your Hadoop environment meets the specifications for SAS Data Loader, you don't actually need to ingest data through SAS Data Loader to use its features. SAS Data Loader can work with data that has been put in Hadoop by any tool as long as the data has been registered in Hive. More specifically, you need to have the data layout described in HCatalog in Hive. If you have data in HDFS that has not been described in Hive you can use tools like Hue to describe the data in HDFS.


Ron

sas-innovate-2024.png

Join us for SAS Innovate April 16-19 at the Aria in Las Vegas. Bring the team and save big with our group pricing for a limited time only.

Pre-conference courses and tutorials are filling up fast and are always a sellout. Register today to reserve your seat.

 

Register now!

How to connect to databases in SAS Viya

Need to connect to databases in SAS Viya? SAS’ David Ghan shows you two methods – via SAS/ACCESS LIBNAME and SAS Data Connector SASLIBS – in this video.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 2 replies
  • 837 views
  • 0 likes
  • 3 in conversation