BookmarkSubscribeRSS Feed
LorenzoMerli
Calcite | Level 5

Hi all,

I am using SAS and Hadoop (SAS "in" Hadoop mode).

I have a SAS Embedded process setup working on an secure Hadoop Cluster, with Kerberos and Yarn Queue management.

I need to specify a particular queue name (Yarn properties: mapred.job.queue.name) in order to schedule SAS yarn application in the right queue on the cluster

 

How can I set this property within  Embedded Process?

 

Thanks,

Lorenzo

1 REPLY 1
SteveSober
SAS Employee

Great question LorenzoMerli

 

A way to accomplish that is to use the PROPERTIES statement as I have in the LIBNAME statement. I realize you are asking how to set this at the Embedded Process level and for that I need to research.

 

libname queues hadoop
server=&hiveserver
user=&hiveuser
database=default
PROPERTIES="mapreduce.job.queuename=root;mapreduce.map.memory.mb=2048";

sas-innovate-2024.png

Available on demand!

Missed SAS Innovate Las Vegas? Watch all the action for free! View the keynotes, general sessions and 22 breakouts on demand.

 

Register now!

How to connect to databases in SAS Viya

Need to connect to databases in SAS Viya? SAS’ David Ghan shows you two methods – via SAS/ACCESS LIBNAME and SAS Data Connector SASLIBS – in this video.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 1 reply
  • 2295 views
  • 1 like
  • 2 in conversation