topic Hadoop, Yarn and Embedded Process in SAS Data Management

Hadoop, Yarn and Embedded Process

LorenzoMerli — Wed, 18 Jan 2017 16:29:37 GMT

Hi all,

I am using SAS and Hadoop (SAS "in" Hadoop mode).

I have a SAS Embedded process setup working on an secure Hadoop Cluster, with Kerberos and Yarn Queue management.

I need to specify a particular queue name (Yarn properties: mapred.job.queue.name) in order to schedule SAS yarn application in the right queue on the cluster

How can I set this property within Embedded Process?

Thanks,

Lorenzo

Re: Hadoop, Yarn and Embedded Process

SteveSober — Wed, 18 Jan 2017 16:30:04 GMT

Great question LorenzoMerli.

A way to accomplish that is to use the PROPERTIES statement as I have in the LIBNAME statement. I realize you are asking how to set this at the Embedded Process level and for that I need to research.

libname queues hadoop
server=&hiveserver
user=&hiveuser
database=default
PROPERTIES="mapreduce.job.queuename=root;mapreduce.map.memory.mb=2048";