SAS Data Integration Studio, DataFlux Data Management Studio, SAS/ACCESS, SAS Data Loader for Hadoop and others

Hadoop, Yarn and Embedded Process

Reply
Frequent Learner
Posts: 1

Hadoop, Yarn and Embedded Process

[ Edited ]

Hi all,

I am using SAS and Hadoop (SAS "in" Hadoop mode).

I have a SAS Embedded process setup working on an secure Hadoop Cluster, with Kerberos and Yarn Queue management.

I need to specify a particular queue name (Yarn properties: mapred.job.queue.name) in order to schedule SAS yarn application in the right queue on the cluster

 

How can I set this property within  Embedded Process?

 

Thanks,

Lorenzo

SAS Employee
Posts: 16

Re: Hadoop, Yarn and Embedded Process

[ Edited ]

Great question LorenzoMerli

 

A way to accomplish that is to use the PROPERTIES statement as I have in the LIBNAME statement. I realize you are asking how to set this at the Embedded Process level and for that I need to research.

 

libname queues hadoop
server=&hiveserver
user=&hiveuser
database=default
PROPERTIES="mapreduce.job.queuename=root;mapreduce.map.memory.mb=2048";

Ask a Question
Discussion stats
  • 1 reply
  • 1058 views
  • 0 likes
  • 2 in conversation