SAS Mapreduce Wordcount example Jar and class

ajain59 — Wed, 22 Mar 2017 09:15:25 GMT

Hi,

I am trying to run map reduce wordcount example as shown in below example.

But I donot have wordcount jar available.

http://support.sas.com/documentation/cdl/en/proc/70377/HTML/default/viewer.htm#p0pxnmn7ufoi1vn11sqywfltd9u7.htm

Can I request you to share the wordcount Jar and its appropriate classes.

My SAS Hadoop set up is as follows:

SAS 9.4

Cloudera CDH5.8 VM

Both are connected well and HDFS configuration are correct as HDFS commands are working properly.

Thanks,

Ashish Jain

Re: SAS Mapreduce Wordcount example Jar and class

JBailey — Tue, 25 Apr 2017 15:16:04 GMT

Hi @ajain59

The wordcount JAR will be on the cluster somewhere. There may be a way of getting it off the web. Here is an example which shows the general form of the JAR name (it is in the comments):

/* Run the Word Count sample program on Moby **bleep** */
/* hadoop-examples-1.2.0.1.3.0.0-96.jar */

proc hadoop options=cfg user="bob"  verbose;
  mapreduce input='/user/bob/Books/moby_dick.txt' 
     output='/user/bob/outBook' 
     jar='C:\Hadoop_examples\hadoop-examples-1.2.0.1.3.0.0-96.jar' 
     outputkey="org.apache.hadoop.io.Text" 
     outputvalue="org.apache.hadoop.io.IntWritable" 
     reduce="org.apache.hadoop.examples.WordCount$IntSumReducer" 
     combine="org.apache.hadoop.examples.WordCount$IntSumReducer" 
     map="org.apache.hadoop.examples.WordCount$TokenizerMapper";
run;

Best wishes,

Jeff

topic SAS Mapreduce Wordcount example Jar and class in SAS Data Management

SAS Mapreduce Wordcount example Jar and class

Re: SAS Mapreduce Wordcount example Jar and class