SAS Data Integration Studio, DataFlux Data Management Studio, SAS/ACCESS, SAS Data Loader for Hadoop and others

SAS Mapreduce Wordcount example Jar and class

Reply
Occasional Contributor
Posts: 17

SAS Mapreduce Wordcount example Jar and class

Hi,

 

I am trying to run map reduce wordcount example as shown in below example.

 

But I donot have wordcount jar available. 

 

http://support.sas.com/documentation/cdl/en/proc/70377/HTML/default/viewer.htm#p0pxnmn7ufoi1vn11sqyw...

 

Can I request you to share the wordcount Jar and its appropriate classes.

My SAS Hadoop set up is as follows:

 

SAS 9.4 

Cloudera CDH5.8 VM

Both are connected well and HDFS configuration are correct as HDFS commands are working properly.

 

 

Thanks,

Ashish Jain 

 

SAS Employee
Posts: 203

Re: SAS Mapreduce Wordcount example Jar and class

Hi @ajain59

 

The wordcount JAR will be on the cluster somewhere. There may be a way of getting it off the web. Here is an example which shows the general form of the JAR name (it is in the comments):

 

/* Run the Word Count sample program on Moby **bleep** */
/* hadoop-examples-1.2.0.1.3.0.0-96.jar */

proc hadoop options=cfg user="bob"  verbose;
  mapreduce input='/user/bob/Books/moby_dick.txt' 
     output='/user/bob/outBook' 
     jar='C:\Hadoop_examples\hadoop-examples-1.2.0.1.3.0.0-96.jar' 
     outputkey="org.apache.hadoop.io.Text" 
     outputvalue="org.apache.hadoop.io.IntWritable" 
     reduce="org.apache.hadoop.examples.WordCount$IntSumReducer" 
     combine="org.apache.hadoop.examples.WordCount$IntSumReducer" 
     map="org.apache.hadoop.examples.WordCount$TokenizerMapper";
run;

Best wishes,

Jeff

Ask a Question
Discussion stats
  • 1 reply
  • 310 views
  • 0 likes
  • 2 in conversation