SAS and Hadoop > Lesson 2: Working with Hadoop Data using Hive and HiveQL - 2.3 Hive Serdes Activity

Venus-labs — Tue, 20 Apr 2021 18:07:32 GMT

I am getting the following error when trying to complete the activity to execute the following AVRO code:

Generic example:

My code and resulting error msg.:

Any suggestions are greatly appreciated.

Thank you,

-Doug

Re: SAS and Hadoop > Lesson 2: Working with Hadoop Data using Hive and HiveQL - 2.3 Hive Serdes A

DavidGhan — Thu, 22 Apr 2021 15:26:51 GMT

Hi Doug,

It looks like your code is correct but there are some steps from earlier in the course that need to be executed to create some objects and files that your program needs to read. Try opening up mRemoteNG and couble click the student@hadoopclient connection. That will open a linux command line where you can execute this:

hdfs dfs -put /workshop/dihdm/data /user/student/dihdm

Next, execute this Hive program in the Hive editor in Hue:

CREATE EXTERNAL TABLE IF NOT EXISTS dihdm.population_census(county string, population int) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' LOCATION '/user/student/dihdm/population_census';

Finally, in the File browser in Hue navigate to

/user/student/dihdm/population_census

And upload D:\Workshop\dihdm\data\census_2010.csv from the windows machine.

Then try your program again and see if it works.

topic Re: SAS and Hadoop > Lesson 2: Working with Hadoop Data using Hive and HiveQL - 2.3 Hive Serdes A in SAS Academy for Data Science

SAS and Hadoop > Lesson 2: Working with Hadoop Data using Hive and HiveQL - 2.3 Hive Serdes Activity

Re: SAS and Hadoop > Lesson 2: Working with Hadoop Data using Hive and HiveQL - 2.3 Hive Serdes A