topic Following Demo in 3.2 - Executing Pig Script in Grunt: Error is Cannot Find .csv Data in SAS Academy for Data Science

Following Demo in 3.2 - Executing Pig Script in Grunt: Error is Cannot Find .csv Data

Venus-labs — Sat, 24 Apr 2021 21:15:35 GMT

When attempting to execute the following script to load data from census_2010.csv and display dump limit for five records:

The following "failed to read data" error is generated as input path cannot be found:

The census_2010.csv file does exist in the following path when viewed in file explorer:

I tried specifying '/user/student/workshop/dihdm/data/census_2010.csv' but this did not work. What path should I specify in order to get the data read successfully in Grunt?

Thank you.

Re: Following Demo in 3.2 - Executing Pig Script in Grunt: Error is Cannot Find .csv Data

DavidGhan — Tue, 27 Apr 2021 13:45:15 GMT

The Pig program is looking for a location in HDFS to find that data. It seems you need to complete an earlier step in the an earlier practice to copy the data into HDFS. That step copies the contents of several folders from the linux client machine to HDFS. To complete that step do the following:

Click (mRemoteNG) on the taskbar to open the application, if required.
Double-click student@HadoopClient to open the connection to the Hadoop client.
Submit the command:

hdfs dfs -put /workshop/dihdm/data /user/student/dihdm

That copies data into HDFS, including the '/user/student/dihdm/data/census_2010.csv' file.

Re: Following Demo in 3.2 - Executing Pig Script in Grunt: Error is Cannot Find .csv Data

Venus-labs — Tue, 27 Apr 2021 16:20:30 GMT

Thank you so much, David! I need to remember to do this every time I start the a new "fresh" client session.