Following Demo in 3.2 - Executing Pig Script in Grunt: Error is Cannot Find .csv Data

[Venus-labs]

When attempting to execute the following script to load data from census_2010.csv and display dump limit for five records:

The following "failed to read data" error is generated as input path cannot be found:

The census_2010.csv file does exist in the following path when viewed in file explorer:

I tried specifying '/user/student/workshop/dihdm/data/census_2010.csv' but this did not work. What path should I specify in order to get the data read successfully in Grunt?

Thank you.

[DavidGhan · Accepted solution]

The Pig program is looking for a location in HDFS to find that data. It seems you need to complete an earlier step in the an earlier practice to copy the data into HDFS. That step copies the contents of several folders from the linux client machine to HDFS. To complete that step do the following:

3. Click (mRemoteNG) on the taskbar to open the application, if required.
4. Double-click student@HadoopClient to open the connection to the Hadoop client.
5. Submit the command:

         hdfs dfs  -put    /workshop/dihdm/data    /user/student/dihdm

That copies data into HDFS, including the '/user/student/dihdm/data/census_2010.csv' file.

[Venus-labs]

Thank you so much, David! I need to remember to do this every time I start the a new "fresh" client session.