BookmarkSubscribeRSS Feed
blast
Fluorite | Level 6

Hi everyone ! 

i've tried many times to copy a csv file to a hadoop cluster.

The datafile is 4.6 Go.

Randomly, the file is copied entirely or stops at 2.1 Go.. 1.5Go..1.6Go sometimes 

i dont know how to make sure that the file is correcly copied, there is no error on the log. 

 

Did you ever had that kind of problem ? 

 

proc hadoop username="&user." password="&mdp." verbose;
   hdfs delete="&chemin_hdfs./&fichierIn." nowarn;
run;

proc hadoop username="&user." password="&mdp." verbose;
   hdfs copyfromlocal="&chemin_sorties.\&fichierIn." out="&chemin_hdfs."   ;
run;

hackathon24-white-horiz.png

The 2025 SAS Hackathon Kicks Off on June 11!

Watch the live Hackathon Kickoff to get all the essential information about the SAS Hackathon—including how to join, how to participate, and expert tips for success.

YouTube LinkedIn

What is Bayesian Analysis?

Learn the difference between classical and Bayesian statistical approaches and see a few PROC examples to perform Bayesian analysis in this video.

Find more tutorials on the SAS Users YouTube channel.

SAS Training: Just a Click Away

 Ready to level-up your skills? Choose your own adventure.

Browse our catalog!

Discussion stats
  • 0 replies
  • 726 views
  • 0 likes
  • 1 in conversation