BookmarkSubscribeRSS Feed
blast
Fluorite | Level 6

Hi everyone ! 

i've tried many times to copy a csv file to a hadoop cluster.

The datafile is 4.6 Go.

Randomly, the file is copied entirely or stops at 2.1 Go.. 1.5Go..1.6Go sometimes 

i dont know how to make sure that the file is correcly copied, there is no error on the log. 

 

Did you ever had that kind of problem ? 

 

proc hadoop username="&user." password="&mdp." verbose;
   hdfs delete="&chemin_hdfs./&fichierIn." nowarn;
run;

proc hadoop username="&user." password="&mdp." verbose;
   hdfs copyfromlocal="&chemin_sorties.\&fichierIn." out="&chemin_hdfs."   ;
run;

SAS Innovate 2025: Register Now

Registration is now open for SAS Innovate 2025 , our biggest and most exciting global event of the year! Join us in Orlando, FL, May 6-9.
Sign up by Dec. 31 to get the 2024 rate of just $495.
Register now!

What is Bayesian Analysis?

Learn the difference between classical and Bayesian statistical approaches and see a few PROC examples to perform Bayesian analysis in this video.

Find more tutorials on the SAS Users YouTube channel.

SAS Training: Just a Click Away

 Ready to level-up your skills? Choose your own adventure.

Browse our catalog!

Discussion stats
  • 0 replies
  • 590 views
  • 0 likes
  • 1 in conversation