Hello Experts,
I need your quick help regarding bulkload option.
Scenario:
I am trying to load data into Hadoop library from SAS work library. Trying with sample 10 records and after 15minutes wait time, 0 records has been loaded to hadoop table..
Tried 3ways with Bulkload=Yes option but getting same output.
1) Data Hdp.abc(bulkload=yes);
set sashelp.cars(obs=10);
run;
2) proc append base=Hdp.abc(bulkload=yes) data=work.cars;
run;
3) created table structre and tried to pust using Insert into statement.
Please suggest the fastet way to load data into Hadoop table
or let me know do I need to do any other changes in config file to work BULKLOAD option.
Your syntax should work. Do you get any error or warning messages or is the SAS job just hanging?
Is there any SAS process that already loads data into this Hadoop cluster?
Given you run a proc append I would expect that your job either fails or data gets loaded.
IF data gets loaded then we could look into performance, if it fails then first why and where it fails.
What does the SAS log tell you for the Proc Append step? Please share the code.
Ideally run your job with following options set before the Proc Append:
option sastrace=',,,d' sastraceloc=saslog nostsuffix;
And not sure and haven't checked if it also applies for Hadoop but also set the following option:
option DBIDIRECTEXEC;
And then share the SAS log for at least the Proc Append step.
Have you tried to use
options sastrace=",,,ds" sastraceloc=saslog nostsuffix msglevel=i;
?
Yes LinusH , I have tried these options as well but could not push data into Hadoop table.
Does it work without the BULKLOAD option? Have you checked with your SAS administrator regarding any site-specific requirements?
Hello SAS Kiwi,
I tried without bulkload as well but same result.
and can you please tell me, what site-specific requirements needs to check with Admin?
Sorry I did not get your question.
I assume that someone in your organisation has actually tested loading SAS data into Hadoop. Your SAS administrator should know what the coding requirements are to do this successfully - ask them what they are. If they don't know they should know someone who does. Otherwise I suggest you open a track with SAS Tech Support.
Thanks SAS Kiwi ,
I have raised ticket with SAS tech support .
THanks for your input.
Are you ready for the spotlight? We're accepting content ideas for SAS Innovate 2025 to be held May 6-9 in Orlando, FL. The call is open until September 25. Read more here about why you should contribute and what is in it for you!
Learn how use the CAT functions in SAS to join values from multiple variables into a single value.
Find more tutorials on the SAS Users YouTube channel.