03-29-2017 02:33 PM
Getting acquainted with SPDE. I have data sitting in a Hadoop cluster. I have no problem reading into our SAS Grid until I use ACCELWHERE=YES in the libname as shown below. Then I get a "generic error." I am attempting that data subsetting be performed in the Hadoop cluster. Hopefully, it will bring the data back much quicker.
I can remove the ACCELWHERE=YES in the libname and it will run, but it runs for much too long a period although it eventually completes. Code below is just a snippet. (SAS Enterprise Guide version: 7.1. Platform version: 126.96.36.199)
Appreciate any help or advice . . .
libname hdp_spd spde '/hdfs/vs1/rptg/phi' hdfshost=default PARALLELWRITE=YES PARALLELREAD=YES ACCELWHERE=YES ;
where INCRD_YR_MN between &bgn_exp and &end_exp ;
ERROR: Generic error.
04-25-2017 11:12 AM
Have you seen this documentation?
Specifically, does your SPD Server have an enabled WHERE?
04-26-2017 02:26 PM
Thanks for input. Not sure of all our setup details, but we aren't using the SPD Server.