Hi ALL,
Getting acquainted with SPDE. I have data sitting in a Hadoop cluster. I have no problem reading into our SAS Grid until I use ACCELWHERE=YES in the libname as shown below. Then I get a "generic error." I am attempting that data subsetting be performed in the Hadoop cluster. Hopefully, it will bring the data back much quicker.
I can remove the ACCELWHERE=YES in the libname and it will run, but it runs for much too long a period although it eventually completes. Code below is just a snippet. (SAS Enterprise Guide version: 7.1. Platform version: 9.4.3.0)
Appreciate any help or advice . . .
Alan
libname hdp_spd spde '/hdfs/vs1/rptg/phi' hdfshost=default PARALLELWRITE=YES PARALLELREAD=YES ACCELWHERE=YES ;
code ...
from hdp_spd.ltv_201702_copy
where INCRD_YR_MN between &bgn_exp and &end_exp ;
ERROR: Generic error.
Hello,
Have you seen this documentation?
Specifically, does your SPD Server have an enabled WHERE?
YES
.NO
.Hi LouGalway_sas,
Thanks for input. Not sure of all our setup details, but we aren't using the SPD Server.
Alan
Join us for SAS Innovate 2025, our biggest and most exciting global event of the year, in Orlando, FL, from May 6-9. Sign up by March 14 for just $795.
Need to connect to databases in SAS Viya? SAS’ David Ghan shows you two methods – via SAS/ACCESS LIBNAME and SAS Data Connector SASLIBS – in this video.
Find more tutorials on the SAS Users YouTube channel.