Hi ALL,
Getting acquainted with SPDE. I have data sitting in a Hadoop cluster. I have no problem reading into our SAS Grid until I use ACCELWHERE=YES in the libname as shown below. Then I get a "generic error." I am attempting that data subsetting be performed in the Hadoop cluster. Hopefully, it will bring the data back much quicker.
I can remove the ACCELWHERE=YES in the libname and it will run, but it runs for much too long a period although it eventually completes. Code below is just a snippet. (SAS Enterprise Guide version: 7.1. Platform version: 9.4.3.0)
Appreciate any help or advice . . .
Alan
libname hdp_spd spde '/hdfs/vs1/rptg/phi' hdfshost=default PARALLELWRITE=YES PARALLELREAD=YES ACCELWHERE=YES ;
code ...
from hdp_spd.ltv_201702_copy
where INCRD_YR_MN between &bgn_exp and &end_exp ;
ERROR: Generic error.
Hello,
Have you seen this documentation?
Specifically, does your SPD Server have an enabled WHERE?
YES
.NO
.Hi LouGalway_sas,
Thanks for input. Not sure of all our setup details, but we aren't using the SPD Server.
Alan
Don't miss out on SAS Innovate - Register now for the FREE Livestream!
Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.
Need to connect to databases in SAS Viya? SAS’ David Ghan shows you two methods – via SAS/ACCESS LIBNAME and SAS Data Connector SASLIBS – in this video.
Find more tutorials on the SAS Users YouTube channel.