Hello, I am using SAS Enterprise Miner (Version 13.2) to develop gradient boosting models (Using the Arbor Procedure).
I am stumbling on a error that seems to be input dependent, and I am have not been able to determine what conditions can cause it. When I run the procedure on the full dataset (1570 features and 75k sample size) I get a Segmentation Violation error:
Segmentation Violation In Task [ ARBOR (2 ] SptGbmClearInitialF+0x00350 - /sas92/bin/SASFoundation/9.2/sasexe/sasarbor spt376+0x00150 - /sas92/bin/SASFoundation/9.2/sasexe/sasarbor spt380+0x00320 - /sas92/bin/SASFoundation/9.2/sasexe/sasarbor ArbDbu1GetNodes+0x003b0 - /sas92/bin/SASFoundation/9.2/sasexe/sasarbor ArbTaskInputVbuf+0x001fc - /sas92/bin/SASFoundation/9.2/sasexe/sasarbor arb188+0x00b54 - /sas92/bin/SASFoundation/9.2/sasexe/sasarbor arb184+0x0067c - /sas92/bin/SASFoundation/9.2/sasexe/sasarbor arb191+0x002f0 - /sas92/bin/SASFoundation/9.2/sasexe/sasarbor spt308+0x00d9c - /sas92/bin/SASFoundation/9.2/sasexe/sasarbor zipstmt+0x0109c - /sas92/bin/SASFoundation/9.2/sasexe/sasarbor zipok+0x000c4 - /sas92/bin/SASFoundation/9.2/sasexe/sasarbor yspproc+0x00830 - /sas92/bin/SASFoundation/9.2/sasexe/sasxshel ziparse+0x000cc - /sas92/bin/SASFoundation/9.2/sasexe/sasarbor sasarbor+0x000a4 - /sas92/bin/SASFoundation/9.2/sasexe/sasarbor vvtentr+0x00130 - /sas92/bin/SASFoundation/9.2/sasexe/sas ___makecontext_v2+0x00108 - /lib/sparcv9/libc.so.1
NOTE: PROCEDURE ARBOR used (Total process time):
real time 1:17.30
cpu time 21.01 seconds
NOTE: 821765 kilobytes of physical memory.
NOTE: Will use 75000 out of 75000 training cases.
NOTE: Using memory pool with 841420800 bytes.
NOTE: The SAS System stopped processing this step because of errors.
NOTE: There were 75000 observations read from the data set WORK.K_CLST_A1_75.
I had limited success in droping some features to make the code execute, but the process is guesswork based and cumbersome on my team (As we have to guess which feature may be causing the problem). Besides, I don't even know if this is a true solution.
I tried to reproduce the error on Dummy data, as I can't disclose the real dataset that is causing the problem, to no avail. I have a binary target and only interval inputs, and I am using the following parameters in the procedure:
Thanks in advance
Anytime that you encounter a segmentation violation, you should report that issue to SAS Technical Support.
From the SAS log, it looks like you are running SAS 9.2, which is ancient. Is that true? You are running EM 13.2 with a SAS server that is running 9.2?
There have been 7 or 8 releases of SAS since 9.2. It is very possible that this problem has already been fixed in a more recent release.
Anytime that you encounter a segmentation violation, you should report that issue to SAS Technical Support.
From the SAS log, it looks like you are running SAS 9.2, which is ancient. Is that true? You are running EM 13.2 with a SAS server that is running 9.2?
There have been 7 or 8 releases of SAS since 9.2. It is very possible that this problem has already been fixed in a more recent release.
Thank you Rick! We tested on the new version of SAS and this resolved the issue.
Don't miss out on SAS Innovate - Register now for the FREE Livestream!
Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.
Use this tutorial as a handy guide to weigh the pros and cons of these commonly used machine learning algorithms.
Find more tutorials on the SAS Users YouTube channel.