topic Re: No error in log file but running is not completed in SAS Data Science

Running is not completed in SAS Eminer

Evelina — Tue, 30 May 2017 14:46:55 GMT

Hi,

I'm running a diagram in SAS Eminer and after about one and a half hour I'm getting 'Run time error'(attached file) when I run the 'Association' node. There is no error in the log file just warning for files that don't exist in the SASwork folder, but they exist there, for example:

WARNING: Physical file does not exist, /opt/saswork/SAS_work505B0000DAE6_servername/SAS_work218C0000DAE6_servername/DiagramOpenSessionResponse.xml

What can be the problem?

Evelina

Re: No error in log file but running is not completed

WendyCzika — Wed, 24 May 2017 18:17:33 GMT

I think what you have attached is the Diagram Log, which wouldn't have information about why the Association node failed. If you right-click on the Association node and select Results... then view the log (under View > SAS Results > Log), you might see a more informative error message there.

Re: No error in log file but running is not completed

ccaulkins9 — Thu, 25 May 2017 13:57:21 GMT

Hi Wendy, Evelina -

Can you verify that the work dataset/file is indeed there in that location when running the program?

4ever Digging Data

Re: No error in log file but running is not completed

Evelina — Mon, 29 May 2017 13:42:31 GMT

@ccaulkins9 the dataset is there when I run the diagram.

I checked the log for Assosiation node and it was 'Runs out of memory' error. I searched on the internet and it seems that it is a common error in SAS EMiner. I checked the variable names and they are less than 30 characters.The 'Result' of Assosiation node has been attached.

Re: No error in log file but running is not completed

WendyCzika — Tue, 30 May 2017 13:13:06 GMT

If you are not doing sequence analysis, you can try using the Market Basket node instead, which should handle large data better. It can also take into account item taxonomy, where products are grouped into subcategories, categories, etc.

Re: No error in log file but running is not completed

ccaulkins9 — Tue, 30 May 2017 15:59:01 GMT

Wendy is right in that other algorithms might support larger amounts of data -
21M+ observations/rows is certainly a lot -
and it took an hour and a half to begin processing them? or

Re: No error in log file but running is not completed

ccaulkins9 — Tue, 30 May 2017 16:04:07 GMT

@WendyCzika

Re: No error in log file but running is not completed

Evelina — Wed, 31 May 2017 11:55:52 GMT

Thanks for your reply.

Yes, it itakes more than one and a half hour to run the model. How can I devide the dataset to smaller parts and run the diagram?

I get the same error even with Market Basket node. Is there any thing that I should change in this node or other node?

Re: No error in log file but running is not completed

ccaulkins9 — Wed, 23 Jan 2019 20:51:57 GMT

hello @Evelina! any updates, wehr you able to finally get the algorithm to run?