Running is not completed in SAS Eminer

[Evelina]

Hi,

I'm running a diagram in SAS Eminer and after about one and a half hour I'm getting 'Run time error'(attached file) when I run the 'Association' node. There is no error in the log file just warning for files that don't exist in the SASwork folder, but they exist there, for example:

WARNING: Physical file does not exist, /opt/saswork/SAS_work505B0000DAE6_servername/SAS_work218C0000DAE6_servername/DiagramOpenSessionResponse.xml

What can be the problem?

Evelina

[WendyCzika]

I think what you have attached is the Diagram Log, which wouldn't have information about why the Association node failed.  If you right-click on the Association node and select Results... then view the log (under View > SAS Results > Log), you might see a more informative error message there.

[ccaulkins9]

Hi Wendy, Evelina -

Can you verify that the work dataset/file is indeed there in that location when running the program?

4ever Digging Data

[Evelina]

@ccaulkins9 the dataset is there when I run the diagram.

I checked the log for Assosiation node and it was 'Runs out of memory' error. I searched on the internet and it seems that it is a common error in SAS EMiner. I checked the variable names and they are less than 30 characters.The 'Result' of Assosiation node has been attached.

[WendyCzika]

If you are not doing sequence analysis, you can try using the Market Basket node instead, which should handle large data better.  It can also take into account item taxonomy, where products are grouped into subcategories, categories, etc. 

[ccaulkins9]

Wendy is right in that other algorithms might support larger amounts of data -
21M+ observations/rows is certainly a lot -
and it took an hour and a half to begin processing them? or 

[ccaulkins9]

@WendyCzika

[Evelina]

Thanks for your reply.

Yes, it itakes more than one and a half hour to run the model. How can I devide the dataset to smaller parts and run the diagram?

I get the same error even with Market Basket node. Is there any thing that I should change in this node or other node?

[ccaulkins9]

hello @Evelina! any updates, wehr you able to finally get the algorithm to run?