SASEminer-Data-Volume-Issue-while-Modelling

Sandeepgup11 — Thu, 07 Dec 2017 09:50:02 GMT

I am using SAS Eminer- HP BN Classifier Node . I have 11 crore records . I am using all data as training dataset ,Since It is a huge data it takes 10-12 hours to run the Model . After first 5-6 hours of execution I am getting below error . Kindly let me know if it is a Limitation of SAS Eminer ? Please suggest any alternative handle such enormous data .

ERROR : The connection to the server has been lost . As a result , this diagram will be closed .

Thanks

Sandeep

Re: SASEminer-Data-Volume-Issue-while-Modelling

MikeStockstill — Fri, 08 Dec 2017 13:59:40 GMT

There are a few different approaches to use in a case like this.

* The literal cause is that your job run time exceeds the time limit that is imposed by your IT department. Contact your IT department about giving you a longer time when you expect to be running longer jobs.

* If you have a client-server installation, then start your diagram, close it, and you can also close Enterprise Miner. Processing continues even though the user interface is not open. Since it is not open, there is no connection to lose. Periodically (after lunch, later in the day, the next day if running over night) try to open the diagram. It should open if the job is completed, but should be locked if it is still running.

* Check your MEMSIZE setting. If you are using a setting that is too small, processing time might take longer. Likewise, increasing the MEMSIZE setting can sometimes enable a job to complete more quickly. For details, go to http://support.sas.com/notes. In the search area, try these terms:

miner memsize

Select this result.
61376 - Overcoming "insufficient memory ." and "parameter larger than documented limit" error messages

http://support.sas.com/kb/61/376.html

* In that same note, see the "Check whether you are trying to use a small-data-algorithm on a large data-set" section.

It is likely that your solution involves a combination of the above issues.

Re: SASEminer-Data-Volume-Issue-while-Modelling

Sandeepgup11 — Sat, 09 Dec 2017 05:44:42 GMT

Thanks Mike.

topic SASEminer-Data-Volume-Issue-while-Modelling in SAS Data Science

SASEminer-Data-Volume-Issue-while-Modelling

Re: SASEminer-Data-Volume-Issue-while-Modelling

Re: SASEminer-Data-Volume-Issue-while-Modelling