BookmarkSubscribeRSS Feed
🔒 This topic is solved and locked. Need further help from the community? Please sign in and ask a new question.
Sandeepgup11
Calcite | Level 5

I am using SAS Eminer-  HP BN Classifier Node .  I have 11 crore records . I am using  all data as training  dataset ,Since It is a huge data it takes 10-12 hours to run the Model . After first 5-6 hours of execution I am getting below error . Kindly let me know  if it is a Limitation of  SAS Eminer  ? Please suggest any alternative handle such enormous data  .

 

ERROR : The connection to the server has been lost . As a result , this diagram will be closed  .

 

Thanks

Sandeep

1 ACCEPTED SOLUTION

Accepted Solutions
MikeStockstill
SAS Employee

There are a few different approaches to use in a case like this.  

 

* The literal cause is that your job run time exceeds the time limit that is imposed by your IT department.  Contact your IT department about giving you a longer time when you expect to be running longer jobs.

 

* If you have a client-server installation, then start your diagram, close it, and you can also close Enterprise Miner.  Processing continues even though the user interface is not open.  Since it is not open, there is no connection to lose.  Periodically (after lunch, later in the day, the next day if running over night) try to open the diagram.  It should open if the job is completed, but should be locked if it is still running.

 

 * Check your MEMSIZE setting.  If you are using a setting that is too small, processing time might take longer.  Likewise, increasing the MEMSIZE setting can sometimes enable a job to complete more quickly.  For details, go to http://support.sas.com/notes.  In the search area, try these terms:

 

     miner memsize

 

Select this result.
61376 - Overcoming "insufficient memory ." and "parameter larger than documented limit" error messag...

http://support.sas.com/kb/61/376.html

 

* In that same note, see the "Check whether you are trying to use a small-data-algorithm on a large data-set" section.

 

 

It is likely that your solution involves a combination of the above issues.

 

View solution in original post

2 REPLIES 2
MikeStockstill
SAS Employee

There are a few different approaches to use in a case like this.  

 

* The literal cause is that your job run time exceeds the time limit that is imposed by your IT department.  Contact your IT department about giving you a longer time when you expect to be running longer jobs.

 

* If you have a client-server installation, then start your diagram, close it, and you can also close Enterprise Miner.  Processing continues even though the user interface is not open.  Since it is not open, there is no connection to lose.  Periodically (after lunch, later in the day, the next day if running over night) try to open the diagram.  It should open if the job is completed, but should be locked if it is still running.

 

 * Check your MEMSIZE setting.  If you are using a setting that is too small, processing time might take longer.  Likewise, increasing the MEMSIZE setting can sometimes enable a job to complete more quickly.  For details, go to http://support.sas.com/notes.  In the search area, try these terms:

 

     miner memsize

 

Select this result.
61376 - Overcoming "insufficient memory ." and "parameter larger than documented limit" error messag...

http://support.sas.com/kb/61/376.html

 

* In that same note, see the "Check whether you are trying to use a small-data-algorithm on a large data-set" section.

 

 

It is likely that your solution involves a combination of the above issues.

 

sas-innovate-2024.png

Join us for SAS Innovate April 16-19 at the Aria in Las Vegas. Bring the team and save big with our group pricing for a limited time only.

Pre-conference courses and tutorials are filling up fast and are always a sellout. Register today to reserve your seat.

 

Register now!

How to choose a machine learning algorithm

Use this tutorial as a handy guide to weigh the pros and cons of these commonly used machine learning algorithms.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 2 replies
  • 828 views
  • 1 like
  • 2 in conversation