topic Dealing with big database in SAS Data Science https://communities.sas.com/t5/SAS-Data-Science/Dealing-with-big-database/m-p/79968#M516 <HTML><HEAD></HEAD><BODY><P>I am connecting SAS EM with some large tables (&gt;1 million records), and the speed of running each node become extremely slow. Even the data node or the graphic explore node become unacceptably slow. I am running some analysis on the whole datasets, and I can't only run a sample. Could anyone give me some suggestion about how to accelerate the job?</P><P></P><P>Thank you in advance!</P></BODY></HTML> Tue, 12 Jun 2012 01:02:51 GMT martinmuller 2012-06-12T01:02:51Z Dealing with big database https://communities.sas.com/t5/SAS-Data-Science/Dealing-with-big-database/m-p/79968#M516 <HTML><HEAD></HEAD><BODY><P>I am connecting SAS EM with some large tables (&gt;1 million records), and the speed of running each node become extremely slow. Even the data node or the graphic explore node become unacceptably slow. I am running some analysis on the whole datasets, and I can't only run a sample. Could anyone give me some suggestion about how to accelerate the job?</P><P></P><P>Thank you in advance!</P></BODY></HTML> Tue, 12 Jun 2012 01:02:51 GMT https://communities.sas.com/t5/SAS-Data-Science/Dealing-with-big-database/m-p/79968#M516 martinmuller 2012-06-12T01:02:51Z Re: Dealing with big database https://communities.sas.com/t5/SAS-Data-Science/Dealing-with-big-database/m-p/79969#M517 <HTML><HEAD></HEAD><BODY><P>How many variables are there in your data set? You may need to work with less number of variables than what is in your data set to make it work.</P><P>Try creating another data set with let's say 1000 variables.We had a similar issue with over 5000 variables and 12 milliions observations and we ended up spliting the data set into 7 sets.</P></BODY></HTML> Tue, 12 Jun 2012 06:23:20 GMT https://communities.sas.com/t5/SAS-Data-Science/Dealing-with-big-database/m-p/79969#M517 Alpay 2012-06-12T06:23:20Z