cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
BookmarkSubscribeRSS Feed
martinmuller
Calcite | Level 5 martinmuller
Calcite | Level 5

Dealing with big database

Posted 06-11-2012 09:02 PM (884 views)

I am connecting SAS EM with some large tables (>1 million records), and the speed of running each node become extremely slow. Even the data node or the graphic explore node become unacceptably slow. I am running some analysis on the whole datasets, and I can't only run a sample. Could anyone give me some suggestion about how to accelerate the job?

Thank you in advance!

0 Likes
Reply
1 REPLY 1
Alpay
Fluorite | Level 6 Alpay
Fluorite | Level 6

Re: Dealing with big database

Posted 06-12-2012 02:23 AM (846 views)  |   In reply to martinmuller

How many variables are there in your data set? You may need to work with less number of variables than what is in your data set to make it work.

Try creating another data set with let's say 1000 variables.We had a similar issue with over 5000 variables and 12 milliions observations and we ended up spliting the data set into 7 sets.

0 Likes
Reply

SAS Innovate 2025: Register Now

Registration is now open for SAS Innovate 2025 , our biggest and most exciting global event of the year! Join us in Orlando, FL, May 6-9.
Sign up by Dec. 31 to get the 2024 rate of just $495.
Register now!

How to choose a machine learning algorithm

Use this tutorial as a handy guide to weigh the pros and cons of these commonly used machine learning algorithms.

Watch How to choose a machine learning algorithm on YouTube

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 1 reply
  • ‎06-11-2012 09:02 PM
  • 885 views
  • 0 likes
  • 2 in conversation