cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
BookmarkSubscribeRSS Feed
martinmuller
Calcite | Level 5 martinmuller
Calcite | Level 5

Dealing with big database

Posted 06-11-2012 09:02 PM (851 views)

I am connecting SAS EM with some large tables (>1 million records), and the speed of running each node become extremely slow. Even the data node or the graphic explore node become unacceptably slow. I am running some analysis on the whole datasets, and I can't only run a sample. Could anyone give me some suggestion about how to accelerate the job?

Thank you in advance!

0 Likes
Reply
1 REPLY 1
Alpay
Fluorite | Level 6 Alpay
Fluorite | Level 6

Re: Dealing with big database

Posted 06-12-2012 02:23 AM (813 views)  |   In reply to martinmuller

How many variables are there in your data set? You may need to work with less number of variables than what is in your data set to make it work.

Try creating another data set with let's say 1000 variables.We had a similar issue with over 5000 variables and 12 milliions observations and we ended up spliting the data set into 7 sets.

0 Likes
Reply

SAS Innovate 2025: Call for Content

Are you ready for the spotlight? We're accepting content ideas for SAS Innovate 2025 to be held May 6-9 in Orlando, FL. The call is open until September 25. Read more here about why you should contribute and what is in it for you!

Submit your idea!

How to choose a machine learning algorithm

Use this tutorial as a handy guide to weigh the pros and cons of these commonly used machine learning algorithms.

Watch How to choose a machine learning algorithm on YouTube

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 1 reply
  • ‎06-11-2012 09:02 PM
  • 852 views
  • 0 likes
  • 2 in conversation