cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
BookmarkSubscribeRSS Feed
martinmuller
Calcite | Level 5 martinmuller
Calcite | Level 5

Dealing with big database

Posted 06-11-2012 09:02 PM (750 views)

I am connecting SAS EM with some large tables (>1 million records), and the speed of running each node become extremely slow. Even the data node or the graphic explore node become unacceptably slow. I am running some analysis on the whole datasets, and I can't only run a sample. Could anyone give me some suggestion about how to accelerate the job?

Thank you in advance!

0 Likes
Reply
1 REPLY 1
Alpay
Fluorite | Level 6 Alpay
Fluorite | Level 6

Re: Dealing with big database

Posted 06-12-2012 02:23 AM (712 views)  |   In reply to martinmuller

How many variables are there in your data set? You may need to work with less number of variables than what is in your data set to make it work.

Try creating another data set with let's say 1000 variables.We had a similar issue with over 5000 variables and 12 milliions observations and we ended up spliting the data set into 7 sets.

0 Likes
Reply

sas-innovate-2024.png

Available on demand!

Missed SAS Innovate Las Vegas? Watch all the action for free! View the keynotes, general sessions and 22 breakouts on demand.

 

Register now!

How to choose a machine learning algorithm

Use this tutorial as a handy guide to weigh the pros and cons of these commonly used machine learning algorithms.

Watch How to choose a machine learning algorithm on YouTube

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 1 reply
  • ‎06-11-2012 09:02 PM
  • 751 views
  • 0 likes
  • 2 in conversation