BookmarkSubscribeRSS Feed
Shakti_Sourav
Quartz | Level 8

Dear Team,

I am executing the Data-flux job having 3 crores record and  It's taking long time to read.

 

I have attached one screenshot, Please suggest me how to handle performance size.

Shakti_Sourav_0-1649670999787.png

 

 

Thank You 

Shakti

2 REPLIES 2
audrey
SAS Employee

Hi,

 

From what I see in the screenshot, you're reading from one dataset over 60M records, appending it with another data source. So the load is not so small for a start.

Then you're running Matchcode, Clustering and Surviving operations which also requires lots of ressources.

This is going to take some time! Depends what you mean by "long".

 

This would probably need to run on a Data Management Server, with appropriate ressources, rather than on a Studio.

 

Hope this helps.

 

Audrey

www.sas.comsupport.sas.com
SAS®... THE POWER TO KNOW®
RacheLGomez123
Fluorite | Level 6
Start by checking your wait stats
Ensure your TempDB database is configured optimally.
Make sure you're running index maintenance frequently.
Implement indexes that provide a benefit to your queries.
Check your most expensive queries and stored procedures.
Monitor your performance counters.
Regards,
Rachel Gomez

sas-innovate-2024.png

Available on demand!

Missed SAS Innovate Las Vegas? Watch all the action for free! View the keynotes, general sessions and 22 breakouts on demand.

 

Register now!

How to connect to databases in SAS Viya

Need to connect to databases in SAS Viya? SAS’ David Ghan shows you two methods – via SAS/ACCESS LIBNAME and SAS Data Connector SASLIBS – in this video.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 2 replies
  • 563 views
  • 1 like
  • 3 in conversation