Dear Team,
I am executing the Data-flux job having 3 crores record and It's taking long time to read.
I have attached one screenshot, Please suggest me how to handle performance size.
Thank You
Shakti
Hi,
From what I see in the screenshot, you're reading from one dataset over 60M records, appending it with another data source. So the load is not so small for a start.
Then you're running Matchcode, Clustering and Surviving operations which also requires lots of ressources.
This is going to take some time! Depends what you mean by "long".
This would probably need to run on a Data Management Server, with appropriate ressources, rather than on a Studio.
Hope this helps.
Audrey
Join us for SAS Innovate 2025, our biggest and most exciting global event of the year, in Orlando, FL, from May 6-9. Sign up by March 14 for just $795.
Need to connect to databases in SAS Viya? SAS’ David Ghan shows you two methods – via SAS/ACCESS LIBNAME and SAS Data Connector SASLIBS – in this video.
Find more tutorials on the SAS Users YouTube channel.