BookmarkSubscribeRSS Feed
willkim0625
Calcite | Level 5

Hi everyone.

 

When I try to run a clustering job on a data set has 65 million records, after an hour or so, dataflux aborts and I get the error shown in the first image below.

 

What does the error message actually mean and how can I fix it?

If the error message is referring to the storage where the output data set is being written, I have 3.65 Tb free.

 

Any help will be greatly appreciated.

 

Thank youerror.PNGstorage.PNGSpecs.PNG

5 REPLIES 5
SASKiwi
PROC Star

Try running your job on a file with half the number of records. If it is successful you can assume that the full size file is probably running out of resources to be processed.

 

Note DM Studio runs just on a workstation, so has limited resources to process large files. It is more an environment to develop your DM jobs with small data volumes. Then for full or large data volumes, use your DM server, particularly if they are taking over an hour to process.

 

misto
Calcite | Level 5

hey, guys, I am looking forward to getting the solution on following Things

1.Data management of the website  Hind Aluminium 

2 Managing the quires and getting some potential insights from it

3 Using business intelligence for enhancing sales and doing some research on sentiment analysis  and #tags 

Looking to get this Queries resolved using SAS technologies.

 

 

 

abansode520
Calcite | Level 5

Please help with my, website that is "Pragati Software". I've been trying to collect the data from my site but it was not happening.
Please help me for the same.

SASKiwi
PROC Star

@abansode520 - Is your question anything to do with SAS software, and if so what specifically? If this is not SAS-related then you have come to the wrong place.

SASKiwi
PROC Star

@misto - The SAS Community is a free service offering specific help to SAS users stuck on a specific SAS problem. If you want consulting services then you have come to the wrong place. SAS Consulting Services or a third-party SAS consultancy may be able to help.

 

I appreciate this is your first post here, but you should have created a new post not adding to a completely-unrelated post by someone else.  

 

 

sas-innovate-wordmark-2025-midnight.png

Register Today!

Join us for SAS Innovate 2025, our biggest and most exciting global event of the year, in Orlando, FL, from May 6-9. Sign up by March 14 for just $795.


Register now!

How to connect to databases in SAS Viya

Need to connect to databases in SAS Viya? SAS’ David Ghan shows you two methods – via SAS/ACCESS LIBNAME and SAS Data Connector SASLIBS – in this video.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 5 replies
  • 944 views
  • 0 likes
  • 4 in conversation