SAS Data Integration Studio, DataFlux Data Management Studio, SAS/ACCESS, SAS Data Loader for Hadoop and others

DataFlux Cluster Generation ISsue

Reply
Highlighted
Contributor sht
Contributor
Posts: 21

DataFlux Cluster Generation ISsue

Hi Team,

 

I am facing issues in Dataflux job which are developed for cluster id generation and scheduled thru Windows scheduler.

If I execute those jobs manually then it executes fine(around hrs) but in windows scheduler jobs are taking long time(around 8-9 hrs )

 

Please suggest what can be the issue

OS: Windows8

DF Studio: 8.1

Data size: More than 40lacs record

 

Thank You

SAS Super FREQ
Posts: 101

Re: DataFlux Cluster Generation ISsue

Hi - are you calling the dmpexec command from your scheduler? There are various options you can set when invoking the command that may impact performance, like choosing to write a log or selecting options that overwrite configuration file settings. There are also options for logging that might help you pinpoint the issue.

 

Another thought - I have seen in the past where dmpexec was executed by a user (different than the one used with Data Management Studio) that had different environment settings associated with it (like where the "temp" directory was located) and this impacted performance. 


Ron

Ask a Question
Discussion stats
  • 1 reply
  • 127 views
  • 0 likes
  • 2 in conversation