SAS Data Integration Studio, DataFlux Data Management Studio, SAS/ACCESS, SAS Data Loader for Hadoop and others

Debugging LSF file events

Accepted Solution Solved
Reply
Highlighted
Occasional Contributor
Posts: 13
Accepted Solution

Debugging LSF file events

[ Edited ]

I have a job which I've scheduled to run via the Schedule Manager in SAS Management Console. I'm using Platform LSF as the scheduling server. The job is designed to start when some files arrive. I've used the "arrival" event rather than the "exists" event.

 

Unfortunately, despite all the files having arrived, the job is still in a waiting state.

 

How do I diagnose the cause here? SAS Management Console gives me no information about jobs which have already been submitted for scheduling. None of the LSF command line utilities, or the Flow Manager application, appear to give me information about file events (external events in LSF lingo). I've checked and double-checked that the files really do exist, in the right location, with the right names.

 

I've got other jobs which are successfully being triggered by file arrival so I don't think it's a general problem with my installation, which is SAS 9.4M4. Platform LSF is version 9.1.3.0.


Accepted Solutions
Solution
‎01-02-2018 02:42 PM
Occasional Contributor
Posts: 13

Re: Debugging LSF file events

Classification: Public

We eventually resolved this ourselves. It seems the user that the LSF scheduling process runs as did not have access to the directory in which the trigger files were located. The vendor documentation is quite bare on this subject so this isn't a definitive root cause, but a permission change on the directory (chmod o+rx) worked.

View solution in original post


All Replies
Super User
Posts: 3,770

Re: Debugging LSF file events

Have you checked Platform Process Manager for the job? Is that where you see a status of "waiting"?

Occasional Contributor
Posts: 13

Re: Debugging LSF file events

Classification: Public

Yes, Platform Process Manager shows the job as waiting. It shows me (in the flow diagram) the list of file event dependencies, but doesn't tell me which of those (if any) it considers true.
Super User
Posts: 3,770

Re: Debugging LSF file events

[ Edited ]

I'd suggest opening a track with SAS Tech Support if you haven't done so already. I suspect you will need to dig into the LSF logs to make any progress.

Solution
‎01-02-2018 02:42 PM
Occasional Contributor
Posts: 13

Re: Debugging LSF file events

Classification: Public

We eventually resolved this ourselves. It seems the user that the LSF scheduling process runs as did not have access to the directory in which the trigger files were located. The vendor documentation is quite bare on this subject so this isn't a definitive root cause, but a permission change on the directory (chmod o+rx) worked.
Super User
Posts: 3,770

Re: Debugging LSF file events

Please update your post as solved then.

☑ This topic is solved.

Need further help from the community? Please ask a new question.

Discussion stats
  • 5 replies
  • 400 views
  • 0 likes
  • 2 in conversation