cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
BookmarkSubscribeRSS Feed
willi_m
Calcite | Level 5 willi_m
Calcite | Level 5

SAS Viya Job Execution API call ending before the true ending

Posted 06-23-2022 05:18 AM (1544 views)

Hello, 

 

I try to execute SAS code through the SAS Job Execution server (Version 2.2) on Viya  platform (V.03.05)

I call the API through shell script and curl command as follow:

#--- Execute SAS job
rc_curl=$(curl -k -X POST "https://${tenant}.${BASEAPIURL}/SASJobExecution/" \
   --connect-timeout 14400 \
   -H "Authorization: Bearer $ACCESS_TOKEN" \
   -H 'Content-Type: application/x-www-form-urlencoded' \
   -H 'Accept: *' \
   -d "_program=/Projects/my_program/&_log=${log}&_param=${param}&_timeout=14400&CSRF=\$CSRF\$" 
   )

I redirect the log in my SAS program in another location in order to parse it with my shell.

 

It works well when the program ran fast, but sometime the program can take a very long time (more than 1 hour).

The issue is that in this case,  the curl command exit, as if the Job is finished. But when I check in the Job Execution Interface, it is still running. 

 

I though that it was my access_token but the time validity is set to 14400 (approx 4h). 

I try the timeout option of curl with same value but it didn't work.

 

I don't know what is the issue. Does someone have an idea ? 

 

 

 

 

0 Likes
Reply
6 REPLIES 6
AllanBowe
Barite | Level 11 AllanBowe
Barite | Level 11

Re: SAS Viya Job Execution API call ending before the true ending

Posted 06-23-2022 05:58 AM (1526 views)  |   In reply to willi_m

Hi @willi_m ,

 

We also observed shaky behaviour in long-running jobs in Viya 3.5 - and so we implemented a 'retries' feature in the SASjs CLI, which ultimately fixed the issue (the customer was running many long-running jobs, so was tested quite heavily)

 

You can find the docs here:  https://cli.sasjs.io/job/

 

Best,

Allan

/Allan
SAS Challenges - SASensei
MacroCore library for app developers
SAS networking events (BeLux, Germany, UK&I)
Data Workflows, Data Contracts, Data Lineage, Drag & drop excel EUCs to SAS 9 & Viya - Data Controller
DevOps and AppDev on SAS 9 / Viya / Base SAS - SASjs
0 Likes
Reply
willi_m
Calcite | Level 5 willi_m
Calcite | Level 5

Re: SAS Viya Job Execution API call ending before the true ending

Posted 06-23-2022 07:24 AM (1498 views)  |   In reply to AllanBowe

Hi @AllanBowe, 

thanks for your answer, i will see if it is possible to install and use this package on my company (as there is some restrictions for the installation of external tool).

 

Things that i noticed and forget in my issue description, is that the curl (rc_curl variable) return me that thing:.

<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>502 Proxy Error</title>
</head><body>
<h1>Proxy Error</h1>
<p>The proxy server received an invalid
response from an upstream server.<br />
The proxy server could not handle the request <em><a href="/SASJobExecution/">POST&nbsp;/SASJobExecution/</a        ></em>.<p>
Reason: <strong>Error reading from remote server</strong></p></p>
</body></html>

any idea ?

0 Likes
Reply
AllanBowe
Barite | Level 11 AllanBowe
Barite | Level 11

Re: SAS Viya Job Execution API call ending before the true ending

Posted 06-25-2022 09:30 AM (1447 views)  |   In reply to willi_m

It happens sometimes.  Actually, quite frequently.  It's not necessarily a Viya issue, could be networking / system related. 

 

SASjs is MIT open source, there are no usage restrictions.  You can compile it directly from github:  https://github.com/sasjs/cli

 

Alternatively, you can build your own tool to poll the status and perform X number of retries for a non-200 response.

/Allan
SAS Challenges - SASensei
MacroCore library for app developers
SAS networking events (BeLux, Germany, UK&I)
Data Workflows, Data Contracts, Data Lineage, Drag & drop excel EUCs to SAS 9 & Viya - Data Controller
DevOps and AppDev on SAS 9 / Viya / Base SAS - SASjs
0 Likes
Reply
Vince_DelGobbo
Calcite | Level 5 Vince_DelGobbo
Calcite | Level 5

Re: SAS Viya Job Execution API call ending before the true ending

Posted 08-16-2022 07:33 PM (1286 views)  |   In reply to willi_m

You might be experiencing what's described here:

 

Job Execution Time-out

https://documentation.sas.com/doc/en/pgmsascdc/9.4_3.5/jobexecug/p1ct9uzl5c7omun1t2zy0gxhlqlc.htm#n1...

 

If so, then using _action=wait or _action=background might help.

 

Vince DelGobbo

Formerly SAS R&D

Reply
willi_m
Calcite | Level 5 willi_m
Calcite | Level 5

Re: SAS Viya Job Execution API call ending before the true ending

Posted 08-24-2023 10:45 AM (690 views)  |   In reply to Vince_DelGobbo

After some search we found a solution, that i will explain here for other people in the same case.

We change the endpoint to trigger to not launch job directly but creating a JobRequest.

Then the JobRequest is launch and we parse the response to take the JobExecutionId.

Then in a loop we check the status of the job every 15-20sec until the Status is "COMPLETED".

 

Thanks all for you help.

0 Likes
Reply
AllanBowe
Barite | Level 11 AllanBowe
Barite | Level 11

Re: SAS Viya Job Execution API call ending before the true ending

Posted 08-24-2023 10:55 AM (684 views)  |   In reply to willi_m

That's pretty much what the SASjs CLI does (although it starts by polling fast, then polls more slowly).

 

Thanks for sharing your solution!

/Allan
SAS Challenges - SASensei
MacroCore library for app developers
SAS networking events (BeLux, Germany, UK&I)
Data Workflows, Data Contracts, Data Lineage, Drag & drop excel EUCs to SAS 9 & Viya - Data Controller
DevOps and AppDev on SAS 9 / Viya / Base SAS - SASjs
0 Likes
Reply

SAS INNOVATE 2024

Innovate_SAS_Blue.png

 

Registration is open! SAS is returning to Vegas for an AI and analytics experience like no other! Whether you're an executive, manager, end user or SAS partner, SAS Innovate is designed for everyone on your team. Register for just $495 by 12/31/2023.

If you are interested in speaking, there is still time to submit a session idea. More details are posted on the website. 

Register now!

How to Concatenate Values

Learn how use the CAT functions in SAS to join values from multiple variables into a single value.

Watch How to Concatenate Values on YouTube

Find more tutorials on the SAS Users YouTube channel.

Get the $99 certification deal.jpg

 

 

Back in the Classroom!

Select SAS Training centers are offering in-person courses. View upcoming courses for:

View all other training opportunities.

Discussion stats
  • 6 replies
  • ‎06-23-2022 05:18 AM
  • 1545 views
  • 1 like
  • 3 in conversation