SAS Studio session is terminating frequently In viya LTS version 2023.03

[HemanthMG]

Hi Folks,

I hope you're all doing well. I wanted to reach out for some assistance with a recurring issue we've been experiencing with SAS Viya Studio sessions terminating unexpectedly. Upon investigation, I noticed that some compute pods were showing a terminating state in Pods, and I was unable to collect the logs. I tried to locate the viya.logs in the SAS directory at "/var/log/sas/viya.log", but unfortunately, I couldn't find them. Has anyone else encountered this problem before? If so, could you please share any steps or solutions that could help us resolve this issue?

Any help or guidance would be greatly appreciated.

Thank you in advance for your assistance.

Regards ,

Hemanth MG 

[gwootton]

Hi Hemanth,
Kubernetes pods typically do not write logs to files but to the output streams stdout and stderr. While the pod is running, these can be retrieved with the kubectl logs command.

If the pod is terminating on startup and you can't capture the log before the pod goes away, you'd need a solution like viya4-monitoring-kubernetes deployed, which persists logs from the pods in an OpenSearch database.

https://github.com/sassoftware/viya4-monitoring-kubernetes

[HemanthMG]

@gwootton - Thanks for your quick response !!

We haven't set up viya4-monitoring-kubernetes in our environment.  Is there any other way to view logs or fix this studio issue? 

Thanks,

Hemanth MG 

[gwootton]

The screenshot shows the pod terminating after 44 seconds, so it is unlikely to be a timeout issue and more likely an error being encountered by the pod when it starts. You can check the Kubernetes event log (kubectl get events) for any references to that pod, but if the failure is due to a FATAL error in the compute server pod and if you do not have any logging solution to persist logs, you would need to catch the pod while it still exists in the terminating state by running kubectl logs pod-name to see what error is being encountered by the pod causing it to terminate.