boemskats Tracker

Finding the Metadata owner of a Workspace session or SASWork directory on Linux

boemskats — Fri, 18 Sep 2020 18:39:23 GMT

Our customers are often surprised that ESM is able to reconcile token-authenticated Workspace sessions and SASWork directories with the Metadata username of their owner. At least on Linux, this information is fairly easy to get to and does not require our product at all. Here's one way it can be done.

Re: Sample Script not storing/identifying the correct PID

boemskats — Fri, 28 Feb 2020 13:32:01 GMT

Hey Juan,

The script syntax s correct, check it out:

nik at b5 in ~ on master*
$ nohup sleep 1234 > my.log 2>&1 &
[3] 1885780
nik at b5 in ~ on master*
$ pid=$!; echo $pid
1885780
$ strings /proc/$pid/cmdline
sleep
1234

I'd make sure that the script you're calling is the target command or execs into it, rather than forking to another pid, like some of the JVM scripts do. That might be your issue.

Nik

Re: Stopping a running scheduled job

boemskats — Thu, 03 Oct 2019 14:01:17 GMT

Hi @Nigel_Pain

On Tuesday I'll be presenting a SUGA webinar showing our Enterprise Session Monitor for SAS. The functionality that lets users manage their own workloads, including batch jobs, has been there for a while - have a look here, around 3mins 30sec into the first video (the one titled What is ESM).

Or join the webinar Tuesday - those videos are a few years old now 🙂

Nik

Re: How to get runtimes of jobs/flows from platform process manager

boemskats — Fri, 10 May 2019 15:25:24 GMT

Hi @DavidKess

If migrating to 9.4 isn't an option that's immediately available to you, we offer a commercial product that will considerably help you in managing the SAS DW that you inherited. Our website is in desperate need of an update, but you can have a look at some of the early core functionalities here.

The product has come a long way in terms of enabling the kind of batch analysis you're after. If you're interested feel free to drop me a line and I can send you some more info & maybe arrange for a demo.

Nik

Re: Error/Bug in VA with visualization and crosstab

boemskats — Sat, 27 Apr 2019 20:14:38 GMT

I just came here from your LinkedIn post. Just to be clear - is the error you describe in your LI post as a 'gross arithmetical error' the loss of precision after the 12th decimal, in cases when there is not a format applied to the result? If so, this just looks like a floating point issue to me.

I'm just trying to understand whether I'm missing something obvious, as I'm not a statistician.

Nik

Re: Anyone interested in developping a VS Code extension for SAS language?

boemskats — Fri, 19 Apr 2019 14:31:37 GMT

If someone was to pick this up I'd strongly recommend an implementation using Microsoft's Language Server Protocol. Would be a fair bit of work, but it would make that editor mode available to a range of other editors (vim obviously being the most important).

VSCode uses a MS javascript editor component called Monaco, as after all, VSCode is just a webapp that's been deployed in Electron. We have a mode for Ace (another javascript editor component) that is extremely similar, which we've used within an internal product called AppFactory for 2 or 3 years now.

Keep in mind that writing a mode for SAS is really hard, as SAS is not just one language - it's more like 4 or 5. Just ask @sspkmnd - he's been working on his SASLint project for SAS for a long time now (implemented in ANTLR v4, so he also has it compiling to a mode for Ace). I'll let Igor elaborate on the difficulties of an all-encompassing mode for SAS, but it's much harder than you'd assume, compared to almost all other languages. I'm sure the developers behind the SAS Studio editor will agree.

Nik

Re: Kill process

boemskats — Tue, 16 Apr 2019 12:26:32 GMT

I've raised an issue here: https://github.com/Boemska/worktop/issues/6

I'll let you know / update this thread once it's implemented. Or someone else can have a go and send a PR 🙂

Nik

Re: Compatibility issues between Oracle 18c and SAS 9.3/9.4

boemskats — Tue, 16 Apr 2019 11:53:53 GMT

You may be caught out by this with the 18c client, so I'll leave it here: http://support.sas.com/kb/60/895.html

Re: Stored Process Server - Editable Dataset - Possible?

boemskats — Thu, 14 Mar 2019 12:13:44 GMT

@arunrami alternatively if you're after a commercially supported solution to this problem (which it sounds like you are), I recommend you check out datacontroller.io as suggested by Allan. Built with the same tech, but with a workflow + change approval process built in.

Re: Stored Process Server - Editable Dataset - Possible?

boemskats — Thu, 14 Mar 2019 11:37:13 GMT

@arunrami - if you read the deployment steps, it involves deploying the stored process and configuring the h54s macro location, and then copying the dist directory to htdocs after editing h54sconfig.json. You don't need to build anything.

If you've still got issues with deployment feel free to raise an issue on GitHub and I'll get someone to help you out 🙂

Nik

Re: Stored Process Server - Editable Dataset - Possible?

boemskats — Thu, 14 Mar 2019 10:27:07 GMT

It doesn't require any configuration changes at all, just the deployment of an .spk file into Metadata, and unzipping a .zip file somewhere in your web server.

What specifically are you limited by? If you let me know I may be able to suggest an alternative.

Nik

Re: Stored Process Server - Editable Dataset - Possible?

boemskats — Tue, 12 Mar 2019 16:19:02 GMT

Hey @arunrami have you had a look at the instructions here?

https://github.com/boemska/sas-hot-editor#how-do-i-deploy-it

Re: Read Multipart/for-data attachment via sas

boemskats — Wed, 27 Feb 2019 17:02:52 GMT

Assuming this is relating to STPs deployed as Web Services to the SASBIWS webapp, and called via the REST interface as documented here?

Re: ExportPackage with command line

boemskats — Thu, 14 Feb 2019 20:18:14 GMT

I'd assume that a workspace server (owned by the user you're authenticating as) is what's actually used for reading the filesystem-based files that store the STP code you're trying to package up, rather than a STP multibridge session (owned by ie. sassrv). This means that the identity you authenticate with for the export must have sufficient credentials registered to start up a workspace server session with the OS, similar to what it'd do in EG.

Are you authenticating with an @saspw account? If so, is it capable of spinning up a session at the operating system level?

Re: Is there documentation on REPLAY stored process?

boemskats — Thu, 06 Dec 2018 20:26:44 GMT

Just found this message after @JRoman PM'd me to ask me the same thing - sorry.

Original message is here.

Nik

Re: Visual Analytics web interface to run an ETL process

boemskats — Mon, 03 Dec 2018 19:48:39 GMT

I'd need to see your code, but I imagine you're doing HTML form submits rather than anything AJAXy. You need to use Javascript and an XMLHttpRequest to interact with a server without having to do a full page refresh. We maintain a library that facilitates this with SAS that may save you a lot of time.

Have a look at the following link on XMLHttpRequests: https://developer.mozilla.org/en-US/docs/Web/API/XMLHttpRequest

And the following for H54S (the lib I mentioned): https://github.com/boemska/h54s

Nik

Re: SAS VIya 3.4 Preinstallation task is failing

boemskats — Fri, 23 Nov 2018 16:35:08 GMT

Glad it fixed it.

Make sure that you run the deployment_cleanup.yml playbook between install attempts, and then try again. If you get this error again then at least it's a more meaningful Consul error with which someone else should be able to help. It might be an idea to start a separate thread for it.

Re: SAS VIya 3.4 Preinstallation task is failing

boemskats — Thu, 22 Nov 2018 20:16:07 GMT

RC 126 means that you're unable to execute that shell script, create_sas_user_group.sh that Ansible copies over to the /tmp filesystem as part of the deployment because the execute bit isn't set. That's what the Permission Denied bit also indicates.

This will be because your /tmp filesystem is mounted with the noexec flag, therefore Ansible is unable to set the execute bit on that script before running it. You will need to talk to your sysadmins to remove the noexec flag from your /tmp mount in /etc/fstab.

You can verify that this is the case by running the mount command on the target machine. You'll see noexec as one of the mount flags for the /tmp filesystem.

Nik

Re: Make stored process output only png image

boemskats — Tue, 13 Nov 2018 18:40:17 GMT

I'll have a think about this. In the meantime -

Be mindful that using session IDs in your STP code like that, even temporarily, will completely circumvent load balancing at the spawner, meaning that all of your users will be redirected to the same multibridge session & that part of your application will have a concurrent capacity of 1 user. See @Vince_SAS's reply here for details. This also risks destabilising the spawner and the JVM if you're using a guest account and are intending to have this as public-facing or high-throughput app with users queuing for the session.

I'm sure there's a better way...

Re: How to check if a SAS module is being used?

boemskats — Mon, 12 Nov 2018 14:18:38 GMT

You can get this information from /proc/pid/maps for individual pids. It's something we've considered building into ESM.

Check it out:

nik at apps in /proc/4597
$ sudo cat maps | awk '{print $6;}' | grep SASFoundation | grep .so | sort | uniq
/pub/sas/SASFoundation/9.4/dbcs/sasexe/sasoda
/pub/sas/SASFoundation/9.4/sasexe/sasjson
/pub/sas/SASFoundation/9.4/sasexe/sasodr
/pub/sas/SASFoundation/9.4/sasexe/sasods
/pub/sas/SASFoundation/9.4/sasexe/sasodsm
/pub/sas/SASFoundation/9.4/sasexe/sasodst
/pub/sas/SASFoundation/9.4/sasexe/sasodtpo
/pub/sas/SASFoundation/9.4/sasexe/sasoevt
/pub/sas/SASFoundation/9.4/sasexe/sasofen
/pub/sas/SASFoundation/9.4/sasexe/sasomip
/pub/sas/SASFoundation/9.4/sasexe/sasoptio
/pub/sas/SASFoundation/9.4/sasexe/sassort
/pub/sas/SASFoundation/9.4/sasexe/saszsort
/pub/sas/SASFoundation/9.4/sasexe/skndns.so
/pub/sas/SASFoundation/9.4/sasexe/t0a0en.so
/pub/sas/SASFoundation/9.4/sasexe/t0a4en.so
/pub/sas/SASFoundation/9.4/sasexe/t0a6de.so
/pub/sas/SASFoundation/9.4/sasexe/t0a6en.so
/pub/sas/SASFoundation/9.4/sasexe/t0a8en.so
/pub/sas/SASFoundation/9.4/sasexe/t0c8en.so
/pub/sas/SASFoundation/9.4/sasexe/t0d2en.so
/pub/sas/SASFoundation/9.4/sasexe/t0l1en.so
/pub/sas/SASFoundation/9.4/sasexe/tk4aboot.so
/pub/sas/SASFoundation/9.4/sasexe/tk4afref.so
/pub/sas/SASFoundation/9.4/sasexe/tk4aiomc.so
/pub/sas/SASFoundation/9.4/sasexe/tk4aiome.so
/pub/sas/SASFoundation/9.4/sasexe/tk4aioms.so
/pub/sas/SASFoundation/9.4/sasexe/tk4aroll.so
/pub/sas/SASFoundation/9.4/sasexe/tk4aunxf.so
/pub/sas/SASFoundation/9.4/sasexe/tkarm.so
/pub/sas/SASFoundation/9.4/sasexe/tkautop.so
/pub/sas/SASFoundation/9.4/sasexe/tkcacr.so
/pub/sas/SASFoundation/9.4/sasexe/tkcacs.so
/pub/sas/SASFoundation/9.4/sasexe/tkcacw.so
...

I think there's information around from a few years ago regarding what library maps onto which product set. I remember someone wrote a paper on using strace and then processing the logs using SAS. This approach should be much more performant / cleaner.

Nik