About titan31

titan31 · ‎04-16-2018

Hi, We're looking to install some hotfixes this weekend, and I want a plan in place if this doesn't go well, as there's any issues, and we need to rollback. We're taking images of the VM where our Compute and Metadata are stored on, and doing a backup of the middle-tier server as that's physical. We've two options there, either a file level backup, or a clone of the image using an external tool. How possible is it to actually rollback after installing hotfixes, and is there anything I need to be aware when taking the backups of the servers to ensure any recovery is easier? Thanks

titan31 · ‎04-16-2018

Nothing seems to have worked so far anyway, still have same issue. One of our service partners thinks that installing all the latest hotfixes will solve the issue, but I can't see anything addressed by the hotfixes that looks like it would fix it.

titan31 · ‎04-10-2018

Ya, I've got the Cleanwork utility scripted to run and clear out anything in the workspace drive. Will look into the processes part, it might make sense as after a full reboot, it goes fine. For the loading, it's a batch load as it's scheduled to run at 1am each night, but even when we're trying it manually, it runs in a similar enough time. Some of the processes are a full reload and some are SCD loads. Differing jobs have different requirements there and nothing I can see that only sort of load is slowing down, it seems to be pretty uniform that everything just ends up tripling in time.

titan31 · ‎04-10-2018

I'm on Windows, SAS 9.4

titan31 · ‎04-10-2018

Would there be a good way to check if there is stuff left over after a run?

titan31 · ‎04-10-2018

Doesn't seem to be Network or IO related anyway from what we've seen. We thought it might have been network but tried a few things there and after every time we reboot the server, it seems fine, but each successive load gets a lot slower then. Once we reboot and do a load, it takes it's normal time, next load takes twice as long, and then 3rd load takes 3 times as long and stays like that. Anything that might be getting filled up somewhere that could explain this

titan31 · ‎04-05-2018

Yup, I've involved the Oracle DBAs we have here but they can't see anything on their side as to the cause of it. Query is a normal Select * from table and we're looking at about 14m rows and 5 columns on it. We've had a DBA run it off multiple different environments but he's not really spotting anything that's causing any slowness. I'd have assumed (can correct me with if it's a wrong assumption) that with the CPU time being so much slower than the Real Time, that the issue is on SAS or the infrastructure.

titan31 · ‎04-05-2018

Hi, Thanks for that. Anything in particular I should be looking at. I've been looking at the trends in the Environment Manager and can see a few things are up but don't know if they're causes or effects of any issues. Like from a network point of view, I can see that the packets transmitted per minute has dropped significantly since like the 22nd March, but that doesn't really coincide with the days we're having issues. CPU usage has also increased since Thursday from about 10% average to 30% but that could just be as a result of the jobs taking much longer. Anything else I'm looking at within the Environment Manager isn't really giving me any indicator that something is wrong

titan31 · ‎04-05-2018

Hi, Our production system's load times have gone through the roof over the last week, and can't seem to find any explanation on how it's happened at all. For months, it's been going at 1.5 hours for loading in all the tables we need from our Oracle database but last Thursday this suddenly increased up to 9 hours, and been like that since bar Tuesday night where we got it down to 2.5 hours, but was then back to its 9 hours timescale last night. As this is a production system, it's having a huge effect on our users so I've been trying everything I can think of to see what the issue is (is it DB related, network related, hardware related or SAS related), but it seems to be like finding a needle in a haystack. Going through logs (and I enabled FULLSTIMER to get extra stats), the CPU time seems to be consistent from the good runs to the bad runs, but the real time is the one that increased. Would anyone have encountered any similar issues, or know of anything worth looking into to reduce the real time of the jobs. Thanks

titan31 · ‎03-26-2018

This is actually ok now. I cleared cookies and it changed to the correct form.

titan31 · ‎03-23-2018

Hi, I've an odd issue with VA at the moment. I'm bringing data in from DI and they all have column descriptions set on them, and even when I go into EG and look at the data, it shows with the correct column description. In VA, however, the column descriptions are against different fields, so field A actually has field B's description against it. I can't figure out why at all, and have tried loading in a different dataset, deleting the source in the VA report and re-adding etc, but still stays at the wrong values. Anyone encountered this before?

titan31 · ‎03-07-2018

Hi, I know how I'd do delete one report in Management Console but I'm looking to mass delete a bunch of reports within one folder if they've been created a certain length of time ago. We've got a folder in our VA setup for people to "temporarily share and store off", but as we've never found a good way of deleting them, they're just permanently there now and not used bar like the few days they're created. Is there a way to delete these using code or some script or utility? Thanks

titan31 · ‎02-23-2018

Hi, Original source is an external DB (Oracle), but we've it converted into physical SAS tables at through our process and data warehousing jobs. When we're creating a datamart from it to be used in VA (joining a bunch of physical tables in SAS together in this step), we seem to be hitting a bottleneck. Target table is in SAS too as we're using it for autoloading into VA.

titan31 · ‎02-23-2018

Hi, We've a very long running table loader (it usually takes around an hour, and seems to be taking longer today). This is yesterdays log for it NOTE: There were 10553628 observations read from the data set WORK.W37RG31. NOTE: 10553628 observations added. NOTE: The data set CMCLMMRT.CLAIM_ITEM has 10553628 observations and 133 variables. NOTE: PROCEDURE APPEND used (Total process time): real time 59:27.16 user cpu time 11:58.76 system cpu time 15:48.31 memory 13482411.56k OS Memory 13501984.00k Timestamp 22/02/2018 06:02:43 a.m. Is that ratio for real time to user cpu time fine, and for writing 10m rows and 133 columns fine, or should this be performing much quicker? If so, what should I be checking to get it to perform faster, as I'm fairly new to a sas administration role so would like to boost performance if I can. it's reading from a SAS temporary view rather than an external database at this point of the process too. It's already read in earlier in the flow from the external database. For today, as it's finally finished running, I got NOTE: There were 10564414 observations read from the data set WORK.WRKDLBX. NOTE: 10564414 observations added. NOTE: The data set CMCLMMRT.CLAIM_ITEM has 10564414 observations and 133 variables. NOTE: PROCEDURE APPEND used (Total process time): real time 1:51:50.98 user cpu time 12:36.75 system cpu time 27:33.04 memory 13480786.12k OS Memory 13505000.00k Timestamp 23/02/2018 11:46:38 a.m. Step Count 85 Switch Count 1

titan31 · ‎09-14-2017

Hi, Thanks for that. Will try that now. We need to get all the errors as we'll send it back to business with all the errors and the line numbers of the file if there are any issues. But, we don't want to continue the job as if there are issues, we don't want to upload bad data into VA

Online Status	Offline
Date Last Visited	‎01-19-2022 08:46 AM

Re: SAS response/recommendations for zero-day log4j2 CVE-2021-44228 vu...

Re: Running DataFlux jobs in Data integration Studio

Re: Running DataFlux jobs in Data integration Studio

Re: Running DataFlux jobs in Data integration Studio

Re: Running DataFlux jobs in Data integration Studio

Running DataFlux jobs in Data integration Studio

Regular backups

Re: Error on running job in Data Management Studio

Re: Error on running job in Data Management Studio

Re: Error on running job in Data Management Studio

Re: Running DataFlux jobs in Data integration Studio

Re: Regular backups

Re: SAS VA 7.5 Text Input Multi Select

Re: SAS User Accounts on Linux after migration

Re: Windows to Linux Migration

SAS 9.4M6 with Oracle 12c and 19c

Re: SAS Distributed vs Non Distributed Environment

SAS Distributed vs Non Distributed Environment

Manage Environment Headings - Loaded vs Description

Re: Safely Enabling Auditing on VA

Hotfix Installation and Recovery

Re: Giant Increase in Load Times from Oracle DB

Re: Giant Increase in Load Times from Oracle DB

Re: Giant Increase in Load Times from Oracle DB

Re: Giant Increase in Load Times from Oracle DB

Re: Giant Increase in Load Times from Oracle DB

Re: Giant Increase in Load Times from Oracle DB

Re: Giant Increase in Load Times from Oracle DB

Giant Increase in Load Times from Oracle DB

Re: VA Category Names not same as EG/DI

VA Category Names not same as EG/DI

Deleting a VA Report from Management Console

Re: SAS Real Time vs CPU Time - Table Loader Performance

SAS Real Time vs CPU Time - Table Loader Performance

Re: SAS DI Check if dataset is empty and abort if not