About Grumbler

Grumbler · ‎08-09-2017

thanks everyone for the tips. i guess i should clarify a bit more. what i have is millions of records of "strings" in one variable. i have another maybe 10 or 20 lists of key words. i would like to count each list of key words in the millions of "strings" and see which list has most frequency. then i will decide how to categorize these strings. was just wondering if there is a fast way to do that. thanks. 🙂

Grumbler · ‎08-09-2017

but this only works for 3 words. i have hundreds of keywords that i would like to count. can't type it all like this. it's all in macro. thanks.

Grumbler · ‎08-09-2017

searched around but couldn't find what i need. example, string="lksadfjlkjthisiswhatineed thisiswhat ineedlkaflkasfdlkj"; i can use prxmatch("m/this|what|need/oi",string); but it only returns the position of the first word. how do i count the all of the words in this string? thanks.

Grumbler · ‎07-05-2017

thanks everyone. problem solved. forgot about using macro loops inside the data step. 🙂

Grumbler · ‎07-05-2017

so i have coded thousands of macro variables each containing a if statement that i need to process in a data step. ideally, i can just make 1 macro and run it. however, it's too big for 1 macro variable to handle. so i have no choice but to create thousands. so how do i call each of the macro variable in 1 data step? right now, i am doing a loop which will call 1 macro at a time but it's just terrible inefficient. example, %do i=1 %to &count %by 1; data step; set step; &macro&i; run; %end; something like this. how can i make this into 1 data step and run all macro variables within? thanks a bunch.

Grumbler · ‎08-18-2016

are there any script to validate the servers? want to setup some schedule jobs to check the status of the servers. thanks.

Grumbler · ‎07-26-2016

thanks. unfortunately, don't think time allows training at this point. was a pretty short notice. i will try to get some training scheduled but may come at end of this small project. anyhow, did some reading last night and it seems i just have to use proc lasr and other proc to start/stop/load/unload or manipulate data in lasr engine. i suppose VA is integrated in that it will just present report using the in-memory data. i guess my question is, is loading data into lasr engine a manual step? everytime there is new data, we need to run proc lasr to append? no real time synch? hope i am asking the right thing. lol

Grumbler · ‎07-26-2016

going to be assigned to a project with SAS LAZR and VA. never worked with the new product before. from what i read, it loads data into memory for faster processing. now, for the project, we will use MySQL database and we need to load the data to SAS LAZR. as the team puts it, "SAS programming of reading from MySQL and then writing to SAS LAZR". for most part, this should be straight forward SAS programming right? maybe some new proc specific to SAS LAZR? also, how is the data loaded from MySQL to SAS LAZR? is it just 1 time load in which i program something to load the data or something else? once data is loaded, VA should be similar to previous version of BI Dashboard, SNA etc.? you just select the loaded tables and proceed with the BI programming? thanks.

Grumbler · ‎04-07-2016

oops. sorry. i think we have a problem with the scripts. the data steps creates temp tables after delete records. but the server doesn't have enough space for temp table anymore. sql delete does not physically deletes the records so the file size is still the same. any ideas? thanks.

Grumbler · ‎04-05-2016

yep, found it. just a few simple SQL statements. should've thought of it before. 🙂 thanks a bunch.

Grumbler · ‎04-05-2016

we have environment manager setup and it's working fine as we observe that the artifacts datasets have accumulated over 100 gigs. however, we are running out of server space. just wondering if we just move those artifacts datasets to another drive, would it impact the process? \SASEnvironmentManager\emi-framework\apm\Data\artifacts talking about the files in this folder. if we remove them would the .bat file re-create those files again later? thanks.

Grumbler · ‎03-01-2016

can someone explain how does the SAS Excel Add-in work as far as loading the data from a large query? does SAS get the data in SAS dataset format first on the server and then download and convert to Excel format and load in the worksheet? how to improve the speed of loading a large amount of data on Excel using SAS? thanks.

Grumbler · ‎03-01-2016

can someone explain to me how does the EG Export step works? not proc export, but the part where you right click a dataset (on the server) and then click export as Excel format. this step is taking a long time if the dataset is large. any way to improve the speed? thanks.

Grumbler · ‎01-14-2016

i have a program with filename statement pointing to a file with a network path. then use the infile statement to convert it to SAS dataset. it works fine vast majority of the time. however, once in a while when we process tons of jobs at same time, one or two will fail due to error of can not find the file. obviously, the file is there. any ideas? thanks.

Grumbler · ‎06-29-2015

again, thanks all. i am not going to have time to study all of the details. however, we do have a testing environment for me to play around. sas may also offer help directly. obviously i don't have enough experience with this as i am just a programmer and analyst. just got thrown into this mess since no one else knows sas in the project at the moment.

Online Status	Offline
Date Last Visited	‎08-12-2018 05:54 AM

Re: [tm] counting multiple substrings in one string

Re: [tm] counting multiple substrings in one string

[tm] counting multiple substrings in one string

Re: too many conditional statements for large datasets

too many conditional statements for large datasets

Script Server Validation

Re: New to SAS LAZR...

New to SAS LAZR...

Re: SAS Environment Manager Artifacts Backup

Re: SAS Environment Manager Artifacts Backup

Re: SAS Environment Manager Artifacts Backup

Re: Enterprise Guide Export Step

Re: Large Query

Re: SAS Access Control

Re: SAS Access Control

Script Server Validation

Re: SAS Environment Manager Artifacts Backup

Re: [tm] counting multiple substrings in one string

Re: [tm] counting multiple substrings in one string

[tm] counting multiple substrings in one string

Re: too many conditional statements for large datasets

too many conditional statements for large datasets

Script Server Validation

Re: New to SAS LAZR...

New to SAS LAZR...

Re: SAS Environment Manager Artifacts Backup

Re: SAS Environment Manager Artifacts Backup

SAS Environment Manager Artifacts Backup

Large Query

Enterprise Guide Export Step

ERROR: Physical file does not exist

Re: SAS Access Control