cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
milts
‎05-12-2018
  • 339 Posts
  • 30 Likes Given
  • 0 Solutions
  • 23 Likes Received

Clustering Links

by Pyrite | Level 9 in SAS Programming
‎04-18-2016 12:42 AM
‎04-18-2016 12:42 AM
I would like to seek your expert advice how do i attain the result table by using the source. I would want to group the ids which are linked together.   As you can see here id 5 is actually both linked to id 1 and 4, but the score of the link between 1 and 5 is higher. Reason that on the desired result it 5 will be under group 1   Greatly appreciate your inputs.   data source; input id1 id2 score; datalines; 1 2 8 1 3 8 3 5 10 5 4 7 4 6 8 ; data result; input group id; datalines; 1 1 1 2 1 3 1 5 2 4 2 6 ; ... View more

Re: Merging Multiple Datasets

by Pyrite | Level 9 in SAS Programming
‎04-03-2016 11:44 PM
‎04-03-2016 11:44 PM
Thanks for the idea. My code previously was like using full outer join like these   select coalesce(a.id_A,b.id_A,....j.id_A) as id_A, select coalesce(a.id_B,b.id_B,....j.id_B) as id_B, score_1,...score_10     ... View more

Re: Merging Multiple Datasets

by Pyrite | Level 9 in SAS Programming
‎04-03-2016 11:13 PM
‎04-03-2016 11:13 PM
For each dataset, there is only one instance of the combination of an id_A and id_B.   Currently I'm using full outer join but I think there's a more efficient way. ... View more

Merging Multiple Datasets

by Pyrite | Level 9 in SAS Programming
‎04-03-2016 10:22 PM
‎04-03-2016 10:22 PM
I have tables with these structure, two IDs and a score.     id_A,id_B,score_01 id_A,id_B,score_02 id_A,id_B,score_03 id_A,id_B,score_04 id_A,id_B,score_0n   What's the most efficient way to combine so that i have a structure id_A,id_B,score_01,score_02,score_03,score_04,score_0n?   Not that the combination of id_A and id_B may not be existing in all datasets.   Thank you very much! ... View more

Re: Cartesian Product Efficiencies

by Pyrite | Level 9 in SAS Programming
‎04-03-2016 10:13 PM
‎04-03-2016 10:13 PM
Thanks for your inputs. I have just decided to have another field to be included to at least trim down the observations to be comapred and not have a single row compared to the whole base ... View more

Re: Cartesian Product Efficiencies

by Pyrite | Level 9 in SAS Programming
‎03-31-2016 11:37 PM
‎03-31-2016 11:37 PM
I want to match each record to the rest of the dataset and identify possibility that record A and B are the same based on some variables(var1 and var2 in my example).   One fuzzy match I want to explore is using complev and then just keep the records with a low complev value. ... View more

Re: Cartesian Product Efficiencies

by Pyrite | Level 9 in SAS Programming
‎03-31-2016 11:26 PM
‎03-31-2016 11:26 PM
The matching I'm referring to is more on some fuzzy matches.    An example with be using complev on var1.   Or would you suggest that on the joining condition I already use complev?   Greatly appreciate your inputs. Thank you! ... View more

Cartesian Product Efficiencies

by Pyrite | Level 9 in SAS Programming
‎03-31-2016 08:48 PM
‎03-31-2016 08:48 PM
I have a 200k customer base  and would like to do compare each record to other records in the data set.   After merging the current row of comparison to all other records, I'm planning to do some matching or comparison of some fields.    Appreciate for any recommendation on how to speed this up as let's say the customer base grow bigger, would it be advisable to split the base table and the do the merging multiple times or merging with the whole table is better?   Thanks in advance!   data current; n=1;  set base point=n; output; stop; run; do test; set current(rename=(id=curr_id var1=curr_var1 var2=curr_var2)); do i=1 to 200000; set base point=i; output; end; run;     ... View more

Record Matching Across Single Table

by Pyrite | Level 9 in SAS Programming
‎03-27-2016 10:48 PM
‎03-27-2016 10:48 PM
I have a data set with 100k records of customer information.   I'm planning to build some simple rules for matching (ex. firstname + lastname);   So the code must go like matching record 1 to the other records then if it matches then i put the ids of these records in an output table.   Greatly appreciate your advise what are the possible faster approaches to attain these matching of records across a single table.   Thanks! ... View more

Getting Consecutive Days

by Pyrite | Level 9 in SAS Programming
‎09-16-2015 08:58 AM
‎09-16-2015 08:58 AM
I have two tables which I need to combine as sometimes some dates are found in table A and not in table B and vice versa. My desired result is that for those overlaps on consecutive days be combined. How can I achieve this using proc SQL only? Table A id startdate enddate-------------------------- 101 12/28/2013 12/31/2013 Table B id startdate enddate-------------------------- 101 12/15/2013 12/15/2013 101 12/16/2013 12/16/2013 101 12/28/2013 12/28/2013 101 12/29/2013 12/31/2013 Desired Result id startdate enddate------------------------- 101 12/15/2013 12/16/2013 101 12/28/2013 12/31/2013   ... View more

Re: Does update on config file require restart?

by Pyrite | Level 9 in Administration and Deployment
‎07-28-2015 05:02 AM
‎07-28-2015 05:02 AM
Thanks I forgot it can sortsize can be overridden in the option statement as well. Apparently I am still having some sort execution failure even with 4G set on sortsize. ... View more

Sort Execution Failure

by Pyrite | Level 9 in SAS Procedures
‎07-28-2015 05:00 AM
‎07-28-2015 05:00 AM
Hi, I have 3 greenplum tables (1.2 million recs,100+ numeric fields) each and then joined together with some small sas tables for lookup and then grouped by id. I have to run this process every month and from time to time I am able to process it successfully. But recently I have been hitting a sort execution failure when processing the join. MEMSIZE is already set to 8G(max) ever since. I have playing around with sortsize 1G, 2G up to 4G and this chunk still fails. In terms of disk space of SAS server, we still have around 60gb in space. So I believe this shouldn't be much of an issue. Greatly appreciate any advise on how to address this problem. Thanks! ... View more

Does update on config file require restart?

by Pyrite | Level 9 in Administration and Deployment
‎07-20-2015 02:10 AM
‎07-20-2015 02:10 AM
Hi, We have been hitting the sort execution failure recently on our batch jobs. memsize in sasv9_usermods.cfg was already set . Appreciate if someone confirm that if we apply changes to the sasv9_usermods.cfg file to adjust sortsize, do we need to restart our SAS servers or it will automatically be in effect on our next batch run? The config file I'm pertaining to is the one which usually sits in the SAS/Config/Lev1 foldfsor Thanks! ... View more

Re: LSF Job Hangs

by Pyrite | Level 9 in Administration and Deployment
‎11-12-2014 02:25 AM
‎11-12-2014 02:25 AM
Kindly correct if my understanding is wrong that in the back-end something might have killed the sas process or might have been disconnected? Because the flow is automated to be triggered on a Saturday evening and no one issued it the job or flow to be killed. Thanks! ... View more

Re: LSF Job Hangs

by Pyrite | Level 9 in Administration and Deployment
‎11-12-2014 01:13 AM
‎11-12-2014 01:13 AM
I have already attempted this steps as well. In SAS DI it works perfectly without any error. Also, It hangs on the same step. In the greenplum active queries this is what I can see hanging which is part of the script: (modified table/column names for security reasons) insert into "WRK"."TMP2" select "TMP1"."id", "TMP1"."highestamount", "TMP1"."latestdate", (select "MAINSRC"."amount" from "WRK"."MAINSRC" as "MAINSRC" where "TMP1"."id" = "MAINSRC"."id" and "TMP1"."latestdate" = "MAINSRC"."txndate" order by "MAINSRC"."id" desc limit 1 ) as "latestamount", "TMP_RSM_PBHV_CCF1_MTH"."outstanding" from "WRK"."TMP1" as "TMP1" ... View more
Contact Me
Online Status
Offline
Date Last Visited
‎05-12-2018 02:19 AM
Likes given to
Quick links