09-01-2015
thomash123
Calcite | Level 5
Member since
06-23-2011
- 38 Posts
- 0 Likes Given
- 0 Solutions
- 0 Likes Received
-
Latest posts by thomash123
Subject Views Posted 5422 09-17-2012 06:39 AM 2111 07-31-2012 10:06 AM 2276 07-30-2012 10:46 AM 9438 07-27-2012 09:49 AM 10242 07-27-2012 09:42 AM 2414 07-20-2012 09:48 AM 982 07-20-2012 09:44 AM 1069 07-19-2012 03:42 AM 1154 06-27-2012 09:53 AM 1229 06-27-2012 08:42 AM -
Activity Feed for thomash123
- Posted Re: CWM/XMI Export of ETL Jobs on SAS Data Management. 09-17-2012 06:39 AM
- Posted Re: Does SAS in batch mode run sasv9_local.cfg? on SAS Programming. 07-31-2012 10:06 AM
- Posted Does SAS in batch mode run sasv9_local.cfg? on SAS Programming. 07-30-2012 10:46 AM
- Posted Re: Hashes, Checksums and all the rest... on SAS Programming. 07-27-2012 09:49 AM
- Posted Re: Hashes, Checksums and all the rest... on SAS Programming. 07-27-2012 09:42 AM
- Posted Second last value of a column on SAS Programming. 07-20-2012 09:48 AM
- Posted Re: SAS Job connects to DB/2 then does nothing on SAS Programming. 07-20-2012 09:44 AM
- Posted SAS Job connects to DB/2 then does nothing on SAS Programming. 07-19-2012 03:42 AM
- Posted Re: Performance Performance! on SAS Procedures. 06-27-2012 09:53 AM
- Posted Performance Performance! on SAS Procedures. 06-27-2012 08:42 AM
- Posted PROC RANK on same values on SAS Procedures. 02-15-2012 09:19 AM
- Posted PROC RANK on same values on SAS Procedures. 02-15-2012 08:36 AM
- Posted Problem converting a value on SAS Programming. 12-19-2011 11:34 AM
- Posted Problem converting a value on SAS Programming. 12-19-2011 05:37 AM
- Posted Problem converting a value on SAS Programming. 12-01-2011 03:27 AM
- Posted Problem converting a value on SAS Programming. 11-30-2011 10:08 AM
- Posted Re: Problem converting a value on SAS Programming. 11-30-2011 07:56 AM
- Posted Problem converting a value on SAS Programming. 11-30-2011 03:41 AM
- Posted Hashes, Checksums and all the rest... on SAS Programming. 11-08-2011 09:17 AM
- Posted Hashes, Checksums and all the rest... on SAS Programming. 11-08-2011 08:44 AM
09-19-2019
06:27 AM
Hi all. I'm currently engaged in a project using multiple technologies including SAS/DI Studio and a non-SAS Enterprise Metadata Catalog solution has been chosen. Much of the basic data management are done using SAS/DI Studio (+500 jobs) with a typical job comprising 40-60 "objects" (tables, joins, mappings, business rules, etc.). In order to establish E2E data lineage and impact analysis we need to registrer the flows, dependencies, etc. in the "Enterprise Data Catalog" to be used by Business, Data Scientists and Data Engineers based on common Glossary/Terms across the value chain. Have tried to import a SPK exported out of SAS/DI Studio and imported into the Data Catalog, During the import it seems as if lots of objects are imported via the metadata bridge for SAS/DI Studio but of 55 objects in the SAS/DI job only 12 gets surfaced within the Data Catalog. It sounds as if there is a way as the SPK actually contains all the right information but this is not supported by SAS's CWM/XMI export/import bridges. Dispite all the major vendors wishes for a single vendor strategy, this is rarely (if never) the case in an enterprise organisation. Hence there is a need/request to be able to exchange metadata and integrate this in built for purpose Metadata Mgmt/Data Catalog solutions like Collibra, Alation, Waterline, Informatica, Talend, Oracle, SAP, etc. So, since this is not currently supported by SAS (we need this) have anyone had success in exporting a SPK and manipulate the XML-structure to successfully import a SAS/DI Studio job/flow to any of the above technologies? Thanks, Lars
... View more
08-03-2017
02:53 PM
1 Like
I have been using a macro variable with a comma delimited list of variables i want to sent to md5. so it looks like %let keyvars = %bquote(subjid, lbrefid, lbreqno, lbtestr, lbdat, lbtpt, lbrptid, lbmethod); to make it easier to live with I use a put function in creating the checksum variable. data x; set y; length checksum $32; checksum = put(md5(strip(compress(catx(&labkeys),,'c'))), hex20.); run; I found it helpful to compress out control characters, forget why at this point I was using this to create a composite key to be used to join or compare datasets, It has proven quite reliable until I discovered just this week that two datasets may have the same variable names, labels and values but if the length is different in any of the variables the checksum values will be different. That kind of blew things up. I was looking around today and came on this post about a new SHA256 function available in SAS 9.4 M1. http://blogs.sas.com/content/sasdummy/2014/01/18/sha256-function-sas94/
... View more
07-31-2012
10:06 AM
Awesome, thank you!
... View more
07-20-2012
09:44 AM
Sure, sure - of course there's nothing wrong with the DB
... View more
06-27-2012
10:04 AM
The one thing which comes to mind is that SAS can only use one index at a time - so you want to make sure that it uses the "best" one. proc sql FEEDBACK;... will write you in the log how SAS re-shuffels your query. I've also made the experience that it's sometimes really worth to re-formulate a join condition - especially if there are OR's in it.
... View more
02-15-2012
09:24 AM
I am not aware that Proc Rank is capable of doing this. When it run into tied values, it ranks them the SAME regardless, because they are TIED. Those different options of tie= do not change this. Now in addition to Art's solution, you can also take advantage of _n_ to do the job: data have; input A B ; cards; 1222 180.00 1222 180.00 1222 260.00 1223 1 1223 4 1224 2 1224 5 1224 5 1224 5 ; proc sort data=have; by a b; run; data want; do _n_=1 by 1 until (last.a); set have; by a; Rank=_n_; output; end; run; proc print;run; Regards, Haikuo
... View more
12-19-2011
11:34 AM
Thanks, Tom - I just did not find out about it, because on the one hand this never happend before when transferring the files and on the other hand the behaviour in DI studio is so odd and actually shows me a correctly imported file. th
... View more
07-26-2011
02:28 PM
SAS 9.2 provides utilities for batch promotion of metadata. This would allow you to build scripts to do partial promotions. See http://support.sas.com/resources/papers/sgf2008/migratemetadata.pdf and go to page 6 ("Batch Partial Promotion").
... View more
05-13-2011
12:56 PM
Check out the GETOPTION data step function.
http://support.sas.com/documentation/cdl/en/lrdict/64316/HTML/default/viewer.htm#a000149068.htm
... View more
05-12-2011
02:34 PM
I have confirmed that we don't have any option that turns off some of these variables but not others. As one of the other users posted, you can choose to go "All User Written" in which case we won't generate any code, it is entirely up to the user to generate whatever code they want. You can go to "User written body" which causes DI Studio to generate the macros (all of the macros, not some of them) but not the body of the transform. Or you can go to all generated. We put a requirement in to consider additional options for the future.
... View more
04-26-2011
08:04 AM
Thanks for the reply!
It is quite helpful as well to enter the required information again into the description field. This one shows more data in the diagram.
However, it somehow looks as if the developers of DI Studio never got in contact with more than a "customer" or "product" training table *irony off* 😉
Thomas
... View more
05-05-2011
05:11 PM
I did check with the developer, and there is some thought that there hasnt been any code changes in the user name resolution since 9.1.3SP4 so this problem has been there for a while. There is a TS track logged on the issue, and we will investigate a fix for a future release.
... View more
04-18-2011
09:22 AM
This isn't the best forum for your question. Try posting your question in the SAS Enterprise Data Management & Integration forum.
Good luck!
... View more