Hi all
We are now starting to use the Dataflux Data Quality Management Suite => DM Server + DM Studio.
We have a Metadata server connection and want to set up a few SAS Base Dataset Libraries as Data Sources.
The bulk of our core datasets are Metadata-bound and encrypted.
I am able to set up a connection to datasets that are not encrypted, but seem to have a problem with encrypted datasets in our Libraries.
I realise that this may not be something everyone is doing, but I will appreciate any help I can get to find out
a) Is it possible for DMStudio to work with Encrypted SAS Datasets (That are also Metadata-bound)
b) And if so, How would I do this?
There are a couple of ways to do this using DM Studio and DM Server. The BASE driver in DM Studio/Server cannot read them directly, but there are a few options available to get this to work.
One way is to use SAS Federation Server to access the data and setup a connection to federation server from DM Studio/Server. Here are instructions on how to configure SAS Federation server connections to metadata bound libraries. http://support.sas.com/documentation/cdl/en/fedsrvag/70395/HTML/default/viewer.htm#p19idcme77fiomn11...
Another way is to use SAS to reach through to the dataset. You can add a SAS code node to your Data jobs and in the code use SAS to reach through to the library. You would then have to process and land the data for DM Studio/Server to read it, but it could only be the required subset that you need for your data management jobs.
A third way is that you can call many of the data quality functions available directly from SAS such as dqparse, dqstandardize, and others. You can also call services in dm server directly from your SAS jobs that perform many data quality functions, which would not require you to move the data to a Data Management instance. For example, DI Studio has a transform available that will processrows of data in the DM Server.
Hope this helps.
Thank you Linus
Yes - we have no problems in SAS EG to work with our encrypted / Metadata-bound Libraries.
But the problem is in Dataflux Data Management Server + Studio.
Connections seem only possible to unencrypted datasets.
I was wondering if there is anyone on the planet that may have had success with this?
(We are very security conscious, hence the encryption and Metadata-bound state of our core data)
There are a couple of ways to do this using DM Studio and DM Server. The BASE driver in DM Studio/Server cannot read them directly, but there are a few options available to get this to work.
One way is to use SAS Federation Server to access the data and setup a connection to federation server from DM Studio/Server. Here are instructions on how to configure SAS Federation server connections to metadata bound libraries. http://support.sas.com/documentation/cdl/en/fedsrvag/70395/HTML/default/viewer.htm#p19idcme77fiomn11...
Another way is to use SAS to reach through to the dataset. You can add a SAS code node to your Data jobs and in the code use SAS to reach through to the library. You would then have to process and land the data for DM Studio/Server to read it, but it could only be the required subset that you need for your data management jobs.
A third way is that you can call many of the data quality functions available directly from SAS such as dqparse, dqstandardize, and others. You can also call services in dm server directly from your SAS jobs that perform many data quality functions, which would not require you to move the data to a Data Management instance. For example, DI Studio has a transform available that will processrows of data in the DM Server.
Hope this helps.
SAS Innovate 2025 is scheduled for May 6-9 in Orlando, FL. Sign up to be first to learn about the agenda and registration!
Need to connect to databases in SAS Viya? SAS’ David Ghan shows you two methods – via SAS/ACCESS LIBNAME and SAS Data Connector SASLIBS – in this video.
Find more tutorials on the SAS Users YouTube channel.