The Cloud Data Exchange(CDE) for SAS Viya platform is available with the 2023.03 release. The CDE allows SAS users to connect a database which could be either co-located at SAS Viya platform or located at an on-premises data center. The CDE enables user to securely exchange on-premises data from behind a firewall to the SAS Viya platform in the cloud. All data transfer/exchange occurs on secured standard-based communications along with sophisticated authentication and authorization. The on-premises data center requires a single port opened through the firewall to facilitate the data exchange.
The CDE Data Agents comes with the standard SAS Viya platform and does not require a separate additional license. The CDE includes two SAS Data Agent to facilitate the data access and exchange. A Co-located SAS Data Agent, used for accessing data available at the SAS Viya platform. A Remote SAS Data Agent, used for accessing data available at on-premises data center (behind a firewall) from SAS Viya platform in cloud. There can be multiple Remote SAS Data Agents associated with a single SAS Viya deployment. The Data Agents are containerized run time service. The Co-located SAS Data Agent container starts with the standard SAS Viya platform. The Remote SAS Data Agent is a on-premises server that runs as a docker container.
The following picture describes an overall data architecture diagram of the SAS Viya platform, co-located Data Agent, and Remote Data Agent to exchange data between various locations.
Select any image to see a larger version.
Mobile users: To view the images, select the "Full" version at the bottom of the page.
The CDE enables users to directly load CAS from on-premises data and save it back to the on-premises server. The CDE access engine is available to both SAS Compute Server and CAS. A SAS user can use the CDE LIBNAME statement from the SAS Compute server and the CDE CASLIB statement from CAS to access the on-premises data sources. The CDE also enables users to move/copy on-premises data files to SAS Viya cloud storage and vice versa.
The SAS Data Agent administration and data access is supported by a microservice that provides a set of REST interfaces. A Command Line Interface 'sas-viya' CLI is available to administer the SAS Data Agents. A SAS user from the "SAS Data Agent Administrators" group can execute administrative tasks like creating domains and data services at the SAS Data Agent. A SAS user from the “Data Agent Power Users” group can perform tasks like DML (insert, update, and delete), DQL(select), and DDL (create and drop table) at SAS Data Agent.
The CDE Data Agent supports following data sources to exchange data.
The configuration of communication between the Remote Data Agent and the SAS Viya platform is a challenging task. An admin user has to have some degree of expertise in configuring the SAS Viya platform with encrypted (TLS..) communication. Stay tuned in for the next blog on how to deploy and configure Remote Data Agent to securely communicate with the SAS Viya Platform.
Many thanks to my colleague Brian Hess for sharing the expert knowledge and help on this post.
Find more articles from SAS Global Enablement and Learning here.
Registration is open! SAS is returning to Vegas for an AI and analytics experience like no other! Whether you're an executive, manager, end user or SAS partner, SAS Innovate is designed for everyone on your team. Register for just $495 by 12/31/2023.
If you are interested in speaking, there is still time to submit a session idea. More details are posted on the website.
Data Literacy is for all, even absolute beginners. Jump on board with this free e-learning and boost your career prospects.