BookmarkSubscribeRSS Feed

SAS Viya on Microsoft Azure Marketplace: Three Ways to Import your Data files

Started ‎10-19-2022 by
Modified ‎11-11-2022 by
Views 2,508

SAS Viya has been released in the Microsoft Azure Marketplace last month during SAS Explore virtual user conference. With the click of a button on a pay-as-you-go basis, one can start working on SAS Viya in minutes. Being able to get access so quickly to SAS Viya is a huge step forward.

 

Now that you have SAS Viya up and running on Microsoft Azure, where do you start? How do you get data in there?

 

Let’s review three simple ways to import data files into SAS Viya on Microsoft Azure.

 

 

SAS Data Explorer – “Manage Data”

 

Manage Data” is the SAS application used to define data sources, load data into memory, discover metadata, and so on. It’s also where you can import data files from your client machine:

 

nir_post_80_01_import.png

Select any image to see a larger version.
Mobile users: To view the images, select the "Full" version at the bottom of the page.

 

This approach offers you many options to customize (type of file, delimiter, etc.) how you want to read a file from your machine:

 

nir_post_80_02_import_details.png

 

If you want to know more about “Manage Data”, here is the documentation.  

 

 

Upload files in SAS Studio – “Develop Code and Flows”

 

  A second option is to upload data files to the "Files" location that has been setup out-of-the-box for you. You can do that from SAS Studio:

 

nir_post_80_03_upload_files.png

 

 

In the “Upload Files” window, you can choose multiple files from your client machine:

 

nir_post_80_04_upload_details.png

 

 

You can observe that:

  • Each file is limited to 100MB, limit that you can change in SAS Environment Manager (see below)
  • Files will be available to both SAS Compute Server and SAS Cloud Analytic Services (CAS) under the path indicated at the top of the window:

 

nir_post_80_05_sas_access.png

 

 

Change the Maximum Upload Size

 

The SAS Viya Administrator (viya_admin by default or any other administrator added afterwards) can change the maxUploadSize property in SAS Environment Manager as shown below:

 

nir_post_80_06_maxUploadSize.png

 

  

Upload files to the NFS server using scp

 

If you are looking for a more industrial way to upload files and folders, then you can directly connect to the jumpbox, an additional server created out-of-the-box, and upload data from there.

 

Indeed, when you create an instance of SAS Viya on Microsoft Azure, you are proposed to save the SSH public key on your machine which enables you to connect to the jumpbox through SSH or SFTP:

 

nir_post_80_07_ssh_download.png

 

Save the SSH key pair somewhere and protect it (give it the right permissions).

 

Then obtain the jumpbox IP address. Open your Managed Resource Group in the Microsoft Azure Portal and look for the jump-vm object:

 

nir_post_80_08_jumpbox_ip.png

 

You are ready to use SCP or an SFTP tool. Here is a SCP command example:

 

scp -i ~/svoma.pem -r mydata jumpuser@20.1XX.XX7.89:/viya-share/sas-viya/data

 

Here, I am uploading a local directory “mydata” and all its contents to the “/viya-share/sas-viya/data” remote directory.

 

Keep in mind that

 

/export/sas-viya/data in SAS

 

maps to

 

/viya-share/sas-viya/data on the jumpbox

 

Anything created in this folder on one side will be reflected on the other side:

 

nir_post_80_09_path_mapping.png

 

 

 

Again, both SAS Compute Server and SAS Cloud Analytic Services (CAS) can access this path seamlessly.

 

If you want to know more about SAS Viya on Microsoft Azure, check the documentation and the community forum.

 

Find more articles from SAS Global Enablement and Learning here.

Version history
Last update:
‎11-11-2022 04:42 PM
Updated by:
Contributors

sas-innovate-2024.png

Available on demand!

Missed SAS Innovate Las Vegas? Watch all the action for free! View the keynotes, general sessions and 22 breakouts on demand.

 

Register now!

Free course: Data Literacy Essentials

Data Literacy is for all, even absolute beginners. Jump on board with this free e-learning  and boost your career prospects.

Get Started