BookmarkSubscribeRSS Feed

Where to define your SAS libraries in SAS Viya? Part 2

Started ‎05-15-2024 by
Modified ‎05-15-2024 by
Views 736

After first part, let’s continue our journey on identifying where to define SAS libraries.

 

So far, we have discussed:

 

  • The global way
  • The contextual way
  • The personal way

 

The UI way

 

Libraries can also be defined using a dedicated User Interface in SAS Studio. This is what Gerry’s blog mentioned in the first part is about.

 

01_NR_nir_post_96_01_sas_studio_new_library-1024x692.png

 

Select any image to see a larger version.
Mobile users: To view the images, select the "Full" version at the bottom of the page.

 

Multiple cases can then happen:

 

  1. A user with no administrative privilege creates a library and doesn’t check “Assign and connect to data sources at startup”

 

02_NR_nir_post_96_02_new_library_case_1-1024x767.png

 

This library is created in the Data Sources microservice. Thus, it is available to a SAS Administrator in SAS Environment Manager as a resource that could be attached to a context (see later).

 

The library will be available as a "Disconnected Library" at next user’s session, regardless of the context. It is tied to a user.

 

It is not added to the user’s SAS Studio autoexec.

 

  1. A user with no administrative privilege creates a library and does check “Assign and connect to data sources at startup”

 

03_NR_nir_post_96_03_new_library_case_2-1024x751.png

 

This library is created in the Data Sources microservice. Thus, it is available to a SAS Administrator in SAS Environment Manager as a resource that could be attached to any context (see later).

 

The library will be available as a “Connected Library” at next session for this user, regardless of the context, because it has been added to the user’s SAS Studio autoexec, through the LIBDEF= LIBNAME option.

 

04_NR_nir_post_96_04_autoexec_libdef-1024x217.png

 

  1. A user with administrative privilege creates a library, checks “Allow all users to view the library connection” but doesn’t check “Assign and connect to data sources at startup”

 

05_NR_nir_post_96_05_new_library_case_3-1024x932.png

 

This library is created in the Data Sources microservice. Thus, it is available to a SAS Administrator in SAS Environment Manager as a resource that could be attached to any context (see later).

 

This library is added to the current context (the one that the user is currently connected to) as a resource. So, it will be available to any user starting a session with this context, as disconnected or as connected (depending on the choice made in the radio box).

 

It is not added to the user’s SAS Studio autoexec, so it will not be available if the user switches to another context.

 

  1. A user with administrative privilege creates a library, checks both “Assign and connect to data sources at startup” and “Allow all users to view the library connection”

 

06_NR_nir_post_96_06_new_library_case_4-1024x943.png

 

This library is created in the Data Sources microservice. Thus, it is available to a SAS Administrator in SAS Environment Manager as a resource that could be attached to any context (see later).

 

This library is added to the current context (the one that the user is currently connected to) as a resource. So, it will be available to any user starting a session with this context, as disconnected or as connected (depending on the choice made in the radio box).

 

The library will be available as a “Connected Library” at next session for this user, regardless of the context, because it has been added to the user’s SAS Studio autoexec, through the LIBDEF= LIBNAME option.

 

07_NR_nir_post_96_07_autoexec_admin_libdef-1024x233.png

 

This is where some confusion can occur because the library is attached to a context and is also defined in the user’s autoexec. So, if the user starts a session using the original context (the one that was used to define the library), the library is assigned twice (the first time from the context, the second time from the autoexec). In reality, it doesn’t really matter. The user sees only one library. But this helps understand how libraries are assigned.

 

Impacts of the UI way

 

Now that we know how to use the UI to define libraries, additional questions arise.

 

 

Where do I see that a library defined in the UI has been attached to a context?

 

Indeed, by checking “Allow all users to view the library connection”, an admin adds a library to the current context. But how does this materialize?

 

In SAS Environment Manager, you can observe the results of that action in the context:

 

08_NR_nir_post_96_08_context_resources-1024x452.png

 

The libraries associated with a context show up under Resources. The Assign check box depends on how the library has been set up (Add as disconnected / Add as connected). Thus, you can have libraries defined under Resources and libraries defined under Advanced in the autoexec.

 

 

How can I add data source definitions to other contexts?

 

Since data source definitions are available globally to a SAS admin, he can decide to attach them to any context. For example, if he wants to add the ADCONT1 and ADCONT2 libraries to another context (for example the SAS Job Execution compute context), he will edit the compute context, go into Resources, then click on the + sign:

 

09_NR_nir_post_96_09_add_context_resources-1024x443.png

 

Then, the SAS admin will select the definitions:

 

10_NR_nir_post_96_10_select_resource-1024x618.png

 

And customize them if needed (assign them by default, rename them):

 

11_NR_nir_post_96_11_customize_resource-1024x547.png

 

 

Instead of providing all the connection details in a SAS code autoexec, can I use the library definitions from the UI (using the LIBDEF= LIBNAME option) at a global level (compute for example)?

 

Yes, I can. I just need to find the right data source definition URI. The quicker way is to check “Assign and connect to data sources at startup” when defining a data source in the UI and check the SAS Studio autoexec right after. You should see the exact syntax of what you would use:

 

12_NR_nir_post_96_12_get_uri_from_autoexec-1024x226.png

 

Then you can edit the compute server (like shown in “the global way”, previous blog) and add the library using the LIBDEF= syntax:

 

13_NR_nir_post_96_13_libdef_library_global-1024x434.png

 

 

Where can I find all data source libraries defined in the UI by SAS users and how can I obtain their URI?

 

An admin can list them when trying to add a library to a context (Select a resource dialog show above). But this won’t give the URI needed by the LIBDEF= LIBNAME option.

 

The other option is to use the SAS Viya REST API to list all data source definitions and eventually obtain their URI.

 

Here are some examples:

 

# Using curl
# List all
curl -k "https://${SAS_VIYA_END_POINT}/dataSources/providers/Compute/sourceDefinitions" \
   -H "Authorization: Bearer $VIYA_ACCESS_TOKEN"
# Query one
curl -k "https://${SAS_VIYA_END_POINT}/dataSources/providers/Compute/sourceDefinitions?filter=eq(name,'ADMIN_CONTEXT2')" \
   -H "Authorization: Bearer $VIYA_ACCESS_TOKEN"

# Using pyviyatools https://github.com/sassoftware/pyviyatools
callrestapi.py -m get -e "/dataSources/providers/Compute/sourceDefinitions?filter=eq(name,'ADMIN_CONTEXT2')"

 

 

Here is a sample output:

 

14_NR_nir_post_96_14_data_source_definition-1024x737.png

 

 

Recap

 

We have been able to see that we can define libraries at different levels and scopes:

 

  • At the server level (compute, batch, connect, etc.)
  • At the context level (for compute servers)
  • At the user level for SAS Studio (which works across contexts)

 

15_NR_nir_post_96_15_recap_scope-1536x532.png

 

We have also observed that libraries defined using the “New Library Connection” wizard in SAS Studio can be managed, attached to compute contexts as Resources and used in library assignment with the LIBDEF= LIBNAME option.

 

 

What’s next?

 

In the future, a central and universal approach will be used to create and manage data source connections for both SAS Cloud Analytic Services (CAS) and SAS servers (compute, batch, etc.). One unique connection will be used to define both a CASLIB (for CAS) and a library (for SAS servers). This will improve the user experience and greatly reduce the maintenance of data source definitions in SAS Viya.

 

This new “Connections” component already exists for CAS connections only (it is NOT yet available for SAS libraries in SAS Studio) and is available in the “Manage Data” menu (SAS Data Explorer):

 

16_NR_nir_post_96_16_data_explorer_add_connection-1024x545.png

 

Defining and maintaining a data source connection becomes easier, fully guided, with a quick access to a lot of options, quick access to the documentation and requirements directly from the connection dialog, ability to search for options and to see what changes have been made.

 

17_NR_nir_post_96_17_data_explorer_connection_details-1024x622.png

 

 

Thanks for reading.

 

 

Find more articles from SAS Global Enablement and Learning here.

Comments

@NicolasRobert Thank you for providing clarity on this topic. I have a question: we have defined domains for oracle databases schemas. When we add such oracle database library to the compute context, then users who are not in the domain are not able to start the compute session in SAS Studio at all. Is this how the context supposed to work? We thought it will load the compute session without the library. We have added this library to the autoexec of  the compute server. Then we have no problems and users can start compute session without this library if they have no permission for it. regards Karolina 

Hello
The library locations have been defined as "/delcontent/data/etc".
Wondering if this is a physical location on user accessible disk OR in the contents in the  web infrastructure data server?

With the REST API I can list all data source definitions. Can I create the compute data source using the REST API? If yes, how looks the syntax?

Thanks @GuenterGreulich 
I am a newbie for SAS Viya. Can you please share the sample code, which I can experiment with.
Thanks

@touwen_k 

Hi Karolina and thanks for your message. I just tried and I did not reproduce the issue. I was able to start a Compute session even with a user who is not authorized to access the authentication domain. The Compute context started without the Oracle library as expected.

Which SAS Viya version are you using and what is your syntax?

Here is what I did:

NicolasRobert_0-1717610396104.png

 

@thesasuser 

Hello.

/gelcontent/data is a physical path accessible from the SAS Compute Server. It is not a path from SAS Content. 

@GuenterGreulich 

Hello.

I believe this is doable as per the documentation (https://developers.sas.com/rest-apis/dataSources-v3), especially this: https://developers.sas.com/rest-apis/dataSources-v3?operation=createSourceDefinition.

I don't have an example to share though.

@NicolasRobert  hello Nicolas, thank you for checking. We have just updated to version 2024.04. Our users have put the libraries in different tab Resources, and then you cannot start the compute session.

touwen_k_0-1717665590882.png

 

Version history
Last update:
‎05-15-2024 11:10 AM
Updated by:
Contributors

sas-innovate-2024.png

Available on demand!

Missed SAS Innovate Las Vegas? Watch all the action for free! View the keynotes, general sessions and 22 breakouts on demand.

 

Register now!

Free course: Data Literacy Essentials

Data Literacy is for all, even absolute beginners. Jump on board with this free e-learning  and boost your career prospects.

Get Started