SAS recently tested SAS 9.4 on MS Azure instances using Sycomp Storage Fueled by IBM Spectrum Scale (GPFS) file system (https://azuremarketplace.microsoft.com/en-us/marketplace/apps/sycompatechnologycompanyinc15881921038... ). The results of the testing were very favorable.
The test infrastructure consisted of the Medium Storage Cluster offering from Sycomp (11 MS Azure instances) defined like this:
During the test, we modified some of the IBM Spectrum Scale settings to improve IO throughput:
mmchconfig pagepool=200g,prefetchPct=40,maxFilesToCache=50000,maxMBpS=4000,seqDiscardThreshold=1073741824,workerThreads=768
The 1-node test gave us 237 MB per second per physical core for WRITEs and 267 MB per second per physical core for READs.
The 2-node test gave us 225 MB per second per physical core for WRITEs and 218 MB per second per physical core for READs.
The 3-node test gave us 167 MB per second per physical core for WRITEs and 150 MB per second per physical core for READs.
The 4-node test gave us 153 MB per second per physical core for WRITEs and 112 MB per second per physical core for READs.
The 5-node test gave us 94 MB per second per physical core for WRITEs and 86 MB per second per physical core for READs.
Please note that SAS recommends a minimum of 100 MB per second per physical for WRITEs and READs.
As you can see, the Medium Storage Cluster can support the minimum IO throughput needs of a 64-core SAS Grid application. Other testing with Sycomp has shown the ability to have even more cores achieve the minimum IO throughput needs of SAS with over 100 cores. Please reach out to Sycomp for more details.
Thank you very much for this share @MargaretC , good one. I know many have been waiting for GPFS in Azure.
Are you aware if currently this file system, or any other, support HA and/or data redundancy (multiplication factor > 1) in Azure?
Thank you Margaret, more good news.
Is this what you are looking for? Sycomp Storage Fueled by IBM Spectrum Scale: A new... - SAS Support Communities
Hi Ram,
Are you using our offer in Azure to deploy the cluster? Would be happy to have a conversation.
email: jz@sycomp.com
I was confused that you are asking about Spectrum Scale in MS Azure since that is the title of this thread. General information on setting up Spectrum Scale in a non-public cloud infrastructure can be found here: performance-tuning-sas-red-hat-using-ibm-spectrum-scale.pdf
The SAS Users Group for Administrators (SUGA) is open to all SAS administrators and architects who install, update, manage or maintain a SAS deployment.
SAS technical trainer Erin Winters shows you how to explore assets, create new data discovery agents, schedule data discovery agents, and much more.
Find more tutorials on the SAS Users YouTube channel.