If you are using (or planning to use) Red Hat's GFS2, PLEASE READ this Advisory

MargaretC — Wed, 07 Dec 2016 15:11:37 GMT

Red Hat’s GFS2 shared file system is a popular shared file system for SAS Grid Manager. If you have recently implemented, or are planning an architecture that requires individual nodes to perform roughly 800 MB/sec or faster throughput for an individual shared file system (e.g. each SASWORK or SASDATA), you need to understand about a new issue we have found with GFS2. Recent throughput testing has uncovered throttled WRITE performance due to a spin lock that controls journal writes to the specific GFS2 file system. The spin lock can become overwhelmed by handling journal locking for competing processes with high throughput. The ceiling for a single node, against single SASWORK or SASDATA file system has shown to be around 800 MegaBytes per second.

Short Facts:

This does not affect READ Performance.
This issue exists in all versions of GFS2, in both RHEL6 and RHEL7.
Red Hat is currently working on the issue. Unfortunately there are changes to several non-trivial items in this process chain that need to be made. It is currently unknown how much the individual changes will affect the outcome of the fix plan and effectiveness. An estimated date for changes has not yet been published, and the change plan will be different for RHEL6 to RHEL7.
Any SAS GRID host node trying to push more than 800 Megabytes per second towards any single file system (SASWORK, SASDATA) will find throughput throttled at that rate.
Higher core counts (e.g. 8 cores and above) and high node application write requests are situations that can drive this throughput rate, and possibly cause this issue to present.

More information will be shared as soon as it is available.

Re: If you are using (or planning to use) Red Hat's GFS2, PLEASE READ this Advisory

MargaretC — Tue, 03 Jan 2017 16:22:43 GMT

Just wanted to let everyone know there is a SAS Usage Note on this subject: http://support.sas.com/kb/59/476.html

At the bottom of the SAS Usage Note is a link to a Red Hat document on the same subject. https://access.redhat.com/solutions/2786031

topic Re: If you are using (or planning to use) Red Hat's GFS2, PLEASE READ this Advisory in Administration and Deployment

If you are using (or planning to use) Red Hat's GFS2, PLEASE READ this Advisory

Re: If you are using (or planning to use) Red Hat's GFS2, PLEASE READ this Advisory