BookmarkSubscribeRSS Feed
woo
Barite | Level 11 woo
Barite | Level 11

we are running with sas 9.4 m6 on rhel 7. We already have one nfs drive for users which is like 60 TB where users save data for x years and asking for more, is it good idea to add more storage under same nfs mount or have another mount for old data storage and use existing one for current data which needs to be process for efficient I/O and all?

 

8 REPLIES 8
Kurt_Bremser
Super User

First of all, I would not use NFS at all in a production environment for SAS datasets, as the performance of NFS is not suited for that. And the bandwidth occupied by storage will negatively impact your other network traffic (HTTP for SAS Studio, COM for EG). If you do not use internal storage (eg Serial Attached SCSI), go for a fibre-channel based SAN.

 

That said, there are two ways to deal with "old" data. You can move it to less performant infrastructure, or you can move it to long-time archival storage, which is provided by all major backup solutions like CommVault, Spectrum Protect (ex TSM), and many others.

Moving it to the tape archive is what we do. If such data is required, it only takes a few minutes for retrieval, and the data does not occupy disk space and does not clutter up our libraries while not needed.

Anita2020
Fluorite | Level 6

Hello,

 

Good Evening,

Commvault is good for backup solutions. If anyone wants to know more about Commvault Online Course, please feel free to ping me.

 

Thanks & Regards,

Anita

SimonDawson
SAS Employee
@woo there are a few things to think about there. Your post hasn't provided much in the way of specific details so I don't think you'll get many specific suggestions. A system/storage administrator at your site is probably going to be better placed to work with you to understand the workload the current SAS environment puts on the storage and suggest a path forward that will optimally provide more space.

Generally speaking the more spindles you can get to back a file system the higher IOPS and throughput you'll get. If your solution to adding more space involves adding more drives then adding them to the same file system would see the throughput increase. If you combined the new spindles to make a new file system you'd likely have two slightly slower file systems.

Like I mentioned up the top this is very generic advice since you don't have specifics about the situation there. Hopefully one of your storage appliance admins can work with you to optimize the configuration you go for to suite the workload.
woo
Barite | Level 11 woo
Barite | Level 11

Thank you Kurt and Simon. appreciate your insights. unfortunately we have nfs storage and infect we are facing different challenges when it comes to IO and all different Application performance. we are looking into different options at the moment. 

 

Please let me know if you can recommend any good SAS papers to read...Thank you.   

SimonDawson
SAS Employee
Personally I found the Optimizing SAS on Red Hat Enterprise Linux particularly interesting.
https://access.redhat.com/articles/1593123

Also the book from Brendan Gregg "Systems Performance: Enterprise and the Cloud". I enjoyed that too.
woo
Barite | Level 11 woo
Barite | Level 11

Thank you so much Simon. I finished that article, very useful. will look out for book as well,

 

Sajid01
Meteorite | Level 14

Hello @woo 
Under your situation, the immediate solution will be to add a second drive and archive what is not needed.

About the 60 TB nfs drive, if it is being used for direct read/write by SAS programs, then please have a review of your storage solution as suggested @SimonDawson .

Anita2020
Fluorite | Level 6

Hello,

 

Good Morning,

 

We have been using Commvault for more than 5 years in my company. On some tape file servers, we use responsive pieces of our virtual equipment. The ability to deploy it across multiple platforms such as environments, file servers, and one of the most difficult issues is saving and protecting data in multiple different environments, but Commvault is the best way to support management and have an idea of ​​the backup process. . The biggest problem we had was abandoning our tape backup software. Commvault brings us a better interface and reduced support.

If anyone Interested to Learn Commvault Training, please feel free to ping me. I am there to guide you.

 

Thanks & Regards,

Anita.

 

 

 

suga badge.PNGThe SAS Users Group for Administrators (SUGA) is open to all SAS administrators and architects who install, update, manage or maintain a SAS deployment. 

Join SUGA 

Get Started with SAS Information Catalog in SAS Viya

SAS technical trainer Erin Winters shows you how to explore assets, create new data discovery agents, schedule data discovery agents, and much more.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 8 replies
  • 1921 views
  • 2 likes
  • 5 in conversation