https://communities.sas.com/t5/New-SAS-User/Memory-usage-keeps-on-increasing-with-number-of-iteration/m-p/539605#M7086 <P><SPAN>I've been using SSH (WRDS cloud) for iterating my heavy SAS procedure, where each batch command is asked to do around 10 million iteration. After 1000 iteration, I use proc datasets to delete all the temporary files, so that work library does not explode. However, I've been seeing my batch is terminated due to excessive memory issue after around 100k iterations. It seems that this is not driven by a 'single' iteration, but as the iteration number increases, the amount of memory used piles up. Can you think of any specific reason for this?</SPAN></P> Fri, 01 Mar 2019 12:59:29 GMT yajatree 2019-03-01T12:59:29Z https://communities.sas.com/t5/New-SAS-User/Memory-usage-keeps-on-increasing-with-number-of-iteration/m-p/539605#M7086 <P><SPAN>I've been using SSH (WRDS cloud) for iterating my heavy SAS procedure, where each batch command is asked to do around 10 million iteration. After 1000 iteration, I use proc datasets to delete all the temporary files, so that work library does not explode. However, I've been seeing my batch is terminated due to excessive memory issue after around 100k iterations. It seems that this is not driven by a 'single' iteration, but as the iteration number increases, the amount of memory used piles up. Can you think of any specific reason for this?</SPAN></P> Fri, 01 Mar 2019 12:59:29 GMT https://communities.sas.com/t5/New-SAS-User/Memory-usage-keeps-on-increasing-with-number-of-iteration/m-p/539605#M7086 yajatree 2019-03-01T12:59:29Z https://communities.sas.com/t5/New-SAS-User/Memory-usage-keeps-on-increasing-with-number-of-iteration/m-p/539608#M7087 <P>Do you iterate in a shell script, or from another SAS program?</P> Fri, 01 Mar 2019 13:27:11 GMT https://communities.sas.com/t5/New-SAS-User/Memory-usage-keeps-on-increasing-with-number-of-iteration/m-p/539608#M7087 Kurt_Bremser 2019-03-01T13:27:11Z