BookmarkSubscribeRSS Feed
deleted_user
Not applicable
Hi to all,

I've search through the internet but I haven't found a way to manage sparse matrices in SAS/IML, like in R.

Is there a way? I'm working with a very sparse matrix with 250000 rows and 17500 columns but few nonzero data.

Thanks to all

Massimo
2 REPLIES 2
Hutch_sas
SAS Employee
What do you want to do with sparse matrices? IML does support several methods for solving large sparse linear systems. See

http://support.sas.com/documentation/cdl/en/imlug/59656/HTML/default/sma_sect1.htm
deleted_user
Not applicable
I'm writing a custom implementation of PLSA (probabilsitic latent semantical analysis) in SAS/IML with an EM algorithm, but I need to manage a large dataset with circa 17000 words and 250000 documents (a 10% cut dataset for the training job is also too much for IML), but this matrix is very sparse.
So when I calculate the product between word-prob matrix and occurrence matrix, with a non sparse matrix "object", IML returns a "not enough memory" error.

SAS Innovate 2025: Register Now

Registration is now open for SAS Innovate 2025 , our biggest and most exciting global event of the year! Join us in Orlando, FL, May 6-9.
Sign up by Dec. 31 to get the 2024 rate of just $495.
Register now!

Multiple Linear Regression in SAS

Learn how to run multiple linear regression models with and without interactions, presented by SAS user Alex Chaplin.

Find more tutorials on the SAS Users YouTube channel.

From The DO Loop
Want more? Visit our blog for more articles like these.
Discussion stats
  • 2 replies
  • 1246 views
  • 0 likes
  • 2 in conversation