BookmarkSubscribeRSS Feed
deleted_user
Not applicable
Hi to all,

I've search through the internet but I haven't found a way to manage sparse matrices in SAS/IML, like in R.

Is there a way? I'm working with a very sparse matrix with 250000 rows and 17500 columns but few nonzero data.

Thanks to all

Massimo
2 REPLIES 2
Hutch_sas
SAS Employee
What do you want to do with sparse matrices? IML does support several methods for solving large sparse linear systems. See

http://support.sas.com/documentation/cdl/en/imlug/59656/HTML/default/sma_sect1.htm
deleted_user
Not applicable
I'm writing a custom implementation of PLSA (probabilsitic latent semantical analysis) in SAS/IML with an EM algorithm, but I need to manage a large dataset with circa 17000 words and 250000 documents (a 10% cut dataset for the training job is also too much for IML), but this matrix is very sparse.
So when I calculate the product between word-prob matrix and occurrence matrix, with a non sparse matrix "object", IML returns a "not enough memory" error.

sas-innovate-2026-white.png



April 27 – 30 | Gaylord Texan | Grapevine, Texas

Registration is open

Walk in ready to learn. Walk out ready to deliver. This is the data and AI conference you can't afford to miss.
Register now and lock in 2025 pricing—just $495!

Register now

From The DO Loop
Want more? Visit our blog for more articles like these.
Discussion stats
  • 2 replies
  • 1787 views
  • 0 likes
  • 2 in conversation