@wang267 wrote:
Hi everyone,
I am just curious about how large is the Work library. Will it be able to contain a data set with 1 billion observations and 100 variables?
However, in IML, a 10000 * 10000 matrix cannot be simulated at one time. Log said something like "need more bytes". Is this related to size of work library or computer memory? Or, work library size is related to computer memory ?
It depends. At my old work place we each had a 2GB limit on the work library and had to get it removed if we worked with big data. At other places there were no restrictions beyond my computer size. You can also redirect work to a network drive which would likely have unlimited space but your read/write time will increase slowing everything down.
... View more