topic Is there a way to breakup a proc tmspell run into a set of smaller tasks? in SAS Data Science

Is there a way to breakup a proc tmspell run into a set of smaller tasks?

art297 — Wed, 17 Oct 2012 12:33:57 GMT

I'm trying to run proc tmspell on a file that has almost 2 million entries. The proc has been running for the past 20 hours and I have no way of knowing which will come first: the proc's completion or a power outage.

Is it possible to break such a run up into sections so that one can take advantage of parallel processing? I haven't been able to find any documentation for the proc, thus am just assuming it may help in accomplishing a particular task. Specifically, we are trying to create two crosswalks, one regarding spelling and another basically a list of synonyms.

TIA,

Art

Re: Is there a way to breakup a proc tmspell run into a set of smaller tasks?

CraigDeVault — Thu, 17 Aug 2017 17:03:18 GMT

There is not a way to have the procedure broken up into multiple sections from a parallel or multi-threaded point of view. The best practice for running PROC TMSPELL on a large data set would be to perform some pre-processing beforehand. For exampl, in the terms table that is output by PROC TGPARSE, subset the table and only use the terms that have a Keep status of Yes. This should shrink the number of terms to be run through PROC TMSPELL considerably and will thus increase performance immensely.