generate a TFIDF vectorization and a BOW vectorization

sateh — Tue, 06 Sep 2022 13:57:59 GMT

I have a table where I store a document id and a text variable that contains all the text of the document. I would like to know if there is any function in sas to be able to generate a TFIDF vectorization and a BOW vectorization of the complete collection.

Re: generate a TFIDF vectorization and a BOW vectorization

ballardw — Tue, 06 Sep 2022 15:01:54 GMT

FEBA, LDLC and other acronyms like your TFIDF and BOW should really be spelled out or provide an example. Not every one uses the the same acronym for things. I have worked with people that had their jargon to obfuscate that a process was basically a second-derivative of an equation evaluated at specific values. But I had to work through a lot of stuff to determine that was what was actually needed because they kept insisting on using subject-matter specific jargon.

So, what is a TFIDF or BOW and where do I find an example.

(For those curious enough to read this far FEBA = Forward Edge of the Battle Area, LDLC= Line of Departure Line of contact, both graphic concepts on 1980's military maps (the jargon changes periodically), are closely related and could be "vectorized" but I wouldn't bother )

topic generate a TFIDF vectorization and a BOW vectorization in SAS Programming

generate a TFIDF vectorization and a BOW vectorization

Re: generate a TFIDF vectorization and a BOW vectorization