My primary objective is to find new issues in the data - things that we haven't seen before.  So, creating user topics won't work because that would only include things that I have seen before in the data. I was hoping to use the terms identified in the Text Topics node for the comparison.  From one time period to the next you would likely see some topics that are exactly the same (5 terms all the same).  You would also see some that changed (2 or 3 terms the same) and then some that are totally new terms.  I would like to score each of the topics in the new time period based on how it compares to the prior months. This is just me coming up with a potential solution.  There may be another method that I am missing to identify new issues.  Any ideas? ... View more

What about getting people to use the LIKE feature that is currently enabled but adding a sort by the number of likes for the responses? I think might be one way to start sorting through responses. Then if they're anything like facebook they can sort all the top liked comments to the top of my feed. The result is that I don't see anything new for days and don't go on.... Until I found a way to change the sorting ... View more

Hi, if there is only blank characters (more than one in string) then you can also use COMPBL function to remove excess blanks. Regards Uma Shanker ... View more

The book "Text Mining and Analysis: Practical Methods, Examples, and Case Studies ... By Goutam Chakraborty, Murali Pagolu, Satish Garla" explains your question quite well. http://books.google.ca/books?id=SUKDAgAAQBAJ&pg=PT218&lpg=PT218&dq=text+rule+builder+node&source=bl&ots=GRW1z6ay_V&sig=UcTKkT5ecN1KcZs9QOEWTQ6HLqM&hl=en&sa=X&ei=kDdQU5GLDdKG2wWAsIH4DA&ved=0CFIQ6AEwCA#v=onepage&q=text%20rule%20builder%20node&f=false ... View more

Hi Jared,      I understand the situation with your IT dept. Keep in mind, Linux is not only for server applications, it can be used as a desktop operating system too and a very great one actually.      OS and Apps don't require that much I/O so this is not where I would invest the most. A good 512 GB SSD will outperform any 2 drive RAID 0 setup in any application. You need at least 4 HD in RAID 0 to match a good 512 GB SSD. A good rule of thumb is: SSD for speed, HD for volume.      Going RAID 1 for storage is very good for data security. But you will get poor write performance and very low capacity compared to a comparable RAID 5 setup. The only issue with RAID 5 is that you will need AT LEAST 3 disks. Also, RAID 5 does not take random IO as well as RAID 1 or RAID 0 but with SAS you'll get mostly sequentiel IO so you don't have to worry about this.      Here is something to think about (please keep in mind that this is oversimplified): you have 16 cores, so you should aim for 800 MB/s of IO throughput. This is a lot but your SSD should give you close to 500 MB/s and it is safe to expect 170-200 MB/s from a 3 disk RAID 5 with a good controller. So if you plan your workload correctly, you should be able to keep this CPU busy! Yoan ... View more

Good article.  I like one of his last comments "Such phrasing also curtails the lecturer’s role, making him or her not so much a source of ideas and a repository of intellectual trust as a purveyor of data packets." As for Text analytics, this constant change of language usage is a good example why a text analytics solution is dynamic and not static.  Solutions must be constantly or periodically tweaked. ... View more

This trick is shown in http://www.sascommunity.org/wiki/List_Processing_Basics_Creating_and_Using_Lists_of_Macro_Variables ... View more

When I had this error, it had to do with my license.  My license for SAS had expired.  I was still able to load EG, but nothing in it would work. ... View more

These links are good.  It helps me understand topics and SVD much more.  I wonder if the fourth post will ever be written.  It looks like the author took a couple years off from blogging.  What these links do not do is compare the Text Cluster and Text Topic nodes. I also liked 2 other articles he linked to.  The first is about synonyms: http://blogs.sas.com/content/text-mining/2008/12/11/when-are-synonyms-useful/ and the second is a real example of SVD: http://www.nytimes.com/2008/11/23/magazine/23Netflix-t.html?_r=3&pagewanted=all& ... View more

That's very interesting.  Cases like these are why a good training corpus is necessary. It's funny how #3 and #6 seem fixable with a slight word change.  "I ate tomato with salt" and "The lamb was cooked and ready to eat".  The others are not as easily fixed. If the classification rules are difficult to make, perhaps the corpus can be modified.  While this is usually never the case, some projects can entertain this as an option. ... View more