Thanks Reeza.  Good idea to add this to the ballot. I did see that macro solution, but it certainly is not pretty. ... View more

I've been coming to the same conclusion.  If it a macro countapart is possible (and it likely is), the code would likely be painful. ... View more

I'd also be interested if anyone has used BR.  OCR does not work well on my surveys that contain handwritten comments, but this BR approach sounds promising. ... View more

These links are good.  It helps me understand topics and SVD much more.  I wonder if the fourth post will ever be written.  It looks like the author took a couple years off from blogging.  What these links do not do is compare the Text Cluster and Text Topic nodes. I also liked 2 other articles he linked to.  The first is about synonyms: http://blogs.sas.com/content/text-mining/2008/12/11/when-are-synonyms-useful/ and the second is a real example of SVD: http://www.nytimes.com/2008/11/23/magazine/23Netflix-t.html?_r=3&pagewanted=all& ... View more

The first thing I do with strange error messages in EG or EM is to check my SAS license.  If your SAS license has expired, it will result in weird errors.  Follow these instructions to check your license expiration: http://support.sas.com/kb/24/283.html I don't really use EG, but my three guesses as to what is going on would be: - Have you recently upgraded EG?  Perhaps you are trying to run a project from a previous version of EG... - The "Task" is a Custom Task which is no longer registered with EG.  You can learn more about custom tasks here and you may need to re-register it: http://www.sas.com/reg/web/corp/2246736 - You may need to install some hotfixes for your version of EG.  Check which version you are running by going to the HELP menu in EG and selecting ABOUT ... View more

That's very interesting.  Cases like these are why a good training corpus is necessary. It's funny how #3 and #6 seem fixable with a slight word change.  "I ate tomato with salt" and "The lamb was cooked and ready to eat".  The others are not as easily fixed. If the classification rules are difficult to make, perhaps the corpus can be modified.  While this is usually never the case, some projects can entertain this as an option. ... View more

You see this type of thing in other programming languages. Python and C# (and therefore Java) all have it.  If conversation with someone, you refer to it as "op equals" as in an operator and equals. In these languages, it is shorthand for performing a calculation of a variable on itself.  Example: myvar = 1 myvar = myvar + 1 We know the above will result in myvar being assigned a value of 2. Instead you can write: myvar = 1 myvar += 1 And again, myvar is now 2. Any operator should work, not just addition. I tested this in FCMP and it works. proc fcmp outlib = sasuser.FCMP_addval.fcns;   function addx(y,x);     y += x;     return(y);   endsub; quit; options cmplib=(sasuser.FCMP_addval); proc fcmp;   myvar = 8;   put "The value of myvar is:" myvar;    myvar = addx(myvar,10);   put "Testing Function Call";   put "Myvar is now:" myvar; quit; ... View more

I like Art's solution.  Another option is to split the data into 2 data sets then use proc append.  This solution might be memory intensive though? This uses the same data set in Art's response. data have_split; set have;     keep Name2        RandomA1_Model_Coeff1     RandomA2_Model_Coeff2;     rename Name2=Name   RandomA1_Model_Coeff1=Random1      RandomA2_Model_Coeff2= RandomA2; run; data have;set have;     drop Name2  RandomA1_Model_Coeff1     RandomA2_Model_Coeff2; run; proc append base=have data=have_split; quit; ... View more

I actually have no experience with OnDemand analytics.  But I do have experience with Enterprise Miner / Text Miner and the Text Import Node. I'm looking at one of my projects which imports Word Doc (.doc, .docx) and PDF files (.pdf).  The PDF documents are 'text format'. You can take two approaches, both of which require being able to point to your directory of PDF documents: 1) Text Import Node 2) %tmfilter macro In the Text Import Node, all I did was change the following properties: Import File Directory: Destination Directory: Text Size: 10,000 The Import directory is where your PDF documents are located.  The export directory is where the resulting SAS data (not SAS dataset).  This node creates a Text file - one for each PDF or document.  You can then proceed to attach your Text Parsing node and other nodes accordingly.  Text Size refers to the number of characters you want from a document.  If you chose 100 but you had a PDF document with 500 characters, then your observation will be cutoff.  Only the first 100 characters will be stored in the SAS dataset. If you want to create an actual SAS Dataset, use the %tmfilter node.  Once you have your SAS dataset, you can proceed to use that in your projects.  Code for the macro looks like this (you can run it from a SAS code node in EM): libname a 'C:\EM_Projects\my_project_folder'; %tmfilter(dataset=a.data_want, dir=C:\EM_Projects\my_project_folder\output, numbytes=32000); The SAS Help files in EM are a fantastic resource to learn about Nodes or the %tmfilter macro. Once you have your dataset, you will then have to import or attach to this data from your EM project. ... View more

This is a great resource, thank you for sharing this. ... View more

According to the Instruction Manual (http://support.sas.com/ondemand/manuals/AcadInstrucManual.pdf), only DATA files can be stored on the SAS Server.  You cannot store program files, course notes, slides...or in your case, PDF documents. I am guessing that is likely the issue you are having, since your PDF's are not in a SAS data format which would then be uploaded through your account portal. The Instruction Manual has a section "Requesting Assistance with Custom Course Data on the SAS Server".  I think you need to contact these folks and ask them how to use PDF's as a datasource (that is, how to get your PDF's into a SAS dataset).  This information seems to be lacking in the manual.  SAS Support is great, I am sure they can address your needs. Related to this discussion.  When I took an EM SAS course, we would remote into a Windows server using RDP where EM was installed.  I am guessing that this was their OnDemand stuff in action.  While an RDP session *can* be setup to allow access to the local computers filesystem, the OnDemand may not be setup that way.   If it is setup that way, a person should be able to use the TM Import (or %tmfilter macro) provided in EM to connect to a folder of PDF documents and generate the SAS dataset.  This certainly would be more ideal than getting SAS support to do it for you. I'd like to add to a previous commentor about PDF's needing to be in a Text format.  PDF documents can be in Text where you can use your cursor to select, copy and then paste to things like MS Word, Notepad, VIM (etc...).  But PDF's can also be like an Image (like a Jpeg) where Text is not selectable.  This is often the result of 1) A paper document was scanned to PDF or 2) An electronic document was converted to a PDF using a sub-standard conversion process.  You can get software that can perform OCR (optical character recognition) on PDF documents that are an 'Image' (Adobe Acrobat Pro paid version can do this).  OCR works best on machine print fonts (times new roman, arial, etc...) as opposed to hand writing.  Although the former is possible. ... View more