Hi, I'm new to Information Retrieval Studio and SAS Crawler, but I was wondering if it was possible to pipe the output of the crawler to a storage place of my choosing - for example, and elasticsearch index? Cheers, Seb ... View more

Hi all, hoping for some help. I have a very simple data set which lists the names of people that were mentioned in a talk. The dataset has 2 columns - personName and talkName. e.g. personName talkName John Smith 123 John Smith 234 Bob Jones 123 I want to create a Network Diagram in VA Explorer which shows all persons, and links them if they were mentioned in the same talk. So in the example above, John Smith should be linked to Bob Jones, since talkName matches. I believed I could do this using an "Ungrouped" network type, and setting the Target to personName, and Source to talkName. All the people are shown in the network diagram, but with no links. Does anyone know if I'm missing something? Thanks, Seb ... View more

A bit of history Yesterday I asked this question, about reading a JSON file which had arbitrary carriage returns in it, and reading it into one variable. This was because the random new lines were messing with my INPUT statement. I'm having a separate issue with the same file which I thought I'd raise separately. My new problem Now that I've sanitised the file to remove the random new lines, I have a text file containing JSON which has a single line of text whose length exceeds 32767 characters (worth pointing out that even before I removed the random new lines, there were still lines longer than 32767 characters!) When I try to read this line in, my INPUT step only processes records until the 32767th character, then ends, so I'm left with a fraction of the observations that I should have. I assume this is either due to the maximum length of the input buffer or the fact that I've set the LRECL to its maximum value (32767)? What I'd like to do Ideally I'd like to specify a record delimiter string (e.g. "},{") which could split my massive, massive line to treat each JSON object (which are wrapped in curly brackets) individually. Is this possible? Any solution which will allow me to read this whole file would work though. Any help appreciated. <<Sample file attached>> ... View more

Assuming I have a plain-text file with contents in an unknown or inconsistent format: Could be spread over multiple lines, or not Could have commas, or not How would I go about reading it into a single variable of a single observation? I just want a "text" variable to contain the entire contents. Try as I might I can't write a program which will get me what I want - I hope that I'm missing something very simple. Example text file: [{"var1":"ses- 14_14723","var2":652720,"var3":653940}] My SAS code so far. data work.test;      infile "C:\test.txt" flowover dlmstr="&(*&)(*&";      input alltext :$ 3000.; run; As you can see - I've experimented using flowover to search for data on new lines. I'm using a delimiter string with a ridiculous value I'll never hit so that the third line isn't split, and I've chosen a randomly-high length for the alltext variable, but used the colon to tell the input statement the length could be variable This strikes me as really hacky and I'm sure it can't be right. It also returns me 2 observations - one for line 1, and one for line 3. Any help would be much appreciated. ... View more