I have a very large json in a single line, I have problems with illegal characters, turn out I have a lot of DC3, EM, FS, GS hidden ascii symbols, so I got rid of those and some other special characters that are making it hard to parse the json, then I ran into issues with the escape characters so I also just replaced those with a space. Now I'm stuck, it appears to be unbalanced quotes. normally I would use some code got from you super smart folks that fixes CL LF in the middle of a quoted string, but that with multiple lines. How do I do that with one giant line?    Is there a way to split the json into multiple lines then see where I have the unbalanced qoute and replace it before importing? Code i used to start cleaning up the data %let dsnnme="/mnt/SAS/Shared Services/SAS_Datasets/tempfiles/tempjson/&nextitem"; data _null_; infile &dsnnme recfm=n sharebuffers; file &dsnnme recfm=n; input a $char1.; if a = '\' then a=&repA; else if a = '13'x then a=&repA; else if a = '1C'x then a=&repA; else if a = '19'x then a=&repA; else if a = '1D'x then a=&repA; else if a = 'F3'x then a=&repA; else if a = 'A0'x then a=&repA; else if a = 'E6'x then a=&repA; else if a = 'F7'x then a=&repA; else if a = 'F2'x then a=&repA; else if a = 'FD'x then a=&repA; else if a = 'F1'x then a=&repA; put a $char1.; run; code I've used to fix cr Lf between qoutes: data _null_; infile &dsnnme recfm=n sharebuffers; file &dsnnme recfm=n; retain open 0; input a $char1.; if a = '"' then open = ^(open); if open then do; if a = '0D'x then put &repD; else if a = '0A'x then put &repA; end; run; Not really sure this will work, but I'm out of ideas. I'll try to upload sample but its PII data. ... View more

Morning SAS Programmers, last night our new head of IT wants to drop SAS from our tool belt. We currently have SAS Viya 3.5 with the AI/ML and Visual Analytics. I come from 25 years of using various versions of SAS from 8 to 9.4 and now mostly use SAS studio. Love the SAS language and all the capabilities I've seen from SAS throughout the years, every bank I've worked for I'm an advocate for bringing in SAS, and this bank is no different. I brought SAS in and have one year left on our contract. My new boss shared an article:  Introduction to Databricks and PySpark for SAS Developers | Databricks Blog    I would love the communities feedback, especially if anyone has used Pyspark/Databricks and how they think it really compares to SAS's capabilities. How accurate is this article, any feedback on how to counter this article. Please share any articles you find. As always really appreciate this communities thoughts. Thank you. ... View more

Need help solving a Broken Bar issue when importing data. I have data that imports just fine until it has Broken bars (DLM='a6'x) in the data. In my datastep I'm not using delimiters as its a fixed length import process. When there are none of these Broken Bars the whole highlighted section imports just fine , it should import as one column:   What I get:   data dsn; length location $1000; set NEW_FILES; location=cats("&path/",FILE_NAME); infile dummy filevar=location end=done; FORMAT ADDENDA_TYPE_CODE $CHAR2. PAYMENT_RELATED_INFORMATION $CHAR80. ADDENDA_SEQUENCE_NUMBER $CHAR4. ENTRY_DETAIL_SEQUENCE_NUMBER $CHAR7.; do while (not done); input RECORD_TYPE_CODE $1. @; if RECORD_TYPE_CODE = "7" then do; input ADD_TYPE_CODE $2. @; if ADD_TYPE_CODE = "05" then do; INPUT @2 ADDENDA_TYPE_CODE $2. @4 PAYMENT_RELATED_INFORMATION $80. @84 ADDENDA_SEQUENCE_NUMBER $4. @88 ENTRY_DETAIL_SEQUENCE_NUMBER $7.; end; end; output ; end; run; I thought it could be  an encoding issue i tried adding encoding="ANSI" to the code but no luck, when looking at the encoding in notepad++ it says its:    To note I'm importing this file into SAS studio 5.2 from a  directory mounted onto our unix servers.   any help would be appreciated. thanks     ... View more