Compile macro with secure and store options - see example 5 in documentation.  https://documentation.sas.com/doc/en/pgmsascdc/9.4_3.5/mcrolref/p1nypovnwon4uyn159rst8pgzqrl.htm#p05y391rq3drjgn1pv40fng2kc3u   To share the compiled macro https://documentation.sas.com/doc/en/pgmsascdc/9.4_3.5/mcrolref/n0sjezyl65z1cpn1b6mqfo8115h2.htm   Paper with more info https://www.mwsug.org/proceedings/2011/appdev/MWSUG-2011-AD13.pdf         ... View more

proc sql; create table data_want as select * from compare_dataset_214_obsv where wrs_acres not in (select distinct wrs_acres from compare_dataset_148_obs); quit; @Fluvio1 wrote: I tried both programs but they do not provide the results I am looking for.  The attached dataset "Compare_dataset_148_obsv" contains 148 observations. The dataset "Compare_dataset_214_obsv" contains 214 observations.  I would like to identify the observations in  "Compare_dataset_214_obsv" that are not in  "Compare_dataset_148_obsv" and output the observations to a file.  While the datasets contain different variables, they have in common:  WRS_acres.   ... View more

https://blogs.sas.com/content/sgf/2017/12/19/running-sas-programs-in-batch-under-unix-linux/     ... View more

Yes. ... View more

Do you have a data dictionary for your data? If so, show us the format and it will be easier to write code to read your data from that. For data of this size, using PROC IMPORT will cause headaches. It guesses...and not always correctly. ... View more

@Manije72 wrote: Hi, I am working with a large dataset containing 500,000 rows and 4,000 columns, which requires 10 GB of memory. I imported the data into SAS, but only a portion of the data was successfully loaded, and many variables were not detected during analysis. My computer has limited memory, with only 16 GB available. Consequently, SAS is unable to open the entire dataset. How can I open the full dataset and ensure all variables are available for analysis in SAS? This what would be considered big data by many. 10GB would also seem to be a lot of text fields I'm guessing? What is the analysis plan for those text fields? ... View more

proc print will not print your entire data set but you should be able to view it using the viewer or printing the top 10 observations though I have no idea how you visually verify 4000 columns. proc print datasetname(obs=10);run; Run Proc Import - look at the log. It will have the code. Copy and paste that into a new program and modify it, verifying your data until you're sure your data is read correctly. Unless...do you have a data dictionary for your data set? ... View more

Does your log show any error? Mine states that the BRR method requires a STRATA statement? Is that perhaps what you need to be using instead of CLASS? ... View more

@ballardw wrote:   BTW, this is the kind of stuff I would normally be charging $75/hour or more to deal with poorly structured files. UNITED STATES appearing on the same line also varies from the majority of the line From the consulting rates I see these days that's incredibly low. $150-300/hour for data/programmers is the norm now.  ... View more

Changed your code to use sashelp.cars and origin/type as the classification variables. It works fine for me - so it's likely an issue with the data somehow.    Use the macro debugging options and review the log for the errors.    options mprint symbolgen; %macro export_to_excel; %let dsn=sashelp.cars; PROC SQL noprint; SELECT DISTINCT origin INTO :country1- FROM &dsn; %let numCountries = &SQLOBS; QUIT; %do i = 1 %to &numCountries; %let country = &&country&i; ods excel file="//home/fkhurshed/Demo1/&country..xlsx"; PROC SQL noprint; SELECT DISTINCT type INTO :event1- FROM &dsn. WHERE origin = "&country"; %let numEvents = &SQLOBS; QUIT; %do j = 1 %to &numEvents; %let event = &&event&j; %let startdate = &&startdate&j; %let sheetname = %sysfunc(tranwrd(&event, %str( ), _)); ods excel options(sheet_name="&sheetname"); PROC REPORT DATA=&dsn; WHERE origin = "&country" AND type = "&event"; COLUMN Origin type make model; RUN; %end; ods excel close; %end; %mend export_to_excel; %export_to_excel; ... View more

@hellohere wrote:     Reading in files, but some columns are numbers but are readin as char.   If you can fix it while you read in the data that's preferable than fixing after the fact. In the odd case you read in a variable as numeric instead of character you would lose information. If all files are the same layout using a data step to read rather than proc import will help to standardize the read in and fix it.  ... View more

Excel is automatically using both of those as delimiters when reading the file, assuming you're just double clicking the file.    Another way to get around this should also be the method I've suggested.  To Import a CSV rather than Open it in Excel see the link below for instructions.  https://www.fcc.gov/general/opening-csv-file-excel   Open Excel Click New, then click on Blank workbook Click on the Data tab Click Get External Data From Text Navigate to the CSV-formatted file saved on your system, select it, then click Import (When browsing to find the file, set browser to look for All Files or for Text Files) This will open the Text Import Wizard In Import Step 1 of 3 – Click on Delimited, then click Next In Import Step 2 of 3 – Check the Comma box, then click Next In Import Step 3 of 3 – Select Text and click Finish, then OK @DrAbhijeetSafai wrote: @Reeza , I am checking them in excel file. I have just attached the sample of the output.    I did not understand what you mean to say by importing the file for this issue. The issue for import is solved and this is issue with export. Kindly let me know if any other information is required for this.    Many thanks for your response.   - Dr. Abhijeet Safai     ... View more

How are you checking the CSV file/columns? In Excel or in a text editor?   Have you tried opening Excel, importing the file via the import data and specifying the delimiters as CSV? Sometimes that works better than how it automatically reads a file.    @DrAbhijeetSafai wrote: Dear All,   Greetings!   I have a dataset of in which one large variable is recently added. This newly added variable was not getting read properly so I used termstr=crlf and that csv file got read properly. It had values in excel at multiple levels (one can enter them by using alt+enter) and only first line was getting read. I used termstr=crlf  and the issue got solved. Now I am able to read and process those values (maximum length is somewhat 1000 characters) in that column properly.   When I am trying to write those values after processing to an external csv file, that is causing a problem. The problem is that where there are many lines in that row, only first line is getting printed in csv properly at that column and remaining values are coming to the first column and all other values are blank for those rows. Meaning only large values are shifted from their position to the first column in the csv.   I would like to know if there is any option like termstr=crlf  for exporting a file? I mean if termstr=crlf  can be used for importing, can similar option be used for exporting? Because the problem is similar in nature. While importing I was not able to read the values on lines below the first line (which has got solved by using termstr=crlf ) and now the issue is that I am not able to write values in such a way that all the lines are in the same row (and column).    In the dataset, the values are perfect. The issue is with proc export in my opinion.    Thanks in advance!   - Dr. Abhijeet Safai   ... View more

https://www.lexjansen.com/search/searchresults.php?q=difference+in+difference+model#gsc.tab=0&gsc.q=difference%20in%20difference%20model&gsc.page=1   GLM/MIXED are typically used. See a few of the links and decide which works best for you.  ... View more