Hello.   I have an interesting one.  I am importing a file with a date field that has dates in the future.  Some of them are importing correctly (2038) and some of them are not (1952).  These are being import from a CSV file.  I can't tell why this is happening or how to fix it.  Can anyone tell me what is going on?   CSV Date 02/01/53 03/01/53 02/01/38 03/01/53 03/01/38 03/01/53 02/01/53 02/01/53 02/01/38 ... View more

Hello,   I have a variable in my dataset that I need to scrub.  The data has special characters that need to be scrubbed out and a carriage return added to make it appear like a list in the variable field.  This data will be pulled into a spreadsheet this way.   For example the values could look like this:   Old Data Corporate (ABC);#1;#Little Rock Branch;#21 Iowa Office;#5;#Des Moines (FCO);#44   New Data Corporate (ABC) Little Rock Branch Iowa Office Des Moines (FCO)   I am hoping there might be a function that can handle this.  Thanks!   ... View more

Hello everyone!   I have a large dataset where I would like to do a couple of different types of analysis on the variables in it.  I have researched proc compare and proc freq but I am not sure if it is the most efficient solution for my needs.  I would like to run this code each night after a dataset has been updated to make sure there are no data issues that occurred and fix any that did.   I would like to:   Write code that summarizes distinct values of values in all variables.  This would be a mix of char, numeric, and date variables.  I know about proc freq, or simply using distinct queries for each value, but is there a function or script that could do it all at once and return a table that includes all of the variables? I would also like to compare values between variables in the same dataset.  Using proc compare, it gives me each observation where there isn't a match of some sort.  The problem with that is there could be thousands of records that don't match.  Proc compare is going to limit how much can be printed.  I don't need to review by each observation, I just need to know a summary of each value that doesn't match from one variable to the other. I feel like I am close with proc compare and proc freq, but I am just not quite where I am wanting to be.  I need a summarized report that I can dig into and write further queries to investigate any observations that look out of place.  I am hoping you guys have some suggestions for me.   Thank you! ... View more

Hello!   I am trying to find a way to periodically validate that all data in a variable meets a certain format.  For example, I want to check to make sure all interest rates are stored as 6.5, so for a 4.75% interest rate, I want to make sure the value is being stored as .04750.  If they are being stored a different way, I want to do an update to correct them.   Is there an easy way to check this?   Thanks!   ... View more