topic Re: I need help with understanding pre-processing steps before using SAS Enterprise Miner in SAS Data Science

I need help with understanding pre-processing steps before using SAS Enterprise Miner

b_smsha — Sun, 30 May 2021 21:10:14 GMT

Hi Everyone,

So I have a query regarding my question. I have an excel file filled up with 23 variables consisting of around 9k records of crimes and victim information for my project. Now I am following the book "Predictive Modelling with SAS Enterprise Miner"and in it I saw they mention that we need to certain preprocessing steps before we actually import to SAS Eminer.

Now I already know what I want to change but I want to know how far am I supposed to with doing these steps within Excel itself? How much data should be changed and what not, what more steps can SAS eminer help me with?

Re: I need help with understanding pre-processing steps before using SAS Enterprise Miner

PaigeMiller — Sun, 30 May 2021 21:39:12 GMT

I believe the general idea is to do most of the pre-processing in SAS Enterprise Miner, and not in Excel, as the tools available in EM are far superior.

If you look at this web page, you will see a section entitled "Data preparation, summarization and exploration", those are the likely tools you would use (and you don't have to use all of them, you use the ones that make sense for your data).

Re: I need help with understanding pre-processing steps before using SAS Enterprise Miner

b_smsha — Mon, 31 May 2021 19:40:51 GMT

Yes, I agree with that, its just that the book im referring to mentions I need to carry out some form of preprocessing before importing to Eminer, i was wondering what that could be ??

For example; my gender data has some info such as M, F, unknown, blanks, Other

Moreover, certain columns have data with different variations of capitals etc so would i need to fix this before importing or can this be done within Eminer through the mentioned nodes?

Re: I need help with understanding pre-processing steps before using SAS Enterprise Miner

PaigeMiller — Mon, 31 May 2021 20:24:16 GMT

@b_smsha wrote:

Yes, I agree with that, its just that the book im referring to mentions I need to carry out some form of preprocessing before importing to Eminer, i was wondering what that could be ??

For example; my gender data has some info such as M, F, unknown, blanks, Other

Moreover, certain columns have data with different variations of capitals etc so would i need to fix this before importing or can this be done within Eminer through the mentioned nodes?

E-Miner has data cleaning routines. You can also write a "code node" in E-Miner with simple SAS code to do specific cleaning. Or if you want, you can certainly do cleaning before importing. It's entirely up to you, whatever works.