Hi All,
I am planning to rebuild a Logistic Regression Model. In the past I have always built a Response model on data with no duplicates. One row per customer.
The current data I have now is as below. Basically we have different call_date per customer. Can we really build a Logistic Regression model on data with duplicates or shall I only take the max call date?? The model I have to rebuild was run on the duplicated data like below...Your help will be much appreciated! Many Thanks
Cust_no | call_date | address_id |
1 | 15-May-13 | 17162265 |
1 | 05-Jun-13 | 17162265 |
1 | 06-Jun-13 | 17162265 |
2 | 11-Apr-13 | 426777 |
2 | 12-Apr-13 | 426777 |
3 | 27-Jun-13 | 1604314 |
3 | 11-Jul-13 | 1604314 |
3 | 22-Jul-13 | 1604314 |
4 | 15-Aug-13 | 518475 |
5 | 16-Sep-13 | 1617498 |
5 | 25-Sep-13 | 12854216 |
6 | 14-May-13 | 1329769 |
7 | 01-Aug-13 | 595104 |
8 | 16-Sep-13 | 12885455 |
9 | 10-Oct-13 | 5022919 |
10 | 05-Aug-13 | 3942622 |
In general, the independence assumption is violated by having the repeated measures in the data. Some suggestions:
First, rebuild the 'wrong' (the one with all the repeats) model to make sure you can reproduce it.
Do a sensitivity analysis. Sometimes, the "wrong" model is still useful.
-- do a model based on the first call.
-- do a model based on the last call.
-- compare them to the original model.
If they all tell the same story, then use the first or last (whichever makes more sense in the analysis context).
If they tell different stories, then you have got more work to do to understand what is going on.
Another possibility for the sensitivity analysis is to use some sort of summary record for each customer. It may be that things like number of calls are important markers.
Good luck with your modelling.
You can also consider collapsing the data to a customer level, and then having specific metrics attached to that customer, eg. Number of calls, number of sales, number of purchases
I don't know if you could use a repeated/random statement in GLIMMIX model instead as well, with a binary response. Random thought would need looking into.
Many Thanks Reeza and Doc. that's really helpful!...
Don't miss out on SAS Innovate - Register now for the FREE Livestream!
Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.
ANOVA, or Analysis Of Variance, is used to compare the averages or means of two or more populations to better understand how they differ. Watch this tutorial for more.
Find more tutorials on the SAS Users YouTube channel.