Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.

Showing results for

Find a Community

- Home
- /
- Analytics
- /
- Stat Procs
- /
- The impact of adding explanatory variables on sign...

- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

04-30-2010 02:47 AM

Hi,

This question pertains perhaps more to panel regression in general than to the SAS software in particular. Anyway, I thought the question might be relevant also to other SAS users (than just me).

I'm doing exploratory analyses with a panel data set. I'm testing the ability of a large number of constructs to explain an outcome. My question is: if an independent variable is deemed insignificant without controls, will it be insignificant with controls.

In other words: Does statistical significance decrease monotonically with increasing number of control variables?

I would like to use the following procedure:

1. test a large number of interesting constructs: are they able to explain the outcome

2. if so, include control variables to rule out alternative explanations

Is it possible that I will drop constructs at phase 1 that would turn out significant at phase 2?

Thanks!

This question pertains perhaps more to panel regression in general than to the SAS software in particular. Anyway, I thought the question might be relevant also to other SAS users (than just me).

I'm doing exploratory analyses with a panel data set. I'm testing the ability of a large number of constructs to explain an outcome. My question is: if an independent variable is deemed insignificant without controls, will it be insignificant with controls.

In other words: Does statistical significance decrease monotonically with increasing number of control variables?

I would like to use the following procedure:

1. test a large number of interesting constructs: are they able to explain the outcome

2. if so, include control variables to rule out alternative explanations

Is it possible that I will drop constructs at phase 1 that would turn out significant at phase 2?

Thanks!

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

05-03-2010 09:09 AM

In short, no.

In general, with linear models, that monotonic characteristic is displayed when the independent variables are all independent of one another. Nice in theory, but doesn't always happen in practice.

That behavior is part of the reason that there are so many approaches to model building.

So, it is possible that your phase II will miss some interesting variables. It is a variation on the Type II error in sample size computation.

In general, with linear models, that monotonic characteristic is displayed when the independent variables are all independent of one another. Nice in theory, but doesn't always happen in practice.

That behavior is part of the reason that there are so many approaches to model building.

So, it is possible that your phase II will miss some interesting variables. It is a variation on the Type II error in sample size computation.

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

05-03-2010 09:29 AM

Thank you very much for your reply! This pretty much answers my question.