topic Re: How to test for linear relationship between 2 continuous variables in SAS Programming

How to test for linear relationship between 2 continuous variables

kpberger — Thu, 12 May 2022 21:26:27 GMT

I have two continuous variables similar to the two below.

data cars; set sashelp.cars; keep horsepower weight; run;

How can I test if the relationship between the two is linear? As one might do before running a regression that assumes as much.

Re: How to test for linear relationship between 2 continuous variables

Reeza — Thu, 12 May 2022 21:33:02 GMT

Correlation?

Re: How to test for linear relationship between 2 continuous variables

ballardw — Thu, 12 May 2022 21:35:47 GMT

Old school is to plot the data such as :

proc sgplot data=sashelp.cars;
  scatter x=weight y=horsepower;
run;

If there is a strong or even medium strength relationship your eye will tell what form is likely.

The funnel shape from this data indicates something interesting may be going on. So:

proc sgplot data=sashelp.cars;
  scatter x=weight y=horsepower/ group=type;
run;

And it looks like there may be a "better" linear relationship between weight and horsepower when vehicle Type is considered.

Re: How to test for linear relationship between 2 continuous variables

PaigeMiller — Fri, 13 May 2022 10:12:58 GMT

@kpberger wrote:

How can I test if the relationship between the two is linear? As one might do before running a regression that assumes as much.

As @ballardw said, you can always plot the raw data.

The linear regression itself is a form of test. There's really no need to perform a formal test for linearity before fitting a linear regression. If you assume it is linear, then fit the regression, plot the residuals. The advantage of plotting the residuals (as compared to plotting the raw data) is that deviations from linearity can be easier to spot in the residuals.

Re: How to test for linear relationship between 2 continuous variables

kpberger — Fri, 13 May 2022 17:14:03 GMT

Can use proc gam to test this? Looking at the p-values on the Analysis of Deviance table. For example, if I am trying to predict horsepower using weight:

proc gam data=sashelp.cars plots=components(clm commonaxes); model horsepower=spline(weight); run;

The p-value for spline(weight) is <0.0001 - is this referring to a rejection of the hypothesis that the relationship is linear/the spline is necessary? I can not tell from documentation/a day of internet searching.

Re: How to test for linear relationship between 2 continuous variables

PaigeMiller — Fri, 13 May 2022 17:20:11 GMT

Honestly, you have ignored all of our advice to plot the data. Had you done so, I think the answer is relatively clear.

Re: How to test for linear relationship between 2 continuous variables

kpberger — Fri, 13 May 2022 17:28:09 GMT

Your assumption is incorrect. I have plotted the data. It is still not clear to me whether the relationships are linear.

Edit: I clearly asked in the question if there was a test for this. If there is no test, the correct answer to my question is just "there is no test".

Re: How to test for linear relationship between 2 continuous variables

PaigeMiller — Fri, 13 May 2022 17:28:12 GMT

After looking at the plot, I can't imagine what other model form (quadratic, spline, non-linear, etc.) would be more appropriate for this data. What do you think is a better model if not linear?

Re: How to test for linear relationship between 2 continuous variables

kpberger — Fri, 13 May 2022 17:31:30 GMT

The data I am using is not actually from a SAS help file. I offered that as an example to aid responses in being specific with code. The unshareable data I am using involves 30+ comparisons and the relationships are not clear.

Re: How to test for linear relationship between 2 continuous variables

PaigeMiller — Fri, 13 May 2022 17:44:38 GMT

Show us a scatterplot, with phony variable names.

Re: How to test for linear relationship between 2 continuous variables

Reeza — Fri, 13 May 2022 18:10:13 GMT

I repeat, correlation, specifically PROC CORR.

See this blog post.

https://blogs.sas.com/content/iml/2011/08/26/visualizing-correlations-between-variables-in-sas.html

Visually examine the graphs and/or look at the correlation matrix.

Re: How to test for linear relationship between 2 continuous variables

PGStats — Fri, 13 May 2022 18:33:13 GMT

This analysis tests for your questions, assuming gaussian independent errors :

proc glimmix data=sashelp.cars;
effect extraSplineEffect = spline(weight);
model horsepower = 
    weight            /* Is there a linear relationship ? */
    extraSplineEffect /* Is there more than just noise in the residuals ? */
    / htype=1;        /* Test these questions sequentially */
run;

Interpretation, for this example: Yes, there is a linear trend relating horsepower to weight. And yes, there remains more than noise in the residuals once the linear trend is removed.

Re: How to test for linear relationship between 2 continuous variables

mkeintz — Fri, 13 May 2022 18:44:53 GMT

@kpberger wrote:

The data I am using is not actually from a SAS help file. I offered that as an example to aid responses in being specific with code. The unshareable data I am using involves 30+ comparisons and the relationships are not clear.

"30+ comparisons"?

Are you suggesting 9 or more variables? It would take 9 variables to generate 36 unique correlations (8 to generate 28). That might change things, since you would be doing multiple comparisons. If you intend some formal "statistical" inference of linear relationship for each of the bivariate relations, then I believe you are at risk of a Multiple Comparisons Problem. I leave it to others to provide a more authoritative discussion of that possibility.