Principal Components

Reply
Occasional Contributor
Posts: 6

Principal Components

Good Morning to everyone,

 

I have been carrying out PCA on my data in order to reduce the dimensionality and I have concluded to extract 2 Principal Components which explain 85% of the variation in the data set.

 

My question is, is there a way which I can model these two PC's with my response variable?

 

Thank you in advance,

George

Respected Advisor
Posts: 3,058

Re: Principal Components

Use Partial Least Squares. Do not use the Principal Components for modeling a Y variable.

 

Why?

 

PLS extracts components that are as predictive as possible of the Y variable, given the constraint that the components are perpendicular to each other. PCA extracts components which are perpendicular to each other, that ignore the Y variable and so may not be predictive at all.

--
Paige Miller
Occasional Contributor
Posts: 6

Re: Principal Components

Posted in reply to PaigeMiller

Yeah I know that but my task is to compare the models extracted by each method (Principal Components Regression and Partial Least Squares Regression), so both have to be done.

 

Regards,

George

Respected Advisor
Posts: 3,058

Re: Principal Components


gstratis wrote:

 

My question is, is there a way which I can model these two PC's with my response variable?

 


Didn't you address this in your other thread? You were running PROC PLS with the PCR method selected.

--
Paige Miller
Occasional Contributor
Posts: 6

Re: Principal Components

Posted in reply to PaigeMiller

Yes I did,

 

I was just wondering if there is another way of doing it so I could verify me results.

 

Regards,

George

Respected Advisor
Posts: 3,058

Re: Principal Components

[ Edited ]

You save the PCA scores, then use these scores as the X-variables in your regression.

 

I was just wondering if there is another way of doing it so I could verify me results.

 

You are implying that the results of PROC PLS with the PCR option need to be verified somehow?? I'm not aware of any such need to verify that PROC PLS is giving the right results, it seems to me that SAS has done that already so you don't have to.

--
Paige Miller
Ask a Question
Discussion stats
  • 5 replies
  • 121 views
  • 2 likes
  • 2 in conversation