topic Principle Components Analysis clarification needed in Statistical Procedures

Principle Components Analysis clarification needed

doudou66 — Tue, 05 Jun 2012 20:28:46 GMT

Hello, All

Suppose my data have two variables A and B. Total_Variance_Original_Data = Var(A) + Var(B) + 2Cov(A,B)

Now I do Principle Components Analysis and get two new variables, say PC_1 and PC_2, with eigenvalues λ_1, and λ_2; Total_Variance_PCA_Explained = λ_1 + λ_2

My question is: are theses two variances equal to each other, Total_Variance_Original_Data = Total_Variance_PCA_Explained ?

Re: Principle Components Analysis clarification needed

PGStats — Tue, 05 Jun 2012 20:43:37 GMT

Yes, if you do the analysis on the covariance matrix, that is, with the COV option (it is not the default option in PRINCOMP). You should analyse the covariance matrix only when your variables are roughly on the same scale.

Re: Principle Components Analysis clarification needed

doudou66 — Tue, 05 Jun 2012 20:52:40 GMT

Thank you very much for helping me.

If variables are not on the same scale (say, variable A is ~1000, and variable B is ~1), should I do normalization on each original variable (i.e. (original_variable - mean)/standard_deviation ) before doing PCA? or is there any other method?

Re: Principle Components Analysis clarification needed

PGStats — Tue, 05 Jun 2012 21:02:37 GMT

Exactly! PRINCOMP without the COV option does that normalization for you. - PG

Re: Principle Components Analysis clarification needed

doudou66 — Tue, 05 Jun 2012 21:03:38 GMT

Thank you very much.