BookmarkSubscribeRSS Feed
DDK
Obsidian | Level 7 DDK
Obsidian | Level 7

I recently came across a site (see below) which covered some aspects of doing principal component analysis. It states at one point:

"Loadings are eigenvectors normalized to respective eigenvalues: A value = V value * sqrt(L value)
Loadings are the covariances between variables and components.
"

The 'L' in their example represents the eigenvalues and the 'V' represents the eigenvectors.

After some searching I came across others that also mention it (see second site below and search for the phrase "I want especially to stress twice here the terminologic difference between eigenvectors").

Would this imply that when a PCA is being performed using proc princomp, that the eigenvector scores are not loadings and that for loadings you need to multiply the eigenvector scores by the square root of the eigenvalue of the corresponding component?

Any help on this would be much appreciated as the SAS help document for proc princomp does not say much about loadings.

Steps done in factor analysis compared to steps done in PCA - Cross Validated

pca - Making sense of principal component analysis, eigenvectors & eigenvalues - Cross Validated

2 REPLIES 2
PaigeMiller
Diamond | Level 26

Eigenvalues and loadings can be scaled in different ways ... different authors will use the terms to mean different things ... it all depends on whether or not you want the scores to have variance of 1, or variance equal to the eigenvalue ... SAS allows you to scale things either way, see the STANDARD option. So instead of worrying about terminology, you can obtain the results that are scaled the way you want ...

Jackson (1991), "A Users Guide to Principal Components", John Wiley and Sons, covers the different possible scalings of the eigenvalues and/or different scalings of the scores. His table 1.2 shows actually three different scalings.

--
Paige Miller
stat_sas
Ammonite | Level 13

Normalization is done because PROC FACTOR assumes all factors/components to have variance of 1, while PROC PRINCOMP creates components that have variances equal to the eigenvalues.

sas-innovate-2024.png

Don't miss out on SAS Innovate - Register now for the FREE Livestream!

Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.

 

Register now!

What is Bayesian Analysis?

Learn the difference between classical and Bayesian statistical approaches and see a few PROC examples to perform Bayesian analysis in this video.

Find more tutorials on the SAS Users YouTube channel.

Click image to register for webinarClick image to register for webinar

Classroom Training Available!

Select SAS Training centers are offering in-person courses. View upcoming courses for:

View all other training opportunities.

Discussion stats
  • 2 replies
  • 2388 views
  • 3 likes
  • 3 in conversation