topic Re: Why Do We Need SVD Before Clustering? in SAS Data Science

Why Do We Need SVD Before Clustering?

aha123 — Mon, 20 Feb 2017 03:15:24 GMT

Text Cluster node in Text Miner peforms SVD before clustering. Can anyone tell me the advantage of SVD here?

Re: Why Do We Need SVD Before Clustering?

JohnJPS — Mon, 20 Feb 2017 14:20:51 GMT

I think this oft-cited paper (http://www.cc.gatech.edu/~vempala/papers/dfkvv.pdf) describes it as well as it can be explained. Basically, they talk about how clustering the SVD solves an approximate clustering solution for the actual dataset, with much better performance. So it's probably that performance boost that is the primary explanation.

Re: Why Do We Need SVD Before Clustering?

aha123 — Mon, 20 Feb 2017 21:30:20 GMT

This paper is excellent. Do you have any paper about how much information is lost after doing SVD? PCA can tell you how much variance is kept in first x numbers of PCs. Wonder if SVD has such measurement. Also why not use PCA for text clustering purpose? I read online many articles and still can't get any clear answer.

Re: Why Do We Need SVD Before Clustering?

JohnJPS — Mon, 20 Feb 2017 21:44:37 GMT

I dug a little deeper and this discussion really does a great job: starting with PCA and moving onto SVD: https://www.cs.princeton.edu/picasso/mats/PCA-Tutorial-Intuition_jp.pdf

A more brief Q&A that is quite nice is here: https://www.quora.com/What-is-an-intuitive-explanation-of-the-relation-between-PCA-and-SVD

Hope that helps!