Building models with SAS Enterprise Miner, SAS Factory Miner, SAS Visual Data Mining and Machine Learning or just with programming

Calculate Mutual Information in Base SAS

Accepted Solution Solved
Reply
Frequent Contributor
Posts: 99
Accepted Solution

Calculate Mutual Information in Base SAS

Hi,
I want to calculate Mutual Information of two variables. Is there a sas procedure which does it. I have Base SAS 9.2 and SAS/STAT.

Regards,

Amit

Accepted Solutions
Solution
2 weeks ago
SAS Employee
Posts: 121

Re: Calculate Mutual Information in Base SAS

Your ability to calculate 'Mutual Information' depends on whether you are using the term in the broad sense (e.g. the correlation between variables might be a way to assess information which two variables share) or if you are talking about the more specific way the term has been used.  Specifically, Mutual Information is a term used to measure how similar the joint distribution p(X,Y) is to the products of a factored marginal distribution p(X)p(Y) for a pair of variables. If you are referring to this specific definition, I know of no Base SAS or SAS/STAT procedures which provide this calculation.  

 

Note: You can specify Mutual Information as a weighting method inside of SAS Text Miner but this would not provide the information described above.

 

Cordially,

Doug 

View solution in original post


All Replies
Solution
2 weeks ago
SAS Employee
Posts: 121

Re: Calculate Mutual Information in Base SAS

Your ability to calculate 'Mutual Information' depends on whether you are using the term in the broad sense (e.g. the correlation between variables might be a way to assess information which two variables share) or if you are talking about the more specific way the term has been used.  Specifically, Mutual Information is a term used to measure how similar the joint distribution p(X,Y) is to the products of a factored marginal distribution p(X)p(Y) for a pair of variables. If you are referring to this specific definition, I know of no Base SAS or SAS/STAT procedures which provide this calculation.  

 

Note: You can specify Mutual Information as a weighting method inside of SAS Text Miner but this would not provide the information described above.

 

Cordially,

Doug 

☑ This topic is SOLVED.

Need further help from the community? Please ask a new question.

Discussion stats
  • 1 reply
  • 503 views
  • 0 likes
  • 2 in conversation