Turn on suggestions

Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.

Showing results for

- Home
- /
- Analytics
- /
- SAS Data Science
- /
- Calculate Mutual Information in Base SAS

Options

- RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page

🔒 This topic is **solved** and **locked**.
Need further help from the community? Please
sign in and ask a **new** question.

- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content

Posted 04-20-2011 07:07 PM
(1663 views)

Hi,

I want to calculate Mutual Information of two variables. Is there a sas procedure which does it. I have Base SAS 9.2 and SAS/STAT.

Regards,

Amit

I want to calculate Mutual Information of two variables. Is there a sas procedure which does it. I have Base SAS 9.2 and SAS/STAT.

Regards,

Amit

1 ACCEPTED SOLUTION

Accepted Solutions

- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content

Your ability to calculate 'Mutual Information' depends on whether you are using the term in the broad sense (e.g. the correlation between variables might be a way to assess information which two variables share) or if you are talking about the more specific way the term has been used. Specifically, Mutual Information is a term used to measure how similar the joint distribution *p*(*X*,*Y*) is to the products of a factored marginal distribution *p*(*X*)*p*(*Y*) for a pair of variables. If you are referring to this specific definition, I know of no Base SAS or SAS/STAT procedures which provide this calculation.

Note: You can specify Mutual Information as a weighting method inside of SAS Text Miner but this would not provide the information described above.

Cordially,

Doug

1 REPLY 1

- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content

Your ability to calculate 'Mutual Information' depends on whether you are using the term in the broad sense (e.g. the correlation between variables might be a way to assess information which two variables share) or if you are talking about the more specific way the term has been used. Specifically, Mutual Information is a term used to measure how similar the joint distribution *p*(*X*,*Y*) is to the products of a factored marginal distribution *p*(*X*)*p*(*Y*) for a pair of variables. If you are referring to this specific definition, I know of no Base SAS or SAS/STAT procedures which provide this calculation.

Note: You can specify Mutual Information as a weighting method inside of SAS Text Miner but this would not provide the information described above.

Cordially,

Doug

**Available on demand!**

Missed SAS Innovate Las Vegas? Watch all the action for free! View the keynotes, general sessions and 22 breakouts on demand.

How to choose a machine learning algorithm

Use this tutorial as a handy guide to weigh the pros and cons of these commonly used machine learning algorithms.

Find more tutorials on the SAS Users YouTube channel.