Symmetric Relative Mutual Information

Symmetric Relative Mutual Information


Symmetric Relative Mutual Information computes the percentage of information gained by observing XX and YY:

ISR(X,Y)=I(X,Y)H(X)×H(Y){I_{SR}}(X,Y) = \frac{{I(X,Y)}}{{\sqrt {H(X) \times H(Y)} }}

This normalization is calculated similarly to Pearson's Correlation Coefficient ρ\rho.

ρX,Y=cov(X,Y)σX2σY2{\rho _{X,Y}} = \frac{{{\mathop{\rm cov}} (X,Y)}}{{\sqrt {\sigma _X^2\sigma _Y^2} }}

where σ2\sigma^2 denotes variance.

So, Mutual Information is comparable to covariance, and Entropy is analogous to variance.


  • For a given network, BayesiaLab can report the Symmetric Relative Mutual Information in several contexts:

  • Select Menu > Analysis > Report > Relationship Analysis:

  • The Symmetric Normalized Mutual Information can also be shown by selecting Menu > Analysis > Visual > Overall > Arc > Mutual Information and then clicking the Show Arc Comments icon or selecting Menu > View > Show Arc Comments.

  • Note that the corresponding options under Preferences > Analysis > Visual Analysis > Arc's Mutual Information Analysis have to be selected first:

  • In Preferences, Child refers to the Relative Mutual Information from the Parent onto the Child node, i.e., in the direction of the arc.
  • Conversely, Parent refers to the Relative Mutual Information from the Child onto the Parent node, i.e., in the opposite direction of the arc.

For North America

Bayesia USA

4235 Hillsboro Pike
Suite 300-688
Nashville, TN 37215, USA

+1 888-386-8383

Head Office

Bayesia S.A.S.

Parc Ceres, Batiment N 21
rue Ferdinand Buisson
53810 Change, France

For Asia/Pacific

Bayesia Singapore

1 Fusionopolis Place
#03-20 Galaxis
Singapore 138522

Copyright © 2024 Bayesia S.A.S., Bayesia USA, LLC, and Bayesia Singapore Pte. Ltd. All Rights Reserved.