Normalized Mutual Information

Normalized Mutual Information


  • Based on Mutual Information, Normalized Mutual Information includes a normalization factor:

    1log2(SX)\frac{1}{{{{\log }_2}({S_X})}}

    where SXS_X denotes the number of states of XX.

  • This means that the Mutual Information I(X,Y)I(X,Y) is divided by the maximum possible entropy of XX, i.e., log2(SX){\log _2}({S_X}).

  • With that, the formal definition of Normalized Mutual Information is:

    IN(X,Y)=I(X,Y)log2(SX){I_N}(X,Y) = \frac{{I(X,Y)}}{{{{\log }_2}({S_X})}}


  • BayesiaLab reports the Normalized Mutual Information in the Target Analysis Report: Menu > Analysis > Report > Target > Relationship with Target Node.
  • Note that this table shows the Normalized Mutual Information of each node, e.g., XRay, Dyspnea, etc., with regard to the Target Node, Cancer.
  • The Normalized Mutual Information can also be shown by selecting Menu > Analysis > Visual > Overall > Arc > Mutual Information and then clicking the Show Arc Comments icon or selecting Menu > View > Show Arc Comments.
  • Note that the corresponding options under Menu > Preferences > Analysis > Visual Analysis > Arc's Mutual Information Analysis have to be selected first:

  • In Preferences, Child refers to the Normalized Mutual Information from the Parent onto the Child node, i.e., in the direction of the arc.

  • Conversely, Parent refers to the Normalized Mutual Information from the Child onto the Parent node, i.e., in the opposite direction of the arc.

For North America

Bayesia USA

4235 Hillsboro Pike
Suite 300-688
Nashville, TN 37215, USA

+1 888-386-8383

Head Office

Bayesia S.A.S.

Parc Ceres, Batiment N 21
rue Ferdinand Buisson
53810 Change, France

For Asia/Pacific

Bayesia Singapore

1 Fusionopolis Place
#03-20 Galaxis
Singapore 138522

Copyright © 2024 Bayesia S.A.S., Bayesia USA, LLC, and Bayesia Singapore Pte. Ltd. All Rights Reserved.