Entropy and Mutual Information of the Conditional Independence Model

Abstract

In this paper, we introduce the conditional independence model that included three elements every element is called conditional independence statement, or some times called network, those networks are defined by discrete random variables, we prove the conditional entropy function of the every element from this model. We also prove the conditional mutual information for every network, through out mesure the distance between the joint conditional probability density function and conditional probability density functions for every element in this model.