# Latex and Machine Learning

Information Gain Original article Information Gain and Mutual Information for Machine Learning $$\mathbf{IG}(\mathbf{S}, a) = \mathbf{H}(\mathbf{S}) – \mathbf{H}(\mathbf{S} | a)$$ Mutual information References Information Gain and Mutual Information for Machine Learning \ An introduction to mutual information - YouTube Concerns the outcome of two random variables. If we know the value of one of the random variables in a system there is a corresponding reduction in...