👩💻 Join our community of thousands of amazing developers!
Original video https://www.youtube.com/watch?v=gfPUWwBkXZY Glossary information gain [data mining] The amount of information that's gained by knowing the value of the attribute, which is the entropy of the distribution before the split minus the entropy of the distribution after it. The largest information gain is equivalent to the smallest entropy. vim +/"mutual information" "$NOTES/ws/glossaries/information-theory.txt" information gain ratio [#decision tree learning] Ratio of information gain...