Generalizing Shannon entropy

1 · John Cook · May 17, 2021, 2:47 p.m.
The most common way to quantify entropy is Shannon entropy. That’s what people usually mean when they say “entropy” without further qualifications. A while back I wrote about Renyi entropy as a generalization of Shannon entropy. This time I’ll explore a different generalization called q-log entropy, a.k.a. Tsallis entropy. The definition of Shannon entropy includes […] The post Generalizing Shannon entropy first appeared on John D. Cook....