KL Divergence — in layman’s terms
If we are asked to look at the three animals below and say which one is more of a cat than a dog, most of us would agree that
- the first one is “all cat and no dog”
- second one is “more cat than dog”
- third is “more dog than cat”
Images of animals are from this link Marvin’s review of The Illustrated Encyclopedia of Cat Breeds