KL Divergence — in layman’s terms

Ajit Rajasekharan
8 min readMar 23, 2019

If we are asked to look at the three animals below and say which one is more of a cat than a dog, most of us would agree that

  • the first one is “all cat and no dog”
  • second one is “more cat than dog”
  • third is “more dog than cat”

Images of animals are from this link Marvin’s review of The Illustrated Encyclopedia of Cat Breeds