Information Theory Cheat Sheet

Here we (try to) explain and illustrate information theory common formula.

Apr 01, 23

Tags: entropy information theory Shannon

Distance, Divergence, and Similarity - A Cheat Sheet

When you read around thousand of papers a year, you become aware that there are many ways to measure distance or similarity between stuff. They do not apply to the same object, the same data-structure, so this variety is necessary.

Mar 01, 23

Tags: distance metric loss similarity divergence scoring

Writing is not that easy

Writing is hard. It is not as easy as pressing the "enter" button to publish your post. It requires more than writing down a bunch of ideas. People cannot read in our mind, therefore we need to organize ideas in a coherent way, around a red line or a story. Additionally, finishing everything requires commitment, checking everything, arranging stuff in a nice way. Nevertheless, even if it is really time consuming, you learn plenty of stuff.

Feb 02, 23