This is the best thing I've read in a while. The interactive illustrations skillfully punctuated a math centric topic in a way that guides an intuitive understanding of the math involved. Definitely worth a read by anyone interested in LLMs or compression or both.
ngrok.comCompression is prediction | ngrok blogCompression and LLMs are trying to solve the exact same problem: predicting what comes next. Learn the fundamentals of compression and how better prediction leads to better shrinkage.
This is the coolest article I've ever written. Genuinely. All of you should read it.
0 reposts1 like