33:51intermediate
But what is cross-entropy? | Compression is Intelligence Part 2
3Blue1Brown explains where the loss function for training LLMs comes from, building cross-entropy up from optimal codes. Good for anyone who trains or studies language models.
3Blue1Brown · 835K views ·
